Jul 07 17:34:27.904838 ip-10-0-132-78 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 07 17:34:27.904848 ip-10-0-132-78 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 07 17:34:27.904856 ip-10-0-132-78 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 07 17:34:27.905097 ip-10-0-132-78 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 07 17:34:38.074730 ip-10-0-132-78 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 07 17:34:38.074752 ip-10-0-132-78 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 4761ca0ca1834ccface590017b99f185 --
Jul 07 17:36:39.350493 ip-10-0-132-78 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 17:36:39.720015 ip-10-0-132-78 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 17:36:39.720015 ip-10-0-132-78 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 17:36:39.720015 ip-10-0-132-78 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 17:36:39.720015 ip-10-0-132-78 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 17:36:39.720015 ip-10-0-132-78 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 17:36:39.721749 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.721660    2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 17:36:39.729421 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729393    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:36:39.729421 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729410    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:36:39.729421 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729413    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:36:39.729421 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729416    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:36:39.729421 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729419    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:36:39.729421 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729422    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:36:39.729421 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729424    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:36:39.729421 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729427    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:36:39.729421 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729430    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:36:39.729421 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729433    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:36:39.729753 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729437    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:36:39.729753 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729441    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:36:39.729753 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729443    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:36:39.729753 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729446    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:36:39.729753 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729449    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:36:39.729753 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729451    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:36:39.729753 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729454    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:36:39.729753 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729457    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:36:39.729753 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729459    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:36:39.729753 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729462    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:36:39.729753 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729464    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:36:39.729753 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729466    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:36:39.729753 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729469    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:36:39.729753 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729471    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:36:39.729753 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729474    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:36:39.729753 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729476    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:36:39.729753 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729478    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:36:39.729753 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729482    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:36:39.729753 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729484    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:36:39.730211 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729489    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:36:39.730211 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729494    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:36:39.730211 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729496    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:36:39.730211 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729499    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:36:39.730211 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729502    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:36:39.730211 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729505    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:36:39.730211 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729508    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:36:39.730211 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729511    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:36:39.730211 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729513    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:36:39.730211 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729516    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:36:39.730211 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729519    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:36:39.730211 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729522    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:36:39.730211 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729524    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:36:39.730211 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729526    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:36:39.730211 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729530    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:36:39.730211 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729533    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:36:39.730211 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729535    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:36:39.730211 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729538    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:36:39.730211 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729540    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:36:39.730663 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729543    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:36:39.730663 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729545    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:36:39.730663 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729550    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:36:39.730663 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729552    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:36:39.730663 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729555    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:36:39.730663 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729557    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:36:39.730663 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729559    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:36:39.730663 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729562    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:36:39.730663 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729564    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:36:39.730663 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729567    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:36:39.730663 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729569    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:36:39.730663 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729572    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:36:39.730663 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729574    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:36:39.730663 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729577    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:36:39.730663 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729580    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:36:39.730663 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729582    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:36:39.730663 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729584    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:36:39.730663 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729587    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:36:39.730663 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729590    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:36:39.730663 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729592    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:36:39.731117 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729596    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:36:39.731117 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729600    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:36:39.731117 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729603    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:36:39.731117 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729605    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:36:39.731117 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729608    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:36:39.731117 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729611    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:36:39.731117 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729613    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:36:39.731117 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729616    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:36:39.731117 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729619    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:36:39.731117 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729621    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:36:39.731117 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729627    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:36:39.731117 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729630    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:36:39.731117 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729633    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:36:39.731117 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729635    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:36:39.731117 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729638    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:36:39.731117 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729641    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:36:39.731117 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729644    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:36:39.731117 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729646    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:36:39.731117 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729649    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:36:39.731608 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729651    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:36:39.731608 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729654    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:36:39.731608 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729657    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:36:39.731608 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729659    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:36:39.731608 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729661    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:36:39.731608 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729664    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:36:39.731608 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729666    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:36:39.731608 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729669    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:36:39.731608 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729671    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:36:39.731608 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729673    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:36:39.731608 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729676    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:36:39.731608 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.729678    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:36:39.731608 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730395    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:36:39.731608 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730403    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:36:39.731608 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730406    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:36:39.731608 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730409    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:36:39.731608 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730411    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:36:39.731608 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730414    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:36:39.731608 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730418    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:36:39.731608 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730422    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:36:39.732059 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730426    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:36:39.732059 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730428    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:36:39.732059 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730431    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:36:39.732059 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730433    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:36:39.732059 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730436    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:36:39.732059 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730438    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:36:39.732059 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730441    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:36:39.732059 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730443    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:36:39.732059 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730446    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:36:39.732059 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730449    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:36:39.732059 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730451    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:36:39.732059 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730454    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:36:39.732059 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730456    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:36:39.732059 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730459    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:36:39.732059 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730461    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:36:39.732059 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730463    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:36:39.732059 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730466    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:36:39.732059 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730468    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:36:39.732059 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730470    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:36:39.732059 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730473    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:36:39.732671 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730477    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:36:39.732671 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730481    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:36:39.732671 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730484    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:36:39.732671 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730486    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:36:39.732671 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730489    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:36:39.732671 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730491    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:36:39.732671 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730494    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:36:39.732671 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730496    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:36:39.732671 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730498    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:36:39.732671 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730501    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:36:39.732671 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730504    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:36:39.732671 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730506    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:36:39.732671 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730510    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:36:39.732671 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730512    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:36:39.732671 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730515    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:36:39.732671 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730517    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:36:39.732671 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730520    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:36:39.732671 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730522    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:36:39.732671 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730525    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:36:39.733115 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730527    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:36:39.733115 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730530    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:36:39.733115 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730532    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:36:39.733115 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730535    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:36:39.733115 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730537    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:36:39.733115 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730539    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:36:39.733115 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730542    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:36:39.733115 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730544    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:36:39.733115 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730546    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:36:39.733115 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730549    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:36:39.733115 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730551    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:36:39.733115 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730553    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:36:39.733115 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730556    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:36:39.733115 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730558    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:36:39.733115 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730561    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:36:39.733115 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730563    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:36:39.733115 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730566    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:36:39.733115 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730568    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:36:39.733115 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730570    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:36:39.733115 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730573    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:36:39.733600 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730575    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:36:39.733600 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730578    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:36:39.733600 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730580    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:36:39.733600 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730583    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:36:39.733600 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730585    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:36:39.733600 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730588    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:36:39.733600 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730591    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:36:39.733600 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730593    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:36:39.733600 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730596    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:36:39.733600 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730600    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:36:39.733600 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730604    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:36:39.733600 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730606    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:36:39.733600 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730609    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:36:39.733600 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730612    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:36:39.733600 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730615    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:36:39.733600 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730617    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:36:39.733600 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730620    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:36:39.733600 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730623    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:36:39.733600 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730625    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:36:39.733600 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730627    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:36:39.734068 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730630    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:36:39.734068 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730632    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:36:39.734068 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730635    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:36:39.734068 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730637    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:36:39.734068 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730639    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:36:39.734068 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730641    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:36:39.734068 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730644    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:36:39.734068 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730646    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:36:39.734068 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730649    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:36:39.734068 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730651    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:36:39.734068 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730653    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:36:39.734068 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.730655    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:36:39.734068 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731020    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:36:39.734068 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731025    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:36:39.734068 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731027    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:36:39.734068 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731030    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:36:39.734068 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731033    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:36:39.734068 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731036    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:36:39.734068 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731038    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:36:39.734068 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731041    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:36:39.734068 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731043    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:36:39.734598 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731046    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:36:39.734598 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731048    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:36:39.734598 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731051    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:36:39.734598 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731053    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:36:39.734598 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731056    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:36:39.734598 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731058    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:36:39.734598 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731061    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:36:39.734598 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731064    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:36:39.734598 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731066    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:36:39.734598 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731069    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:36:39.734598 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731071    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:36:39.734598 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731074    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:36:39.734598 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731076    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:36:39.734598 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731079    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:36:39.734598 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731081    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:36:39.734598 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731084    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:36:39.734598 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731086    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:36:39.734598 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731088    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:36:39.734598 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731091    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:36:39.735029 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731093    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:36:39.735029 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731095    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:36:39.735029 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731097    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:36:39.735029 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731099    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:36:39.735029 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731102    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:36:39.735029 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731104    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:36:39.735029 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731106    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:36:39.735029 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731108    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:36:39.735029 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731111    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:36:39.735029 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731114    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:36:39.735029 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731117    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:36:39.735029 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731119    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:36:39.735029 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731122    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:36:39.735029 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731124    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:36:39.735029 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731126    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:36:39.735029 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731130    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:36:39.735029 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731134    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:36:39.735029 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731137    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:36:39.735029 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731139    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:36:39.735487 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731142    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:36:39.735487 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731145    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:36:39.735487 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731148    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:36:39.735487 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731150    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:36:39.735487 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731153    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:36:39.735487 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731156    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:36:39.735487 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731159    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:36:39.735487 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731162    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:36:39.735487 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731164    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:36:39.735487 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731195    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:36:39.735487 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731199    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:36:39.735487 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731201    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:36:39.735487 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731204    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:36:39.735487 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731207    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:36:39.735487 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731210    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:36:39.735487 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731220    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:36:39.735487 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731223    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:36:39.735487 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731226    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:36:39.735487 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731228    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:36:39.735487 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731230    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:36:39.735985 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731233    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:36:39.735985 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731235    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:36:39.735985 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731238    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:36:39.735985 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731241    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:36:39.735985 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731243    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:36:39.735985 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731245    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:36:39.735985 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731248    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:36:39.735985 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731250    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:36:39.735985 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731254    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:36:39.735985 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731256    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:36:39.735985 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731259    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:36:39.735985 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731262    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:36:39.735985 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731264    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:36:39.735985 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731267    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:36:39.735985 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731269    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:36:39.735985 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731272    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:36:39.735985 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731274    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:36:39.735985 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731277    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:36:39.735985 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731279    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:36:39.735985 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731282    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:36:39.736457 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731284    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:36:39.736457 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731287    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:36:39.736457 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731289    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:36:39.736457 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731291    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:36:39.736457 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731294    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:36:39.736457 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731296    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:36:39.736457 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731298    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:36:39.736457 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731300    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:36:39.736457 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731303    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:36:39.736457 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731305    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:36:39.736457 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731308    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:36:39.736457 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731310    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:36:39.736457 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731377    2559 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 17:36:39.736457 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731384    2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 17:36:39.736457 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731390    2559 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 17:36:39.736457 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731394    2559 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 17:36:39.736457 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731398    2559 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 17:36:39.736457 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731401    2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 17:36:39.736457 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731405    2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 17:36:39.736457 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731409    2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 17:36:39.736457 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731412    2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 17:36:39.736938 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731414    2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 17:36:39.736938 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731418    2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 17:36:39.736938 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731421    2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 17:36:39.736938 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731424    2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 17:36:39.736938 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731427    2559 flags.go:64] FLAG: --cgroup-root=""
Jul 07 17:36:39.736938 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731429    2559 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 17:36:39.736938 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731432    2559 flags.go:64] FLAG: --client-ca-file=""
Jul 07 17:36:39.736938 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731435    2559 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 17:36:39.736938 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731438    2559 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 17:36:39.736938 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731442    2559 flags.go:64] FLAG: --cluster-domain=""
Jul 07 17:36:39.736938 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731444    2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 17:36:39.736938 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731447    2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 17:36:39.736938 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731450    2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 17:36:39.736938 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731453    2559 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 17:36:39.736938 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731456    2559 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 17:36:39.736938 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731459    2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 17:36:39.736938 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731462    2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 17:36:39.736938 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731465    2559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 17:36:39.736938 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731468    2559 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 17:36:39.736938 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731471    2559 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 17:36:39.736938 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731474    2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 17:36:39.736938 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731477    2559 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 17:36:39.736938 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731480    2559 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 17:36:39.736938 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731483    2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 17:36:39.737562 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731487    2559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 17:36:39.737562 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731490    2559 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 17:36:39.737562 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731493    2559 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 17:36:39.737562 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731496    2559 flags.go:64] FLAG: --enable-server="true"
Jul 07 17:36:39.737562 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731498    2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 17:36:39.737562 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731503    2559 flags.go:64] FLAG: --event-burst="100"
Jul 07 17:36:39.737562 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731506    2559 flags.go:64] FLAG: --event-qps="50"
Jul 07 17:36:39.737562 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731509    2559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 17:36:39.737562 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731511    2559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 17:36:39.737562 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731514    2559 flags.go:64] FLAG: --eviction-hard=""
Jul 07 17:36:39.737562 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731518    2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 17:36:39.737562 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731520    2559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 17:36:39.737562 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731523    2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 17:36:39.737562 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731526    2559 flags.go:64] FLAG: --eviction-soft=""
Jul 07 17:36:39.737562 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731528    2559 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 17:36:39.737562 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731531    2559 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 17:36:39.737562 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731535    2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 17:36:39.737562 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731537    2559 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 17:36:39.737562 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731540    2559 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 17:36:39.737562 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731542    2559 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 17:36:39.737562 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731545    2559 flags.go:64] FLAG: --feature-gates=""
Jul 07 17:36:39.737562 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731549    2559 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 17:36:39.737562 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731552    2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 17:36:39.737562 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731554    2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 17:36:39.737562 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731557    2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 17:36:39.738148 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731560    2559 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 17:36:39.738148 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731563    2559 flags.go:64] FLAG: --help="false"
Jul 07 17:36:39.738148 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731565    2559 flags.go:64] FLAG: --hostname-override="ip-10-0-132-78.ec2.internal"
Jul 07 17:36:39.738148 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731568    2559 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 17:36:39.738148 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731571    2559 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 17:36:39.738148 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731573    2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 17:36:39.738148 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731577    2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 17:36:39.738148 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731580    2559 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 17:36:39.738148 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731583    2559 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 17:36:39.738148 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731586    2559 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 17:36:39.738148 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731588    2559 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 17:36:39.738148 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731591    2559 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 17:36:39.738148 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731594    2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 17:36:39.738148 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731596    2559 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 17:36:39.738148 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731599    2559 flags.go:64] FLAG: --kube-reserved=""
Jul 07 17:36:39.738148 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731602    2559 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 17:36:39.738148 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731604    2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 17:36:39.738148 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731607    2559 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 17:36:39.738148 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731609    2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 17:36:39.738148 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731612    2559 flags.go:64] FLAG: --lock-file=""
Jul 07 17:36:39.738148 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731615    2559 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 17:36:39.738148 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731617    2559 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 17:36:39.738148 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731620    2559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 17:36:39.738148 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731625    2559 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 17:36:39.738719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731628    2559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 17:36:39.738719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731631    2559 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 17:36:39.738719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731633    2559 flags.go:64] FLAG: --logging-format="text"
Jul 07 17:36:39.738719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731636    2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 17:36:39.738719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731639    2559 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 17:36:39.738719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731642    2559 flags.go:64] FLAG: --manifest-url=""
Jul 07 17:36:39.738719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731644    2559 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 17:36:39.738719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731648    2559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 17:36:39.738719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731651    2559 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 17:36:39.738719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731654    2559 flags.go:64] FLAG: --max-pods="110"
Jul 07 17:36:39.738719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731657    2559 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 17:36:39.738719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731659    2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 17:36:39.738719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731662    2559 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 17:36:39.738719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731665    2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 17:36:39.738719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731667    2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 17:36:39.738719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731670    2559 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 17:36:39.738719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731675    2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 17:36:39.738719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731682    2559 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 17:36:39.738719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731685    2559 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 17:36:39.738719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731688    2559 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 17:36:39.738719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731690    2559 flags.go:64] FLAG: --pod-cidr=""
Jul 07 17:36:39.738719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731693    2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 17:36:39.738719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731698    2559 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 17:36:39.739289 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731700    2559 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 17:36:39.739289 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731703    2559 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 17:36:39.739289 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731706    2559 flags.go:64] FLAG: --port="10250"
Jul 07 17:36:39.739289 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731708    2559 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 17:36:39.739289 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731711    2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b1497b68aa5e132f"
Jul 07 17:36:39.739289 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731714    2559 flags.go:64] FLAG: --qos-reserved=""
Jul 07 17:36:39.739289 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731717    2559 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 17:36:39.739289 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731719    2559 flags.go:64] FLAG: --register-node="true"
Jul 07 17:36:39.739289 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731722    2559 flags.go:64] FLAG: --register-with-taints=""
Jul 07 17:36:39.739289 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731725    2559 flags.go:64] FLAG: --registry-burst="10"
Jul 07 17:36:39.739289 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731728    2559 flags.go:64] FLAG: --registry-qps="5"
Jul 07 17:36:39.739289 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731731    2559 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 17:36:39.739289 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731734    2559 flags.go:64] FLAG: --reserved-memory=""
Jul 07 17:36:39.739289 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731737    2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 17:36:39.739289 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731740    2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 17:36:39.739289 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731743    2559 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 17:36:39.739289 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731746    2559 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 17:36:39.739289 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731748    2559 flags.go:64] FLAG: --runonce="false"
Jul 07 17:36:39.739289 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731751    2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 17:36:39.739289 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731754    2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 17:36:39.739289 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731756    2559 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 17:36:39.739289 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731759    2559 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 17:36:39.739289 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731761    2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 17:36:39.739289 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731764    2559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 17:36:39.739289 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731769    2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 17:36:39.739289 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731771    2559 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 17:36:39.739887 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731777    2559 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 17:36:39.739887 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731780    2559 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 17:36:39.739887 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731783    2559 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 17:36:39.739887 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731785    2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 17:36:39.739887 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731788    2559 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 17:36:39.739887 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731791    2559 flags.go:64] FLAG: --system-cgroups=""
Jul 07 17:36:39.739887 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731793    2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 17:36:39.739887 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731804    2559 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 17:36:39.739887 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731807    2559 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 17:36:39.739887 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731809    2559 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 17:36:39.739887 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731813    2559 flags.go:64] FLAG: --tls-min-version=""
Jul 07 17:36:39.739887 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731816    2559 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 17:36:39.739887 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731818    2559 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 17:36:39.739887 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731821    2559 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 17:36:39.739887 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731824    2559 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 17:36:39.739887 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731826    2559 flags.go:64] FLAG: --v="2"
Jul 07 17:36:39.739887 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731834    2559 flags.go:64] FLAG: --version="false"
Jul 07 17:36:39.739887 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731838    2559 flags.go:64] FLAG: --vmodule=""
Jul 07 17:36:39.739887 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731841    2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 17:36:39.739887 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.731844    2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 17:36:39.739887 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731961    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:36:39.739887 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731965    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:36:39.739887 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731968    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:36:39.739887 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731971    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:36:39.740463 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731974    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:36:39.740463 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731977    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:36:39.740463 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731979    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:36:39.740463 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731982    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:36:39.740463 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731984    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:36:39.740463 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731986    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:36:39.740463 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731990    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:36:39.740463 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731993    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:36:39.740463 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731996    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:36:39.740463 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.731999    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:36:39.740463 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732002    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:36:39.740463 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732004    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:36:39.740463 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732007    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:36:39.740463 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732009    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:36:39.740463 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732011    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:36:39.740463 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732014    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:36:39.740463 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732016    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:36:39.740463 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732019    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:36:39.740463 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732021    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:36:39.740463 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732023    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:36:39.740967 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732026    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:36:39.740967 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732028    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:36:39.740967 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732030    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:36:39.740967 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732033    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:36:39.740967 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732036    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:36:39.740967 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732039    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:36:39.740967 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732043    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:36:39.740967 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732045    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:36:39.740967 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732047    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:36:39.740967 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732050    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:36:39.740967 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732052    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:36:39.740967 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732054    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:36:39.740967 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732057    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:36:39.740967 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732059    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:36:39.740967 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732061    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:36:39.740967 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732064    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:36:39.740967 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732067    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:36:39.740967 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732069    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:36:39.740967 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732073    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:36:39.741433 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732076    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:36:39.741433 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732080    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:36:39.741433 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732082    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:36:39.741433 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732084    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:36:39.741433 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732087    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:36:39.741433 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732089    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:36:39.741433 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732091    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:36:39.741433 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732094    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:36:39.741433 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732096    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:36:39.741433 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732098    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:36:39.741433 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732101    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:36:39.741433 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732104    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:36:39.741433 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732106    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:36:39.741433 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732108    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:36:39.741433 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732111    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:36:39.741433 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732113    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:36:39.741433 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732115    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:36:39.741433 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732118    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:36:39.741433 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732120    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:36:39.741433 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732122    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:36:39.741899 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732125    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:36:39.741899 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732127    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:36:39.741899 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732130    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:36:39.741899 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732132    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:36:39.741899 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732134    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:36:39.741899 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732136    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:36:39.741899 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732139    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:36:39.741899 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732141    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:36:39.741899 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732143    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:36:39.741899 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732145    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:36:39.741899 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732148    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:36:39.741899 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732153    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:36:39.741899 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732155    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:36:39.741899 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732159    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:36:39.741899 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732162    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:36:39.741899 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732165    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:36:39.741899 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732185    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:36:39.741899 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732189    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:36:39.741899 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732193    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:36:39.742362 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732196    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:36:39.742362 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732198    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:36:39.742362 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732201    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:36:39.742362 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732203    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:36:39.742362 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732205    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:36:39.742362 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732208    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:36:39.742362 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732210    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:36:39.742362 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732212    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:36:39.742362 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732215    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:36:39.742362 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732217    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:36:39.742362 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732219    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:36:39.742362 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732222    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:36:39.742362 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732224    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:36:39.742362 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732226    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:36:39.742362 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732229    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:36:39.742362 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732232    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:36:39.742362 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.732234    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:36:39.742759 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.733485    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 17:36:39.742759 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.742201    2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 17:36:39.742759 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.742217    2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 17:36:39.742934 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.742923    2559 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 17:36:39.742962 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.742934    2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 17:36:39.743011 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743002    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:36:39.743011 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743011    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:36:39.743060 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743015    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:36:39.743060 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743018    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:36:39.743060 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743021    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:36:39.743060 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743024    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:36:39.743060 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743027    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:36:39.743060 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743030    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:36:39.743060 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743033    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:36:39.743060 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743036    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:36:39.743060 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743038    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:36:39.743060 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743041    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:36:39.743060 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743043    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:36:39.743060 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743046    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:36:39.743060 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743048    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:36:39.743060 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743051    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:36:39.743060 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743053    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:36:39.743060 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743056    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:36:39.743060 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743058    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:36:39.743060 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743060    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:36:39.743060 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743063    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:36:39.743060 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743067    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:36:39.743537 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743070    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:36:39.743537 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743073    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:36:39.743537 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743076    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:36:39.743537 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743079    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:36:39.743537 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743082    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:36:39.743537 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743084    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:36:39.743537 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743087    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:36:39.743537 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743089    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:36:39.743537 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743092    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:36:39.743537 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743094    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:36:39.743537 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743097    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:36:39.743537 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743100    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:36:39.743537 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743103    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:36:39.743537 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743106    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:36:39.743537 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743108    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:36:39.743537 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743111    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:36:39.743537 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743114    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:36:39.743537 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743116    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:36:39.743537 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743118    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:36:39.743979 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743121    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:36:39.743979 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743123    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:36:39.743979 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743126    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:36:39.743979 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743128    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:36:39.743979 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743130    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:36:39.743979 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743133    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:36:39.743979 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743135    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:36:39.743979 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743138    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:36:39.743979 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743140    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:36:39.743979 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743143    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:36:39.743979 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743146    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:36:39.743979 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743149    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:36:39.743979 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743151    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:36:39.743979 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743154    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:36:39.743979 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743157    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:36:39.743979 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743160    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:36:39.743979 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743163    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:36:39.743979 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743165    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:36:39.743979 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743185    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:36:39.743979 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743189    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:36:39.744489 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743193    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:36:39.744489 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743197    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:36:39.744489 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743200    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:36:39.744489 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743202    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:36:39.744489 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743205    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:36:39.744489 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743208    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:36:39.744489 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743218    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:36:39.744489 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743221    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:36:39.744489 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743224    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:36:39.744489 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743226    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:36:39.744489 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743229    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:36:39.744489 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743232    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:36:39.744489 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743235    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:36:39.744489 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743238    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:36:39.744489 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743241    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:36:39.744489 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743243    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:36:39.744489 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743246    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:36:39.744489 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743249    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:36:39.744489 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743251    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:36:39.744929 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743254    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:36:39.744929 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743256    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:36:39.744929 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743259    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:36:39.744929 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743261    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:36:39.744929 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743263    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:36:39.744929 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743266    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:36:39.744929 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743268    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:36:39.744929 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743271    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:36:39.744929 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743274    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:36:39.744929 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743278    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:36:39.744929 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743283    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:36:39.744929 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743285    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:36:39.744929 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743288    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:36:39.744929 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743290    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:36:39.744929 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743293    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:36:39.744929 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743296    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:36:39.744929 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743299    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:36:39.744929 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743302    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:36:39.744929 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743305    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:36:39.745377 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.743310    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 17:36:39.745377 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743476    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:36:39.745377 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743480    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:36:39.745377 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743482    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:36:39.745377 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743485    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:36:39.745377 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743487    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:36:39.745377 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743490    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:36:39.745377 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743492    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:36:39.745377 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743495    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:36:39.745377 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743498    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:36:39.745377 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743500    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:36:39.745377 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743502    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:36:39.745377 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743504    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:36:39.745377 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743507    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:36:39.745377 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743509    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:36:39.745729 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743511    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:36:39.745729 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743514    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:36:39.745729 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743516    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:36:39.745729 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743519    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:36:39.745729 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743521    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:36:39.745729 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743524    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:36:39.745729 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743526    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:36:39.745729 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743529    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:36:39.745729 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743531    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:36:39.745729 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743541    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:36:39.745729 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743543    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:36:39.745729 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743546    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:36:39.745729 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743548    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:36:39.745729 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743551    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:36:39.745729 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743553    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:36:39.745729 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743556    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:36:39.745729 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743558    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:36:39.745729 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743560    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:36:39.745729 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743562    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:36:39.745729 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743565    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:36:39.746208 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743567    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:36:39.746208 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743569    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:36:39.746208 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743571    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:36:39.746208 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743574    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:36:39.746208 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743576    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:36:39.746208 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743578    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:36:39.746208 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743581    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:36:39.746208 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743584    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:36:39.746208 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743586    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:36:39.746208 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743588    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:36:39.746208 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743590    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:36:39.746208 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743593    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:36:39.746208 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743595    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:36:39.746208 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743598    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:36:39.746208 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743600    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:36:39.746208 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743603    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:36:39.746208 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743605    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:36:39.746208 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743608    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:36:39.746208 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743610    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:36:39.746208 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743612    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:36:39.746677 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743615    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:36:39.746677 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743617    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:36:39.746677 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743625    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:36:39.746677 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743627    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:36:39.746677 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743631    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:36:39.746677 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743634    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:36:39.746677 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743638    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:36:39.746677 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743641    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:36:39.746677 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743644    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:36:39.746677 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743646    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:36:39.746677 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743649    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:36:39.746677 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743651    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:36:39.746677 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743654    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:36:39.746677 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743657    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:36:39.746677 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743660    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:36:39.746677 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743662    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:36:39.746677 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743665    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:36:39.746677 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743667    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:36:39.746677 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743670    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:36:39.747110 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743672    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:36:39.747110 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743675    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:36:39.747110 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743677    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:36:39.747110 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743679    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:36:39.747110 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743683    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:36:39.747110 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743686    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:36:39.747110 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743688    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:36:39.747110 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743691    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:36:39.747110 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743693    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:36:39.747110 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743695    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:36:39.747110 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743698    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:36:39.747110 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743700    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:36:39.747110 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743702    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:36:39.747110 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743705    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:36:39.747110 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743707    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:36:39.747110 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743710    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:36:39.747110 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743717    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:36:39.747110 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743720    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:36:39.747110 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743722    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:36:39.747110 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743725    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:36:39.747577 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743727    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:36:39.747577 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743729    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:36:39.747577 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743731    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:36:39.747577 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743734    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:36:39.747577 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743736    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:36:39.747577 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:39.743738    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:36:39.747577 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.743743    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 17:36:39.747577 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.743853    2559 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 17:36:39.747577 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.746060    2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 17:36:39.747577 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.747459    2559 server.go:1019] "Starting client certificate rotation"
Jul 07 17:36:39.747822 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.747575    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 17:36:39.747822 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.747615    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 17:36:39.750071 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.750052    2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 17:36:39.751786 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.751768    2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 17:36:39.760722 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.760696    2559 log.go:25] "Validated CRI v1 runtime API"
Jul 07 17:36:39.762898 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.762882    2559 log.go:25] "Validated CRI v1 image API"
Jul 07 17:36:39.765856 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.765833    2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 17:36:39.768587 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.768569    2559 fs.go:135] Filesystem UUIDs: map[5673221a-33c8-4b5b-b010-e8e88db8bd62:/dev/nvme0n1p4 59d0845d-e877-4732-84bd-f1ef6db34203:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 07 17:36:39.768653 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.768588    2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 17:36:39.773774 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.773670    2559 manager.go:216] Machine: {Timestamp:2026-07-07 17:36:39.772487445 +0000 UTC m=+0.313501596 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3186406 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24441ef1b74dac39a369ef8adcf055 SystemUUID:ec24441e-f1b7-4dac-39a3-69ef8adcf055 BootID:4761ca0c-a183-4ccf-ace5-90017b99f185 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:30:db:4b:ad:0f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:30:db:4b:ad:0f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:e0:4f:86:79:45 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 17:36:39.773774 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.773768    2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 17:36:39.773901 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.773843    2559 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 17:36:39.776903 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.776878    2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 17:36:39.776975 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.776961    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 17:36:39.777032 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.776906    2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-78.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 17:36:39.777610 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.777600    2559 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 17:36:39.777643 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.777613    2559 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 17:36:39.777643 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.777620    2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 17:36:39.777643 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.777633    2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 17:36:39.779130 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.779119    2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 17:36:39.783430 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.783418    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 17:36:39.783534 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.783525    2559 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 17:36:39.783570 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.783554    2559 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 17:36:39.783570 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.783564    2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 17:36:39.783626 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.783577    2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 17:36:39.783626 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.783587    2559 kubelet.go:398] "Adding apiserver pod source"
Jul 07 17:36:39.783626 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.783595    2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 17:36:39.783979 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.783967    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 17:36:39.784022 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.783992    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 17:36:39.785899 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.785882    2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 17:36:39.787946 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.787933    2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 17:36:39.787995 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.787963    2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 17:36:39.789152 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.789142    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 17:36:39.789212 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.789158    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 17:36:39.789212 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.789164    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 17:36:39.789212 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.789187    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 17:36:39.789212 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.789196    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 17:36:39.789212 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.789201    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 17:36:39.789212 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.789208    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 17:36:39.789212 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.789213    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 17:36:39.789393 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.789219    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 17:36:39.789393 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.789224    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 17:36:39.789393 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.789232    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 17:36:39.789393 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.789237    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 17:36:39.790586 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.790571    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 17:36:39.790625 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.790594    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 17:36:39.793804 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.793784    2559 server.go:1268] "Started kubelet"
Jul 07 17:36:39.793920 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.793872    2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 17:36:39.794612 ip-10-0-132-78 systemd[1]: Started Kubernetes Kubelet.
Jul 07 17:36:39.794752 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.794668    2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 17:36:39.794990 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.794967    2559 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 17:36:39.798606 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.798581    2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 17:36:39.798932 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:39.798906    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 17:36:39.799024 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:39.798938    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-78.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 17:36:39.799473 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.799451    2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-78.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 17:36:39.800111 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.800092    2559 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 17:36:39.800389 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:39.800369    2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 17:36:39.802368 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:39.801466    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-78.ec2.internal.18c012817cde860d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-78.ec2.internal,UID:ip-10-0-132-78.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-78.ec2.internal,},FirstTimestamp:2026-07-07 17:36:39.793755661 +0000 UTC m=+0.334769811,LastTimestamp:2026-07-07 17:36:39.793755661 +0000 UTC m=+0.334769811,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-78.ec2.internal,}"
Jul 07 17:36:39.806536 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.806459    2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 17:36:39.806536 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.806484    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 17:36:39.806641 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:39.806587    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-78.ec2.internal\" not found"
Jul 07 17:36:39.807117 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.807070    2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 17:36:39.807234 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.807136    2559 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 17:36:39.807234 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.807150    2559 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 17:36:39.807368 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.807279    2559 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 17:36:39.807368 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.807290    2559 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 17:36:39.807842 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.807826    2559 factory.go:55] Registering systemd factory
Jul 07 17:36:39.807965 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.807936    2559 factory.go:223] Registration of the systemd container factory successfully
Jul 07 17:36:39.808297 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.808279    2559 factory.go:153] Registering CRI-O factory
Jul 07 17:36:39.808379 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.808299    2559 factory.go:223] Registration of the crio container factory successfully
Jul 07 17:36:39.808379 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.808347    2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 17:36:39.808472 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.808381    2559 factory.go:103] Registering Raw factory
Jul 07 17:36:39.808472 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.808396    2559 manager.go:1196] Started watching for new ooms in manager
Jul 07 17:36:39.808949 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.808930    2559 manager.go:349] Starting recovery of all containers
Jul 07 17:36:39.809862 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:39.809834    2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-78.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 07 17:36:39.809993 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:39.809971    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 07 17:36:39.810722 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.810701    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8kks7"
Jul 07 17:36:39.818016 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.817913    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8kks7"
Jul 07 17:36:39.818937 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.818922    2559 manager.go:354] Recovery completed
Jul 07 17:36:39.822877 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.822865    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:36:39.824802 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.824782    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-78.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:36:39.824864 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.824807    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-78.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:36:39.824864 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.824818    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-78.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:36:39.825311 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.825296    2559 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 17:36:39.825311 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.825308    2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 17:36:39.825447 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.825322    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 17:36:39.825447 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.825334    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:36:39.826439 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.826424    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-78.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:36:39.826499 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.826448    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-78.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:36:39.826499 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.826459    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-78.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:36:39.826786 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:39.826730    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-78.ec2.internal.18c012817eb82543  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-78.ec2.internal,UID:ip-10-0-132-78.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-78.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-78.ec2.internal,},FirstTimestamp:2026-07-07 17:36:39.824794947 +0000 UTC m=+0.365809098,LastTimestamp:2026-07-07 17:36:39.824794947 +0000 UTC m=+0.365809098,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-78.ec2.internal,}"
Jul 07 17:36:39.827337 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.827321    2559 policy_none.go:49] "None policy: Start"
Jul 07 17:36:39.827337 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.827338    2559 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 17:36:39.827423 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.827349    2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 17:36:39.829417 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.829405    2559 policy_none.go:47] "Start"
Jul 07 17:36:39.860116 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.860102    2559 manager.go:337] "Starting Device Plugin manager"
Jul 07 17:36:39.860215 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:39.860132    2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 17:36:39.860215 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.860141    2559 server.go:87] "Starting device plugin registration server"
Jul 07 17:36:39.860395 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.860383    2559 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 17:36:39.860455 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.860396    2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 17:36:39.860507 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.860485    2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 17:36:39.860577 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.860561    2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 17:36:39.860577 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.860574    2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 17:36:39.861125 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:39.861103    2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 17:36:39.861243 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:39.861151    2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-78.ec2.internal\" not found"
Jul 07 17:36:39.960554 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.960525    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:36:39.962742 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.962580    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-78.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:36:39.962742 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.962609    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-78.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:36:39.962742 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.962623    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-78.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:36:39.962742 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.962653    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-78.ec2.internal"
Jul 07 17:36:39.970125 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.970075    2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-78.ec2.internal"
Jul 07 17:36:39.970125 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:39.970103    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-78.ec2.internal\": node \"ip-10-0-132-78.ec2.internal\" not found"
Jul 07 17:36:39.973139 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.973115    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 17:36:39.974492 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.974474    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 17:36:39.974588 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.974510    2559 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 17:36:39.974588 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.974530    2559 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 17:36:39.974588 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:39.974569    2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 17:36:39.976510 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:39.976489    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:36:39.983031 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:39.983014    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-78.ec2.internal\" not found"
Jul 07 17:36:40.074673 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.074622    2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-78.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-78.ec2.internal"]
Jul 07 17:36:40.074823 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.074716    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:36:40.076365 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.076350    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-78.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:36:40.076427 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.076387    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-78.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:36:40.076427 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.076407    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-78.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:36:40.078832 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.078819    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:36:40.078965 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.078951    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-78.ec2.internal"
Jul 07 17:36:40.079005 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.078980    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:36:40.079547 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.079529    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-78.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:36:40.079646 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.079561    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-78.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:36:40.079646 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.079571    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-78.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:36:40.079646 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.079536    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-78.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:36:40.079646 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.079633    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-78.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:36:40.079646 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.079648    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-78.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:36:40.081764 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.081751    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-78.ec2.internal"
Jul 07 17:36:40.081829 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.081777    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:36:40.082385 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.082371    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-78.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:36:40.082474 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.082397    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-78.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:36:40.082474 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.082411    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-78.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:36:40.083186 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:40.083155    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-78.ec2.internal\" not found"
Jul 07 17:36:40.098730 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:40.098707    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-78.ec2.internal\" not found" node="ip-10-0-132-78.ec2.internal"
Jul 07 17:36:40.102488 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:40.102472    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-78.ec2.internal\" not found" node="ip-10-0-132-78.ec2.internal"
Jul 07 17:36:40.109103 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.109088    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d1173d55afe0841f3da9d7bed0dfe65d-config\") pod \"kube-apiserver-proxy-ip-10-0-132-78.ec2.internal\" (UID: \"d1173d55afe0841f3da9d7bed0dfe65d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-78.ec2.internal"
Jul 07 17:36:40.109208 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.109114    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bf6dd33ab0df7b388b9c2881db96647c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-78.ec2.internal\" (UID: \"bf6dd33ab0df7b388b9c2881db96647c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-78.ec2.internal"
Jul 07 17:36:40.109208 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.109137    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf6dd33ab0df7b388b9c2881db96647c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-78.ec2.internal\" (UID: \"bf6dd33ab0df7b388b9c2881db96647c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-78.ec2.internal"
Jul 07 17:36:40.184265 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:40.184237    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-78.ec2.internal\" not found"
Jul 07 17:36:40.209593 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.209573    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bf6dd33ab0df7b388b9c2881db96647c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-78.ec2.internal\" (UID: \"bf6dd33ab0df7b388b9c2881db96647c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-78.ec2.internal"
Jul 07 17:36:40.209652 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.209598    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf6dd33ab0df7b388b9c2881db96647c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-78.ec2.internal\" (UID: \"bf6dd33ab0df7b388b9c2881db96647c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-78.ec2.internal"
Jul 07 17:36:40.209652 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.209614    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d1173d55afe0841f3da9d7bed0dfe65d-config\") pod \"kube-apiserver-proxy-ip-10-0-132-78.ec2.internal\" (UID: \"d1173d55afe0841f3da9d7bed0dfe65d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-78.ec2.internal"
Jul 07 17:36:40.209729 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.209661    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d1173d55afe0841f3da9d7bed0dfe65d-config\") pod \"kube-apiserver-proxy-ip-10-0-132-78.ec2.internal\" (UID: \"d1173d55afe0841f3da9d7bed0dfe65d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-78.ec2.internal"
Jul 07 17:36:40.209729 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.209676    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bf6dd33ab0df7b388b9c2881db96647c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-78.ec2.internal\" (UID: \"bf6dd33ab0df7b388b9c2881db96647c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-78.ec2.internal"
Jul 07 17:36:40.209729 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.209683    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf6dd33ab0df7b388b9c2881db96647c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-78.ec2.internal\" (UID: \"bf6dd33ab0df7b388b9c2881db96647c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-78.ec2.internal"
Jul 07 17:36:40.284891 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:40.284827    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-78.ec2.internal\" not found"
Jul 07 17:36:40.385418 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:40.385374    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-78.ec2.internal\" not found"
Jul 07 17:36:40.402533 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.402515    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-78.ec2.internal"
Jul 07 17:36:40.405922 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.405901    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-78.ec2.internal"
Jul 07 17:36:40.485714 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:40.485665    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-78.ec2.internal\" not found"
Jul 07 17:36:40.586227 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:40.586199    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-78.ec2.internal\" not found"
Jul 07 17:36:40.686719 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:40.686678    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-78.ec2.internal\" not found"
Jul 07 17:36:40.747355 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.747320    2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 17:36:40.747862 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.747475    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 17:36:40.787800 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:40.787768    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-78.ec2.internal\" not found"
Jul 07 17:36:40.821021 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.820987    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 17:31:40 +0000 UTC" deadline="2028-03-26 18:46:59.620939812 +0000 UTC"
Jul 07 17:36:40.821021 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.821017    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15073h10m18.799927119s"
Jul 07 17:36:40.888069 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:40.888010    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-78.ec2.internal\" not found"
Jul 07 17:36:40.920696 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:40.920667    2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:36:41.007461 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:41.007429    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-78.ec2.internal"
Jul 07 17:36:41.017852 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:41.017831    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 17:36:41.019475 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:41.019458    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-78.ec2.internal"
Jul 07 17:36:41.025871 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:41.025851    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 17:36:41.039797 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:41.039757    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf6dd33ab0df7b388b9c2881db96647c.slice/crio-49a25d232299ac8d640945fe7ab21ea4f8f9da95aca8193295711c2765c680f1 WatchSource:0}: Error finding container 49a25d232299ac8d640945fe7ab21ea4f8f9da95aca8193295711c2765c680f1: Status 404 returned error can't find the container with id 49a25d232299ac8d640945fe7ab21ea4f8f9da95aca8193295711c2765c680f1
Jul 07 17:36:41.040010 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:41.039995    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1173d55afe0841f3da9d7bed0dfe65d.slice/crio-78f4c17e2cdfea578f5fd60d9b67668097ea98da6b60c8daf423942ffa441e08 WatchSource:0}: Error finding container 78f4c17e2cdfea578f5fd60d9b67668097ea98da6b60c8daf423942ffa441e08: Status 404 returned error can't find the container with id 78f4c17e2cdfea578f5fd60d9b67668097ea98da6b60c8daf423942ffa441e08
Jul 07 17:36:41.043908 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:41.043890    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 17:36:41.048620 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:41.048603    2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:36:41.128948 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:41.128913    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:36:42.810809 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.810783    2559 apiserver.go:52] "Watching apiserver"
Jul 07 17:36:42.819602 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.819571    2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 17:36:42.820470 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.820431    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-hd255","openshift-multus/network-metrics-daemon-ltf2l","openshift-ovn-kubernetes/ovnkube-node-8s7h4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt7nm","openshift-cluster-node-tuning-operator/tuned-5pchl","openshift-dns/node-resolver-hwbkw","openshift-image-registry/node-ca-rn66n","openshift-multus/multus-6svr4","openshift-network-diagnostics/network-check-target-vzqgz","openshift-network-operator/iptables-alerter-nzkhn","kube-system/global-pull-secret-syncer-5r9p6","kube-system/konnectivity-agent-47mnk","kube-system/kube-apiserver-proxy-ip-10-0-132-78.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-78.ec2.internal"]
Jul 07 17:36:42.823309 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.823286    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nzkhn"
Jul 07 17:36:42.825537 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.825516    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt7nm"
Jul 07 17:36:42.826378 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.826362    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 17:36:42.826511 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.826492    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 17:36:42.826595 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.826469    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 17:36:42.826595 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.826565    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zlz9h\""
Jul 07 17:36:42.827628 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.827606    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 17:36:42.827887 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.827874    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 17:36:42.828268 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.828246    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 17:36:42.828488 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.828470    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-l5tv8\""
Jul 07 17:36:42.829280 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.829260    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.831339 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.831322    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 17:36:42.831550 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.831532    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hd255"
Jul 07 17:36:42.831688 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.831669    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 17:36:42.834719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.832456    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 17:36:42.834719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.832686    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gkttq\""
Jul 07 17:36:42.834719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.832894    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 17:36:42.834719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.833090    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 17:36:42.834719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.833246    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 17:36:42.834719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.833974    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 17:36:42.834719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.834082    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 17:36:42.834719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.834116    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 17:36:42.834719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.834237    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 17:36:42.834719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.834282    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-k6j82\""
Jul 07 17:36:42.834719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.834305    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 17:36:42.834719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.834404    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 17:36:42.834719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.834444    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.836642 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.836621    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 17:36:42.836642 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.836635    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 17:36:42.836867 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.836850    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2kxnw\""
Jul 07 17:36:42.838590 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.838472    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hwbkw"
Jul 07 17:36:42.840430 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.840413    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 17:36:42.840991 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.840771    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 17:36:42.841585 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.841288    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-x78zm\""
Jul 07 17:36:42.843118 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.842641    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rn66n"
Jul 07 17:36:42.843118 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.842805    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bed0ab9e-a1dc-473d-9a55-157118bd4bab-host-slash\") pod \"iptables-alerter-nzkhn\" (UID: \"bed0ab9e-a1dc-473d-9a55-157118bd4bab\") " pod="openshift-network-operator/iptables-alerter-nzkhn"
Jul 07 17:36:42.843118 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.842827    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58f7r\" (UniqueName: \"kubernetes.io/projected/bed0ab9e-a1dc-473d-9a55-157118bd4bab-kube-api-access-58f7r\") pod \"iptables-alerter-nzkhn\" (UID: \"bed0ab9e-a1dc-473d-9a55-157118bd4bab\") " pod="openshift-network-operator/iptables-alerter-nzkhn"
Jul 07 17:36:42.843118 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.842843    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4c309e8e-07d4-416b-8c80-b49eea680c0f-sys-fs\") pod \"aws-ebs-csi-driver-node-vt7nm\" (UID: \"4c309e8e-07d4-416b-8c80-b49eea680c0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt7nm"
Jul 07 17:36:42.843118 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.842857    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-host-kubelet\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.843118 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.842871    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-log-socket\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.843118 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.842890    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-host-cni-bin\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.843118 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.842904    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0819ed1d-2fe9-4bf5-b986-96f59fb24a8b-system-cni-dir\") pod \"multus-additional-cni-plugins-hd255\" (UID: \"0819ed1d-2fe9-4bf5-b986-96f59fb24a8b\") " pod="openshift-multus/multus-additional-cni-plugins-hd255"
Jul 07 17:36:42.843118 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.842920    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.843118 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.843003    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5f7bf700-4743-4276-b4b1-9245cd337343-ovnkube-config\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.843118 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.843028    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f7bf700-4743-4276-b4b1-9245cd337343-ovn-node-metrics-cert\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.843118 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.843071    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0819ed1d-2fe9-4bf5-b986-96f59fb24a8b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hd255\" (UID: \"0819ed1d-2fe9-4bf5-b986-96f59fb24a8b\") " pod="openshift-multus/multus-additional-cni-plugins-hd255"
Jul 07 17:36:42.843118 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.843090    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf8md\" (UniqueName: \"kubernetes.io/projected/0819ed1d-2fe9-4bf5-b986-96f59fb24a8b-kube-api-access-bf8md\") pod \"multus-additional-cni-plugins-hd255\" (UID: \"0819ed1d-2fe9-4bf5-b986-96f59fb24a8b\") " pod="openshift-multus/multus-additional-cni-plugins-hd255"
Jul 07 17:36:42.843712 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.843140    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-etc-sysctl-conf\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.843712 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.843165    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-etc-systemd\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.843712 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.843215    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4c309e8e-07d4-416b-8c80-b49eea680c0f-registration-dir\") pod \"aws-ebs-csi-driver-node-vt7nm\" (UID: \"4c309e8e-07d4-416b-8c80-b49eea680c0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt7nm"
Jul 07 17:36:42.843712 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.843239    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-host-run-netns\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.843712 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.843261    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-node-log\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.843712 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.843284    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5f7bf700-4743-4276-b4b1-9245cd337343-env-overrides\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.843712 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.843306    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-etc-sysconfig\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.843712 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.843334    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-var-lib-kubelet\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.843712 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.843362    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bed0ab9e-a1dc-473d-9a55-157118bd4bab-iptables-alerter-script\") pod \"iptables-alerter-nzkhn\" (UID: \"bed0ab9e-a1dc-473d-9a55-157118bd4bab\") " pod="openshift-network-operator/iptables-alerter-nzkhn"
Jul 07 17:36:42.843712 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.843381    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdsnc\" (UniqueName: \"kubernetes.io/projected/4c309e8e-07d4-416b-8c80-b49eea680c0f-kube-api-access-xdsnc\") pod \"aws-ebs-csi-driver-node-vt7nm\" (UID: \"4c309e8e-07d4-416b-8c80-b49eea680c0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt7nm"
Jul 07 17:36:42.843712 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.843418    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5f7bf700-4743-4276-b4b1-9245cd337343-ovnkube-script-lib\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.843712 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.843433    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0819ed1d-2fe9-4bf5-b986-96f59fb24a8b-cnibin\") pod \"multus-additional-cni-plugins-hd255\" (UID: \"0819ed1d-2fe9-4bf5-b986-96f59fb24a8b\") " pod="openshift-multus/multus-additional-cni-plugins-hd255"
Jul 07 17:36:42.843712 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.843446    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0819ed1d-2fe9-4bf5-b986-96f59fb24a8b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hd255\" (UID: \"0819ed1d-2fe9-4bf5-b986-96f59fb24a8b\") " pod="openshift-multus/multus-additional-cni-plugins-hd255"
Jul 07 17:36:42.843712 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.843459    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-etc-sysctl-d\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.843712 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.843485    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-sys\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.843712 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.843498    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-lib-modules\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.844442 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.843566    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4c309e8e-07d4-416b-8c80-b49eea680c0f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vt7nm\" (UID: \"4c309e8e-07d4-416b-8c80-b49eea680c0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt7nm"
Jul 07 17:36:42.844442 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.843769    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4c309e8e-07d4-416b-8c80-b49eea680c0f-etc-selinux\") pod \"aws-ebs-csi-driver-node-vt7nm\" (UID: \"4c309e8e-07d4-416b-8c80-b49eea680c0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt7nm"
Jul 07 17:36:42.844442 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.844245    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6svr4"
Jul 07 17:36:42.844587 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.844569    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-systemd-units\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.844641 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.844602    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-host-slash\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.844641 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.844625    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-run-openvswitch\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.844731 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.844640    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 17:36:42.844731 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.844645    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-run-ovn\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.844731 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.844668    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-host-run-ovn-kubernetes\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.844731 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.844700    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-etc-openvswitch\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.844731 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.844725    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58fbm\" (UniqueName: \"kubernetes.io/projected/5f7bf700-4743-4276-b4b1-9245cd337343-kube-api-access-58fbm\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.844945 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.844763    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0819ed1d-2fe9-4bf5-b986-96f59fb24a8b-os-release\") pod \"multus-additional-cni-plugins-hd255\" (UID: \"0819ed1d-2fe9-4bf5-b986-96f59fb24a8b\") " pod="openshift-multus/multus-additional-cni-plugins-hd255"
Jul 07 17:36:42.844945 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.844787    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0819ed1d-2fe9-4bf5-b986-96f59fb24a8b-cni-binary-copy\") pod \"multus-additional-cni-plugins-hd255\" (UID: \"0819ed1d-2fe9-4bf5-b986-96f59fb24a8b\") " pod="openshift-multus/multus-additional-cni-plugins-hd255"
Jul 07 17:36:42.844945 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.844813    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0819ed1d-2fe9-4bf5-b986-96f59fb24a8b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hd255\" (UID: \"0819ed1d-2fe9-4bf5-b986-96f59fb24a8b\") " pod="openshift-multus/multus-additional-cni-plugins-hd255"
Jul 07 17:36:42.844945 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.844834    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-etc-modprobe-d\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.844945 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.844859    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-etc-kubernetes\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.844945 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.844889    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-host\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.844945 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.844920    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-run-systemd\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.845292 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.844944    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-var-lib-openvswitch\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.845292 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.844983    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 17:36:42.845292 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.845067    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 17:36:42.845292 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.844986    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-host-cni-netd\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.845292 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.845154    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-run\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.845292 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.845181    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-etc-tuned\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.845292 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.845203    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-tmp\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.845292 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.845227    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4c309e8e-07d4-416b-8c80-b49eea680c0f-socket-dir\") pod \"aws-ebs-csi-driver-node-vt7nm\" (UID: \"4c309e8e-07d4-416b-8c80-b49eea680c0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt7nm"
Jul 07 17:36:42.845292 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.845251    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4c309e8e-07d4-416b-8c80-b49eea680c0f-device-dir\") pod \"aws-ebs-csi-driver-node-vt7nm\" (UID: \"4c309e8e-07d4-416b-8c80-b49eea680c0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt7nm"
Jul 07 17:36:42.845292 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.845278    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m665\" (UniqueName: \"kubernetes.io/projected/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-kube-api-access-9m665\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.846380 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.846029    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 17:36:42.846380 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.846064    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jntd4\""
Jul 07 17:36:42.846535 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.846466    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hrv6x\""
Jul 07 17:36:42.846982 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.846739    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 17:36:42.847359 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.847106    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzqgz"
Jul 07 17:36:42.847359 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:42.847184    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzqgz" podUID="3c7b7842-ac7e-4d39-9f7d-02b994a8f075"
Jul 07 17:36:42.849616 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.849599    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltf2l"
Jul 07 17:36:42.849678 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:42.849663    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltf2l" podUID="14607182-3f75-4121-b763-1acf8e7e3c4c"
Jul 07 17:36:42.851688 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.851659    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:36:42.851756 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:42.851722    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r9p6" podUID="8eb6fe4b-fba4-4c80-b328-93ff6b880816"
Jul 07 17:36:42.853997 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.853787    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-47mnk"
Jul 07 17:36:42.856709 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.856685    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pnxk9\""
Jul 07 17:36:42.857002 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.856979    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 17:36:42.857267 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.857250    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 17:36:42.876699 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.876674    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qd8jd"
Jul 07 17:36:42.885896 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.885870    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qd8jd"
Jul 07 17:36:42.934337 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.934312    2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 17:36:42.945677 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.945646    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m665\" (UniqueName: \"kubernetes.io/projected/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-kube-api-access-9m665\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.945677 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.945688    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bed0ab9e-a1dc-473d-9a55-157118bd4bab-host-slash\") pod \"iptables-alerter-nzkhn\" (UID: \"bed0ab9e-a1dc-473d-9a55-157118bd4bab\") " pod="openshift-network-operator/iptables-alerter-nzkhn"
Jul 07 17:36:42.945899 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.945713    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4c309e8e-07d4-416b-8c80-b49eea680c0f-sys-fs\") pod \"aws-ebs-csi-driver-node-vt7nm\" (UID: \"4c309e8e-07d4-416b-8c80-b49eea680c0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt7nm"
Jul 07 17:36:42.945899 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.945735    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-log-socket\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.945899 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.945762    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-host-run-multus-certs\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:42.945899 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.945785    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9a0fe013-4d37-461e-a883-7889017895c0-hosts-file\") pod \"node-resolver-hwbkw\" (UID: \"9a0fe013-4d37-461e-a883-7889017895c0\") " pod="openshift-dns/node-resolver-hwbkw"
Jul 07 17:36:42.945899 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.945822    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.945899 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.945848    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf8md\" (UniqueName: \"kubernetes.io/projected/0819ed1d-2fe9-4bf5-b986-96f59fb24a8b-kube-api-access-bf8md\") pod \"multus-additional-cni-plugins-hd255\" (UID: \"0819ed1d-2fe9-4bf5-b986-96f59fb24a8b\") " pod="openshift-multus/multus-additional-cni-plugins-hd255"
Jul 07 17:36:42.945899 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.945870    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-etc-sysctl-conf\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.945899 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.945891    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-system-cni-dir\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:42.946285 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.945913    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-host-run-k8s-cni-cncf-io\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:42.946285 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.945938    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvtvh\" (UniqueName: \"kubernetes.io/projected/14607182-3f75-4121-b763-1acf8e7e3c4c-kube-api-access-rvtvh\") pod \"network-metrics-daemon-ltf2l\" (UID: \"14607182-3f75-4121-b763-1acf8e7e3c4c\") " pod="openshift-multus/network-metrics-daemon-ltf2l"
Jul 07 17:36:42.946285 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.945988    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-host-run-netns\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.946285 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946004    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5f7bf700-4743-4276-b4b1-9245cd337343-env-overrides\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.946285 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946020    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-etc-sysconfig\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.946285 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946041    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-host-var-lib-cni-multus\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:42.946285 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946066    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-host-var-lib-kubelet\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:42.946285 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946088    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0fe8e6ad-d639-4924-807d-8893d085d71c-serviceca\") pod \"node-ca-rn66n\" (UID: \"0fe8e6ad-d639-4924-807d-8893d085d71c\") " pod="openshift-image-registry/node-ca-rn66n"
Jul 07 17:36:42.946285 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946112    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdsnc\" (UniqueName: \"kubernetes.io/projected/4c309e8e-07d4-416b-8c80-b49eea680c0f-kube-api-access-xdsnc\") pod \"aws-ebs-csi-driver-node-vt7nm\" (UID: \"4c309e8e-07d4-416b-8c80-b49eea680c0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt7nm"
Jul 07 17:36:42.946285 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946141    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0819ed1d-2fe9-4bf5-b986-96f59fb24a8b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hd255\" (UID: \"0819ed1d-2fe9-4bf5-b986-96f59fb24a8b\") " pod="openshift-multus/multus-additional-cni-plugins-hd255"
Jul 07 17:36:42.946285 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946156    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-sys\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.946285 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946183    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4c309e8e-07d4-416b-8c80-b49eea680c0f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vt7nm\" (UID: \"4c309e8e-07d4-416b-8c80-b49eea680c0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt7nm"
Jul 07 17:36:42.946285 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946203    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4c309e8e-07d4-416b-8c80-b49eea680c0f-etc-selinux\") pod \"aws-ebs-csi-driver-node-vt7nm\" (UID: \"4c309e8e-07d4-416b-8c80-b49eea680c0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt7nm"
Jul 07 17:36:42.946285 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946228    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-systemd-units\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.946285 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946250    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-host-slash\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.946285 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946272    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-run-openvswitch\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.946285 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946289    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-run-ovn\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.946919 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946304    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-host-run-ovn-kubernetes\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.946919 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946327    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-etc-openvswitch\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.946919 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946345    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-host\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.946919 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946359    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-etc-tuned\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.946919 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946375    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7v4n\" (UniqueName: \"kubernetes.io/projected/3c7b7842-ac7e-4d39-9f7d-02b994a8f075-kube-api-access-h7v4n\") pod \"network-check-target-vzqgz\" (UID: \"3c7b7842-ac7e-4d39-9f7d-02b994a8f075\") " pod="openshift-network-diagnostics/network-check-target-vzqgz"
Jul 07 17:36:42.946919 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946390    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-var-lib-openvswitch\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.946919 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946408    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-run\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.946919 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946445    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a0fe013-4d37-461e-a883-7889017895c0-tmp-dir\") pod \"node-resolver-hwbkw\" (UID: \"9a0fe013-4d37-461e-a883-7889017895c0\") " pod="openshift-dns/node-resolver-hwbkw"
Jul 07 17:36:42.946919 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946470    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd1252ab-8a9b-4f7b-b121-7e144ad610f4-konnectivity-ca\") pod \"konnectivity-agent-47mnk\" (UID: \"fd1252ab-8a9b-4f7b-b121-7e144ad610f4\") " pod="kube-system/konnectivity-agent-47mnk"
Jul 07 17:36:42.946919 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946501    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4c309e8e-07d4-416b-8c80-b49eea680c0f-socket-dir\") pod \"aws-ebs-csi-driver-node-vt7nm\" (UID: \"4c309e8e-07d4-416b-8c80-b49eea680c0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt7nm"
Jul 07 17:36:42.946919 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946524    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4c309e8e-07d4-416b-8c80-b49eea680c0f-device-dir\") pod \"aws-ebs-csi-driver-node-vt7nm\" (UID: \"4c309e8e-07d4-416b-8c80-b49eea680c0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt7nm"
Jul 07 17:36:42.946919 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946548    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-cnibin\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:42.946919 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946570    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8eb6fe4b-fba4-4c80-b328-93ff6b880816-kubelet-config\") pod \"global-pull-secret-syncer-5r9p6\" (UID: \"8eb6fe4b-fba4-4c80-b328-93ff6b880816\") " pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:36:42.946919 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946594    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8eb6fe4b-fba4-4c80-b328-93ff6b880816-dbus\") pod \"global-pull-secret-syncer-5r9p6\" (UID: \"8eb6fe4b-fba4-4c80-b328-93ff6b880816\") " pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:36:42.946919 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946617    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8eb6fe4b-fba4-4c80-b328-93ff6b880816-original-pull-secret\") pod \"global-pull-secret-syncer-5r9p6\" (UID: \"8eb6fe4b-fba4-4c80-b328-93ff6b880816\") " pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:36:42.946919 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946658    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58f7r\" (UniqueName: \"kubernetes.io/projected/bed0ab9e-a1dc-473d-9a55-157118bd4bab-kube-api-access-58f7r\") pod \"iptables-alerter-nzkhn\" (UID: \"bed0ab9e-a1dc-473d-9a55-157118bd4bab\") " pod="openshift-network-operator/iptables-alerter-nzkhn"
Jul 07 17:36:42.946919 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946682    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-host-kubelet\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.947481 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946711    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-host-cni-bin\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.947481 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946736    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0819ed1d-2fe9-4bf5-b986-96f59fb24a8b-system-cni-dir\") pod \"multus-additional-cni-plugins-hd255\" (UID: \"0819ed1d-2fe9-4bf5-b986-96f59fb24a8b\") " pod="openshift-multus/multus-additional-cni-plugins-hd255"
Jul 07 17:36:42.947481 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946765    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0819ed1d-2fe9-4bf5-b986-96f59fb24a8b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hd255\" (UID: \"0819ed1d-2fe9-4bf5-b986-96f59fb24a8b\") " pod="openshift-multus/multus-additional-cni-plugins-hd255"
Jul 07 17:36:42.947481 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946790    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-lib-modules\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.947481 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946812    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-host-run-netns\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:42.947481 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946835    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0fe8e6ad-d639-4924-807d-8893d085d71c-host\") pod \"node-ca-rn66n\" (UID: \"0fe8e6ad-d639-4924-807d-8893d085d71c\") " pod="openshift-image-registry/node-ca-rn66n"
Jul 07 17:36:42.947481 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946865    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5f7bf700-4743-4276-b4b1-9245cd337343-ovnkube-config\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.947481 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946891    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f7bf700-4743-4276-b4b1-9245cd337343-ovn-node-metrics-cert\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.947481 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946915    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-etc-systemd\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.947481 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946942    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4c309e8e-07d4-416b-8c80-b49eea680c0f-registration-dir\") pod \"aws-ebs-csi-driver-node-vt7nm\" (UID: \"4c309e8e-07d4-416b-8c80-b49eea680c0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt7nm"
Jul 07 17:36:42.947481 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.946984    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-node-log\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.947481 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.947009    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-var-lib-kubelet\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.947481 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.947031    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rggg9\" (UniqueName: \"kubernetes.io/projected/503f5710-ce38-4a88-b125-043754ab1a51-kube-api-access-rggg9\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:42.947481 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.947047    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-tmp\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.947481 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.947063    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bed0ab9e-a1dc-473d-9a55-157118bd4bab-iptables-alerter-script\") pod \"iptables-alerter-nzkhn\" (UID: \"bed0ab9e-a1dc-473d-9a55-157118bd4bab\") " pod="openshift-network-operator/iptables-alerter-nzkhn"
Jul 07 17:36:42.947481 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.947080    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5f7bf700-4743-4276-b4b1-9245cd337343-ovnkube-script-lib\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.947481 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.947105    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0819ed1d-2fe9-4bf5-b986-96f59fb24a8b-cnibin\") pod \"multus-additional-cni-plugins-hd255\" (UID: \"0819ed1d-2fe9-4bf5-b986-96f59fb24a8b\") " pod="openshift-multus/multus-additional-cni-plugins-hd255"
Jul 07 17:36:42.948097 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.947140    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-etc-sysctl-d\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.948097 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.947164    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/503f5710-ce38-4a88-b125-043754ab1a51-cni-binary-copy\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:42.948097 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.947188    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14607182-3f75-4121-b763-1acf8e7e3c4c-metrics-certs\") pod \"network-metrics-daemon-ltf2l\" (UID: \"14607182-3f75-4121-b763-1acf8e7e3c4c\") " pod="openshift-multus/network-metrics-daemon-ltf2l"
Jul 07 17:36:42.948097 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.947213    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0819ed1d-2fe9-4bf5-b986-96f59fb24a8b-os-release\") pod \"multus-additional-cni-plugins-hd255\" (UID: \"0819ed1d-2fe9-4bf5-b986-96f59fb24a8b\") " pod="openshift-multus/multus-additional-cni-plugins-hd255"
Jul 07 17:36:42.948097 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.947239    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0819ed1d-2fe9-4bf5-b986-96f59fb24a8b-cni-binary-copy\") pod \"multus-additional-cni-plugins-hd255\" (UID: \"0819ed1d-2fe9-4bf5-b986-96f59fb24a8b\") " pod="openshift-multus/multus-additional-cni-plugins-hd255"
Jul 07 17:36:42.948097 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.947265    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-etc-kubernetes\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.948097 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.947287    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-multus-cni-dir\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:42.948097 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.947316    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-multus-socket-dir-parent\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:42.948097 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.947341    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-hostroot\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:42.948097 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.947365    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmh4q\" (UniqueName: \"kubernetes.io/projected/0fe8e6ad-d639-4924-807d-8893d085d71c-kube-api-access-dmh4q\") pod \"node-ca-rn66n\" (UID: \"0fe8e6ad-d639-4924-807d-8893d085d71c\") " pod="openshift-image-registry/node-ca-rn66n"
Jul 07 17:36:42.948097 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.947388    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd1252ab-8a9b-4f7b-b121-7e144ad610f4-agent-certs\") pod \"konnectivity-agent-47mnk\" (UID: \"fd1252ab-8a9b-4f7b-b121-7e144ad610f4\") " pod="kube-system/konnectivity-agent-47mnk"
Jul 07 17:36:42.948097 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.947407    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58fbm\" (UniqueName: \"kubernetes.io/projected/5f7bf700-4743-4276-b4b1-9245cd337343-kube-api-access-58fbm\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.948097 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.947427    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0819ed1d-2fe9-4bf5-b986-96f59fb24a8b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hd255\" (UID: \"0819ed1d-2fe9-4bf5-b986-96f59fb24a8b\") " pod="openshift-multus/multus-additional-cni-plugins-hd255"
Jul 07 17:36:42.948097 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.947454    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-etc-modprobe-d\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.948097 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.947478    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-host-var-lib-cni-bin\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:42.948097 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.947502    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/503f5710-ce38-4a88-b125-043754ab1a51-multus-daemon-config\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:42.948097 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.947517    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-etc-kubernetes\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:42.948662 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.947532    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz4qd\" (UniqueName: \"kubernetes.io/projected/9a0fe013-4d37-461e-a883-7889017895c0-kube-api-access-bz4qd\") pod \"node-resolver-hwbkw\" (UID: \"9a0fe013-4d37-461e-a883-7889017895c0\") " pod="openshift-dns/node-resolver-hwbkw"
Jul 07 17:36:42.948662 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.947548    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-run-systemd\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.948662 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.947566    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-host-cni-netd\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.948662 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.947591    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-os-release\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:42.948662 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.947616    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-multus-conf-dir\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:42.948662 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.947938    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bed0ab9e-a1dc-473d-9a55-157118bd4bab-host-slash\") pod \"iptables-alerter-nzkhn\" (UID: \"bed0ab9e-a1dc-473d-9a55-157118bd4bab\") " pod="openshift-network-operator/iptables-alerter-nzkhn"
Jul 07 17:36:42.948662 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.948021    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4c309e8e-07d4-416b-8c80-b49eea680c0f-sys-fs\") pod \"aws-ebs-csi-driver-node-vt7nm\" (UID: \"4c309e8e-07d4-416b-8c80-b49eea680c0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt7nm"
Jul 07 17:36:42.948662 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.948054    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-log-socket\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.948662 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.948114    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.948662 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.948384    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-etc-sysctl-conf\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.948662 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.948451    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-host-run-netns\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.949108 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.948868    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5f7bf700-4743-4276-b4b1-9245cd337343-env-overrides\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.949108 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.948940    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-etc-sysconfig\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.951088 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.949329    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-etc-kubernetes\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.951088 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.949404    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-etc-modprobe-d\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.951088 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.949634    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0819ed1d-2fe9-4bf5-b986-96f59fb24a8b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hd255\" (UID: \"0819ed1d-2fe9-4bf5-b986-96f59fb24a8b\") " pod="openshift-multus/multus-additional-cni-plugins-hd255"
Jul 07 17:36:42.951088 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.949716    2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 17:36:42.951088 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.949735    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-etc-systemd\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.951088 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.949736    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4c309e8e-07d4-416b-8c80-b49eea680c0f-registration-dir\") pod \"aws-ebs-csi-driver-node-vt7nm\" (UID: \"4c309e8e-07d4-416b-8c80-b49eea680c0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt7nm"
Jul 07 17:36:42.951088 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.949775    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-node-log\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.951088 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.949776    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5f7bf700-4743-4276-b4b1-9245cd337343-ovnkube-config\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.951088 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.949822    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0819ed1d-2fe9-4bf5-b986-96f59fb24a8b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hd255\" (UID: \"0819ed1d-2fe9-4bf5-b986-96f59fb24a8b\") " pod="openshift-multus/multus-additional-cni-plugins-hd255"
Jul 07 17:36:42.951088 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.949828    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-sys\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.951088 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.949827    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-var-lib-kubelet\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.951088 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.949880    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4c309e8e-07d4-416b-8c80-b49eea680c0f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vt7nm\" (UID: \"4c309e8e-07d4-416b-8c80-b49eea680c0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt7nm"
Jul 07 17:36:42.951088 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.949898    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-run-systemd\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.951088 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.949965    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4c309e8e-07d4-416b-8c80-b49eea680c0f-etc-selinux\") pod \"aws-ebs-csi-driver-node-vt7nm\" (UID: \"4c309e8e-07d4-416b-8c80-b49eea680c0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt7nm"
Jul 07 17:36:42.951088 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.949972    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-host-cni-netd\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.951088 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.950013    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-systemd-units\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.951088 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.950018    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-run-openvswitch\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.951088 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.950049    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-host-slash\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.952031 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.950062    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-run-ovn\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.952031 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.950104    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-host-run-ovn-kubernetes\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.952031 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.950158    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-etc-openvswitch\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.952031 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.950205    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bed0ab9e-a1dc-473d-9a55-157118bd4bab-iptables-alerter-script\") pod \"iptables-alerter-nzkhn\" (UID: \"bed0ab9e-a1dc-473d-9a55-157118bd4bab\") " pod="openshift-network-operator/iptables-alerter-nzkhn"
Jul 07 17:36:42.952031 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.950208    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-host\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.952031 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.950278    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-var-lib-openvswitch\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.952031 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.950305    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-host-kubelet\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.952031 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.950325    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-run\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.952031 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.950343    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f7bf700-4743-4276-b4b1-9245cd337343-host-cni-bin\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.952031 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.950414    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0819ed1d-2fe9-4bf5-b986-96f59fb24a8b-system-cni-dir\") pod \"multus-additional-cni-plugins-hd255\" (UID: \"0819ed1d-2fe9-4bf5-b986-96f59fb24a8b\") " pod="openshift-multus/multus-additional-cni-plugins-hd255"
Jul 07 17:36:42.952031 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.950431    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-lib-modules\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.952031 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.950477    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0819ed1d-2fe9-4bf5-b986-96f59fb24a8b-cnibin\") pod \"multus-additional-cni-plugins-hd255\" (UID: \"0819ed1d-2fe9-4bf5-b986-96f59fb24a8b\") " pod="openshift-multus/multus-additional-cni-plugins-hd255"
Jul 07 17:36:42.952031 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.950554    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-etc-sysctl-d\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.952031 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.950626    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0819ed1d-2fe9-4bf5-b986-96f59fb24a8b-os-release\") pod \"multus-additional-cni-plugins-hd255\" (UID: \"0819ed1d-2fe9-4bf5-b986-96f59fb24a8b\") " pod="openshift-multus/multus-additional-cni-plugins-hd255"
Jul 07 17:36:42.952031 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.950874    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0819ed1d-2fe9-4bf5-b986-96f59fb24a8b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hd255\" (UID: \"0819ed1d-2fe9-4bf5-b986-96f59fb24a8b\") " pod="openshift-multus/multus-additional-cni-plugins-hd255"
Jul 07 17:36:42.952031 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.950987    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5f7bf700-4743-4276-b4b1-9245cd337343-ovnkube-script-lib\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.952031 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.951005    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4c309e8e-07d4-416b-8c80-b49eea680c0f-socket-dir\") pod \"aws-ebs-csi-driver-node-vt7nm\" (UID: \"4c309e8e-07d4-416b-8c80-b49eea680c0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt7nm"
Jul 07 17:36:42.952637 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.951059    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4c309e8e-07d4-416b-8c80-b49eea680c0f-device-dir\") pod \"aws-ebs-csi-driver-node-vt7nm\" (UID: \"4c309e8e-07d4-416b-8c80-b49eea680c0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt7nm"
Jul 07 17:36:42.952637 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.951075    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0819ed1d-2fe9-4bf5-b986-96f59fb24a8b-cni-binary-copy\") pod \"multus-additional-cni-plugins-hd255\" (UID: \"0819ed1d-2fe9-4bf5-b986-96f59fb24a8b\") " pod="openshift-multus/multus-additional-cni-plugins-hd255"
Jul 07 17:36:42.954601 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.953288    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-etc-tuned\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.954601 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.953434    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f7bf700-4743-4276-b4b1-9245cd337343-ovn-node-metrics-cert\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.954601 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.953454    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-tmp\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.956734 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.956714    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m665\" (UniqueName: \"kubernetes.io/projected/9f65a52c-e50e-4ddf-8d5d-025755e0fccc-kube-api-access-9m665\") pod \"tuned-5pchl\" (UID: \"9f65a52c-e50e-4ddf-8d5d-025755e0fccc\") " pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:42.957464 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.957441    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf8md\" (UniqueName: \"kubernetes.io/projected/0819ed1d-2fe9-4bf5-b986-96f59fb24a8b-kube-api-access-bf8md\") pod \"multus-additional-cni-plugins-hd255\" (UID: \"0819ed1d-2fe9-4bf5-b986-96f59fb24a8b\") " pod="openshift-multus/multus-additional-cni-plugins-hd255"
Jul 07 17:36:42.958327 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.958308    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58fbm\" (UniqueName: \"kubernetes.io/projected/5f7bf700-4743-4276-b4b1-9245cd337343-kube-api-access-58fbm\") pod \"ovnkube-node-8s7h4\" (UID: \"5f7bf700-4743-4276-b4b1-9245cd337343\") " pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:42.958778 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.958757    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58f7r\" (UniqueName: \"kubernetes.io/projected/bed0ab9e-a1dc-473d-9a55-157118bd4bab-kube-api-access-58f7r\") pod \"iptables-alerter-nzkhn\" (UID: \"bed0ab9e-a1dc-473d-9a55-157118bd4bab\") " pod="openshift-network-operator/iptables-alerter-nzkhn"
Jul 07 17:36:42.960189 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:42.960149    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdsnc\" (UniqueName: \"kubernetes.io/projected/4c309e8e-07d4-416b-8c80-b49eea680c0f-kube-api-access-xdsnc\") pod \"aws-ebs-csi-driver-node-vt7nm\" (UID: \"4c309e8e-07d4-416b-8c80-b49eea680c0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt7nm"
Jul 07 17:36:43.006229 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.006173    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-78.ec2.internal" event={"ID":"d1173d55afe0841f3da9d7bed0dfe65d","Type":"ContainerStarted","Data":"78f4c17e2cdfea578f5fd60d9b67668097ea98da6b60c8daf423942ffa441e08"}
Jul 07 17:36:43.011694 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.011605    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-78.ec2.internal" event={"ID":"bf6dd33ab0df7b388b9c2881db96647c","Type":"ContainerStarted","Data":"49a25d232299ac8d640945fe7ab21ea4f8f9da95aca8193295711c2765c680f1"}
Jul 07 17:36:43.048826 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.048792    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-system-cni-dir\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.049050 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.048833    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-host-run-k8s-cni-cncf-io\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.049050 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.048861    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvtvh\" (UniqueName: \"kubernetes.io/projected/14607182-3f75-4121-b763-1acf8e7e3c4c-kube-api-access-rvtvh\") pod \"network-metrics-daemon-ltf2l\" (UID: \"14607182-3f75-4121-b763-1acf8e7e3c4c\") " pod="openshift-multus/network-metrics-daemon-ltf2l"
Jul 07 17:36:43.049050 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.048890    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-host-var-lib-cni-multus\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.049050 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.048905    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-host-var-lib-kubelet\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.049050 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.048920    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0fe8e6ad-d639-4924-807d-8893d085d71c-serviceca\") pod \"node-ca-rn66n\" (UID: \"0fe8e6ad-d639-4924-807d-8893d085d71c\") " pod="openshift-image-registry/node-ca-rn66n"
Jul 07 17:36:43.049050 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.048950    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7v4n\" (UniqueName: \"kubernetes.io/projected/3c7b7842-ac7e-4d39-9f7d-02b994a8f075-kube-api-access-h7v4n\") pod \"network-check-target-vzqgz\" (UID: \"3c7b7842-ac7e-4d39-9f7d-02b994a8f075\") " pod="openshift-network-diagnostics/network-check-target-vzqgz"
Jul 07 17:36:43.049050 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.048999    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a0fe013-4d37-461e-a883-7889017895c0-tmp-dir\") pod \"node-resolver-hwbkw\" (UID: \"9a0fe013-4d37-461e-a883-7889017895c0\") " pod="openshift-dns/node-resolver-hwbkw"
Jul 07 17:36:43.049050 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.049024    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd1252ab-8a9b-4f7b-b121-7e144ad610f4-konnectivity-ca\") pod \"konnectivity-agent-47mnk\" (UID: \"fd1252ab-8a9b-4f7b-b121-7e144ad610f4\") " pod="kube-system/konnectivity-agent-47mnk"
Jul 07 17:36:43.049522 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.049067    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-cnibin\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.049522 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.049086    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8eb6fe4b-fba4-4c80-b328-93ff6b880816-kubelet-config\") pod \"global-pull-secret-syncer-5r9p6\" (UID: \"8eb6fe4b-fba4-4c80-b328-93ff6b880816\") " pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:36:43.049522 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.049102    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8eb6fe4b-fba4-4c80-b328-93ff6b880816-dbus\") pod \"global-pull-secret-syncer-5r9p6\" (UID: \"8eb6fe4b-fba4-4c80-b328-93ff6b880816\") " pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:36:43.049522 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.049119    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8eb6fe4b-fba4-4c80-b328-93ff6b880816-original-pull-secret\") pod \"global-pull-secret-syncer-5r9p6\" (UID: \"8eb6fe4b-fba4-4c80-b328-93ff6b880816\") " pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:36:43.049522 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.049148    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-host-run-netns\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.049522 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.049172    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0fe8e6ad-d639-4924-807d-8893d085d71c-host\") pod \"node-ca-rn66n\" (UID: \"0fe8e6ad-d639-4924-807d-8893d085d71c\") " pod="openshift-image-registry/node-ca-rn66n"
Jul 07 17:36:43.049522 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.049202    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rggg9\" (UniqueName: \"kubernetes.io/projected/503f5710-ce38-4a88-b125-043754ab1a51-kube-api-access-rggg9\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.049522 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.049233    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/503f5710-ce38-4a88-b125-043754ab1a51-cni-binary-copy\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.049522 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.049256    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14607182-3f75-4121-b763-1acf8e7e3c4c-metrics-certs\") pod \"network-metrics-daemon-ltf2l\" (UID: \"14607182-3f75-4121-b763-1acf8e7e3c4c\") " pod="openshift-multus/network-metrics-daemon-ltf2l"
Jul 07 17:36:43.049522 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.049282    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-multus-cni-dir\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.049522 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.049305    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-multus-socket-dir-parent\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.049522 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.049331    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-hostroot\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.049522 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.049353    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmh4q\" (UniqueName: \"kubernetes.io/projected/0fe8e6ad-d639-4924-807d-8893d085d71c-kube-api-access-dmh4q\") pod \"node-ca-rn66n\" (UID: \"0fe8e6ad-d639-4924-807d-8893d085d71c\") " pod="openshift-image-registry/node-ca-rn66n"
Jul 07 17:36:43.049522 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.049376    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd1252ab-8a9b-4f7b-b121-7e144ad610f4-agent-certs\") pod \"konnectivity-agent-47mnk\" (UID: \"fd1252ab-8a9b-4f7b-b121-7e144ad610f4\") " pod="kube-system/konnectivity-agent-47mnk"
Jul 07 17:36:43.049522 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.049404    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-host-var-lib-cni-bin\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.049522 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.049426    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/503f5710-ce38-4a88-b125-043754ab1a51-multus-daemon-config\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.049522 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.049449    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-etc-kubernetes\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.049522 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.049476    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz4qd\" (UniqueName: \"kubernetes.io/projected/9a0fe013-4d37-461e-a883-7889017895c0-kube-api-access-bz4qd\") pod \"node-resolver-hwbkw\" (UID: \"9a0fe013-4d37-461e-a883-7889017895c0\") " pod="openshift-dns/node-resolver-hwbkw"
Jul 07 17:36:43.050366 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.049504    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-os-release\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.050366 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.049526    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-multus-conf-dir\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.050366 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.049556    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-host-run-multus-certs\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.050366 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.049581    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9a0fe013-4d37-461e-a883-7889017895c0-hosts-file\") pod \"node-resolver-hwbkw\" (UID: \"9a0fe013-4d37-461e-a883-7889017895c0\") " pod="openshift-dns/node-resolver-hwbkw"
Jul 07 17:36:43.050366 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.049752    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9a0fe013-4d37-461e-a883-7889017895c0-hosts-file\") pod \"node-resolver-hwbkw\" (UID: \"9a0fe013-4d37-461e-a883-7889017895c0\") " pod="openshift-dns/node-resolver-hwbkw"
Jul 07 17:36:43.050366 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.049803    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-system-cni-dir\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.050366 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.049837    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-host-run-k8s-cni-cncf-io\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.050366 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.050127    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-host-var-lib-cni-multus\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.050366 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.050168    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-host-var-lib-kubelet\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.050719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.050550    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0fe8e6ad-d639-4924-807d-8893d085d71c-serviceca\") pod \"node-ca-rn66n\" (UID: \"0fe8e6ad-d639-4924-807d-8893d085d71c\") " pod="openshift-image-registry/node-ca-rn66n"
Jul 07 17:36:43.050934 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.050914    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a0fe013-4d37-461e-a883-7889017895c0-tmp-dir\") pod \"node-resolver-hwbkw\" (UID: \"9a0fe013-4d37-461e-a883-7889017895c0\") " pod="openshift-dns/node-resolver-hwbkw"
Jul 07 17:36:43.051358 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.051335    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd1252ab-8a9b-4f7b-b121-7e144ad610f4-konnectivity-ca\") pod \"konnectivity-agent-47mnk\" (UID: \"fd1252ab-8a9b-4f7b-b121-7e144ad610f4\") " pod="kube-system/konnectivity-agent-47mnk"
Jul 07 17:36:43.051451 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.051386    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-cnibin\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.051451 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.051430    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8eb6fe4b-fba4-4c80-b328-93ff6b880816-kubelet-config\") pod \"global-pull-secret-syncer-5r9p6\" (UID: \"8eb6fe4b-fba4-4c80-b328-93ff6b880816\") " pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:36:43.051540 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.051519    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8eb6fe4b-fba4-4c80-b328-93ff6b880816-dbus\") pod \"global-pull-secret-syncer-5r9p6\" (UID: \"8eb6fe4b-fba4-4c80-b328-93ff6b880816\") " pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:36:43.051617 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:43.051604    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:36:43.051674 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:43.051668    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eb6fe4b-fba4-4c80-b328-93ff6b880816-original-pull-secret podName:8eb6fe4b-fba4-4c80-b328-93ff6b880816 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:43.551653171 +0000 UTC m=+3.066883484 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8eb6fe4b-fba4-4c80-b328-93ff6b880816-original-pull-secret") pod "global-pull-secret-syncer-5r9p6" (UID: "8eb6fe4b-fba4-4c80-b328-93ff6b880816") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:36:43.051756 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.051699    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-host-run-netns\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.051756 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.051722    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0fe8e6ad-d639-4924-807d-8893d085d71c-host\") pod \"node-ca-rn66n\" (UID: \"0fe8e6ad-d639-4924-807d-8893d085d71c\") " pod="openshift-image-registry/node-ca-rn66n"
Jul 07 17:36:43.052264 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.052248    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/503f5710-ce38-4a88-b125-043754ab1a51-cni-binary-copy\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.052329 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:43.052317    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:36:43.052376 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:43.052359    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14607182-3f75-4121-b763-1acf8e7e3c4c-metrics-certs podName:14607182-3f75-4121-b763-1acf8e7e3c4c nodeName:}" failed. No retries permitted until 2026-07-07 17:36:43.552348928 +0000 UTC m=+3.067579243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14607182-3f75-4121-b763-1acf8e7e3c4c-metrics-certs") pod "network-metrics-daemon-ltf2l" (UID: "14607182-3f75-4121-b763-1acf8e7e3c4c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:36:43.052435 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.052407    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-multus-cni-dir\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.052485 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.052445    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-multus-socket-dir-parent\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.052485 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.052479    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-hostroot\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.053164 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.053051    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-multus-conf-dir\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.053164 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.053071    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-os-release\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.053164 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.053055    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-host-run-multus-certs\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.053164 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.053121    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-etc-kubernetes\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.053164 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.053135    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/503f5710-ce38-4a88-b125-043754ab1a51-host-var-lib-cni-bin\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.053474 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.053452    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/503f5710-ce38-4a88-b125-043754ab1a51-multus-daemon-config\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.055226 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.055202    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd1252ab-8a9b-4f7b-b121-7e144ad610f4-agent-certs\") pod \"konnectivity-agent-47mnk\" (UID: \"fd1252ab-8a9b-4f7b-b121-7e144ad610f4\") " pod="kube-system/konnectivity-agent-47mnk"
Jul 07 17:36:43.055466 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:43.055438    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:36:43.055466 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:43.055464    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:36:43.055612 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:43.055478    2559 projected.go:196] Error preparing data for projected volume kube-api-access-h7v4n for pod openshift-network-diagnostics/network-check-target-vzqgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:36:43.055612 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:43.055548    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c7b7842-ac7e-4d39-9f7d-02b994a8f075-kube-api-access-h7v4n podName:3c7b7842-ac7e-4d39-9f7d-02b994a8f075 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:43.555534601 +0000 UTC m=+3.070764928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-h7v4n" (UniqueName: "kubernetes.io/projected/3c7b7842-ac7e-4d39-9f7d-02b994a8f075-kube-api-access-h7v4n") pod "network-check-target-vzqgz" (UID: "3c7b7842-ac7e-4d39-9f7d-02b994a8f075") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:36:43.058787 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.058764    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvtvh\" (UniqueName: \"kubernetes.io/projected/14607182-3f75-4121-b763-1acf8e7e3c4c-kube-api-access-rvtvh\") pod \"network-metrics-daemon-ltf2l\" (UID: \"14607182-3f75-4121-b763-1acf8e7e3c4c\") " pod="openshift-multus/network-metrics-daemon-ltf2l"
Jul 07 17:36:43.060531 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.060488    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmh4q\" (UniqueName: \"kubernetes.io/projected/0fe8e6ad-d639-4924-807d-8893d085d71c-kube-api-access-dmh4q\") pod \"node-ca-rn66n\" (UID: \"0fe8e6ad-d639-4924-807d-8893d085d71c\") " pod="openshift-image-registry/node-ca-rn66n"
Jul 07 17:36:43.061027 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.060941    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rggg9\" (UniqueName: \"kubernetes.io/projected/503f5710-ce38-4a88-b125-043754ab1a51-kube-api-access-rggg9\") pod \"multus-6svr4\" (UID: \"503f5710-ce38-4a88-b125-043754ab1a51\") " pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.061027 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.060979    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz4qd\" (UniqueName: \"kubernetes.io/projected/9a0fe013-4d37-461e-a883-7889017895c0-kube-api-access-bz4qd\") pod \"node-resolver-hwbkw\" (UID: \"9a0fe013-4d37-461e-a883-7889017895c0\") " pod="openshift-dns/node-resolver-hwbkw"
Jul 07 17:36:43.137087 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.137055    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nzkhn"
Jul 07 17:36:43.146379 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.146199    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt7nm"
Jul 07 17:36:43.162114 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.162079    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:36:43.168929 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.168904    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hd255"
Jul 07 17:36:43.175795 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.175775    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5pchl"
Jul 07 17:36:43.183497 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.183472    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hwbkw"
Jul 07 17:36:43.192115 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.192086    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rn66n"
Jul 07 17:36:43.200909 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.200883    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6svr4"
Jul 07 17:36:43.211795 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.211767    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-47mnk"
Jul 07 17:36:43.213734 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.213704    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:36:43.552622 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.552586    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8eb6fe4b-fba4-4c80-b328-93ff6b880816-original-pull-secret\") pod \"global-pull-secret-syncer-5r9p6\" (UID: \"8eb6fe4b-fba4-4c80-b328-93ff6b880816\") " pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:36:43.552818 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.552637    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14607182-3f75-4121-b763-1acf8e7e3c4c-metrics-certs\") pod \"network-metrics-daemon-ltf2l\" (UID: \"14607182-3f75-4121-b763-1acf8e7e3c4c\") " pod="openshift-multus/network-metrics-daemon-ltf2l"
Jul 07 17:36:43.552818 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:43.552758    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:36:43.552818 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:43.552760    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:36:43.553011 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:43.552831    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14607182-3f75-4121-b763-1acf8e7e3c4c-metrics-certs podName:14607182-3f75-4121-b763-1acf8e7e3c4c nodeName:}" failed. No retries permitted until 2026-07-07 17:36:44.552808886 +0000 UTC m=+4.068039204 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14607182-3f75-4121-b763-1acf8e7e3c4c-metrics-certs") pod "network-metrics-daemon-ltf2l" (UID: "14607182-3f75-4121-b763-1acf8e7e3c4c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:36:43.553011 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:43.552859    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eb6fe4b-fba4-4c80-b328-93ff6b880816-original-pull-secret podName:8eb6fe4b-fba4-4c80-b328-93ff6b880816 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:44.552838182 +0000 UTC m=+4.068068496 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8eb6fe4b-fba4-4c80-b328-93ff6b880816-original-pull-secret") pod "global-pull-secret-syncer-5r9p6" (UID: "8eb6fe4b-fba4-4c80-b328-93ff6b880816") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:36:43.653205 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.653167    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7v4n\" (UniqueName: \"kubernetes.io/projected/3c7b7842-ac7e-4d39-9f7d-02b994a8f075-kube-api-access-h7v4n\") pod \"network-check-target-vzqgz\" (UID: \"3c7b7842-ac7e-4d39-9f7d-02b994a8f075\") " pod="openshift-network-diagnostics/network-check-target-vzqgz"
Jul 07 17:36:43.653380 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:43.653342    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:36:43.653380 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:43.653367    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:36:43.653380 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:43.653378    2559 projected.go:196] Error preparing data for projected volume kube-api-access-h7v4n for pod openshift-network-diagnostics/network-check-target-vzqgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:36:43.653490 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:43.653437    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c7b7842-ac7e-4d39-9f7d-02b994a8f075-kube-api-access-h7v4n podName:3c7b7842-ac7e-4d39-9f7d-02b994a8f075 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:44.653424218 +0000 UTC m=+4.168654531 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-h7v4n" (UniqueName: "kubernetes.io/projected/3c7b7842-ac7e-4d39-9f7d-02b994a8f075-kube-api-access-h7v4n") pod "network-check-target-vzqgz" (UID: "3c7b7842-ac7e-4d39-9f7d-02b994a8f075") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:36:43.889703 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.889652    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 17:31:42 +0000 UTC" deadline="2027-12-04 07:34:27.454512525 +0000 UTC"
Jul 07 17:36:43.889703 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:43.889694    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12349h57m43.564823002s"
Jul 07 17:36:44.119701 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:44.119668    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c309e8e_07d4_416b_8c80_b49eea680c0f.slice/crio-515d86822cd0b20afce8b2ef0e69c9c7d67bdf043545565f16eeba81fba32e36 WatchSource:0}: Error finding container 515d86822cd0b20afce8b2ef0e69c9c7d67bdf043545565f16eeba81fba32e36: Status 404 returned error can't find the container with id 515d86822cd0b20afce8b2ef0e69c9c7d67bdf043545565f16eeba81fba32e36
Jul 07 17:36:44.121584 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:44.121545    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0819ed1d_2fe9_4bf5_b986_96f59fb24a8b.slice/crio-6349832f84a386c42d65d4117dcfdfbbce6fcf0267a8d8c174efabd767bee3e9 WatchSource:0}: Error finding container 6349832f84a386c42d65d4117dcfdfbbce6fcf0267a8d8c174efabd767bee3e9: Status 404 returned error can't find the container with id 6349832f84a386c42d65d4117dcfdfbbce6fcf0267a8d8c174efabd767bee3e9
Jul 07 17:36:44.124981 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:44.124940    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbed0ab9e_a1dc_473d_9a55_157118bd4bab.slice/crio-a7c3e4f8b2cee4d42c72f1c6237d39d4a6fd27959acdc1a19608278242e48bc0 WatchSource:0}: Error finding container a7c3e4f8b2cee4d42c72f1c6237d39d4a6fd27959acdc1a19608278242e48bc0: Status 404 returned error can't find the container with id a7c3e4f8b2cee4d42c72f1c6237d39d4a6fd27959acdc1a19608278242e48bc0
Jul 07 17:36:44.125647 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:44.125629    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd1252ab_8a9b_4f7b_b121_7e144ad610f4.slice/crio-c879ad99442fec13f2f56e898cb6efda8f7ddd0b2681de4933bb9c40d88ae8b8 WatchSource:0}: Error finding container c879ad99442fec13f2f56e898cb6efda8f7ddd0b2681de4933bb9c40d88ae8b8: Status 404 returned error can't find the container with id c879ad99442fec13f2f56e898cb6efda8f7ddd0b2681de4933bb9c40d88ae8b8
Jul 07 17:36:44.126840 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:44.126812    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a0fe013_4d37_461e_a883_7889017895c0.slice/crio-41908f330e6c452e9724c1bc22446606c308708155445cdfca8c4e8394b01b3d WatchSource:0}: Error finding container 41908f330e6c452e9724c1bc22446606c308708155445cdfca8c4e8394b01b3d: Status 404 returned error can't find the container with id 41908f330e6c452e9724c1bc22446606c308708155445cdfca8c4e8394b01b3d
Jul 07 17:36:44.127649 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:44.127625    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f65a52c_e50e_4ddf_8d5d_025755e0fccc.slice/crio-d87bcf3f240a865c846a2b33d980d5eba196229262713e02aed920df2b5b1124 WatchSource:0}: Error finding container d87bcf3f240a865c846a2b33d980d5eba196229262713e02aed920df2b5b1124: Status 404 returned error can't find the container with id d87bcf3f240a865c846a2b33d980d5eba196229262713e02aed920df2b5b1124
Jul 07 17:36:44.130559 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:44.130533    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f7bf700_4743_4276_b4b1_9245cd337343.slice/crio-354524579ac74ffe6a65cfd76e166a90de1160d7cb7221625b83b3ea0a5993ad WatchSource:0}: Error finding container 354524579ac74ffe6a65cfd76e166a90de1160d7cb7221625b83b3ea0a5993ad: Status 404 returned error can't find the container with id 354524579ac74ffe6a65cfd76e166a90de1160d7cb7221625b83b3ea0a5993ad
Jul 07 17:36:44.131268 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:44.131231    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod503f5710_ce38_4a88_b125_043754ab1a51.slice/crio-30d1e9e705bdd4dc394ed3ef56c0bd0705285d8bacbb56aef6efa468f99fa660 WatchSource:0}: Error finding container 30d1e9e705bdd4dc394ed3ef56c0bd0705285d8bacbb56aef6efa468f99fa660: Status 404 returned error can't find the container with id 30d1e9e705bdd4dc394ed3ef56c0bd0705285d8bacbb56aef6efa468f99fa660
Jul 07 17:36:44.133092 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:36:44.132779    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fe8e6ad_d639_4924_807d_8893d085d71c.slice/crio-553fbd21634c6436b569f019ab129337159b7b267751458c92f6edacad9ea9eb WatchSource:0}: Error finding container 553fbd21634c6436b569f019ab129337159b7b267751458c92f6edacad9ea9eb: Status 404 returned error can't find the container with id 553fbd21634c6436b569f019ab129337159b7b267751458c92f6edacad9ea9eb
Jul 07 17:36:44.560267 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:44.559999    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8eb6fe4b-fba4-4c80-b328-93ff6b880816-original-pull-secret\") pod \"global-pull-secret-syncer-5r9p6\" (UID: \"8eb6fe4b-fba4-4c80-b328-93ff6b880816\") " pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:36:44.560422 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:44.560314    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14607182-3f75-4121-b763-1acf8e7e3c4c-metrics-certs\") pod \"network-metrics-daemon-ltf2l\" (UID: \"14607182-3f75-4121-b763-1acf8e7e3c4c\") " pod="openshift-multus/network-metrics-daemon-ltf2l"
Jul 07 17:36:44.560422 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:44.560204    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:36:44.560422 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:44.560410    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eb6fe4b-fba4-4c80-b328-93ff6b880816-original-pull-secret podName:8eb6fe4b-fba4-4c80-b328-93ff6b880816 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:46.560388798 +0000 UTC m=+6.075619126 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8eb6fe4b-fba4-4c80-b328-93ff6b880816-original-pull-secret") pod "global-pull-secret-syncer-5r9p6" (UID: "8eb6fe4b-fba4-4c80-b328-93ff6b880816") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:36:44.560523 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:44.560456    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:36:44.560523 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:44.560505    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14607182-3f75-4121-b763-1acf8e7e3c4c-metrics-certs podName:14607182-3f75-4121-b763-1acf8e7e3c4c nodeName:}" failed. No retries permitted until 2026-07-07 17:36:46.560489951 +0000 UTC m=+6.075720266 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14607182-3f75-4121-b763-1acf8e7e3c4c-metrics-certs") pod "network-metrics-daemon-ltf2l" (UID: "14607182-3f75-4121-b763-1acf8e7e3c4c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:36:44.661019 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:44.660913    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7v4n\" (UniqueName: \"kubernetes.io/projected/3c7b7842-ac7e-4d39-9f7d-02b994a8f075-kube-api-access-h7v4n\") pod \"network-check-target-vzqgz\" (UID: \"3c7b7842-ac7e-4d39-9f7d-02b994a8f075\") " pod="openshift-network-diagnostics/network-check-target-vzqgz"
Jul 07 17:36:44.661203 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:44.661188    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:36:44.661263 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:44.661211    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:36:44.661263 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:44.661224    2559 projected.go:196] Error preparing data for projected volume kube-api-access-h7v4n for pod openshift-network-diagnostics/network-check-target-vzqgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:36:44.661362 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:44.661276    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c7b7842-ac7e-4d39-9f7d-02b994a8f075-kube-api-access-h7v4n podName:3c7b7842-ac7e-4d39-9f7d-02b994a8f075 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:46.661259303 +0000 UTC m=+6.176489620 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-h7v4n" (UniqueName: "kubernetes.io/projected/3c7b7842-ac7e-4d39-9f7d-02b994a8f075-kube-api-access-h7v4n") pod "network-check-target-vzqgz" (UID: "3c7b7842-ac7e-4d39-9f7d-02b994a8f075") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:36:44.890362 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:44.890316    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 17:31:42 +0000 UTC" deadline="2028-03-12 02:38:20.342505141 +0000 UTC"
Jul 07 17:36:44.890362 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:44.890355    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14721h1m35.452155345s"
Jul 07 17:36:45.002161 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:45.002081    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzqgz"
Jul 07 17:36:45.002310 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:45.002220    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzqgz" podUID="3c7b7842-ac7e-4d39-9f7d-02b994a8f075"
Jul 07 17:36:45.002310 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:45.002237    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltf2l"
Jul 07 17:36:45.002415 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:45.002357    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltf2l" podUID="14607182-3f75-4121-b763-1acf8e7e3c4c"
Jul 07 17:36:45.002415 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:45.002093    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:36:45.002502 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:45.002462    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r9p6" podUID="8eb6fe4b-fba4-4c80-b328-93ff6b880816"
Jul 07 17:36:45.017290 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:45.017247    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-47mnk" event={"ID":"fd1252ab-8a9b-4f7b-b121-7e144ad610f4","Type":"ContainerStarted","Data":"c879ad99442fec13f2f56e898cb6efda8f7ddd0b2681de4933bb9c40d88ae8b8"}
Jul 07 17:36:45.019307 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:45.019226    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt7nm" event={"ID":"4c309e8e-07d4-416b-8c80-b49eea680c0f","Type":"ContainerStarted","Data":"515d86822cd0b20afce8b2ef0e69c9c7d67bdf043545565f16eeba81fba32e36"}
Jul 07 17:36:45.021514 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:45.021487    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rn66n" event={"ID":"0fe8e6ad-d639-4924-807d-8893d085d71c","Type":"ContainerStarted","Data":"553fbd21634c6436b569f019ab129337159b7b267751458c92f6edacad9ea9eb"}
Jul 07 17:36:45.028360 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:45.028276    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6svr4" event={"ID":"503f5710-ce38-4a88-b125-043754ab1a51","Type":"ContainerStarted","Data":"30d1e9e705bdd4dc394ed3ef56c0bd0705285d8bacbb56aef6efa468f99fa660"}
Jul 07 17:36:45.033426 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:45.033317    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hwbkw" event={"ID":"9a0fe013-4d37-461e-a883-7889017895c0","Type":"ContainerStarted","Data":"41908f330e6c452e9724c1bc22446606c308708155445cdfca8c4e8394b01b3d"}
Jul 07 17:36:45.060091 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:45.059852    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hd255" event={"ID":"0819ed1d-2fe9-4bf5-b986-96f59fb24a8b","Type":"ContainerStarted","Data":"6349832f84a386c42d65d4117dcfdfbbce6fcf0267a8d8c174efabd767bee3e9"}
Jul 07 17:36:45.073013 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:45.072463    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-78.ec2.internal" event={"ID":"d1173d55afe0841f3da9d7bed0dfe65d","Type":"ContainerStarted","Data":"832787abab6e05140a8ecf96aba7810afd08ffe8ac56d34d778ba26ddd6d0e26"}
Jul 07 17:36:45.087848 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:45.086812    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-78.ec2.internal" podStartSLOduration=3.086792477 podStartE2EDuration="3.086792477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:36:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:36:45.086444007 +0000 UTC m=+4.601674343" watchObservedRunningTime="2026-07-07 17:36:45.086792477 +0000 UTC m=+4.602022813"
Jul 07 17:36:45.111267 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:45.110299    2559 generic.go:356] "Generic (PLEG): container finished" podID="bf6dd33ab0df7b388b9c2881db96647c" containerID="040c59820b756c59c45a05a2d42d0dcaf0cb6c7d77fd9dc46ad7426f51bd8738" exitCode=0
Jul 07 17:36:45.111267 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:45.110417    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-78.ec2.internal" event={"ID":"bf6dd33ab0df7b388b9c2881db96647c","Type":"ContainerDied","Data":"040c59820b756c59c45a05a2d42d0dcaf0cb6c7d77fd9dc46ad7426f51bd8738"}
Jul 07 17:36:45.125878 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:45.125841    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4" event={"ID":"5f7bf700-4743-4276-b4b1-9245cd337343","Type":"ContainerStarted","Data":"354524579ac74ffe6a65cfd76e166a90de1160d7cb7221625b83b3ea0a5993ad"}
Jul 07 17:36:45.132635 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:45.132600    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5pchl" event={"ID":"9f65a52c-e50e-4ddf-8d5d-025755e0fccc","Type":"ContainerStarted","Data":"d87bcf3f240a865c846a2b33d980d5eba196229262713e02aed920df2b5b1124"}
Jul 07 17:36:45.142076 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:45.142030    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nzkhn" event={"ID":"bed0ab9e-a1dc-473d-9a55-157118bd4bab","Type":"ContainerStarted","Data":"a7c3e4f8b2cee4d42c72f1c6237d39d4a6fd27959acdc1a19608278242e48bc0"}
Jul 07 17:36:46.168491 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:46.168063    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-78.ec2.internal" event={"ID":"bf6dd33ab0df7b388b9c2881db96647c","Type":"ContainerStarted","Data":"d132ff376072cf93d7017e671b381caaa4097fbdf34a8ce3c0912e0f379e4e6b"}
Jul 07 17:36:46.586295 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:46.586211    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14607182-3f75-4121-b763-1acf8e7e3c4c-metrics-certs\") pod \"network-metrics-daemon-ltf2l\" (UID: \"14607182-3f75-4121-b763-1acf8e7e3c4c\") " pod="openshift-multus/network-metrics-daemon-ltf2l"
Jul 07 17:36:46.586455 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:46.586306    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8eb6fe4b-fba4-4c80-b328-93ff6b880816-original-pull-secret\") pod \"global-pull-secret-syncer-5r9p6\" (UID: \"8eb6fe4b-fba4-4c80-b328-93ff6b880816\") " pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:36:46.586455 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:46.586432    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:36:46.586561 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:46.586494    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eb6fe4b-fba4-4c80-b328-93ff6b880816-original-pull-secret podName:8eb6fe4b-fba4-4c80-b328-93ff6b880816 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:50.586476514 +0000 UTC m=+10.101706831 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8eb6fe4b-fba4-4c80-b328-93ff6b880816-original-pull-secret") pod "global-pull-secret-syncer-5r9p6" (UID: "8eb6fe4b-fba4-4c80-b328-93ff6b880816") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:36:46.586887 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:46.586867    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:36:46.586999 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:46.586921    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14607182-3f75-4121-b763-1acf8e7e3c4c-metrics-certs podName:14607182-3f75-4121-b763-1acf8e7e3c4c nodeName:}" failed. No retries permitted until 2026-07-07 17:36:50.58690618 +0000 UTC m=+10.102136493 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14607182-3f75-4121-b763-1acf8e7e3c4c-metrics-certs") pod "network-metrics-daemon-ltf2l" (UID: "14607182-3f75-4121-b763-1acf8e7e3c4c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:36:46.686980 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:46.686931    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7v4n\" (UniqueName: \"kubernetes.io/projected/3c7b7842-ac7e-4d39-9f7d-02b994a8f075-kube-api-access-h7v4n\") pod \"network-check-target-vzqgz\" (UID: \"3c7b7842-ac7e-4d39-9f7d-02b994a8f075\") " pod="openshift-network-diagnostics/network-check-target-vzqgz"
Jul 07 17:36:46.687164 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:46.687135    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:36:46.687164 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:46.687157    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:36:46.687267 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:46.687169    2559 projected.go:196] Error preparing data for projected volume kube-api-access-h7v4n for pod openshift-network-diagnostics/network-check-target-vzqgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:36:46.687267 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:46.687230    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c7b7842-ac7e-4d39-9f7d-02b994a8f075-kube-api-access-h7v4n podName:3c7b7842-ac7e-4d39-9f7d-02b994a8f075 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:50.687211072 +0000 UTC m=+10.202441402 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-h7v4n" (UniqueName: "kubernetes.io/projected/3c7b7842-ac7e-4d39-9f7d-02b994a8f075-kube-api-access-h7v4n") pod "network-check-target-vzqgz" (UID: "3c7b7842-ac7e-4d39-9f7d-02b994a8f075") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:36:47.002530 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:47.002501    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzqgz"
Jul 07 17:36:47.002699 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:47.002598    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzqgz" podUID="3c7b7842-ac7e-4d39-9f7d-02b994a8f075"
Jul 07 17:36:47.002910 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:47.002892    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltf2l"
Jul 07 17:36:47.003249 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:47.002993    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltf2l" podUID="14607182-3f75-4121-b763-1acf8e7e3c4c"
Jul 07 17:36:47.003249 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:47.003058    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:36:47.003249 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:47.003134    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r9p6" podUID="8eb6fe4b-fba4-4c80-b328-93ff6b880816"
Jul 07 17:36:49.002016 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:49.001929    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzqgz"
Jul 07 17:36:49.002393 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:49.002093    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzqgz" podUID="3c7b7842-ac7e-4d39-9f7d-02b994a8f075"
Jul 07 17:36:49.002538 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:49.002512    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltf2l"
Jul 07 17:36:49.002671 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:49.002647    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltf2l" podUID="14607182-3f75-4121-b763-1acf8e7e3c4c"
Jul 07 17:36:49.002746 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:49.002709    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:36:49.007500 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:49.003185    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r9p6" podUID="8eb6fe4b-fba4-4c80-b328-93ff6b880816"
Jul 07 17:36:50.623114 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:50.623073    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14607182-3f75-4121-b763-1acf8e7e3c4c-metrics-certs\") pod \"network-metrics-daemon-ltf2l\" (UID: \"14607182-3f75-4121-b763-1acf8e7e3c4c\") " pod="openshift-multus/network-metrics-daemon-ltf2l"
Jul 07 17:36:50.623608 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:50.623172    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8eb6fe4b-fba4-4c80-b328-93ff6b880816-original-pull-secret\") pod \"global-pull-secret-syncer-5r9p6\" (UID: \"8eb6fe4b-fba4-4c80-b328-93ff6b880816\") " pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:36:50.623608 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:50.623252    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:36:50.623608 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:50.623324    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:36:50.623608 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:50.623328    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14607182-3f75-4121-b763-1acf8e7e3c4c-metrics-certs podName:14607182-3f75-4121-b763-1acf8e7e3c4c nodeName:}" failed. No retries permitted until 2026-07-07 17:36:58.623310335 +0000 UTC m=+18.138540652 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14607182-3f75-4121-b763-1acf8e7e3c4c-metrics-certs") pod "network-metrics-daemon-ltf2l" (UID: "14607182-3f75-4121-b763-1acf8e7e3c4c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:36:50.623608 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:50.623403    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eb6fe4b-fba4-4c80-b328-93ff6b880816-original-pull-secret podName:8eb6fe4b-fba4-4c80-b328-93ff6b880816 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:58.623385276 +0000 UTC m=+18.138615593 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8eb6fe4b-fba4-4c80-b328-93ff6b880816-original-pull-secret") pod "global-pull-secret-syncer-5r9p6" (UID: "8eb6fe4b-fba4-4c80-b328-93ff6b880816") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:36:50.724155 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:50.724115    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7v4n\" (UniqueName: \"kubernetes.io/projected/3c7b7842-ac7e-4d39-9f7d-02b994a8f075-kube-api-access-h7v4n\") pod \"network-check-target-vzqgz\" (UID: \"3c7b7842-ac7e-4d39-9f7d-02b994a8f075\") " pod="openshift-network-diagnostics/network-check-target-vzqgz"
Jul 07 17:36:50.724324 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:50.724249    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:36:50.724324 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:50.724264    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:36:50.724324 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:50.724272    2559 projected.go:196] Error preparing data for projected volume kube-api-access-h7v4n for pod openshift-network-diagnostics/network-check-target-vzqgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:36:50.724470 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:50.724329    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c7b7842-ac7e-4d39-9f7d-02b994a8f075-kube-api-access-h7v4n podName:3c7b7842-ac7e-4d39-9f7d-02b994a8f075 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:58.724312447 +0000 UTC m=+18.239542761 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-h7v4n" (UniqueName: "kubernetes.io/projected/3c7b7842-ac7e-4d39-9f7d-02b994a8f075-kube-api-access-h7v4n") pod "network-check-target-vzqgz" (UID: "3c7b7842-ac7e-4d39-9f7d-02b994a8f075") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:36:51.002449 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:51.002365    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzqgz"
Jul 07 17:36:51.002610 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:51.002476    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzqgz" podUID="3c7b7842-ac7e-4d39-9f7d-02b994a8f075"
Jul 07 17:36:51.002610 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:51.002505    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltf2l"
Jul 07 17:36:51.002610 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:51.002575    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:36:51.002753 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:51.002677    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r9p6" podUID="8eb6fe4b-fba4-4c80-b328-93ff6b880816"
Jul 07 17:36:51.002811 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:51.002775    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltf2l" podUID="14607182-3f75-4121-b763-1acf8e7e3c4c"
Jul 07 17:36:53.001047 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:53.000896    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzqgz"
Jul 07 17:36:53.001388 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:53.001212    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzqgz" podUID="3c7b7842-ac7e-4d39-9f7d-02b994a8f075"
Jul 07 17:36:53.001388 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:53.000995    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:36:53.001388 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:53.001329    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r9p6" podUID="8eb6fe4b-fba4-4c80-b328-93ff6b880816"
Jul 07 17:36:53.001388 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:53.000943    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltf2l"
Jul 07 17:36:53.001523 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:53.001444    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltf2l" podUID="14607182-3f75-4121-b763-1acf8e7e3c4c"
Jul 07 17:36:55.001312 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:55.001227    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzqgz"
Jul 07 17:36:55.001753 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:55.001228    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltf2l"
Jul 07 17:36:55.001753 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:55.001351    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzqgz" podUID="3c7b7842-ac7e-4d39-9f7d-02b994a8f075"
Jul 07 17:36:55.001753 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:55.001465    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltf2l" podUID="14607182-3f75-4121-b763-1acf8e7e3c4c"
Jul 07 17:36:55.001753 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:55.001238    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:36:55.001753 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:55.001578    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r9p6" podUID="8eb6fe4b-fba4-4c80-b328-93ff6b880816"
Jul 07 17:36:57.003331 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:57.003293    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltf2l"
Jul 07 17:36:57.003702 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:57.003434    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltf2l" podUID="14607182-3f75-4121-b763-1acf8e7e3c4c"
Jul 07 17:36:57.003702 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:57.003688    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzqgz"
Jul 07 17:36:57.003771 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:57.003711    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:36:57.003802 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:57.003783    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzqgz" podUID="3c7b7842-ac7e-4d39-9f7d-02b994a8f075"
Jul 07 17:36:57.003881 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:57.003855    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r9p6" podUID="8eb6fe4b-fba4-4c80-b328-93ff6b880816"
Jul 07 17:36:58.686107 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:58.686067    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8eb6fe4b-fba4-4c80-b328-93ff6b880816-original-pull-secret\") pod \"global-pull-secret-syncer-5r9p6\" (UID: \"8eb6fe4b-fba4-4c80-b328-93ff6b880816\") " pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:36:58.686525 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:58.686126    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14607182-3f75-4121-b763-1acf8e7e3c4c-metrics-certs\") pod \"network-metrics-daemon-ltf2l\" (UID: \"14607182-3f75-4121-b763-1acf8e7e3c4c\") " pod="openshift-multus/network-metrics-daemon-ltf2l"
Jul 07 17:36:58.686525 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:58.686240    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:36:58.686525 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:58.686242    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:36:58.686525 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:58.686299    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14607182-3f75-4121-b763-1acf8e7e3c4c-metrics-certs podName:14607182-3f75-4121-b763-1acf8e7e3c4c nodeName:}" failed. No retries permitted until 2026-07-07 17:37:14.686281623 +0000 UTC m=+34.201511937 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14607182-3f75-4121-b763-1acf8e7e3c4c-metrics-certs") pod "network-metrics-daemon-ltf2l" (UID: "14607182-3f75-4121-b763-1acf8e7e3c4c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:36:58.686525 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:58.686317    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eb6fe4b-fba4-4c80-b328-93ff6b880816-original-pull-secret podName:8eb6fe4b-fba4-4c80-b328-93ff6b880816 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:14.686308872 +0000 UTC m=+34.201539188 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8eb6fe4b-fba4-4c80-b328-93ff6b880816-original-pull-secret") pod "global-pull-secret-syncer-5r9p6" (UID: "8eb6fe4b-fba4-4c80-b328-93ff6b880816") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:36:58.787123 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:58.787088    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7v4n\" (UniqueName: \"kubernetes.io/projected/3c7b7842-ac7e-4d39-9f7d-02b994a8f075-kube-api-access-h7v4n\") pod \"network-check-target-vzqgz\" (UID: \"3c7b7842-ac7e-4d39-9f7d-02b994a8f075\") " pod="openshift-network-diagnostics/network-check-target-vzqgz"
Jul 07 17:36:58.787330 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:58.787308    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:36:58.787401 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:58.787338    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:36:58.787401 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:58.787352    2559 projected.go:196] Error preparing data for projected volume kube-api-access-h7v4n for pod openshift-network-diagnostics/network-check-target-vzqgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:36:58.787497 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:58.787433    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c7b7842-ac7e-4d39-9f7d-02b994a8f075-kube-api-access-h7v4n podName:3c7b7842-ac7e-4d39-9f7d-02b994a8f075 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:14.787395026 +0000 UTC m=+34.302625366 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-h7v4n" (UniqueName: "kubernetes.io/projected/3c7b7842-ac7e-4d39-9f7d-02b994a8f075-kube-api-access-h7v4n") pod "network-check-target-vzqgz" (UID: "3c7b7842-ac7e-4d39-9f7d-02b994a8f075") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:36:59.001062 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:59.001038    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltf2l"
Jul 07 17:36:59.001169 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:59.001149    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltf2l" podUID="14607182-3f75-4121-b763-1acf8e7e3c4c"
Jul 07 17:36:59.001225 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:59.001038    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzqgz"
Jul 07 17:36:59.001282 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:59.001261    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzqgz" podUID="3c7b7842-ac7e-4d39-9f7d-02b994a8f075"
Jul 07 17:36:59.001323 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:36:59.001174    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:36:59.001354 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:36:59.001334    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r9p6" podUID="8eb6fe4b-fba4-4c80-b328-93ff6b880816"
Jul 07 17:37:01.002081 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:01.002042    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltf2l"
Jul 07 17:37:01.002081 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:01.002064    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzqgz"
Jul 07 17:37:01.002617 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:01.002162    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltf2l" podUID="14607182-3f75-4121-b763-1acf8e7e3c4c"
Jul 07 17:37:01.002617 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:01.002263    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzqgz" podUID="3c7b7842-ac7e-4d39-9f7d-02b994a8f075"
Jul 07 17:37:01.002617 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:01.002316    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:37:01.002617 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:01.002393    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r9p6" podUID="8eb6fe4b-fba4-4c80-b328-93ff6b880816"
Jul 07 17:37:03.000810 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:03.000777    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzqgz"
Jul 07 17:37:03.001190 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:03.000779    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:37:03.001190 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:03.000879    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzqgz" podUID="3c7b7842-ac7e-4d39-9f7d-02b994a8f075"
Jul 07 17:37:03.001190 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:03.000787    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltf2l"
Jul 07 17:37:03.001190 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:03.000988    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r9p6" podUID="8eb6fe4b-fba4-4c80-b328-93ff6b880816"
Jul 07 17:37:03.001190 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:03.001060    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltf2l" podUID="14607182-3f75-4121-b763-1acf8e7e3c4c"
Jul 07 17:37:03.207595 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:03.207382    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-47mnk" event={"ID":"fd1252ab-8a9b-4f7b-b121-7e144ad610f4","Type":"ContainerStarted","Data":"b30402c30b3e81fda1d499661c275da253b001ecb662957deade6e31098fecbe"}
Jul 07 17:37:04.212526 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:04.212347    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8s7h4_5f7bf700-4743-4276-b4b1-9245cd337343/ovn-acl-logging/0.log"
Jul 07 17:37:04.213175 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:04.212829    2559 generic.go:356] "Generic (PLEG): container finished" podID="5f7bf700-4743-4276-b4b1-9245cd337343" containerID="e88b1781541e90d853793787b86fe3930e42e4e5712981a6f9c71334c6f5c2ea" exitCode=1
Jul 07 17:37:04.213175 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:04.212900    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4" event={"ID":"5f7bf700-4743-4276-b4b1-9245cd337343","Type":"ContainerStarted","Data":"f0fa83950f468cd4d32a12b44b037e298241e322a70cf29124b3dc50ccf285a6"}
Jul 07 17:37:04.213175 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:04.213043    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4" event={"ID":"5f7bf700-4743-4276-b4b1-9245cd337343","Type":"ContainerStarted","Data":"1bd1c34bfbc6d0a7cf2902f3716902d6c1d3a0ce1a70a0124b934dc3fafb866e"}
Jul 07 17:37:04.213175 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:04.213099    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4" event={"ID":"5f7bf700-4743-4276-b4b1-9245cd337343","Type":"ContainerStarted","Data":"9eb5df7be1669b02de8c59d09162a40056fc4387c6046f9e45c16d728ebfade4"}
Jul 07 17:37:04.213175 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:04.213131    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4" event={"ID":"5f7bf700-4743-4276-b4b1-9245cd337343","Type":"ContainerStarted","Data":"d5906ccf0e9e432842ded62ef04b7f8a9b30b0ea21f1f9250d216236414ad321"}
Jul 07 17:37:04.213175 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:04.213174    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4" event={"ID":"5f7bf700-4743-4276-b4b1-9245cd337343","Type":"ContainerDied","Data":"e88b1781541e90d853793787b86fe3930e42e4e5712981a6f9c71334c6f5c2ea"}
Jul 07 17:37:04.213383 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:04.213204    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4" event={"ID":"5f7bf700-4743-4276-b4b1-9245cd337343","Type":"ContainerStarted","Data":"967f0f9cf8ebb14cf605c690f4a373023317412d517d6f20670986c7b00f53e7"}
Jul 07 17:37:04.214375 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:04.214355    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5pchl" event={"ID":"9f65a52c-e50e-4ddf-8d5d-025755e0fccc","Type":"ContainerStarted","Data":"b07c4c9ad52b0c27ac3bcb9688d55293983a49877b250030aa87092b0d3eee6c"}
Jul 07 17:37:04.215710 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:04.215686    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt7nm" event={"ID":"4c309e8e-07d4-416b-8c80-b49eea680c0f","Type":"ContainerStarted","Data":"66d6dae50e80b71a68fbb73987a351da79b78ad502d328d168164223408e89a1"}
Jul 07 17:37:04.218394 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:04.218372    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rn66n" event={"ID":"0fe8e6ad-d639-4924-807d-8893d085d71c","Type":"ContainerStarted","Data":"72c0ca0898cb3e55087342e38dfa60258b52c01faa1b83b84295f7405c2a3122"}
Jul 07 17:37:04.219750 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:04.219731    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6svr4" event={"ID":"503f5710-ce38-4a88-b125-043754ab1a51","Type":"ContainerStarted","Data":"2868f84fe25dba4598ab1374830d4b073f31fd91e37216f2db638c5efd0369cc"}
Jul 07 17:37:04.220945 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:04.220927    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hwbkw" event={"ID":"9a0fe013-4d37-461e-a883-7889017895c0","Type":"ContainerStarted","Data":"ad7585c7c8ce33f63e602d2a7237fa2cef424fc27552b137b3e87e1aecaa11c1"}
Jul 07 17:37:04.222182 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:04.222162    2559 generic.go:356] "Generic (PLEG): container finished" podID="0819ed1d-2fe9-4bf5-b986-96f59fb24a8b" containerID="d045a146cae4542d923585ab65f772f6542767afe63297d1fb7928ce809caa34" exitCode=0
Jul 07 17:37:04.222265 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:04.222245    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hd255" event={"ID":"0819ed1d-2fe9-4bf5-b986-96f59fb24a8b","Type":"ContainerDied","Data":"d045a146cae4542d923585ab65f772f6542767afe63297d1fb7928ce809caa34"}
Jul 07 17:37:04.231015 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:04.230976    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5pchl" podStartSLOduration=4.290783523 podStartE2EDuration="23.23094729s" totalImagesPullingTime="18.940163767s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:04.230793853 +0000 UTC m=+23.746024191" watchObservedRunningTime="2026-07-07 17:37:04.23094729 +0000 UTC m=+23.746177625"
Jul 07 17:37:04.231346 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:04.231321    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-78.ec2.internal" podStartSLOduration=22.231314633 podStartE2EDuration="22.231314633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:36:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:36:46.182658488 +0000 UTC m=+5.697888824" watchObservedRunningTime="2026-07-07 17:37:04.231314633 +0000 UTC m=+23.746544967"
Jul 07 17:37:04.243936 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:04.243885    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-47mnk" podStartSLOduration=8.339505491 podStartE2EDuration="23.243870568s" totalImagesPullingTime="14.904365077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:04.243864075 +0000 UTC m=+23.759094410" watchObservedRunningTime="2026-07-07 17:37:04.243870568 +0000 UTC m=+23.759100904"
Jul 07 17:37:04.257416 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:04.257368    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hwbkw" podStartSLOduration=4.315025836 podStartE2EDuration="23.25735393s" totalImagesPullingTime="18.942328094s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:04.257147531 +0000 UTC m=+23.772377866" watchObservedRunningTime="2026-07-07 17:37:04.25735393 +0000 UTC m=+23.772584265"
Jul 07 17:37:04.270011 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:04.269949    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rn66n" podStartSLOduration=4.369786112 podStartE2EDuration="23.269935813s" totalImagesPullingTime="18.900149701s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:04.269747502 +0000 UTC m=+23.784977837" watchObservedRunningTime="2026-07-07 17:37:04.269935813 +0000 UTC m=+23.785166149"
Jul 07 17:37:04.285669 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:04.285613    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6svr4" podStartSLOduration=4.290963169 podStartE2EDuration="23.285599192s" totalImagesPullingTime="18.994636023s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:04.285565099 +0000 UTC m=+23.800795434" watchObservedRunningTime="2026-07-07 17:37:04.285599192 +0000 UTC m=+23.800829527"
Jul 07 17:37:04.655891 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:04.655866    2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 17:37:04.905538 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:04.905437    2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T17:37:04.655886844Z","UUID":"c9eb9a32-3ab8-48a2-86fe-34207134bff5","Handler":null,"Name":"","Endpoint":""}
Jul 07 17:37:04.908074 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:04.908048    2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 17:37:04.908219 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:04.908096    2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 17:37:05.001202 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:05.001167    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltf2l"
Jul 07 17:37:05.001381 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:05.001180    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:37:05.001381 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:05.001309    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltf2l" podUID="14607182-3f75-4121-b763-1acf8e7e3c4c"
Jul 07 17:37:05.001381 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:05.001180    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzqgz"
Jul 07 17:37:05.001539 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:05.001376    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r9p6" podUID="8eb6fe4b-fba4-4c80-b328-93ff6b880816"
Jul 07 17:37:05.001539 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:05.001449    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzqgz" podUID="3c7b7842-ac7e-4d39-9f7d-02b994a8f075"
Jul 07 17:37:05.227080 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:05.226984    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nzkhn" event={"ID":"bed0ab9e-a1dc-473d-9a55-157118bd4bab","Type":"ContainerStarted","Data":"670f19069a76a5ab99b33defb0d6131a6f8a3b4331ad841c427227e9bfe58070"}
Jul 07 17:37:05.235619 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:05.235585    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt7nm" event={"ID":"4c309e8e-07d4-416b-8c80-b49eea680c0f","Type":"ContainerStarted","Data":"6a4d2ba1bd4ee652cc7178c9fa54a931d2db17d0b91ab3bbbf9fa585bf6af776"}
Jul 07 17:37:05.244777 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:05.244731    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nzkhn" podStartSLOduration=6.33659865 podStartE2EDuration="25.244716896s" totalImagesPullingTime="18.908118246s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:36:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:05.244399918 +0000 UTC m=+24.759630257" watchObservedRunningTime="2026-07-07 17:37:05.244716896 +0000 UTC m=+24.759947232"
Jul 07 17:37:06.242261 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:06.242069    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8s7h4_5f7bf700-4743-4276-b4b1-9245cd337343/ovn-acl-logging/0.log"
Jul 07 17:37:06.242739 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:06.242708    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4" event={"ID":"5f7bf700-4743-4276-b4b1-9245cd337343","Type":"ContainerStarted","Data":"bb28d8335dca7ca8e1e6e979dbab520dfbcd3aad7434d4174a28278f521b1833"}
Jul 07 17:37:06.245061 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:06.244994    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt7nm" event={"ID":"4c309e8e-07d4-416b-8c80-b49eea680c0f","Type":"ContainerStarted","Data":"0ace357fd92345410d6b8b268c00a3a8cf3835c5cf519d6d62cc2bd782fc2dc1"}
Jul 07 17:37:06.263909 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:06.263857    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vt7nm" podStartSLOduration=4.108281443 podStartE2EDuration="25.263841269s" totalImagesPullingTime="21.155559826s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:36:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:06.263554268 +0000 UTC m=+25.778784606" watchObservedRunningTime="2026-07-07 17:37:06.263841269 +0000 UTC m=+25.779071605"
Jul 07 17:37:07.001259 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:07.001193    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzqgz"
Jul 07 17:37:07.001444 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:07.001267    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:37:07.001444 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:07.001198    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltf2l"
Jul 07 17:37:07.001444 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:07.001347    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzqgz" podUID="3c7b7842-ac7e-4d39-9f7d-02b994a8f075"
Jul 07 17:37:07.001444 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:07.001408    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltf2l" podUID="14607182-3f75-4121-b763-1acf8e7e3c4c"
Jul 07 17:37:07.001653 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:07.001485    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r9p6" podUID="8eb6fe4b-fba4-4c80-b328-93ff6b880816"
Jul 07 17:37:07.157455 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:07.157414    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-47mnk"
Jul 07 17:37:07.158225 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:07.158199    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-47mnk"
Jul 07 17:37:09.001670 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:09.001417    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzqgz"
Jul 07 17:37:09.002281 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:09.001422    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltf2l"
Jul 07 17:37:09.002281 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:09.001780    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzqgz" podUID="3c7b7842-ac7e-4d39-9f7d-02b994a8f075"
Jul 07 17:37:09.002281 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:09.001453    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:37:09.002281 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:09.001852    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltf2l" podUID="14607182-3f75-4121-b763-1acf8e7e3c4c"
Jul 07 17:37:09.002281 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:09.001931    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r9p6" podUID="8eb6fe4b-fba4-4c80-b328-93ff6b880816"
Jul 07 17:37:09.254621 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:09.254539    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8s7h4_5f7bf700-4743-4276-b4b1-9245cd337343/ovn-acl-logging/0.log"
Jul 07 17:37:09.255002 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:09.254974    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4" event={"ID":"5f7bf700-4743-4276-b4b1-9245cd337343","Type":"ContainerStarted","Data":"11f114fabf3e4c2459e476ea0d7c4f994471641d627d50d4f921a485ea6daeed"}
Jul 07 17:37:09.255257 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:09.255236    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:37:09.255338 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:09.255307    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:37:09.255465 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:09.255443    2559 scope.go:117] "RemoveContainer" containerID="e88b1781541e90d853793787b86fe3930e42e4e5712981a6f9c71334c6f5c2ea"
Jul 07 17:37:09.257316 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:09.257289    2559 generic.go:356] "Generic (PLEG): container finished" podID="0819ed1d-2fe9-4bf5-b986-96f59fb24a8b" containerID="c282809f714b52d9c7f8ac22204f92f485e155640e135aa70dda001e5ec0ebde" exitCode=0
Jul 07 17:37:09.257468 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:09.257328    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hd255" event={"ID":"0819ed1d-2fe9-4bf5-b986-96f59fb24a8b","Type":"ContainerDied","Data":"c282809f714b52d9c7f8ac22204f92f485e155640e135aa70dda001e5ec0ebde"}
Jul 07 17:37:09.272168 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:09.272139    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:37:09.272298 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:09.272287    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:37:10.263056 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:10.263032    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8s7h4_5f7bf700-4743-4276-b4b1-9245cd337343/ovn-acl-logging/0.log"
Jul 07 17:37:10.263427 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:10.263405    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4" event={"ID":"5f7bf700-4743-4276-b4b1-9245cd337343","Type":"ContainerStarted","Data":"9ad81f329e58a3e96e3d1a33752dbe3e77c7e1eb8678ebdd169babc6cd78b596"}
Jul 07 17:37:10.263570 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:10.263560    2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 17:37:10.295004 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:10.294926    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4" podStartSLOduration=10.307112618 podStartE2EDuration="29.294905358s" totalImagesPullingTime="18.98779274s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:10.293461527 +0000 UTC m=+29.808691877" watchObservedRunningTime="2026-07-07 17:37:10.294905358 +0000 UTC m=+29.810135695"
Jul 07 17:37:10.364302 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:10.364278    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:37:10.641901 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:10.641869    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5r9p6"]
Jul 07 17:37:10.642067 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:10.642009    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:37:10.642132 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:10.642104    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r9p6" podUID="8eb6fe4b-fba4-4c80-b328-93ff6b880816"
Jul 07 17:37:10.644882 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:10.644848    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vzqgz"]
Jul 07 17:37:10.645019 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:10.644980    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzqgz"
Jul 07 17:37:10.645113 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:10.645096    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzqgz" podUID="3c7b7842-ac7e-4d39-9f7d-02b994a8f075"
Jul 07 17:37:10.645680 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:10.645659    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ltf2l"]
Jul 07 17:37:10.645777 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:10.645765    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltf2l"
Jul 07 17:37:10.645871 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:10.645853    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltf2l" podUID="14607182-3f75-4121-b763-1acf8e7e3c4c"
Jul 07 17:37:11.268067 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:11.268036    2559 generic.go:356] "Generic (PLEG): container finished" podID="0819ed1d-2fe9-4bf5-b986-96f59fb24a8b" containerID="5e9a20efb578ce8a2cab064ff49df560aad83ce2aa15edd3cd191f58a4549bfc" exitCode=0
Jul 07 17:37:11.268470 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:11.268084    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hd255" event={"ID":"0819ed1d-2fe9-4bf5-b986-96f59fb24a8b","Type":"ContainerDied","Data":"5e9a20efb578ce8a2cab064ff49df560aad83ce2aa15edd3cd191f58a4549bfc"}
Jul 07 17:37:11.807559 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:11.807523    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-47mnk"
Jul 07 17:37:11.807813 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:11.807687    2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 17:37:11.808283 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:11.808263    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-47mnk"
Jul 07 17:37:12.001577 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:12.001535    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:37:12.001837 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:12.001649    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzqgz"
Jul 07 17:37:12.001837 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:12.001664    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r9p6" podUID="8eb6fe4b-fba4-4c80-b328-93ff6b880816"
Jul 07 17:37:12.001837 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:12.001684    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltf2l"
Jul 07 17:37:12.001837 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:12.001760    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzqgz" podUID="3c7b7842-ac7e-4d39-9f7d-02b994a8f075"
Jul 07 17:37:12.001837 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:12.001837    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltf2l" podUID="14607182-3f75-4121-b763-1acf8e7e3c4c"
Jul 07 17:37:12.272870 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:12.272837    2559 generic.go:356] "Generic (PLEG): container finished" podID="0819ed1d-2fe9-4bf5-b986-96f59fb24a8b" containerID="21cee21b0eb2e33b2fd075724f68b9ced76782124ff1e1bc03f69115b8ec9001" exitCode=0
Jul 07 17:37:12.273465 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:12.272916    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hd255" event={"ID":"0819ed1d-2fe9-4bf5-b986-96f59fb24a8b","Type":"ContainerDied","Data":"21cee21b0eb2e33b2fd075724f68b9ced76782124ff1e1bc03f69115b8ec9001"}
Jul 07 17:37:14.001449 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:14.001419    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltf2l"
Jul 07 17:37:14.002234 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:14.001451    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzqgz"
Jul 07 17:37:14.002234 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:14.001419    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:37:14.002234 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:14.001558    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ltf2l" podUID="14607182-3f75-4121-b763-1acf8e7e3c4c"
Jul 07 17:37:14.002234 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:14.001712    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5r9p6" podUID="8eb6fe4b-fba4-4c80-b328-93ff6b880816"
Jul 07 17:37:14.002234 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:14.001818    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vzqgz" podUID="3c7b7842-ac7e-4d39-9f7d-02b994a8f075"
Jul 07 17:37:14.706158 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:14.706080    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8eb6fe4b-fba4-4c80-b328-93ff6b880816-original-pull-secret\") pod \"global-pull-secret-syncer-5r9p6\" (UID: \"8eb6fe4b-fba4-4c80-b328-93ff6b880816\") " pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:37:14.706158 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:14.706129    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14607182-3f75-4121-b763-1acf8e7e3c4c-metrics-certs\") pod \"network-metrics-daemon-ltf2l\" (UID: \"14607182-3f75-4121-b763-1acf8e7e3c4c\") " pod="openshift-multus/network-metrics-daemon-ltf2l"
Jul 07 17:37:14.706337 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:14.706229    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:37:14.706337 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:14.706255    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:37:14.706337 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:14.706300    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14607182-3f75-4121-b763-1acf8e7e3c4c-metrics-certs podName:14607182-3f75-4121-b763-1acf8e7e3c4c nodeName:}" failed. No retries permitted until 2026-07-07 17:37:46.706283306 +0000 UTC m=+66.221513619 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14607182-3f75-4121-b763-1acf8e7e3c4c-metrics-certs") pod "network-metrics-daemon-ltf2l" (UID: "14607182-3f75-4121-b763-1acf8e7e3c4c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:37:14.706337 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:14.706316    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eb6fe4b-fba4-4c80-b328-93ff6b880816-original-pull-secret podName:8eb6fe4b-fba4-4c80-b328-93ff6b880816 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:46.706308452 +0000 UTC m=+66.221538765 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8eb6fe4b-fba4-4c80-b328-93ff6b880816-original-pull-secret") pod "global-pull-secret-syncer-5r9p6" (UID: "8eb6fe4b-fba4-4c80-b328-93ff6b880816") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:37:14.807471 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:14.807435    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7v4n\" (UniqueName: \"kubernetes.io/projected/3c7b7842-ac7e-4d39-9f7d-02b994a8f075-kube-api-access-h7v4n\") pod \"network-check-target-vzqgz\" (UID: \"3c7b7842-ac7e-4d39-9f7d-02b994a8f075\") " pod="openshift-network-diagnostics/network-check-target-vzqgz"
Jul 07 17:37:14.807647 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:14.807583    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:37:14.807647 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:14.807601    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:37:14.807647 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:14.807613    2559 projected.go:196] Error preparing data for projected volume kube-api-access-h7v4n for pod openshift-network-diagnostics/network-check-target-vzqgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:37:14.807784 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:14.807671    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c7b7842-ac7e-4d39-9f7d-02b994a8f075-kube-api-access-h7v4n podName:3c7b7842-ac7e-4d39-9f7d-02b994a8f075 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:46.807656689 +0000 UTC m=+66.322887003 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-h7v4n" (UniqueName: "kubernetes.io/projected/3c7b7842-ac7e-4d39-9f7d-02b994a8f075-kube-api-access-h7v4n") pod "network-check-target-vzqgz" (UID: "3c7b7842-ac7e-4d39-9f7d-02b994a8f075") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:37:15.825284 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:15.825252    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-78.ec2.internal" event="NodeReady"
Jul 07 17:37:15.825850 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:15.825435    2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 17:37:15.867088 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:15.867055    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8mj9d"]
Jul 07 17:37:15.899427 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:15.899385    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pbgbb"]
Jul 07 17:37:15.899608 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:15.899515    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8mj9d"
Jul 07 17:37:15.901668 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:15.901642    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 17:37:15.902057 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:15.902038    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 17:37:15.902176 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:15.902083    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2vm2m\""
Jul 07 17:37:15.917059 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:15.917028    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8mj9d"]
Jul 07 17:37:15.917191 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:15.917070    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pbgbb"
Jul 07 17:37:15.917191 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:15.917100    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pbgbb"]
Jul 07 17:37:15.919493 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:15.919468    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 17:37:15.919663 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:15.919593    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-trtbr\""
Jul 07 17:37:15.919663 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:15.919623    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 17:37:15.919910 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:15.919893    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 17:37:16.001257 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:16.001164    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzqgz"
Jul 07 17:37:16.001257 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:16.001226    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltf2l"
Jul 07 17:37:16.001471 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:16.001336    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:37:16.003819 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:16.003793    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 17:37:16.003981 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:16.003847    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pkhdg\""
Jul 07 17:37:16.003981 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:16.003849    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 17:37:16.003981 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:16.003855    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f7nks\""
Jul 07 17:37:16.003981 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:16.003931    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 17:37:16.004246 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:16.004221    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 17:37:16.015467 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:16.015443    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/704699f9-7e17-4a8b-a4df-7259aed03300-config-volume\") pod \"dns-default-8mj9d\" (UID: \"704699f9-7e17-4a8b-a4df-7259aed03300\") " pod="openshift-dns/dns-default-8mj9d"
Jul 07 17:37:16.015612 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:16.015495    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/704699f9-7e17-4a8b-a4df-7259aed03300-metrics-tls\") pod \"dns-default-8mj9d\" (UID: \"704699f9-7e17-4a8b-a4df-7259aed03300\") " pod="openshift-dns/dns-default-8mj9d"
Jul 07 17:37:16.015612 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:16.015549    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22gh7\" (UniqueName: \"kubernetes.io/projected/704699f9-7e17-4a8b-a4df-7259aed03300-kube-api-access-22gh7\") pod \"dns-default-8mj9d\" (UID: \"704699f9-7e17-4a8b-a4df-7259aed03300\") " pod="openshift-dns/dns-default-8mj9d"
Jul 07 17:37:16.015612 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:16.015583    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26673412-89bb-4709-99d3-938900fbb332-cert\") pod \"ingress-canary-pbgbb\" (UID: \"26673412-89bb-4709-99d3-938900fbb332\") " pod="openshift-ingress-canary/ingress-canary-pbgbb"
Jul 07 17:37:16.015612 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:16.015607    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ctck\" (UniqueName: \"kubernetes.io/projected/26673412-89bb-4709-99d3-938900fbb332-kube-api-access-9ctck\") pod \"ingress-canary-pbgbb\" (UID: \"26673412-89bb-4709-99d3-938900fbb332\") " pod="openshift-ingress-canary/ingress-canary-pbgbb"
Jul 07 17:37:16.015823 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:16.015648    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/704699f9-7e17-4a8b-a4df-7259aed03300-tmp-dir\") pod \"dns-default-8mj9d\" (UID: \"704699f9-7e17-4a8b-a4df-7259aed03300\") " pod="openshift-dns/dns-default-8mj9d"
Jul 07 17:37:16.116842 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:16.116792    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/704699f9-7e17-4a8b-a4df-7259aed03300-tmp-dir\") pod \"dns-default-8mj9d\" (UID: \"704699f9-7e17-4a8b-a4df-7259aed03300\") " pod="openshift-dns/dns-default-8mj9d"
Jul 07 17:37:16.116842 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:16.116844    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/704699f9-7e17-4a8b-a4df-7259aed03300-config-volume\") pod \"dns-default-8mj9d\" (UID: \"704699f9-7e17-4a8b-a4df-7259aed03300\") " pod="openshift-dns/dns-default-8mj9d"
Jul 07 17:37:16.117137 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:16.116896    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/704699f9-7e17-4a8b-a4df-7259aed03300-metrics-tls\") pod \"dns-default-8mj9d\" (UID: \"704699f9-7e17-4a8b-a4df-7259aed03300\") " pod="openshift-dns/dns-default-8mj9d"
Jul 07 17:37:16.117137 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:16.116920    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22gh7\" (UniqueName: \"kubernetes.io/projected/704699f9-7e17-4a8b-a4df-7259aed03300-kube-api-access-22gh7\") pod \"dns-default-8mj9d\" (UID: \"704699f9-7e17-4a8b-a4df-7259aed03300\") " pod="openshift-dns/dns-default-8mj9d"
Jul 07 17:37:16.117137 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:16.117038    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:37:16.117137 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:16.117114    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/704699f9-7e17-4a8b-a4df-7259aed03300-metrics-tls podName:704699f9-7e17-4a8b-a4df-7259aed03300 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:16.617092876 +0000 UTC m=+36.132323200 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/704699f9-7e17-4a8b-a4df-7259aed03300-metrics-tls") pod "dns-default-8mj9d" (UID: "704699f9-7e17-4a8b-a4df-7259aed03300") : secret "dns-default-metrics-tls" not found
Jul 07 17:37:16.117377 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:16.117208    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/704699f9-7e17-4a8b-a4df-7259aed03300-tmp-dir\") pod \"dns-default-8mj9d\" (UID: \"704699f9-7e17-4a8b-a4df-7259aed03300\") " pod="openshift-dns/dns-default-8mj9d"
Jul 07 17:37:16.117377 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:16.117258    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26673412-89bb-4709-99d3-938900fbb332-cert\") pod \"ingress-canary-pbgbb\" (UID: \"26673412-89bb-4709-99d3-938900fbb332\") " pod="openshift-ingress-canary/ingress-canary-pbgbb"
Jul 07 17:37:16.117377 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:16.117293    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ctck\" (UniqueName: \"kubernetes.io/projected/26673412-89bb-4709-99d3-938900fbb332-kube-api-access-9ctck\") pod \"ingress-canary-pbgbb\" (UID: \"26673412-89bb-4709-99d3-938900fbb332\") " pod="openshift-ingress-canary/ingress-canary-pbgbb"
Jul 07 17:37:16.117596 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:16.117575    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/704699f9-7e17-4a8b-a4df-7259aed03300-config-volume\") pod \"dns-default-8mj9d\" (UID: \"704699f9-7e17-4a8b-a4df-7259aed03300\") " pod="openshift-dns/dns-default-8mj9d"
Jul 07 17:37:16.121792 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:16.121768    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26673412-89bb-4709-99d3-938900fbb332-cert\") pod \"ingress-canary-pbgbb\" (UID: \"26673412-89bb-4709-99d3-938900fbb332\") " pod="openshift-ingress-canary/ingress-canary-pbgbb"
Jul 07 17:37:16.125512 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:16.125488    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22gh7\" (UniqueName: \"kubernetes.io/projected/704699f9-7e17-4a8b-a4df-7259aed03300-kube-api-access-22gh7\") pod \"dns-default-8mj9d\" (UID: \"704699f9-7e17-4a8b-a4df-7259aed03300\") " pod="openshift-dns/dns-default-8mj9d"
Jul 07 17:37:16.125700 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:16.125677    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ctck\" (UniqueName: \"kubernetes.io/projected/26673412-89bb-4709-99d3-938900fbb332-kube-api-access-9ctck\") pod \"ingress-canary-pbgbb\" (UID: \"26673412-89bb-4709-99d3-938900fbb332\") " pod="openshift-ingress-canary/ingress-canary-pbgbb"
Jul 07 17:37:16.227067 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:16.226867    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pbgbb"
Jul 07 17:37:16.458682 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:16.458641    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pbgbb"]
Jul 07 17:37:16.532409 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:37:16.532370    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26673412_89bb_4709_99d3_938900fbb332.slice/crio-4f1cc82e00460384bc8027b127df353022ed46b3ace16e73c12a498cc3895b8a WatchSource:0}: Error finding container 4f1cc82e00460384bc8027b127df353022ed46b3ace16e73c12a498cc3895b8a: Status 404 returned error can't find the container with id 4f1cc82e00460384bc8027b127df353022ed46b3ace16e73c12a498cc3895b8a
Jul 07 17:37:16.622251 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:16.622209    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/704699f9-7e17-4a8b-a4df-7259aed03300-metrics-tls\") pod \"dns-default-8mj9d\" (UID: \"704699f9-7e17-4a8b-a4df-7259aed03300\") " pod="openshift-dns/dns-default-8mj9d"
Jul 07 17:37:16.622438 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:16.622361    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:37:16.622503 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:16.622440    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/704699f9-7e17-4a8b-a4df-7259aed03300-metrics-tls podName:704699f9-7e17-4a8b-a4df-7259aed03300 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:17.622418956 +0000 UTC m=+37.137649275 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/704699f9-7e17-4a8b-a4df-7259aed03300-metrics-tls") pod "dns-default-8mj9d" (UID: "704699f9-7e17-4a8b-a4df-7259aed03300") : secret "dns-default-metrics-tls" not found
Jul 07 17:37:16.931411 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:16.931357    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:17.028407 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:17.028368    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:17.288810 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:17.288595    2559 generic.go:356] "Generic (PLEG): container finished" podID="0819ed1d-2fe9-4bf5-b986-96f59fb24a8b" containerID="d8dd96bf21f520fc3872d19947efd89fd3204f7edb6e6526cc3348629ee2a516" exitCode=0
Jul 07 17:37:17.288810 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:17.288690    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hd255" event={"ID":"0819ed1d-2fe9-4bf5-b986-96f59fb24a8b","Type":"ContainerDied","Data":"d8dd96bf21f520fc3872d19947efd89fd3204f7edb6e6526cc3348629ee2a516"}
Jul 07 17:37:17.292171 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:17.290640    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pbgbb" event={"ID":"26673412-89bb-4709-99d3-938900fbb332","Type":"ContainerStarted","Data":"4f1cc82e00460384bc8027b127df353022ed46b3ace16e73c12a498cc3895b8a"}
Jul 07 17:37:17.628974 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:17.628911    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/704699f9-7e17-4a8b-a4df-7259aed03300-metrics-tls\") pod \"dns-default-8mj9d\" (UID: \"704699f9-7e17-4a8b-a4df-7259aed03300\") " pod="openshift-dns/dns-default-8mj9d"
Jul 07 17:37:17.629164 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:17.629067    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:37:17.629164 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:17.629136    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/704699f9-7e17-4a8b-a4df-7259aed03300-metrics-tls podName:704699f9-7e17-4a8b-a4df-7259aed03300 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:19.629120004 +0000 UTC m=+39.144350318 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/704699f9-7e17-4a8b-a4df-7259aed03300-metrics-tls") pod "dns-default-8mj9d" (UID: "704699f9-7e17-4a8b-a4df-7259aed03300") : secret "dns-default-metrics-tls" not found
Jul 07 17:37:18.296411 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:18.296376    2559 generic.go:356] "Generic (PLEG): container finished" podID="0819ed1d-2fe9-4bf5-b986-96f59fb24a8b" containerID="5c499d7e6fdded943feb72a4650c709c889460b06829f698d6f95e29d78a6894" exitCode=0
Jul 07 17:37:18.296867 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:18.296433    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hd255" event={"ID":"0819ed1d-2fe9-4bf5-b986-96f59fb24a8b","Type":"ContainerDied","Data":"5c499d7e6fdded943feb72a4650c709c889460b06829f698d6f95e29d78a6894"}
Jul 07 17:37:18.310509 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:18.310475    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:18.372007 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:18.371944    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:19.303513 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:19.303342    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hd255" event={"ID":"0819ed1d-2fe9-4bf5-b986-96f59fb24a8b","Type":"ContainerStarted","Data":"017d291128bd70161e91fdc2f91a14cde851fd636303836154b85ae5b27e86a0"}
Jul 07 17:37:19.326500 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:19.326443    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hd255" podStartSLOduration=9.115683026 podStartE2EDuration="38.326423415s" totalImagesPullingTime="29.210740389s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:36:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:19.325470163 +0000 UTC m=+38.840700524" watchObservedRunningTime="2026-07-07 17:37:19.326423415 +0000 UTC m=+38.841653743"
Jul 07 17:37:19.445050 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:19.445008    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:19.545245 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:19.545161    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:19.643696 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:19.643662    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/704699f9-7e17-4a8b-a4df-7259aed03300-metrics-tls\") pod \"dns-default-8mj9d\" (UID: \"704699f9-7e17-4a8b-a4df-7259aed03300\") " pod="openshift-dns/dns-default-8mj9d"
Jul 07 17:37:19.643846 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:19.643809    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:37:19.643886 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:19.643871    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/704699f9-7e17-4a8b-a4df-7259aed03300-metrics-tls podName:704699f9-7e17-4a8b-a4df-7259aed03300 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:23.643856431 +0000 UTC m=+43.159086749 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/704699f9-7e17-4a8b-a4df-7259aed03300-metrics-tls") pod "dns-default-8mj9d" (UID: "704699f9-7e17-4a8b-a4df-7259aed03300") : secret "dns-default-metrics-tls" not found
Jul 07 17:37:20.306946 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:20.306857    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pbgbb" event={"ID":"26673412-89bb-4709-99d3-938900fbb332","Type":"ContainerStarted","Data":"c217255240cec73396365a62e3e034c5c8ab3c36ced9b8dcc063d57ab78835c9"}
Jul 07 17:37:20.322599 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:20.322552    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pbgbb" podStartSLOduration=2.679949186 podStartE2EDuration="5.322535668s" totalImagesPullingTime="2.642586482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:20.321315651 +0000 UTC m=+39.836545989" watchObservedRunningTime="2026-07-07 17:37:20.322535668 +0000 UTC m=+39.837766004"
Jul 07 17:37:20.902403 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:20.902363    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:20.962633 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:20.962596    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:21.200267 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:21.200187    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:21.301466 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:21.301430    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:23.668140 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:23.668095    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/704699f9-7e17-4a8b-a4df-7259aed03300-metrics-tls\") pod \"dns-default-8mj9d\" (UID: \"704699f9-7e17-4a8b-a4df-7259aed03300\") " pod="openshift-dns/dns-default-8mj9d"
Jul 07 17:37:23.668611 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:23.668243    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:37:23.668611 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:23.668308    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/704699f9-7e17-4a8b-a4df-7259aed03300-metrics-tls podName:704699f9-7e17-4a8b-a4df-7259aed03300 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:31.668292959 +0000 UTC m=+51.183523272 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/704699f9-7e17-4a8b-a4df-7259aed03300-metrics-tls") pod "dns-default-8mj9d" (UID: "704699f9-7e17-4a8b-a4df-7259aed03300") : secret "dns-default-metrics-tls" not found
Jul 07 17:37:24.921200 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:24.921167    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:24.981767 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:24.981736    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:26.956113 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:26.956081    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:27.015420 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:27.015386    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:29.471412 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.471380    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-pwr2g"]
Jul 07 17:37:29.484371 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.484344    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-pwr2g"
Jul 07 17:37:29.484864 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.484839    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-pwr2g"]
Jul 07 17:37:29.486892 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.486865    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-td52f\""
Jul 07 17:37:29.587381 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.587353    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-75f79f56bf-jktn5"]
Jul 07 17:37:29.597120 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.597101    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-75f79f56bf-jktn5"
Jul 07 17:37:29.599609 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.599584    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 07 17:37:29.599720 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.599680    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 07 17:37:29.599720 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.599695    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 17:37:29.599816 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.599788    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ngq2g\""
Jul 07 17:37:29.600286 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.600268    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 07 17:37:29.600382 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.600367    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 07 17:37:29.600382 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.600377    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 17:37:29.603894 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.603874    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-75f79f56bf-jktn5"]
Jul 07 17:37:29.612337 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.612316    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgxwk\" (UniqueName: \"kubernetes.io/projected/36423184-2522-4986-8bb0-055eb5fdb649-kube-api-access-jgxwk\") pod \"network-check-source-989f8b8dc-pwr2g\" (UID: \"36423184-2522-4986-8bb0-055eb5fdb649\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-pwr2g"
Jul 07 17:37:29.676057 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.676024    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-9gvhn"]
Jul 07 17:37:29.685412 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.685384    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mspls"]
Jul 07 17:37:29.685545 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.685508    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-9gvhn"
Jul 07 17:37:29.688162 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.688138    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 07 17:37:29.688284 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.688138    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4hh7m\""
Jul 07 17:37:29.688520 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.688499    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 07 17:37:29.692154 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.692132    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-9gvhn"]
Jul 07 17:37:29.692260 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.692232    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mspls"
Jul 07 17:37:29.694725 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.694696    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-brl7n\""
Jul 07 17:37:29.694929 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.694916    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 07 17:37:29.695027 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.694948    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 07 17:37:29.695279 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.695268    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 07 17:37:29.695326 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.695301    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mspls"]
Jul 07 17:37:29.712614 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.712584    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c349ce7-0bb4-42be-bccc-ec6129edb764-service-ca-bundle\") pod \"router-default-75f79f56bf-jktn5\" (UID: \"9c349ce7-0bb4-42be-bccc-ec6129edb764\") " pod="openshift-ingress/router-default-75f79f56bf-jktn5"
Jul 07 17:37:29.712614 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.712623    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgxwk\" (UniqueName: \"kubernetes.io/projected/36423184-2522-4986-8bb0-055eb5fdb649-kube-api-access-jgxwk\") pod \"network-check-source-989f8b8dc-pwr2g\" (UID: \"36423184-2522-4986-8bb0-055eb5fdb649\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-pwr2g"
Jul 07 17:37:29.712832 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.712657    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9c349ce7-0bb4-42be-bccc-ec6129edb764-default-certificate\") pod \"router-default-75f79f56bf-jktn5\" (UID: \"9c349ce7-0bb4-42be-bccc-ec6129edb764\") " pod="openshift-ingress/router-default-75f79f56bf-jktn5"
Jul 07 17:37:29.712832 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.712674    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26vvt\" (UniqueName: \"kubernetes.io/projected/9c349ce7-0bb4-42be-bccc-ec6129edb764-kube-api-access-26vvt\") pod \"router-default-75f79f56bf-jktn5\" (UID: \"9c349ce7-0bb4-42be-bccc-ec6129edb764\") " pod="openshift-ingress/router-default-75f79f56bf-jktn5"
Jul 07 17:37:29.712832 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.712696    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c349ce7-0bb4-42be-bccc-ec6129edb764-metrics-certs\") pod \"router-default-75f79f56bf-jktn5\" (UID: \"9c349ce7-0bb4-42be-bccc-ec6129edb764\") " pod="openshift-ingress/router-default-75f79f56bf-jktn5"
Jul 07 17:37:29.712832 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.712769    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9c349ce7-0bb4-42be-bccc-ec6129edb764-stats-auth\") pod \"router-default-75f79f56bf-jktn5\" (UID: \"9c349ce7-0bb4-42be-bccc-ec6129edb764\") " pod="openshift-ingress/router-default-75f79f56bf-jktn5"
Jul 07 17:37:29.732598 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.732527    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgxwk\" (UniqueName: \"kubernetes.io/projected/36423184-2522-4986-8bb0-055eb5fdb649-kube-api-access-jgxwk\") pod \"network-check-source-989f8b8dc-pwr2g\" (UID: \"36423184-2522-4986-8bb0-055eb5fdb649\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-pwr2g"
Jul 07 17:37:29.793797 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.793757    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-pwr2g"
Jul 07 17:37:29.813238 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.813206    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9c349ce7-0bb4-42be-bccc-ec6129edb764-default-certificate\") pod \"router-default-75f79f56bf-jktn5\" (UID: \"9c349ce7-0bb4-42be-bccc-ec6129edb764\") " pod="openshift-ingress/router-default-75f79f56bf-jktn5"
Jul 07 17:37:29.813372 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.813270    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26vvt\" (UniqueName: \"kubernetes.io/projected/9c349ce7-0bb4-42be-bccc-ec6129edb764-kube-api-access-26vvt\") pod \"router-default-75f79f56bf-jktn5\" (UID: \"9c349ce7-0bb4-42be-bccc-ec6129edb764\") " pod="openshift-ingress/router-default-75f79f56bf-jktn5"
Jul 07 17:37:29.813372 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.813304    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe704914-04b6-4b82-8584-2d0aaf910194-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mspls\" (UID: \"fe704914-04b6-4b82-8584-2d0aaf910194\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mspls"
Jul 07 17:37:29.813372 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.813332    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zz5v\" (UniqueName: \"kubernetes.io/projected/fe704914-04b6-4b82-8584-2d0aaf910194-kube-api-access-8zz5v\") pod \"cluster-samples-operator-56fcf86bf-mspls\" (UID: \"fe704914-04b6-4b82-8584-2d0aaf910194\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mspls"
Jul 07 17:37:29.813372 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.813361    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c349ce7-0bb4-42be-bccc-ec6129edb764-metrics-certs\") pod \"router-default-75f79f56bf-jktn5\" (UID: \"9c349ce7-0bb4-42be-bccc-ec6129edb764\") " pod="openshift-ingress/router-default-75f79f56bf-jktn5"
Jul 07 17:37:29.813580 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.813400    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9c349ce7-0bb4-42be-bccc-ec6129edb764-stats-auth\") pod \"router-default-75f79f56bf-jktn5\" (UID: \"9c349ce7-0bb4-42be-bccc-ec6129edb764\") " pod="openshift-ingress/router-default-75f79f56bf-jktn5"
Jul 07 17:37:29.813803 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:29.813781    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 17:37:29.813982 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:29.813938    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c349ce7-0bb4-42be-bccc-ec6129edb764-service-ca-bundle podName:9c349ce7-0bb4-42be-bccc-ec6129edb764 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:30.313915435 +0000 UTC m=+49.829145767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9c349ce7-0bb4-42be-bccc-ec6129edb764-service-ca-bundle") pod "router-default-75f79f56bf-jktn5" (UID: "9c349ce7-0bb4-42be-bccc-ec6129edb764") : configmap references non-existent config key: service-ca.crt
Jul 07 17:37:29.814076 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.813988    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:29.814076 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.813480    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c349ce7-0bb4-42be-bccc-ec6129edb764-service-ca-bundle\") pod \"router-default-75f79f56bf-jktn5\" (UID: \"9c349ce7-0bb4-42be-bccc-ec6129edb764\") " pod="openshift-ingress/router-default-75f79f56bf-jktn5"
Jul 07 17:37:29.814190 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.814109    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/afebc539-17cc-4174-8c80-499c0e3652d3-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-9gvhn\" (UID: \"afebc539-17cc-4174-8c80-499c0e3652d3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9gvhn"
Jul 07 17:37:29.814190 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.814140    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/afebc539-17cc-4174-8c80-499c0e3652d3-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-9gvhn\" (UID: \"afebc539-17cc-4174-8c80-499c0e3652d3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9gvhn"
Jul 07 17:37:29.814328 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:29.814313    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c349ce7-0bb4-42be-bccc-ec6129edb764-metrics-certs podName:9c349ce7-0bb4-42be-bccc-ec6129edb764 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:30.314295401 +0000 UTC m=+49.829525729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c349ce7-0bb4-42be-bccc-ec6129edb764-metrics-certs") pod "router-default-75f79f56bf-jktn5" (UID: "9c349ce7-0bb4-42be-bccc-ec6129edb764") : secret "router-metrics-certs-default" not found
Jul 07 17:37:29.816329 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.816309    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9c349ce7-0bb4-42be-bccc-ec6129edb764-default-certificate\") pod \"router-default-75f79f56bf-jktn5\" (UID: \"9c349ce7-0bb4-42be-bccc-ec6129edb764\") " pod="openshift-ingress/router-default-75f79f56bf-jktn5"
Jul 07 17:37:29.816761 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.816739    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9c349ce7-0bb4-42be-bccc-ec6129edb764-stats-auth\") pod \"router-default-75f79f56bf-jktn5\" (UID: \"9c349ce7-0bb4-42be-bccc-ec6129edb764\") " pod="openshift-ingress/router-default-75f79f56bf-jktn5"
Jul 07 17:37:29.825271 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.825244    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26vvt\" (UniqueName: \"kubernetes.io/projected/9c349ce7-0bb4-42be-bccc-ec6129edb764-kube-api-access-26vvt\") pod \"router-default-75f79f56bf-jktn5\" (UID: \"9c349ce7-0bb4-42be-bccc-ec6129edb764\") " pod="openshift-ingress/router-default-75f79f56bf-jktn5"
Jul 07 17:37:29.913916 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.913885    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:29.914933 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.914912    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/afebc539-17cc-4174-8c80-499c0e3652d3-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-9gvhn\" (UID: \"afebc539-17cc-4174-8c80-499c0e3652d3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9gvhn"
Jul 07 17:37:29.915045 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.914941    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/afebc539-17cc-4174-8c80-499c0e3652d3-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-9gvhn\" (UID: \"afebc539-17cc-4174-8c80-499c0e3652d3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9gvhn"
Jul 07 17:37:29.915045 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.915000    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe704914-04b6-4b82-8584-2d0aaf910194-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mspls\" (UID: \"fe704914-04b6-4b82-8584-2d0aaf910194\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mspls"
Jul 07 17:37:29.915045 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.915017    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zz5v\" (UniqueName: \"kubernetes.io/projected/fe704914-04b6-4b82-8584-2d0aaf910194-kube-api-access-8zz5v\") pod \"cluster-samples-operator-56fcf86bf-mspls\" (UID: \"fe704914-04b6-4b82-8584-2d0aaf910194\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mspls"
Jul 07 17:37:29.915189 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:29.915137    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 17:37:29.915236 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:29.915198    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe704914-04b6-4b82-8584-2d0aaf910194-samples-operator-tls podName:fe704914-04b6-4b82-8584-2d0aaf910194 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:30.415180005 +0000 UTC m=+49.930410322 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fe704914-04b6-4b82-8584-2d0aaf910194-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mspls" (UID: "fe704914-04b6-4b82-8584-2d0aaf910194") : secret "samples-operator-tls" not found
Jul 07 17:37:29.915236 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:29.915138    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 17:37:29.915346 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:29.915241    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afebc539-17cc-4174-8c80-499c0e3652d3-networking-console-plugin-cert podName:afebc539-17cc-4174-8c80-499c0e3652d3 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:30.415231627 +0000 UTC m=+49.930461941 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/afebc539-17cc-4174-8c80-499c0e3652d3-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-9gvhn" (UID: "afebc539-17cc-4174-8c80-499c0e3652d3") : secret "networking-console-plugin-cert" not found
Jul 07 17:37:29.922372 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.922341    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/afebc539-17cc-4174-8c80-499c0e3652d3-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-9gvhn\" (UID: \"afebc539-17cc-4174-8c80-499c0e3652d3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9gvhn"
Jul 07 17:37:29.935411 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.935380    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-pwr2g"]
Jul 07 17:37:29.938517 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:37:29.938484    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36423184_2522_4986_8bb0_055eb5fdb649.slice/crio-1bf4ff4d27781ccd7212631a1329ce516c05f6cf8455b472c25ab3ca7312656f WatchSource:0}: Error finding container 1bf4ff4d27781ccd7212631a1329ce516c05f6cf8455b472c25ab3ca7312656f: Status 404 returned error can't find the container with id 1bf4ff4d27781ccd7212631a1329ce516c05f6cf8455b472c25ab3ca7312656f
Jul 07 17:37:29.940251 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:29.940230    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zz5v\" (UniqueName: \"kubernetes.io/projected/fe704914-04b6-4b82-8584-2d0aaf910194-kube-api-access-8zz5v\") pod \"cluster-samples-operator-56fcf86bf-mspls\" (UID: \"fe704914-04b6-4b82-8584-2d0aaf910194\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mspls"
Jul 07 17:37:30.013701 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:30.013613    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:30.082996 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:30.082938    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:30.318376 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:30.318283    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c349ce7-0bb4-42be-bccc-ec6129edb764-service-ca-bundle\") pod \"router-default-75f79f56bf-jktn5\" (UID: \"9c349ce7-0bb4-42be-bccc-ec6129edb764\") " pod="openshift-ingress/router-default-75f79f56bf-jktn5"
Jul 07 17:37:30.318376 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:30.318370    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c349ce7-0bb4-42be-bccc-ec6129edb764-metrics-certs\") pod \"router-default-75f79f56bf-jktn5\" (UID: \"9c349ce7-0bb4-42be-bccc-ec6129edb764\") " pod="openshift-ingress/router-default-75f79f56bf-jktn5"
Jul 07 17:37:30.318604 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:30.318460    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c349ce7-0bb4-42be-bccc-ec6129edb764-service-ca-bundle podName:9c349ce7-0bb4-42be-bccc-ec6129edb764 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:31.318442938 +0000 UTC m=+50.833673254 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9c349ce7-0bb4-42be-bccc-ec6129edb764-service-ca-bundle") pod "router-default-75f79f56bf-jktn5" (UID: "9c349ce7-0bb4-42be-bccc-ec6129edb764") : configmap references non-existent config key: service-ca.crt
Jul 07 17:37:30.318604 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:30.318490    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 17:37:30.318604 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:30.318538    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c349ce7-0bb4-42be-bccc-ec6129edb764-metrics-certs podName:9c349ce7-0bb4-42be-bccc-ec6129edb764 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:31.318524141 +0000 UTC m=+50.833754470 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c349ce7-0bb4-42be-bccc-ec6129edb764-metrics-certs") pod "router-default-75f79f56bf-jktn5" (UID: "9c349ce7-0bb4-42be-bccc-ec6129edb764") : secret "router-metrics-certs-default" not found
Jul 07 17:37:30.332523 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:30.332495    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-pwr2g" event={"ID":"36423184-2522-4986-8bb0-055eb5fdb649","Type":"ContainerStarted","Data":"1bf4ff4d27781ccd7212631a1329ce516c05f6cf8455b472c25ab3ca7312656f"}
Jul 07 17:37:30.419120 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:30.419082    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/afebc539-17cc-4174-8c80-499c0e3652d3-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-9gvhn\" (UID: \"afebc539-17cc-4174-8c80-499c0e3652d3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9gvhn"
Jul 07 17:37:30.419295 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:30.419140    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe704914-04b6-4b82-8584-2d0aaf910194-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mspls\" (UID: \"fe704914-04b6-4b82-8584-2d0aaf910194\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mspls"
Jul 07 17:37:30.419295 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:30.419223    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 17:37:30.419295 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:30.419228    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 17:37:30.419295 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:30.419284    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe704914-04b6-4b82-8584-2d0aaf910194-samples-operator-tls podName:fe704914-04b6-4b82-8584-2d0aaf910194 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:31.419268311 +0000 UTC m=+50.934498646 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fe704914-04b6-4b82-8584-2d0aaf910194-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mspls" (UID: "fe704914-04b6-4b82-8584-2d0aaf910194") : secret "samples-operator-tls" not found
Jul 07 17:37:30.419295 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:30.419297    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afebc539-17cc-4174-8c80-499c0e3652d3-networking-console-plugin-cert podName:afebc539-17cc-4174-8c80-499c0e3652d3 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:31.419291428 +0000 UTC m=+50.934521743 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/afebc539-17cc-4174-8c80-499c0e3652d3-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-9gvhn" (UID: "afebc539-17cc-4174-8c80-499c0e3652d3") : secret "networking-console-plugin-cert" not found
Jul 07 17:37:31.326492 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:31.326457    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c349ce7-0bb4-42be-bccc-ec6129edb764-metrics-certs\") pod \"router-default-75f79f56bf-jktn5\" (UID: \"9c349ce7-0bb4-42be-bccc-ec6129edb764\") " pod="openshift-ingress/router-default-75f79f56bf-jktn5"
Jul 07 17:37:31.326929 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:31.326531    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c349ce7-0bb4-42be-bccc-ec6129edb764-service-ca-bundle\") pod \"router-default-75f79f56bf-jktn5\" (UID: \"9c349ce7-0bb4-42be-bccc-ec6129edb764\") " pod="openshift-ingress/router-default-75f79f56bf-jktn5"
Jul 07 17:37:31.326929 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:31.326633    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 17:37:31.326929 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:31.326643    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c349ce7-0bb4-42be-bccc-ec6129edb764-service-ca-bundle podName:9c349ce7-0bb4-42be-bccc-ec6129edb764 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:33.326631179 +0000 UTC m=+52.841861497 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9c349ce7-0bb4-42be-bccc-ec6129edb764-service-ca-bundle") pod "router-default-75f79f56bf-jktn5" (UID: "9c349ce7-0bb4-42be-bccc-ec6129edb764") : configmap references non-existent config key: service-ca.crt
Jul 07 17:37:31.326929 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:31.326710    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c349ce7-0bb4-42be-bccc-ec6129edb764-metrics-certs podName:9c349ce7-0bb4-42be-bccc-ec6129edb764 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:33.326693068 +0000 UTC m=+52.841923385 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c349ce7-0bb4-42be-bccc-ec6129edb764-metrics-certs") pod "router-default-75f79f56bf-jktn5" (UID: "9c349ce7-0bb4-42be-bccc-ec6129edb764") : secret "router-metrics-certs-default" not found
Jul 07 17:37:31.427418 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:31.427378    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/afebc539-17cc-4174-8c80-499c0e3652d3-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-9gvhn\" (UID: \"afebc539-17cc-4174-8c80-499c0e3652d3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9gvhn"
Jul 07 17:37:31.427583 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:31.427437    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe704914-04b6-4b82-8584-2d0aaf910194-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mspls\" (UID: \"fe704914-04b6-4b82-8584-2d0aaf910194\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mspls"
Jul 07 17:37:31.427583 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:31.427536    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 17:37:31.427583 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:31.427536    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 17:37:31.427684 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:31.427587    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe704914-04b6-4b82-8584-2d0aaf910194-samples-operator-tls podName:fe704914-04b6-4b82-8584-2d0aaf910194 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:33.427573826 +0000 UTC m=+52.942804141 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fe704914-04b6-4b82-8584-2d0aaf910194-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mspls" (UID: "fe704914-04b6-4b82-8584-2d0aaf910194") : secret "samples-operator-tls" not found
Jul 07 17:37:31.427684 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:31.427604    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afebc539-17cc-4174-8c80-499c0e3652d3-networking-console-plugin-cert podName:afebc539-17cc-4174-8c80-499c0e3652d3 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:33.427596737 +0000 UTC m=+52.942827051 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/afebc539-17cc-4174-8c80-499c0e3652d3-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-9gvhn" (UID: "afebc539-17cc-4174-8c80-499c0e3652d3") : secret "networking-console-plugin-cert" not found
Jul 07 17:37:31.730534 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:31.730486    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/704699f9-7e17-4a8b-a4df-7259aed03300-metrics-tls\") pod \"dns-default-8mj9d\" (UID: \"704699f9-7e17-4a8b-a4df-7259aed03300\") " pod="openshift-dns/dns-default-8mj9d"
Jul 07 17:37:31.730717 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:31.730671    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:37:31.730765 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:31.730746    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/704699f9-7e17-4a8b-a4df-7259aed03300-metrics-tls podName:704699f9-7e17-4a8b-a4df-7259aed03300 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:47.730725702 +0000 UTC m=+67.245956019 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/704699f9-7e17-4a8b-a4df-7259aed03300-metrics-tls") pod "dns-default-8mj9d" (UID: "704699f9-7e17-4a8b-a4df-7259aed03300") : secret "dns-default-metrics-tls" not found
Jul 07 17:37:32.303826 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:32.303788    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:33.343464 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:33.343432    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c349ce7-0bb4-42be-bccc-ec6129edb764-service-ca-bundle\") pod \"router-default-75f79f56bf-jktn5\" (UID: \"9c349ce7-0bb4-42be-bccc-ec6129edb764\") " pod="openshift-ingress/router-default-75f79f56bf-jktn5"
Jul 07 17:37:33.343921 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:33.343530    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c349ce7-0bb4-42be-bccc-ec6129edb764-metrics-certs\") pod \"router-default-75f79f56bf-jktn5\" (UID: \"9c349ce7-0bb4-42be-bccc-ec6129edb764\") " pod="openshift-ingress/router-default-75f79f56bf-jktn5"
Jul 07 17:37:33.343921 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:33.343570    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c349ce7-0bb4-42be-bccc-ec6129edb764-service-ca-bundle podName:9c349ce7-0bb4-42be-bccc-ec6129edb764 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:37.343551776 +0000 UTC m=+56.858782093 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9c349ce7-0bb4-42be-bccc-ec6129edb764-service-ca-bundle") pod "router-default-75f79f56bf-jktn5" (UID: "9c349ce7-0bb4-42be-bccc-ec6129edb764") : configmap references non-existent config key: service-ca.crt
Jul 07 17:37:33.343921 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:33.343632    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 17:37:33.343921 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:33.343670    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c349ce7-0bb4-42be-bccc-ec6129edb764-metrics-certs podName:9c349ce7-0bb4-42be-bccc-ec6129edb764 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:37.343657757 +0000 UTC m=+56.858888073 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c349ce7-0bb4-42be-bccc-ec6129edb764-metrics-certs") pod "router-default-75f79f56bf-jktn5" (UID: "9c349ce7-0bb4-42be-bccc-ec6129edb764") : secret "router-metrics-certs-default" not found
Jul 07 17:37:33.443982 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:33.443934    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/afebc539-17cc-4174-8c80-499c0e3652d3-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-9gvhn\" (UID: \"afebc539-17cc-4174-8c80-499c0e3652d3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9gvhn"
Jul 07 17:37:33.444164 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:33.444016    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe704914-04b6-4b82-8584-2d0aaf910194-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mspls\" (UID: \"fe704914-04b6-4b82-8584-2d0aaf910194\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mspls"
Jul 07 17:37:33.444227 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:33.444168    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 17:37:33.444280 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:33.444233    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe704914-04b6-4b82-8584-2d0aaf910194-samples-operator-tls podName:fe704914-04b6-4b82-8584-2d0aaf910194 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:37.444214386 +0000 UTC m=+56.959444712 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fe704914-04b6-4b82-8584-2d0aaf910194-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mspls" (UID: "fe704914-04b6-4b82-8584-2d0aaf910194") : secret "samples-operator-tls" not found
Jul 07 17:37:33.444686 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:33.444666    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 17:37:33.444764 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:33.444715    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afebc539-17cc-4174-8c80-499c0e3652d3-networking-console-plugin-cert podName:afebc539-17cc-4174-8c80-499c0e3652d3 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:37.444704438 +0000 UTC m=+56.959934755 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/afebc539-17cc-4174-8c80-499c0e3652d3-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-9gvhn" (UID: "afebc539-17cc-4174-8c80-499c0e3652d3") : secret "networking-console-plugin-cert" not found
Jul 07 17:37:34.097295 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.097260    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-brl7n"]
Jul 07 17:37:34.099638 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.099615    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-brl7n"
Jul 07 17:37:34.102161 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.102134    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 17:37:34.103115 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.103092    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 17:37:34.103115 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.103110    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 17:37:34.103282 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.103120    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 17:37:34.103282 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.103114    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7mx9j\""
Jul 07 17:37:34.112071 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.112046    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-brl7n"]
Jul 07 17:37:34.161614 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.161579    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:34.220002 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.219969    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:34.250211 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.250171    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ad442bfc-df96-4c50-a0f1-28c1adf66895-crio-socket\") pod \"insights-runtime-extractor-brl7n\" (UID: \"ad442bfc-df96-4c50-a0f1-28c1adf66895\") " pod="openshift-insights/insights-runtime-extractor-brl7n"
Jul 07 17:37:34.250346 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.250245    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ad442bfc-df96-4c50-a0f1-28c1adf66895-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-brl7n\" (UID: \"ad442bfc-df96-4c50-a0f1-28c1adf66895\") " pod="openshift-insights/insights-runtime-extractor-brl7n"
Jul 07 17:37:34.250346 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.250321    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ad442bfc-df96-4c50-a0f1-28c1adf66895-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-brl7n\" (UID: \"ad442bfc-df96-4c50-a0f1-28c1adf66895\") " pod="openshift-insights/insights-runtime-extractor-brl7n"
Jul 07 17:37:34.250434 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.250406    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2zm6\" (UniqueName: \"kubernetes.io/projected/ad442bfc-df96-4c50-a0f1-28c1adf66895-kube-api-access-d2zm6\") pod \"insights-runtime-extractor-brl7n\" (UID: \"ad442bfc-df96-4c50-a0f1-28c1adf66895\") " pod="openshift-insights/insights-runtime-extractor-brl7n"
Jul 07 17:37:34.250476 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.250452    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad442bfc-df96-4c50-a0f1-28c1adf66895-data-volume\") pod \"insights-runtime-extractor-brl7n\" (UID: \"ad442bfc-df96-4c50-a0f1-28c1adf66895\") " pod="openshift-insights/insights-runtime-extractor-brl7n"
Jul 07 17:37:34.342852 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.342760    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-pwr2g" event={"ID":"36423184-2522-4986-8bb0-055eb5fdb649","Type":"ContainerStarted","Data":"6670b8011a53416fc48e9c5e8bd087278b9ec653425cd2b59547603f31c5735d"}
Jul 07 17:37:34.351681 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.351659    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad442bfc-df96-4c50-a0f1-28c1adf66895-data-volume\") pod \"insights-runtime-extractor-brl7n\" (UID: \"ad442bfc-df96-4c50-a0f1-28c1adf66895\") " pod="openshift-insights/insights-runtime-extractor-brl7n"
Jul 07 17:37:34.351681 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.351689    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ad442bfc-df96-4c50-a0f1-28c1adf66895-crio-socket\") pod \"insights-runtime-extractor-brl7n\" (UID: \"ad442bfc-df96-4c50-a0f1-28c1adf66895\") " pod="openshift-insights/insights-runtime-extractor-brl7n"
Jul 07 17:37:34.352130 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.351728    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ad442bfc-df96-4c50-a0f1-28c1adf66895-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-brl7n\" (UID: \"ad442bfc-df96-4c50-a0f1-28c1adf66895\") " pod="openshift-insights/insights-runtime-extractor-brl7n"
Jul 07 17:37:34.352130 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.351805    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ad442bfc-df96-4c50-a0f1-28c1adf66895-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-brl7n\" (UID: \"ad442bfc-df96-4c50-a0f1-28c1adf66895\") " pod="openshift-insights/insights-runtime-extractor-brl7n"
Jul 07 17:37:34.352130 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:34.351817    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 17:37:34.352130 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:34.351882    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad442bfc-df96-4c50-a0f1-28c1adf66895-insights-runtime-extractor-tls podName:ad442bfc-df96-4c50-a0f1-28c1adf66895 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:34.851866737 +0000 UTC m=+54.367097056 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ad442bfc-df96-4c50-a0f1-28c1adf66895-insights-runtime-extractor-tls") pod "insights-runtime-extractor-brl7n" (UID: "ad442bfc-df96-4c50-a0f1-28c1adf66895") : secret "insights-runtime-extractor-tls" not found
Jul 07 17:37:34.352130 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:34.351914    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 17:37:34.352130 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.351925    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ad442bfc-df96-4c50-a0f1-28c1adf66895-crio-socket\") pod \"insights-runtime-extractor-brl7n\" (UID: \"ad442bfc-df96-4c50-a0f1-28c1adf66895\") " pod="openshift-insights/insights-runtime-extractor-brl7n"
Jul 07 17:37:34.352130 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.351912    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2zm6\" (UniqueName: \"kubernetes.io/projected/ad442bfc-df96-4c50-a0f1-28c1adf66895-kube-api-access-d2zm6\") pod \"insights-runtime-extractor-brl7n\" (UID: \"ad442bfc-df96-4c50-a0f1-28c1adf66895\") " pod="openshift-insights/insights-runtime-extractor-brl7n"
Jul 07 17:37:34.352130 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:34.351990    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad442bfc-df96-4c50-a0f1-28c1adf66895-kube-rbac-proxy-cm podName:ad442bfc-df96-4c50-a0f1-28c1adf66895 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:34.851975845 +0000 UTC m=+54.367206162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ad442bfc-df96-4c50-a0f1-28c1adf66895-kube-rbac-proxy-cm") pod "insights-runtime-extractor-brl7n" (UID: "ad442bfc-df96-4c50-a0f1-28c1adf66895") : configmap "kube-rbac-proxy" not found
Jul 07 17:37:34.352130 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.352095    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad442bfc-df96-4c50-a0f1-28c1adf66895-data-volume\") pod \"insights-runtime-extractor-brl7n\" (UID: \"ad442bfc-df96-4c50-a0f1-28c1adf66895\") " pod="openshift-insights/insights-runtime-extractor-brl7n"
Jul 07 17:37:34.357759 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.357720    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-pwr2g" podStartSLOduration=1.293054522 podStartE2EDuration="5.357708715s" totalImagesPullingTime="4.064654193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:37:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:34.357187124 +0000 UTC m=+53.872417461" watchObservedRunningTime="2026-07-07 17:37:34.357708715 +0000 UTC m=+53.872939051"
Jul 07 17:37:34.361199 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.361175    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2zm6\" (UniqueName: \"kubernetes.io/projected/ad442bfc-df96-4c50-a0f1-28c1adf66895-kube-api-access-d2zm6\") pod \"insights-runtime-extractor-brl7n\" (UID: \"ad442bfc-df96-4c50-a0f1-28c1adf66895\") " pod="openshift-insights/insights-runtime-extractor-brl7n"
Jul 07 17:37:34.755365 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.755332    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:34.771491 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.771459    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-l7mgf"]
Jul 07 17:37:34.773908 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.773892    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-l7mgf"
Jul 07 17:37:34.776230 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.776199    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 07 17:37:34.776384 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.776369    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-nttdp\""
Jul 07 17:37:34.777227 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.777212    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 07 17:37:34.784720 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.784699    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-l7mgf"]
Jul 07 17:37:34.842557 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.842518    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:34.855759 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.855731    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ad442bfc-df96-4c50-a0f1-28c1adf66895-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-brl7n\" (UID: \"ad442bfc-df96-4c50-a0f1-28c1adf66895\") " pod="openshift-insights/insights-runtime-extractor-brl7n"
Jul 07 17:37:34.855869 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.855804    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ad442bfc-df96-4c50-a0f1-28c1adf66895-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-brl7n\" (UID: \"ad442bfc-df96-4c50-a0f1-28c1adf66895\") " pod="openshift-insights/insights-runtime-extractor-brl7n"
Jul 07 17:37:34.855938 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:34.855882    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 17:37:34.855938 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:34.855896    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 17:37:34.856059 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:34.855942    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad442bfc-df96-4c50-a0f1-28c1adf66895-insights-runtime-extractor-tls podName:ad442bfc-df96-4c50-a0f1-28c1adf66895 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:35.85592788 +0000 UTC m=+55.371158194 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ad442bfc-df96-4c50-a0f1-28c1adf66895-insights-runtime-extractor-tls") pod "insights-runtime-extractor-brl7n" (UID: "ad442bfc-df96-4c50-a0f1-28c1adf66895") : secret "insights-runtime-extractor-tls" not found
Jul 07 17:37:34.856059 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:34.855977    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad442bfc-df96-4c50-a0f1-28c1adf66895-kube-rbac-proxy-cm podName:ad442bfc-df96-4c50-a0f1-28c1adf66895 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:35.855950606 +0000 UTC m=+55.371180923 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ad442bfc-df96-4c50-a0f1-28c1adf66895-kube-rbac-proxy-cm") pod "insights-runtime-extractor-brl7n" (UID: "ad442bfc-df96-4c50-a0f1-28c1adf66895") : configmap "kube-rbac-proxy" not found
Jul 07 17:37:34.902708 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.902676    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:34.956797 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:34.956763    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfsx5\" (UniqueName: \"kubernetes.io/projected/c5ba8132-627a-4818-bc23-ee762901434f-kube-api-access-tfsx5\") pod \"migrator-d57d58cc9-l7mgf\" (UID: \"c5ba8132-627a-4818-bc23-ee762901434f\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-l7mgf"
Jul 07 17:37:35.058076 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:35.057984    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfsx5\" (UniqueName: \"kubernetes.io/projected/c5ba8132-627a-4818-bc23-ee762901434f-kube-api-access-tfsx5\") pod \"migrator-d57d58cc9-l7mgf\" (UID: \"c5ba8132-627a-4818-bc23-ee762901434f\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-l7mgf"
Jul 07 17:37:35.066187 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:35.066157    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:35.066516 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:35.066494    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfsx5\" (UniqueName: \"kubernetes.io/projected/c5ba8132-627a-4818-bc23-ee762901434f-kube-api-access-tfsx5\") pod \"migrator-d57d58cc9-l7mgf\" (UID: \"c5ba8132-627a-4818-bc23-ee762901434f\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-l7mgf"
Jul 07 17:37:35.083258 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:35.083230    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-l7mgf"
Jul 07 17:37:35.144571 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:35.144121    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:35.220088 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:35.220058    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-l7mgf"]
Jul 07 17:37:35.223016 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:37:35.222991    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5ba8132_627a_4818_bc23_ee762901434f.slice/crio-7ac9ad283b2f2b786a2db09f8f2fb58a131b02943e8b7066d06549fbe638f9ca WatchSource:0}: Error finding container 7ac9ad283b2f2b786a2db09f8f2fb58a131b02943e8b7066d06549fbe638f9ca: Status 404 returned error can't find the container with id 7ac9ad283b2f2b786a2db09f8f2fb58a131b02943e8b7066d06549fbe638f9ca
Jul 07 17:37:35.346162 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:35.346068    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-l7mgf" event={"ID":"c5ba8132-627a-4818-bc23-ee762901434f","Type":"ContainerStarted","Data":"7ac9ad283b2f2b786a2db09f8f2fb58a131b02943e8b7066d06549fbe638f9ca"}
Jul 07 17:37:35.492675 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:35.492639    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:35.547895 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:35.547863    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:35.784220 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:35.784183    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:35.848684 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:35.848653    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:35.866800 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:35.866768    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ad442bfc-df96-4c50-a0f1-28c1adf66895-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-brl7n\" (UID: \"ad442bfc-df96-4c50-a0f1-28c1adf66895\") " pod="openshift-insights/insights-runtime-extractor-brl7n"
Jul 07 17:37:35.866926 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:35.866840    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ad442bfc-df96-4c50-a0f1-28c1adf66895-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-brl7n\" (UID: \"ad442bfc-df96-4c50-a0f1-28c1adf66895\") " pod="openshift-insights/insights-runtime-extractor-brl7n"
Jul 07 17:37:35.866926 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:35.866918    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 17:37:35.867020 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:35.866921    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 17:37:35.867020 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:35.867007    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad442bfc-df96-4c50-a0f1-28c1adf66895-kube-rbac-proxy-cm podName:ad442bfc-df96-4c50-a0f1-28c1adf66895 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:37.866990183 +0000 UTC m=+57.382220497 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ad442bfc-df96-4c50-a0f1-28c1adf66895-kube-rbac-proxy-cm") pod "insights-runtime-extractor-brl7n" (UID: "ad442bfc-df96-4c50-a0f1-28c1adf66895") : configmap "kube-rbac-proxy" not found
Jul 07 17:37:35.867092 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:35.867024    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad442bfc-df96-4c50-a0f1-28c1adf66895-insights-runtime-extractor-tls podName:ad442bfc-df96-4c50-a0f1-28c1adf66895 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:37.867016269 +0000 UTC m=+57.382246583 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ad442bfc-df96-4c50-a0f1-28c1adf66895-insights-runtime-extractor-tls") pod "insights-runtime-extractor-brl7n" (UID: "ad442bfc-df96-4c50-a0f1-28c1adf66895") : secret "insights-runtime-extractor-tls" not found
Jul 07 17:37:36.105778 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:36.105706    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hwbkw_9a0fe013-4d37-461e-a883-7889017895c0/dns-node-resolver/0.log"
Jul 07 17:37:37.305553 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:37.305524    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rn66n_0fe8e6ad-d639-4924-807d-8893d085d71c/node-ca/0.log"
Jul 07 17:37:37.353070 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:37.352971    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-l7mgf" event={"ID":"c5ba8132-627a-4818-bc23-ee762901434f","Type":"ContainerStarted","Data":"2e3485d4de34b676f7acfa407564853ba83b21654d53372ec86ab79796a7f12f"}
Jul 07 17:37:37.353070 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:37.353062    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-l7mgf" event={"ID":"c5ba8132-627a-4818-bc23-ee762901434f","Type":"ContainerStarted","Data":"d26a6c39b03ac03993cae7a44d1b960da41ea160da5b3fb6513ae61a4cd51eb2"}
Jul 07 17:37:37.370170 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:37.370122    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-l7mgf" podStartSLOduration=1.5042760099999999 podStartE2EDuration="3.370107938s" totalImagesPullingTime="1.865831928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:37:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:37.369376961 +0000 UTC m=+56.884607297" watchObservedRunningTime="2026-07-07 17:37:37.370107938 +0000 UTC m=+56.885338274"
Jul 07 17:37:37.380819 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:37.380788    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c349ce7-0bb4-42be-bccc-ec6129edb764-service-ca-bundle\") pod \"router-default-75f79f56bf-jktn5\" (UID: \"9c349ce7-0bb4-42be-bccc-ec6129edb764\") " pod="openshift-ingress/router-default-75f79f56bf-jktn5"
Jul 07 17:37:37.380935 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:37.380903    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c349ce7-0bb4-42be-bccc-ec6129edb764-metrics-certs\") pod \"router-default-75f79f56bf-jktn5\" (UID: \"9c349ce7-0bb4-42be-bccc-ec6129edb764\") " pod="openshift-ingress/router-default-75f79f56bf-jktn5"
Jul 07 17:37:37.381033 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:37.380973    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c349ce7-0bb4-42be-bccc-ec6129edb764-service-ca-bundle podName:9c349ce7-0bb4-42be-bccc-ec6129edb764 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:45.380934003 +0000 UTC m=+64.896164334 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9c349ce7-0bb4-42be-bccc-ec6129edb764-service-ca-bundle") pod "router-default-75f79f56bf-jktn5" (UID: "9c349ce7-0bb4-42be-bccc-ec6129edb764") : configmap references non-existent config key: service-ca.crt
Jul 07 17:37:37.381108 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:37.381048    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 17:37:37.381151 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:37.381108    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c349ce7-0bb4-42be-bccc-ec6129edb764-metrics-certs podName:9c349ce7-0bb4-42be-bccc-ec6129edb764 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:45.38109255 +0000 UTC m=+64.896322879 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c349ce7-0bb4-42be-bccc-ec6129edb764-metrics-certs") pod "router-default-75f79f56bf-jktn5" (UID: "9c349ce7-0bb4-42be-bccc-ec6129edb764") : secret "router-metrics-certs-default" not found
Jul 07 17:37:37.406632 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:37.406605    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:37.481559 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:37.481524    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe704914-04b6-4b82-8584-2d0aaf910194-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mspls\" (UID: \"fe704914-04b6-4b82-8584-2d0aaf910194\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mspls"
Jul 07 17:37:37.481688 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:37.481656    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/afebc539-17cc-4174-8c80-499c0e3652d3-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-9gvhn\" (UID: \"afebc539-17cc-4174-8c80-499c0e3652d3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9gvhn"
Jul 07 17:37:37.481738 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:37.481682    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 17:37:37.481772 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:37.481737    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 17:37:37.481772 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:37.481754    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe704914-04b6-4b82-8584-2d0aaf910194-samples-operator-tls podName:fe704914-04b6-4b82-8584-2d0aaf910194 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:45.48173534 +0000 UTC m=+64.996965657 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fe704914-04b6-4b82-8584-2d0aaf910194-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mspls" (UID: "fe704914-04b6-4b82-8584-2d0aaf910194") : secret "samples-operator-tls" not found
Jul 07 17:37:37.481772 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:37.481772    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afebc539-17cc-4174-8c80-499c0e3652d3-networking-console-plugin-cert podName:afebc539-17cc-4174-8c80-499c0e3652d3 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:45.481761724 +0000 UTC m=+64.996992038 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/afebc539-17cc-4174-8c80-499c0e3652d3-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-9gvhn" (UID: "afebc539-17cc-4174-8c80-499c0e3652d3") : secret "networking-console-plugin-cert" not found
Jul 07 17:37:37.510216 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:37.510187    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:37.885569 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:37.885529    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ad442bfc-df96-4c50-a0f1-28c1adf66895-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-brl7n\" (UID: \"ad442bfc-df96-4c50-a0f1-28c1adf66895\") " pod="openshift-insights/insights-runtime-extractor-brl7n"
Jul 07 17:37:37.885788 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:37.885634    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ad442bfc-df96-4c50-a0f1-28c1adf66895-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-brl7n\" (UID: \"ad442bfc-df96-4c50-a0f1-28c1adf66895\") " pod="openshift-insights/insights-runtime-extractor-brl7n"
Jul 07 17:37:37.885788 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:37.885677    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 17:37:37.885788 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:37.885733    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 17:37:37.885788 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:37.885771    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad442bfc-df96-4c50-a0f1-28c1adf66895-kube-rbac-proxy-cm podName:ad442bfc-df96-4c50-a0f1-28c1adf66895 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:41.885750444 +0000 UTC m=+61.400980767 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ad442bfc-df96-4c50-a0f1-28c1adf66895-kube-rbac-proxy-cm") pod "insights-runtime-extractor-brl7n" (UID: "ad442bfc-df96-4c50-a0f1-28c1adf66895") : configmap "kube-rbac-proxy" not found
Jul 07 17:37:37.885788 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:37.885791    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad442bfc-df96-4c50-a0f1-28c1adf66895-insights-runtime-extractor-tls podName:ad442bfc-df96-4c50-a0f1-28c1adf66895 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:41.885782115 +0000 UTC m=+61.401012432 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ad442bfc-df96-4c50-a0f1-28c1adf66895-insights-runtime-extractor-tls") pod "insights-runtime-extractor-brl7n" (UID: "ad442bfc-df96-4c50-a0f1-28c1adf66895") : secret "insights-runtime-extractor-tls" not found
Jul 07 17:37:37.905916 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:37.905890    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pbgbb_26673412-89bb-4709-99d3-938900fbb332/serve-healthcheck-canary/0.log"
Jul 07 17:37:38.186301 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:38.186227    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:38.836806 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:38.836772    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:38.978688 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:38.978649    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:39.079713 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:39.079673    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:39.180018 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:39.179985    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:39.330860 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:39.330826    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:39.528895 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:39.528812    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:40.527925 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:40.527890    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:40.928103 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:40.928068    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:41.130782 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:41.130751    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:41.327467 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:41.327379    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:41.522218 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:41.522184    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:41.922772 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:41.922717    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ad442bfc-df96-4c50-a0f1-28c1adf66895-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-brl7n\" (UID: \"ad442bfc-df96-4c50-a0f1-28c1adf66895\") " pod="openshift-insights/insights-runtime-extractor-brl7n"
Jul 07 17:37:41.923205 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:41.922804    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ad442bfc-df96-4c50-a0f1-28c1adf66895-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-brl7n\" (UID: \"ad442bfc-df96-4c50-a0f1-28c1adf66895\") " pod="openshift-insights/insights-runtime-extractor-brl7n"
Jul 07 17:37:41.923205 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:41.922878    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 17:37:41.923205 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:41.922881    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 17:37:41.923205 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:41.922949    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad442bfc-df96-4c50-a0f1-28c1adf66895-insights-runtime-extractor-tls podName:ad442bfc-df96-4c50-a0f1-28c1adf66895 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:49.922929578 +0000 UTC m=+69.438159897 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ad442bfc-df96-4c50-a0f1-28c1adf66895-insights-runtime-extractor-tls") pod "insights-runtime-extractor-brl7n" (UID: "ad442bfc-df96-4c50-a0f1-28c1adf66895") : secret "insights-runtime-extractor-tls" not found
Jul 07 17:37:41.923205 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:41.922992    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad442bfc-df96-4c50-a0f1-28c1adf66895-kube-rbac-proxy-cm podName:ad442bfc-df96-4c50-a0f1-28c1adf66895 nodeName:}" failed. No retries permitted until 2026-07-07 17:37:49.922982548 +0000 UTC m=+69.438212865 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ad442bfc-df96-4c50-a0f1-28c1adf66895-kube-rbac-proxy-cm") pod "insights-runtime-extractor-brl7n" (UID: "ad442bfc-df96-4c50-a0f1-28c1adf66895") : configmap "kube-rbac-proxy" not found
Jul 07 17:37:42.080947 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:42.080912    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:42.181277 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:42.181204    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:42.284760 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:42.284735    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8s7h4"
Jul 07 17:37:42.519826 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:42.519749    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:42.583598 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:42.583571    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:42.720902 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:42.720866    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:42.779761 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:42.779694    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:43.123812 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:43.123780    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:43.318359 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:43.318330    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:43.991542 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:43.991504    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:44.521878 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:44.521847    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:44.722010 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:44.721973    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:44.943383 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:44.943344    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:45.313181 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:45.313095    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:45.368713 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:45.368685    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:45.456545 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:45.456489    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c349ce7-0bb4-42be-bccc-ec6129edb764-metrics-certs\") pod \"router-default-75f79f56bf-jktn5\" (UID: \"9c349ce7-0bb4-42be-bccc-ec6129edb764\") " pod="openshift-ingress/router-default-75f79f56bf-jktn5"
Jul 07 17:37:45.456735 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:45.456614    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c349ce7-0bb4-42be-bccc-ec6129edb764-service-ca-bundle\") pod \"router-default-75f79f56bf-jktn5\" (UID: \"9c349ce7-0bb4-42be-bccc-ec6129edb764\") " pod="openshift-ingress/router-default-75f79f56bf-jktn5"
Jul 07 17:37:45.457271 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:45.457253    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c349ce7-0bb4-42be-bccc-ec6129edb764-service-ca-bundle\") pod \"router-default-75f79f56bf-jktn5\" (UID: \"9c349ce7-0bb4-42be-bccc-ec6129edb764\") " pod="openshift-ingress/router-default-75f79f56bf-jktn5"
Jul 07 17:37:45.459061 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:45.459042    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c349ce7-0bb4-42be-bccc-ec6129edb764-metrics-certs\") pod \"router-default-75f79f56bf-jktn5\" (UID: \"9c349ce7-0bb4-42be-bccc-ec6129edb764\") " pod="openshift-ingress/router-default-75f79f56bf-jktn5"
Jul 07 17:37:45.508160 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:45.508129    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ngq2g\""
Jul 07 17:37:45.517115 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:45.517088    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-75f79f56bf-jktn5"
Jul 07 17:37:45.558045 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:45.558007    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/afebc539-17cc-4174-8c80-499c0e3652d3-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-9gvhn\" (UID: \"afebc539-17cc-4174-8c80-499c0e3652d3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9gvhn"
Jul 07 17:37:45.558510 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:45.558109    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe704914-04b6-4b82-8584-2d0aaf910194-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mspls\" (UID: \"fe704914-04b6-4b82-8584-2d0aaf910194\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mspls"
Jul 07 17:37:45.558510 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:45.558162    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 17:37:45.558510 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:37:45.558230    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/afebc539-17cc-4174-8c80-499c0e3652d3-networking-console-plugin-cert podName:afebc539-17cc-4174-8c80-499c0e3652d3 nodeName:}" failed. No retries permitted until 2026-07-07 17:38:01.55821488 +0000 UTC m=+81.073445194 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/afebc539-17cc-4174-8c80-499c0e3652d3-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-9gvhn" (UID: "afebc539-17cc-4174-8c80-499c0e3652d3") : secret "networking-console-plugin-cert" not found
Jul 07 17:37:45.560806 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:45.560775    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe704914-04b6-4b82-8584-2d0aaf910194-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mspls\" (UID: \"fe704914-04b6-4b82-8584-2d0aaf910194\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mspls"
Jul 07 17:37:45.606564 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:45.606532    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-brl7n\""
Jul 07 17:37:45.615133 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:45.615084    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mspls"
Jul 07 17:37:45.651692 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:45.651663    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-75f79f56bf-jktn5"]
Jul 07 17:37:45.654092 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:37:45.654046    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c349ce7_0bb4_42be_bccc_ec6129edb764.slice/crio-c4837f920daeaf895a55c5cc8e3956e6a63b0080a09687747d452447d952f40c WatchSource:0}: Error finding container c4837f920daeaf895a55c5cc8e3956e6a63b0080a09687747d452447d952f40c: Status 404 returned error can't find the container with id c4837f920daeaf895a55c5cc8e3956e6a63b0080a09687747d452447d952f40c
Jul 07 17:37:45.748555 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:45.748520    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mspls"]
Jul 07 17:37:46.124160 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:46.124123    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:46.320999 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:46.320945    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:46.379676 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:46.379587    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mspls" event={"ID":"fe704914-04b6-4b82-8584-2d0aaf910194","Type":"ContainerStarted","Data":"2d6a54efbe4c0b2c0ca740b881ea1bb8a87c7bc079d2fdb7bc410891ea90f936"}
Jul 07 17:37:46.380906 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:46.380880    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-75f79f56bf-jktn5" event={"ID":"9c349ce7-0bb4-42be-bccc-ec6129edb764","Type":"ContainerStarted","Data":"acf3251c782e8884dd2c9c1f043cc5a8c38c57874585f937672e05808f0f5e8e"}
Jul 07 17:37:46.381044 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:46.380923    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-75f79f56bf-jktn5" event={"ID":"9c349ce7-0bb4-42be-bccc-ec6129edb764","Type":"ContainerStarted","Data":"c4837f920daeaf895a55c5cc8e3956e6a63b0080a09687747d452447d952f40c"}
Jul 07 17:37:46.399866 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:46.399811    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-75f79f56bf-jktn5" podStartSLOduration=17.399794478 podStartE2EDuration="17.399794478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:37:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:46.399175271 +0000 UTC m=+65.914405608" watchObservedRunningTime="2026-07-07 17:37:46.399794478 +0000 UTC m=+65.915024792"
Jul 07 17:37:46.518044 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:46.518007    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-75f79f56bf-jktn5"
Jul 07 17:37:46.521153 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:46.521127    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-75f79f56bf-jktn5"
Jul 07 17:37:46.725327 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:46.725242    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:46.767623 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:46.767584    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8eb6fe4b-fba4-4c80-b328-93ff6b880816-original-pull-secret\") pod \"global-pull-secret-syncer-5r9p6\" (UID: \"8eb6fe4b-fba4-4c80-b328-93ff6b880816\") " pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:37:46.767825 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:46.767651    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14607182-3f75-4121-b763-1acf8e7e3c4c-metrics-certs\") pod \"network-metrics-daemon-ltf2l\" (UID: \"14607182-3f75-4121-b763-1acf8e7e3c4c\") " pod="openshift-multus/network-metrics-daemon-ltf2l"
Jul 07 17:37:46.770110 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:46.770081    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 17:37:46.770233 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:46.770114    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 17:37:46.780889 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:46.780860    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8eb6fe4b-fba4-4c80-b328-93ff6b880816-original-pull-secret\") pod \"global-pull-secret-syncer-5r9p6\" (UID: \"8eb6fe4b-fba4-4c80-b328-93ff6b880816\") " pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:37:46.782335 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:46.782312    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14607182-3f75-4121-b763-1acf8e7e3c4c-metrics-certs\") pod \"network-metrics-daemon-ltf2l\" (UID: \"14607182-3f75-4121-b763-1acf8e7e3c4c\") " pod="openshift-multus/network-metrics-daemon-ltf2l"
Jul 07 17:37:46.868706 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:46.868669    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7v4n\" (UniqueName: \"kubernetes.io/projected/3c7b7842-ac7e-4d39-9f7d-02b994a8f075-kube-api-access-h7v4n\") pod \"network-check-target-vzqgz\" (UID: \"3c7b7842-ac7e-4d39-9f7d-02b994a8f075\") " pod="openshift-network-diagnostics/network-check-target-vzqgz"
Jul 07 17:37:46.871633 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:46.871604    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7v4n\" (UniqueName: \"kubernetes.io/projected/3c7b7842-ac7e-4d39-9f7d-02b994a8f075-kube-api-access-h7v4n\") pod \"network-check-target-vzqgz\" (UID: \"3c7b7842-ac7e-4d39-9f7d-02b994a8f075\") " pod="openshift-network-diagnostics/network-check-target-vzqgz"
Jul 07 17:37:46.915601 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:46.915570    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f7nks\""
Jul 07 17:37:46.922091 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:46.922066    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5r9p6"
Jul 07 17:37:46.923215 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:46.923192    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:46.924000 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:46.923983    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vzqgz"
Jul 07 17:37:46.931223 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:46.931203    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pkhdg\""
Jul 07 17:37:46.940147 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:46.940122    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ltf2l"
Jul 07 17:37:47.090978 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:47.090816    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5r9p6"]
Jul 07 17:37:47.096180 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:37:47.096128    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eb6fe4b_fba4_4c80_b328_93ff6b880816.slice/crio-3aadf3bc00762424544a7d6a507db47f719d7def227e57341e3ad6b5fc64183e WatchSource:0}: Error finding container 3aadf3bc00762424544a7d6a507db47f719d7def227e57341e3ad6b5fc64183e: Status 404 returned error can't find the container with id 3aadf3bc00762424544a7d6a507db47f719d7def227e57341e3ad6b5fc64183e
Jul 07 17:37:47.113723 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:47.113691    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vzqgz"]
Jul 07 17:37:47.117782 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:37:47.117754    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c7b7842_ac7e_4d39_9f7d_02b994a8f075.slice/crio-0e4ef068b266e38fbcc1cf93cd654225ea7088726295a3911bfa48b3d6884d47 WatchSource:0}: Error finding container 0e4ef068b266e38fbcc1cf93cd654225ea7088726295a3911bfa48b3d6884d47: Status 404 returned error can't find the container with id 0e4ef068b266e38fbcc1cf93cd654225ea7088726295a3911bfa48b3d6884d47
Jul 07 17:37:47.146907 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:47.146873    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ltf2l"]
Jul 07 17:37:47.152040 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:37:47.152005    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14607182_3f75_4121_b763_1acf8e7e3c4c.slice/crio-0a5fc0eec79ce086b5beb8698e41bd141bc4e7dcbb928e5a869aee03ee272e16 WatchSource:0}: Error finding container 0a5fc0eec79ce086b5beb8698e41bd141bc4e7dcbb928e5a869aee03ee272e16: Status 404 returned error can't find the container with id 0a5fc0eec79ce086b5beb8698e41bd141bc4e7dcbb928e5a869aee03ee272e16
Jul 07 17:37:47.290353 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:47.290274    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:47.347009 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:47.346973    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:47.387880 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:47.387841    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vzqgz" event={"ID":"3c7b7842-ac7e-4d39-9f7d-02b994a8f075","Type":"ContainerStarted","Data":"714ef89661abee702f163ec6dc28930bea6db307a833ab8a4110860167526594"}
Jul 07 17:37:47.388101 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:47.387902    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vzqgz" event={"ID":"3c7b7842-ac7e-4d39-9f7d-02b994a8f075","Type":"ContainerStarted","Data":"0e4ef068b266e38fbcc1cf93cd654225ea7088726295a3911bfa48b3d6884d47"}
Jul 07 17:37:47.388101 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:47.387928    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vzqgz"
Jul 07 17:37:47.388994 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:47.388926    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ltf2l" event={"ID":"14607182-3f75-4121-b763-1acf8e7e3c4c","Type":"ContainerStarted","Data":"0a5fc0eec79ce086b5beb8698e41bd141bc4e7dcbb928e5a869aee03ee272e16"}
Jul 07 17:37:47.393787 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:47.393736    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5r9p6" event={"ID":"8eb6fe4b-fba4-4c80-b328-93ff6b880816","Type":"ContainerStarted","Data":"3aadf3bc00762424544a7d6a507db47f719d7def227e57341e3ad6b5fc64183e"}
Jul 07 17:37:47.394138 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:47.394113    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-75f79f56bf-jktn5"
Jul 07 17:37:47.395393 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:47.395369    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-75f79f56bf-jktn5"
Jul 07 17:37:47.403359 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:47.403300    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vzqgz" podStartSLOduration=66.403285718 podStartE2EDuration="1m6.403285718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:36:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:47.402085289 +0000 UTC m=+66.917315627" watchObservedRunningTime="2026-07-07 17:37:47.403285718 +0000 UTC m=+66.918516054"
Jul 07 17:37:47.775635 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:47.775600    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/704699f9-7e17-4a8b-a4df-7259aed03300-metrics-tls\") pod \"dns-default-8mj9d\" (UID: \"704699f9-7e17-4a8b-a4df-7259aed03300\") " pod="openshift-dns/dns-default-8mj9d"
Jul 07 17:37:47.778367 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:47.778345    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/704699f9-7e17-4a8b-a4df-7259aed03300-metrics-tls\") pod \"dns-default-8mj9d\" (UID: \"704699f9-7e17-4a8b-a4df-7259aed03300\") " pod="openshift-dns/dns-default-8mj9d"
Jul 07 17:37:47.941887 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:47.941819    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:48.014259 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:48.014225    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2vm2m\""
Jul 07 17:37:48.022062 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:48.022026    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8mj9d"
Jul 07 17:37:48.528941 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:48.528905    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:48.768661 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:48.768570    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:48.866182 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:48.866152    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8mj9d"]
Jul 07 17:37:48.875425 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:37:48.875348    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod704699f9_7e17_4a8b_a4df_7259aed03300.slice/crio-9ad5032ab21bcce01bdb271dd50b8b365bcf1eb8a97de85c190e4ee067328624 WatchSource:0}: Error finding container 9ad5032ab21bcce01bdb271dd50b8b365bcf1eb8a97de85c190e4ee067328624: Status 404 returned error can't find the container with id 9ad5032ab21bcce01bdb271dd50b8b365bcf1eb8a97de85c190e4ee067328624
Jul 07 17:37:49.123209 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:49.123173    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:49.321852 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:49.321821    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:49.404355 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:49.404257    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ltf2l" event={"ID":"14607182-3f75-4121-b763-1acf8e7e3c4c","Type":"ContainerStarted","Data":"707e79380d3bdcf620aeb5d1d6c483ee640c03b64bfe83840c5b127b1fa60785"}
Jul 07 17:37:49.404355 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:49.404329    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ltf2l" event={"ID":"14607182-3f75-4121-b763-1acf8e7e3c4c","Type":"ContainerStarted","Data":"be59a57bfdd2cf727a27c52d7fbb8134c4e03223aa56c77b0549b08639dcf6a2"}
Jul 07 17:37:49.406408 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:49.406376    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mspls" event={"ID":"fe704914-04b6-4b82-8584-2d0aaf910194","Type":"ContainerStarted","Data":"4514cf4e14614267b482fcbb35a476569a824d311a2cc5dbc026170d9bbdce4e"}
Jul 07 17:37:49.406557 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:49.406438    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mspls" event={"ID":"fe704914-04b6-4b82-8584-2d0aaf910194","Type":"ContainerStarted","Data":"0067f3d644298d90464f91fbf08eeae5168a01af54a5807b99cb32276e0033b2"}
Jul 07 17:37:49.409015 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:49.408589    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8mj9d" event={"ID":"704699f9-7e17-4a8b-a4df-7259aed03300","Type":"ContainerStarted","Data":"9ad5032ab21bcce01bdb271dd50b8b365bcf1eb8a97de85c190e4ee067328624"}
Jul 07 17:37:49.420859 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:49.420808    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ltf2l" podStartSLOduration=66.865048362 podStartE2EDuration="1m8.42078687s" totalImagesPullingTime="1.555738508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:49.420404464 +0000 UTC m=+68.935634801" watchObservedRunningTime="2026-07-07 17:37:49.42078687 +0000 UTC m=+68.936017207"
Jul 07 17:37:49.438015 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:49.437901    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mspls" podStartSLOduration=17.519215851 podStartE2EDuration="20.437874638s" totalImagesPullingTime="2.918658787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:37:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:49.436896264 +0000 UTC m=+68.952126613" watchObservedRunningTime="2026-07-07 17:37:49.437874638 +0000 UTC m=+68.953104975"
Jul 07 17:37:49.523451 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:49.523419    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:49.668280 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:49.668176    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:49.997374 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:49.997276    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ad442bfc-df96-4c50-a0f1-28c1adf66895-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-brl7n\" (UID: \"ad442bfc-df96-4c50-a0f1-28c1adf66895\") " pod="openshift-insights/insights-runtime-extractor-brl7n"
Jul 07 17:37:49.997839 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:49.997361    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ad442bfc-df96-4c50-a0f1-28c1adf66895-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-brl7n\" (UID: \"ad442bfc-df96-4c50-a0f1-28c1adf66895\") " pod="openshift-insights/insights-runtime-extractor-brl7n"
Jul 07 17:37:49.998384 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:49.998360    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ad442bfc-df96-4c50-a0f1-28c1adf66895-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-brl7n\" (UID: \"ad442bfc-df96-4c50-a0f1-28c1adf66895\") " pod="openshift-insights/insights-runtime-extractor-brl7n"
Jul 07 17:37:50.001139 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:50.001104    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ad442bfc-df96-4c50-a0f1-28c1adf66895-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-brl7n\" (UID: \"ad442bfc-df96-4c50-a0f1-28c1adf66895\") " pod="openshift-insights/insights-runtime-extractor-brl7n"
Jul 07 17:37:50.011547 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:50.011511    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7mx9j\""
Jul 07 17:37:50.019540 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:50.019510    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-brl7n"
Jul 07 17:37:50.939372 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:50.939316    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:51.058796 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:51.058747    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:51.686989 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:51.683379    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-brl7n"]
Jul 07 17:37:51.688651 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:37:51.688614    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad442bfc_df96_4c50_a0f1_28c1adf66895.slice/crio-62bdeb3349a8057b7e9dc04833c192612fabe5c0b1f5263b7dbabc675ff10f8b WatchSource:0}: Error finding container 62bdeb3349a8057b7e9dc04833c192612fabe5c0b1f5263b7dbabc675ff10f8b: Status 404 returned error can't find the container with id 62bdeb3349a8057b7e9dc04833c192612fabe5c0b1f5263b7dbabc675ff10f8b
Jul 07 17:37:52.209420 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:52.209354    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:52.310546 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:52.310508    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:52.425689 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:52.425652    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5r9p6" event={"ID":"8eb6fe4b-fba4-4c80-b328-93ff6b880816","Type":"ContainerStarted","Data":"6edff76848c5021cd5c78994d8e7222e6ac46c5431c34701ec282a0f014f2a54"}
Jul 07 17:37:52.429354 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:52.429325    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8mj9d" event={"ID":"704699f9-7e17-4a8b-a4df-7259aed03300","Type":"ContainerStarted","Data":"2563914c01d10b17ee3198086ebdd9a658526d438d5dbd188e0998d2149df08b"}
Jul 07 17:37:52.429493 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:52.429377    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8mj9d" event={"ID":"704699f9-7e17-4a8b-a4df-7259aed03300","Type":"ContainerStarted","Data":"8a7aa82ea4314a13ea5af6c34e6825380b376d32cb0634cfb606fc7641c61761"}
Jul 07 17:37:52.429922 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:52.429880    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8mj9d"
Jul 07 17:37:52.431479 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:52.431455    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-brl7n" event={"ID":"ad442bfc-df96-4c50-a0f1-28c1adf66895","Type":"ContainerStarted","Data":"62bdeb3349a8057b7e9dc04833c192612fabe5c0b1f5263b7dbabc675ff10f8b"}
Jul 07 17:37:52.442362 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:52.442324    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:52.463652 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:52.463521    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8mj9d" podStartSLOduration=34.806241772999996 podStartE2EDuration="37.463497357s" totalImagesPullingTime="2.657255584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:52.462091414 +0000 UTC m=+71.977321751" watchObservedRunningTime="2026-07-07 17:37:52.463497357 +0000 UTC m=+71.978727694"
Jul 07 17:37:52.463899 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:52.463865    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5r9p6" podStartSLOduration=67.02301364 podStartE2EDuration="1m11.463853351s" totalImagesPullingTime="4.440839711s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:52.443071115 +0000 UTC m=+71.958301450" watchObservedRunningTime="2026-07-07 17:37:52.463853351 +0000 UTC m=+71.979083669"
Jul 07 17:37:52.699336 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:52.699272    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:52.879691 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:52.879654    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:52.953884 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:52.953849    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:53.274786 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:53.274706    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:53.337400 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:53.337354    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:53.509034 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:53.508971    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:53.584318 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:53.584242    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:54.153100 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:54.153063    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:54.283773 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:54.283702    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:54.384003 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:54.383950    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:55.376675 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:55.376637    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:55.433022 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:55.432977    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:55.499677 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:55.499648    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:55.599451 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:55.599411    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:56.448581 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:56.448547    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-brl7n" event={"ID":"ad442bfc-df96-4c50-a0f1-28c1adf66895","Type":"ContainerStarted","Data":"a21825dd2f8444d565e76b0d2392c37578d034d2dd1fbffb306416ab1e82cc88"}
Jul 07 17:37:56.448984 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:56.448629    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-brl7n" event={"ID":"ad442bfc-df96-4c50-a0f1-28c1adf66895","Type":"ContainerStarted","Data":"cd2ef29857854b4782355757abe7f77a0b37ab9fafe027b18b63d3907d4f657d"}
Jul 07 17:37:57.189596 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.189564    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-xjgss"]
Jul 07 17:37:57.192642 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.192619    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-xjgss"
Jul 07 17:37:57.195117 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.194949    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-5r5p6\""
Jul 07 17:37:57.195117 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.194986    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 07 17:37:57.195282 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.195120    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 07 17:37:57.205487 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.205462    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-xjgss"]
Jul 07 17:37:57.245117 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.245080    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6bd74b6444-5kgbr"]
Jul 07 17:37:57.248209 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.248183    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bd74b6444-5kgbr"
Jul 07 17:37:57.251984 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.251945    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 17:37:57.252108 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.252038    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 17:37:57.252267 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.252249    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 17:37:57.252372 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.252300    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hdmrj\""
Jul 07 17:37:57.255336 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.255312    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57l6d\" (UniqueName: \"kubernetes.io/projected/c5896898-42be-4d32-86cf-12af1377ee5f-kube-api-access-57l6d\") pod \"downloads-685bfb5f64-xjgss\" (UID: \"c5896898-42be-4d32-86cf-12af1377ee5f\") " pod="openshift-console/downloads-685bfb5f64-xjgss"
Jul 07 17:37:57.269857 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.269831    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bd74b6444-5kgbr"]
Jul 07 17:37:57.270392 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.270373    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 17:37:57.325048 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.325003    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:57.355705 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.355667    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/171b9a5c-37f2-446b-8c0e-a2417516e3b8-installation-pull-secrets\") pod \"image-registry-6bd74b6444-5kgbr\" (UID: \"171b9a5c-37f2-446b-8c0e-a2417516e3b8\") " pod="openshift-image-registry/image-registry-6bd74b6444-5kgbr"
Jul 07 17:37:57.355885 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.355712    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/171b9a5c-37f2-446b-8c0e-a2417516e3b8-ca-trust-extracted\") pod \"image-registry-6bd74b6444-5kgbr\" (UID: \"171b9a5c-37f2-446b-8c0e-a2417516e3b8\") " pod="openshift-image-registry/image-registry-6bd74b6444-5kgbr"
Jul 07 17:37:57.355885 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.355776    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/171b9a5c-37f2-446b-8c0e-a2417516e3b8-registry-certificates\") pod \"image-registry-6bd74b6444-5kgbr\" (UID: \"171b9a5c-37f2-446b-8c0e-a2417516e3b8\") " pod="openshift-image-registry/image-registry-6bd74b6444-5kgbr"
Jul 07 17:37:57.355885 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.355803    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57l6d\" (UniqueName: \"kubernetes.io/projected/c5896898-42be-4d32-86cf-12af1377ee5f-kube-api-access-57l6d\") pod \"downloads-685bfb5f64-xjgss\" (UID: \"c5896898-42be-4d32-86cf-12af1377ee5f\") " pod="openshift-console/downloads-685bfb5f64-xjgss"
Jul 07 17:37:57.355885 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.355857    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/171b9a5c-37f2-446b-8c0e-a2417516e3b8-bound-sa-token\") pod \"image-registry-6bd74b6444-5kgbr\" (UID: \"171b9a5c-37f2-446b-8c0e-a2417516e3b8\") " pod="openshift-image-registry/image-registry-6bd74b6444-5kgbr"
Jul 07 17:37:57.356139 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.355907    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/171b9a5c-37f2-446b-8c0e-a2417516e3b8-registry-tls\") pod \"image-registry-6bd74b6444-5kgbr\" (UID: \"171b9a5c-37f2-446b-8c0e-a2417516e3b8\") " pod="openshift-image-registry/image-registry-6bd74b6444-5kgbr"
Jul 07 17:37:57.356139 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.355944    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj6jz\" (UniqueName: \"kubernetes.io/projected/171b9a5c-37f2-446b-8c0e-a2417516e3b8-kube-api-access-kj6jz\") pod \"image-registry-6bd74b6444-5kgbr\" (UID: \"171b9a5c-37f2-446b-8c0e-a2417516e3b8\") " pod="openshift-image-registry/image-registry-6bd74b6444-5kgbr"
Jul 07 17:37:57.356139 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.355985    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/171b9a5c-37f2-446b-8c0e-a2417516e3b8-image-registry-private-configuration\") pod \"image-registry-6bd74b6444-5kgbr\" (UID: \"171b9a5c-37f2-446b-8c0e-a2417516e3b8\") " pod="openshift-image-registry/image-registry-6bd74b6444-5kgbr"
Jul 07 17:37:57.356139 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.356017    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/171b9a5c-37f2-446b-8c0e-a2417516e3b8-trusted-ca\") pod \"image-registry-6bd74b6444-5kgbr\" (UID: \"171b9a5c-37f2-446b-8c0e-a2417516e3b8\") " pod="openshift-image-registry/image-registry-6bd74b6444-5kgbr"
Jul 07 17:37:57.370369 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.370332    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57l6d\" (UniqueName: \"kubernetes.io/projected/c5896898-42be-4d32-86cf-12af1377ee5f-kube-api-access-57l6d\") pod \"downloads-685bfb5f64-xjgss\" (UID: \"c5896898-42be-4d32-86cf-12af1377ee5f\") " pod="openshift-console/downloads-685bfb5f64-xjgss"
Jul 07 17:37:57.404295 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.404170    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:57.456739 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.456699    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/171b9a5c-37f2-446b-8c0e-a2417516e3b8-bound-sa-token\") pod \"image-registry-6bd74b6444-5kgbr\" (UID: \"171b9a5c-37f2-446b-8c0e-a2417516e3b8\") " pod="openshift-image-registry/image-registry-6bd74b6444-5kgbr"
Jul 07 17:37:57.457242 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.456761    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/171b9a5c-37f2-446b-8c0e-a2417516e3b8-registry-tls\") pod \"image-registry-6bd74b6444-5kgbr\" (UID: \"171b9a5c-37f2-446b-8c0e-a2417516e3b8\") " pod="openshift-image-registry/image-registry-6bd74b6444-5kgbr"
Jul 07 17:37:57.457242 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.456794    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj6jz\" (UniqueName: \"kubernetes.io/projected/171b9a5c-37f2-446b-8c0e-a2417516e3b8-kube-api-access-kj6jz\") pod \"image-registry-6bd74b6444-5kgbr\" (UID: \"171b9a5c-37f2-446b-8c0e-a2417516e3b8\") " pod="openshift-image-registry/image-registry-6bd74b6444-5kgbr"
Jul 07 17:37:57.457242 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.456819    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/171b9a5c-37f2-446b-8c0e-a2417516e3b8-image-registry-private-configuration\") pod \"image-registry-6bd74b6444-5kgbr\" (UID: \"171b9a5c-37f2-446b-8c0e-a2417516e3b8\") " pod="openshift-image-registry/image-registry-6bd74b6444-5kgbr"
Jul 07 17:37:57.457242 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.456850    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/171b9a5c-37f2-446b-8c0e-a2417516e3b8-trusted-ca\") pod \"image-registry-6bd74b6444-5kgbr\" (UID: \"171b9a5c-37f2-446b-8c0e-a2417516e3b8\") " pod="openshift-image-registry/image-registry-6bd74b6444-5kgbr"
Jul 07 17:37:57.457242 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.456875    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/171b9a5c-37f2-446b-8c0e-a2417516e3b8-installation-pull-secrets\") pod \"image-registry-6bd74b6444-5kgbr\" (UID: \"171b9a5c-37f2-446b-8c0e-a2417516e3b8\") " pod="openshift-image-registry/image-registry-6bd74b6444-5kgbr"
Jul 07 17:37:57.457242 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.457060    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/171b9a5c-37f2-446b-8c0e-a2417516e3b8-ca-trust-extracted\") pod \"image-registry-6bd74b6444-5kgbr\" (UID: \"171b9a5c-37f2-446b-8c0e-a2417516e3b8\") " pod="openshift-image-registry/image-registry-6bd74b6444-5kgbr"
Jul 07 17:37:57.457242 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.457110    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/171b9a5c-37f2-446b-8c0e-a2417516e3b8-registry-certificates\") pod \"image-registry-6bd74b6444-5kgbr\" (UID: \"171b9a5c-37f2-446b-8c0e-a2417516e3b8\") " pod="openshift-image-registry/image-registry-6bd74b6444-5kgbr"
Jul 07 17:37:57.457615 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.457594    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/171b9a5c-37f2-446b-8c0e-a2417516e3b8-ca-trust-extracted\") pod \"image-registry-6bd74b6444-5kgbr\" (UID: \"171b9a5c-37f2-446b-8c0e-a2417516e3b8\") " pod="openshift-image-registry/image-registry-6bd74b6444-5kgbr"
Jul 07 17:37:57.457989 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.457945    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/171b9a5c-37f2-446b-8c0e-a2417516e3b8-registry-certificates\") pod \"image-registry-6bd74b6444-5kgbr\" (UID: \"171b9a5c-37f2-446b-8c0e-a2417516e3b8\") " pod="openshift-image-registry/image-registry-6bd74b6444-5kgbr"
Jul 07 17:37:57.458330 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.458282    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/171b9a5c-37f2-446b-8c0e-a2417516e3b8-trusted-ca\") pod \"image-registry-6bd74b6444-5kgbr\" (UID: \"171b9a5c-37f2-446b-8c0e-a2417516e3b8\") " pod="openshift-image-registry/image-registry-6bd74b6444-5kgbr"
Jul 07 17:37:57.459982 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.459935    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/171b9a5c-37f2-446b-8c0e-a2417516e3b8-image-registry-private-configuration\") pod \"image-registry-6bd74b6444-5kgbr\" (UID: \"171b9a5c-37f2-446b-8c0e-a2417516e3b8\") " pod="openshift-image-registry/image-registry-6bd74b6444-5kgbr"
Jul 07 17:37:57.460205 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.460184    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/171b9a5c-37f2-446b-8c0e-a2417516e3b8-installation-pull-secrets\") pod \"image-registry-6bd74b6444-5kgbr\" (UID: \"171b9a5c-37f2-446b-8c0e-a2417516e3b8\") " pod="openshift-image-registry/image-registry-6bd74b6444-5kgbr"
Jul 07 17:37:57.460484 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.460463    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/171b9a5c-37f2-446b-8c0e-a2417516e3b8-registry-tls\") pod \"image-registry-6bd74b6444-5kgbr\" (UID: \"171b9a5c-37f2-446b-8c0e-a2417516e3b8\") " pod="openshift-image-registry/image-registry-6bd74b6444-5kgbr"
Jul 07 17:37:57.466330 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.466308    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/171b9a5c-37f2-446b-8c0e-a2417516e3b8-bound-sa-token\") pod \"image-registry-6bd74b6444-5kgbr\" (UID: \"171b9a5c-37f2-446b-8c0e-a2417516e3b8\") " pod="openshift-image-registry/image-registry-6bd74b6444-5kgbr"
Jul 07 17:37:57.466588 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.466568    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj6jz\" (UniqueName: \"kubernetes.io/projected/171b9a5c-37f2-446b-8c0e-a2417516e3b8-kube-api-access-kj6jz\") pod \"image-registry-6bd74b6444-5kgbr\" (UID: \"171b9a5c-37f2-446b-8c0e-a2417516e3b8\") " pod="openshift-image-registry/image-registry-6bd74b6444-5kgbr"
Jul 07 17:37:57.475915 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.475879    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:57.509855 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.509811    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-xjgss"
Jul 07 17:37:57.559994 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.559045    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bd74b6444-5kgbr"
Jul 07 17:37:57.575880 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.575797    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:57.666582 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.666506    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-xjgss"]
Jul 07 17:37:57.670601 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:37:57.670574    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5896898_42be_4d32_86cf_12af1377ee5f.slice/crio-5cbcb0018c80e5b82edbc977ebd58efbf2adf450f75d9fe532817a639cc31f97 WatchSource:0}: Error finding container 5cbcb0018c80e5b82edbc977ebd58efbf2adf450f75d9fe532817a639cc31f97: Status 404 returned error can't find the container with id 5cbcb0018c80e5b82edbc977ebd58efbf2adf450f75d9fe532817a639cc31f97
Jul 07 17:37:57.732049 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:57.732018    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bd74b6444-5kgbr"]
Jul 07 17:37:58.457008 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:58.456966    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-xjgss" event={"ID":"c5896898-42be-4d32-86cf-12af1377ee5f","Type":"ContainerStarted","Data":"5cbcb0018c80e5b82edbc977ebd58efbf2adf450f75d9fe532817a639cc31f97"}
Jul 07 17:37:58.805409 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:37:58.805333    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod171b9a5c_37f2_446b_8c0e_a2417516e3b8.slice/crio-1ab93c715775035c31304b995fd8b7d6b2588993190c8c626ddaea43f93d7d6a WatchSource:0}: Error finding container 1ab93c715775035c31304b995fd8b7d6b2588993190c8c626ddaea43f93d7d6a: Status 404 returned error can't find the container with id 1ab93c715775035c31304b995fd8b7d6b2588993190c8c626ddaea43f93d7d6a
Jul 07 17:37:59.463888 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:59.463836    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-brl7n" event={"ID":"ad442bfc-df96-4c50-a0f1-28c1adf66895","Type":"ContainerStarted","Data":"f53266587c07a9d0db55c240ad73b799db745510f1c43bd2e21b2f9b97bb7018"}
Jul 07 17:37:59.465860 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:59.465826    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bd74b6444-5kgbr" event={"ID":"171b9a5c-37f2-446b-8c0e-a2417516e3b8","Type":"ContainerStarted","Data":"9d28ce4e817973afadfd3ffd5db17fac9c7db291c8e7cc05c854643b8bf4cdfd"}
Jul 07 17:37:59.466077 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:59.465890    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6bd74b6444-5kgbr"
Jul 07 17:37:59.466077 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:59.465907    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bd74b6444-5kgbr" event={"ID":"171b9a5c-37f2-446b-8c0e-a2417516e3b8","Type":"ContainerStarted","Data":"1ab93c715775035c31304b995fd8b7d6b2588993190c8c626ddaea43f93d7d6a"}
Jul 07 17:37:59.481246 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:59.480772    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-brl7n" podStartSLOduration=18.426609969 podStartE2EDuration="25.480749014s" totalImagesPullingTime="7.054139045s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:37:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:59.4796843 +0000 UTC m=+78.994914656" watchObservedRunningTime="2026-07-07 17:37:59.480749014 +0000 UTC m=+78.995979353"
Jul 07 17:37:59.496802 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:37:59.496747    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6bd74b6444-5kgbr" podStartSLOduration=2.496724732 podStartE2EDuration="2.496724732s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:37:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:37:59.495884632 +0000 UTC m=+79.011114969" watchObservedRunningTime="2026-07-07 17:37:59.496724732 +0000 UTC m=+79.011955067"
Jul 07 17:38:01.591609 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:01.591568    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/afebc539-17cc-4174-8c80-499c0e3652d3-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-9gvhn\" (UID: \"afebc539-17cc-4174-8c80-499c0e3652d3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9gvhn"
Jul 07 17:38:01.594552 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:01.594524    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/afebc539-17cc-4174-8c80-499c0e3652d3-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-9gvhn\" (UID: \"afebc539-17cc-4174-8c80-499c0e3652d3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9gvhn"
Jul 07 17:38:01.799629 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:01.799510    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4hh7m\""
Jul 07 17:38:01.808360 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:01.808324    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-9gvhn"
Jul 07 17:38:01.974373 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:01.974337    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-9gvhn"]
Jul 07 17:38:01.977141 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:38:01.977108    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafebc539_17cc_4174_8c80_499c0e3652d3.slice/crio-744f505c543cb287c7ebcf2b4088657e1da0f796b8fb4de9dd55f5e3d64a1d04 WatchSource:0}: Error finding container 744f505c543cb287c7ebcf2b4088657e1da0f796b8fb4de9dd55f5e3d64a1d04: Status 404 returned error can't find the container with id 744f505c543cb287c7ebcf2b4088657e1da0f796b8fb4de9dd55f5e3d64a1d04
Jul 07 17:38:02.477504 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:02.477464    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-9gvhn" event={"ID":"afebc539-17cc-4174-8c80-499c0e3652d3","Type":"ContainerStarted","Data":"744f505c543cb287c7ebcf2b4088657e1da0f796b8fb4de9dd55f5e3d64a1d04"}
Jul 07 17:38:03.441895 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:03.441864    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8mj9d"
Jul 07 17:38:04.487950 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:04.487915    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-9gvhn" event={"ID":"afebc539-17cc-4174-8c80-499c0e3652d3","Type":"ContainerStarted","Data":"88e73811d2539538eb9ca2270d44ce6964b7e82658553138a66868147fa72074"}
Jul 07 17:38:04.509678 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:04.509626    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-9gvhn" podStartSLOduration=34.035500529 podStartE2EDuration="35.509606855s" totalImagesPullingTime="1.474106326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:37:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:38:04.508501349 +0000 UTC m=+84.023731682" watchObservedRunningTime="2026-07-07 17:38:04.509606855 +0000 UTC m=+84.024837191"
Jul 07 17:38:04.575167 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:04.575136    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:04.676540 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:04.676506    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:04.732253 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:04.732216    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zf2kf"]
Jul 07 17:38:04.735568 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:04.735542    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zf2kf"
Jul 07 17:38:04.737783 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:04.737754    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 07 17:38:04.737904 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:04.737866    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-48mn7\""
Jul 07 17:38:04.741992 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:04.741892    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zf2kf"]
Jul 07 17:38:04.747636 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:04.747607    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:04.821471 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:04.821435    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/068d5512-2338-417e-805d-4e45523bc2b2-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-zf2kf\" (UID: \"068d5512-2338-417e-805d-4e45523bc2b2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zf2kf"
Jul 07 17:38:04.823650 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:04.823618    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:04.922515 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:04.922476    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/068d5512-2338-417e-805d-4e45523bc2b2-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-zf2kf\" (UID: \"068d5512-2338-417e-805d-4e45523bc2b2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zf2kf"
Jul 07 17:38:04.925013 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:04.924993    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/068d5512-2338-417e-805d-4e45523bc2b2-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-zf2kf\" (UID: \"068d5512-2338-417e-805d-4e45523bc2b2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zf2kf"
Jul 07 17:38:05.047725 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:05.047638    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zf2kf"
Jul 07 17:38:05.185745 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:05.185711    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zf2kf"]
Jul 07 17:38:05.189039 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:38:05.189004    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod068d5512_2338_417e_805d_4e45523bc2b2.slice/crio-70e4a288b5c9112aa233aa75b0c481a6abc71a52c2687677a81c206dfa70dadd WatchSource:0}: Error finding container 70e4a288b5c9112aa233aa75b0c481a6abc71a52c2687677a81c206dfa70dadd: Status 404 returned error can't find the container with id 70e4a288b5c9112aa233aa75b0c481a6abc71a52c2687677a81c206dfa70dadd
Jul 07 17:38:05.496392 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:05.496354    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zf2kf" event={"ID":"068d5512-2338-417e-805d-4e45523bc2b2","Type":"ContainerStarted","Data":"70e4a288b5c9112aa233aa75b0c481a6abc71a52c2687677a81c206dfa70dadd"}
Jul 07 17:38:05.892036 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:05.891997    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-576b9b5ff6-9w6mc"]
Jul 07 17:38:05.894307 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:05.894282    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-576b9b5ff6-9w6mc"
Jul 07 17:38:05.897321 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:05.897296    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 07 17:38:05.897589 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:05.897569    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 07 17:38:05.898784 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:05.898423    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 07 17:38:05.898784 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:05.898483    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-j6gcg\""
Jul 07 17:38:05.898784 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:05.898429    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 07 17:38:05.899034 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:05.898866    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 07 17:38:05.905288 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:05.904225    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 07 17:38:05.905658 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:05.905639    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-576b9b5ff6-9w6mc"]
Jul 07 17:38:06.032142 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.032106    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdc42\" (UniqueName: \"kubernetes.io/projected/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-kube-api-access-rdc42\") pod \"console-576b9b5ff6-9w6mc\" (UID: \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\") " pod="openshift-console/console-576b9b5ff6-9w6mc"
Jul 07 17:38:06.032296 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.032165    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-console-serving-cert\") pod \"console-576b9b5ff6-9w6mc\" (UID: \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\") " pod="openshift-console/console-576b9b5ff6-9w6mc"
Jul 07 17:38:06.032296 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.032197    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-trusted-ca-bundle\") pod \"console-576b9b5ff6-9w6mc\" (UID: \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\") " pod="openshift-console/console-576b9b5ff6-9w6mc"
Jul 07 17:38:06.032296 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.032246    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-oauth-serving-cert\") pod \"console-576b9b5ff6-9w6mc\" (UID: \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\") " pod="openshift-console/console-576b9b5ff6-9w6mc"
Jul 07 17:38:06.032296 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.032283    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-service-ca\") pod \"console-576b9b5ff6-9w6mc\" (UID: \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\") " pod="openshift-console/console-576b9b5ff6-9w6mc"
Jul 07 17:38:06.032435 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.032337    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-console-oauth-config\") pod \"console-576b9b5ff6-9w6mc\" (UID: \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\") " pod="openshift-console/console-576b9b5ff6-9w6mc"
Jul 07 17:38:06.032435 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.032353    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-console-config\") pod \"console-576b9b5ff6-9w6mc\" (UID: \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\") " pod="openshift-console/console-576b9b5ff6-9w6mc"
Jul 07 17:38:06.133158 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.133122    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-console-oauth-config\") pod \"console-576b9b5ff6-9w6mc\" (UID: \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\") " pod="openshift-console/console-576b9b5ff6-9w6mc"
Jul 07 17:38:06.133158 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.133158    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-console-config\") pod \"console-576b9b5ff6-9w6mc\" (UID: \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\") " pod="openshift-console/console-576b9b5ff6-9w6mc"
Jul 07 17:38:06.133403 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.133196    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdc42\" (UniqueName: \"kubernetes.io/projected/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-kube-api-access-rdc42\") pod \"console-576b9b5ff6-9w6mc\" (UID: \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\") " pod="openshift-console/console-576b9b5ff6-9w6mc"
Jul 07 17:38:06.133403 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.133228    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-console-serving-cert\") pod \"console-576b9b5ff6-9w6mc\" (UID: \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\") " pod="openshift-console/console-576b9b5ff6-9w6mc"
Jul 07 17:38:06.133403 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.133251    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-trusted-ca-bundle\") pod \"console-576b9b5ff6-9w6mc\" (UID: \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\") " pod="openshift-console/console-576b9b5ff6-9w6mc"
Jul 07 17:38:06.133403 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.133277    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-oauth-serving-cert\") pod \"console-576b9b5ff6-9w6mc\" (UID: \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\") " pod="openshift-console/console-576b9b5ff6-9w6mc"
Jul 07 17:38:06.133403 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.133311    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-service-ca\") pod \"console-576b9b5ff6-9w6mc\" (UID: \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\") " pod="openshift-console/console-576b9b5ff6-9w6mc"
Jul 07 17:38:06.134392 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.134366    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-service-ca\") pod \"console-576b9b5ff6-9w6mc\" (UID: \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\") " pod="openshift-console/console-576b9b5ff6-9w6mc"
Jul 07 17:38:06.134510 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.134435    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-console-config\") pod \"console-576b9b5ff6-9w6mc\" (UID: \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\") " pod="openshift-console/console-576b9b5ff6-9w6mc"
Jul 07 17:38:06.134510 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.134446    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-oauth-serving-cert\") pod \"console-576b9b5ff6-9w6mc\" (UID: \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\") " pod="openshift-console/console-576b9b5ff6-9w6mc"
Jul 07 17:38:06.134777 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.134748    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-trusted-ca-bundle\") pod \"console-576b9b5ff6-9w6mc\" (UID: \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\") " pod="openshift-console/console-576b9b5ff6-9w6mc"
Jul 07 17:38:06.136253 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.136232    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-console-serving-cert\") pod \"console-576b9b5ff6-9w6mc\" (UID: \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\") " pod="openshift-console/console-576b9b5ff6-9w6mc"
Jul 07 17:38:06.136358 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.136342    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-console-oauth-config\") pod \"console-576b9b5ff6-9w6mc\" (UID: \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\") " pod="openshift-console/console-576b9b5ff6-9w6mc"
Jul 07 17:38:06.141873 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.141851    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdc42\" (UniqueName: \"kubernetes.io/projected/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-kube-api-access-rdc42\") pod \"console-576b9b5ff6-9w6mc\" (UID: \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\") " pod="openshift-console/console-576b9b5ff6-9w6mc"
Jul 07 17:38:06.207792 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.207705    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-576b9b5ff6-9w6mc"
Jul 07 17:38:06.446471 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.446384    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-576b9b5ff6-9w6mc"]
Jul 07 17:38:06.448763 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:38:06.448735    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98a2d15f_69fb_4583_80a8_ab5f0e4bb3eb.slice/crio-d8f9eb43df065d7979c3270393c3c1001fd7a4a996f7f14dabe9a9402fb0416e WatchSource:0}: Error finding container d8f9eb43df065d7979c3270393c3c1001fd7a4a996f7f14dabe9a9402fb0416e: Status 404 returned error can't find the container with id d8f9eb43df065d7979c3270393c3c1001fd7a4a996f7f14dabe9a9402fb0416e
Jul 07 17:38:06.501338 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.501251    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-576b9b5ff6-9w6mc" event={"ID":"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb","Type":"ContainerStarted","Data":"d8f9eb43df065d7979c3270393c3c1001fd7a4a996f7f14dabe9a9402fb0416e"}
Jul 07 17:38:06.503008 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.502977    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zf2kf" event={"ID":"068d5512-2338-417e-805d-4e45523bc2b2","Type":"ContainerStarted","Data":"2517da75b46898fa836b457b23b38e5d7256112d9b4de1d0d023b39cf7adea57"}
Jul 07 17:38:06.503211 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.503186    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zf2kf"
Jul 07 17:38:06.508078 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.508055    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zf2kf"
Jul 07 17:38:06.519010 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.518945    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zf2kf" podStartSLOduration=1.37580053 podStartE2EDuration="2.518928334s" totalImagesPullingTime="1.143127804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:38:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:38:06.517742745 +0000 UTC m=+86.032973097" watchObservedRunningTime="2026-07-07 17:38:06.518928334 +0000 UTC m=+86.034158647"
Jul 07 17:38:06.710549 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.710511    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:06.795893 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.795818    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:06.799231 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.799208    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-5jnx9"]
Jul 07 17:38:06.802588 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.802570    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5jnx9"
Jul 07 17:38:06.804940 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.804919    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 07 17:38:06.805282 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.805267    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-b9842\""
Jul 07 17:38:06.805507 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.805494    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 17:38:06.806021 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.806008    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 17:38:06.806552 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.806533    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 17:38:06.806647 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.806541    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 07 17:38:06.812847 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.812825    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-5jnx9"]
Jul 07 17:38:06.854852 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.854808    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:06.933051 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.933013    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:06.939143 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.939124    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f6eab0c8-907e-4b95-b4ac-6aed563559b8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-5jnx9\" (UID: \"f6eab0c8-907e-4b95-b4ac-6aed563559b8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5jnx9"
Jul 07 17:38:06.939213 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.939153    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsbz2\" (UniqueName: \"kubernetes.io/projected/f6eab0c8-907e-4b95-b4ac-6aed563559b8-kube-api-access-rsbz2\") pod \"prometheus-operator-567f7b8b7c-5jnx9\" (UID: \"f6eab0c8-907e-4b95-b4ac-6aed563559b8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5jnx9"
Jul 07 17:38:06.939213 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.939191    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6eab0c8-907e-4b95-b4ac-6aed563559b8-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-5jnx9\" (UID: \"f6eab0c8-907e-4b95-b4ac-6aed563559b8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5jnx9"
Jul 07 17:38:06.939284 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:06.939260    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6eab0c8-907e-4b95-b4ac-6aed563559b8-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-5jnx9\" (UID: \"f6eab0c8-907e-4b95-b4ac-6aed563559b8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5jnx9"
Jul 07 17:38:07.040440 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:07.040405    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f6eab0c8-907e-4b95-b4ac-6aed563559b8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-5jnx9\" (UID: \"f6eab0c8-907e-4b95-b4ac-6aed563559b8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5jnx9"
Jul 07 17:38:07.040440 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:07.040440    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsbz2\" (UniqueName: \"kubernetes.io/projected/f6eab0c8-907e-4b95-b4ac-6aed563559b8-kube-api-access-rsbz2\") pod \"prometheus-operator-567f7b8b7c-5jnx9\" (UID: \"f6eab0c8-907e-4b95-b4ac-6aed563559b8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5jnx9"
Jul 07 17:38:07.040643 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:07.040487    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6eab0c8-907e-4b95-b4ac-6aed563559b8-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-5jnx9\" (UID: \"f6eab0c8-907e-4b95-b4ac-6aed563559b8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5jnx9"
Jul 07 17:38:07.040643 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:07.040548    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6eab0c8-907e-4b95-b4ac-6aed563559b8-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-5jnx9\" (UID: \"f6eab0c8-907e-4b95-b4ac-6aed563559b8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5jnx9"
Jul 07 17:38:07.041265 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:07.041232    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6eab0c8-907e-4b95-b4ac-6aed563559b8-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-5jnx9\" (UID: \"f6eab0c8-907e-4b95-b4ac-6aed563559b8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5jnx9"
Jul 07 17:38:07.043066 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:07.043042    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f6eab0c8-907e-4b95-b4ac-6aed563559b8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-5jnx9\" (UID: \"f6eab0c8-907e-4b95-b4ac-6aed563559b8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5jnx9"
Jul 07 17:38:07.043192 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:07.043138    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f6eab0c8-907e-4b95-b4ac-6aed563559b8-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-5jnx9\" (UID: \"f6eab0c8-907e-4b95-b4ac-6aed563559b8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5jnx9"
Jul 07 17:38:07.047904 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:07.047849    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsbz2\" (UniqueName: \"kubernetes.io/projected/f6eab0c8-907e-4b95-b4ac-6aed563559b8-kube-api-access-rsbz2\") pod \"prometheus-operator-567f7b8b7c-5jnx9\" (UID: \"f6eab0c8-907e-4b95-b4ac-6aed563559b8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5jnx9"
Jul 07 17:38:07.112096 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:07.112062    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5jnx9"
Jul 07 17:38:07.258595 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:07.258310    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-5jnx9"]
Jul 07 17:38:07.261642 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:38:07.261577    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6eab0c8_907e_4b95_b4ac_6aed563559b8.slice/crio-26e45b6f77069c99b3a3f8e28529f4ae72e750336832c009b40cd1f4ff479b47 WatchSource:0}: Error finding container 26e45b6f77069c99b3a3f8e28529f4ae72e750336832c009b40cd1f4ff479b47: Status 404 returned error can't find the container with id 26e45b6f77069c99b3a3f8e28529f4ae72e750336832c009b40cd1f4ff479b47
Jul 07 17:38:07.507898 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:07.507862    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5jnx9" event={"ID":"f6eab0c8-907e-4b95-b4ac-6aed563559b8","Type":"ContainerStarted","Data":"26e45b6f77069c99b3a3f8e28529f4ae72e750336832c009b40cd1f4ff479b47"}
Jul 07 17:38:09.358283 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:09.358246    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:09.516860 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:09.516826    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5jnx9" event={"ID":"f6eab0c8-907e-4b95-b4ac-6aed563559b8","Type":"ContainerStarted","Data":"832a872bed606b6beed2d312719135813953be0400a98d88ff6801ab097e6995"}
Jul 07 17:38:09.517079 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:09.516882    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5jnx9" event={"ID":"f6eab0c8-907e-4b95-b4ac-6aed563559b8","Type":"ContainerStarted","Data":"06a41eb721be596952359811a67a01a9025a2676c9f6bd4b8d0c39514dacca7a"}
Jul 07 17:38:09.532388 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:09.532342    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5jnx9" podStartSLOduration=1.747344625 podStartE2EDuration="3.532324336s" totalImagesPullingTime="1.784979711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:38:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:38:09.531620992 +0000 UTC m=+89.046851340" watchObservedRunningTime="2026-07-07 17:38:09.532324336 +0000 UTC m=+89.047554671"
Jul 07 17:38:09.533493 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:09.533460    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:09.633941 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:09.633856    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:10.097069 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:10.096924    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:10.893029 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:10.892988    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:11.012826 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.012748    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:11.115732 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.115697    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:11.138894 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.138862    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8q6n2"]
Jul 07 17:38:11.142175 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.142155    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hg6j8"]
Jul 07 17:38:11.142314 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.142293    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8q6n2"
Jul 07 17:38:11.144520 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.144501    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 07 17:38:11.144639 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.144618    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7v8kl\""
Jul 07 17:38:11.144691 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.144678    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 07 17:38:11.145418 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.145398    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hg6j8"
Jul 07 17:38:11.145713 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.145690    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 07 17:38:11.147567 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.147552    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 17:38:11.147759 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.147740    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4gg69\""
Jul 07 17:38:11.147855 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.147788    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 17:38:11.147855 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.147839    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 17:38:11.151690 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.151667    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8q6n2"]
Jul 07 17:38:11.213688 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.213649    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:11.278093 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.278003    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4105c06b-0719-43bd-a257-2a8ccbe0f80d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hg6j8\" (UID: \"4105c06b-0719-43bd-a257-2a8ccbe0f80d\") " pod="openshift-monitoring/node-exporter-hg6j8"
Jul 07 17:38:11.278093 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.278044    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/144e91d9-f4f8-421b-86c1-80dadfb4bb36-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-8q6n2\" (UID: \"144e91d9-f4f8-421b-86c1-80dadfb4bb36\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8q6n2"
Jul 07 17:38:11.278093 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.278078    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4105c06b-0719-43bd-a257-2a8ccbe0f80d-metrics-client-ca\") pod \"node-exporter-hg6j8\" (UID: \"4105c06b-0719-43bd-a257-2a8ccbe0f80d\") " pod="openshift-monitoring/node-exporter-hg6j8"
Jul 07 17:38:11.278362 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.278148    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/144e91d9-f4f8-421b-86c1-80dadfb4bb36-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-8q6n2\" (UID: \"144e91d9-f4f8-421b-86c1-80dadfb4bb36\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8q6n2"
Jul 07 17:38:11.278362 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.278200    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4105c06b-0719-43bd-a257-2a8ccbe0f80d-node-exporter-wtmp\") pod \"node-exporter-hg6j8\" (UID: \"4105c06b-0719-43bd-a257-2a8ccbe0f80d\") " pod="openshift-monitoring/node-exporter-hg6j8"
Jul 07 17:38:11.278362 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.278230    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkvkn\" (UniqueName: \"kubernetes.io/projected/144e91d9-f4f8-421b-86c1-80dadfb4bb36-kube-api-access-bkvkn\") pod \"kube-state-metrics-7c9dbb8b7d-8q6n2\" (UID: \"144e91d9-f4f8-421b-86c1-80dadfb4bb36\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8q6n2"
Jul 07 17:38:11.278362 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.278252    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4105c06b-0719-43bd-a257-2a8ccbe0f80d-root\") pod \"node-exporter-hg6j8\" (UID: \"4105c06b-0719-43bd-a257-2a8ccbe0f80d\") " pod="openshift-monitoring/node-exporter-hg6j8"
Jul 07 17:38:11.278362 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.278275    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x6pp\" (UniqueName: \"kubernetes.io/projected/4105c06b-0719-43bd-a257-2a8ccbe0f80d-kube-api-access-7x6pp\") pod \"node-exporter-hg6j8\" (UID: \"4105c06b-0719-43bd-a257-2a8ccbe0f80d\") " pod="openshift-monitoring/node-exporter-hg6j8"
Jul 07 17:38:11.278362 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.278303    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4105c06b-0719-43bd-a257-2a8ccbe0f80d-sys\") pod \"node-exporter-hg6j8\" (UID: \"4105c06b-0719-43bd-a257-2a8ccbe0f80d\") " pod="openshift-monitoring/node-exporter-hg6j8"
Jul 07 17:38:11.278362 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.278336    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/144e91d9-f4f8-421b-86c1-80dadfb4bb36-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-8q6n2\" (UID: \"144e91d9-f4f8-421b-86c1-80dadfb4bb36\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8q6n2"
Jul 07 17:38:11.278613 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.278360    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4105c06b-0719-43bd-a257-2a8ccbe0f80d-node-exporter-accelerators-collector-config\") pod \"node-exporter-hg6j8\" (UID: \"4105c06b-0719-43bd-a257-2a8ccbe0f80d\") " pod="openshift-monitoring/node-exporter-hg6j8"
Jul 07 17:38:11.278613 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.278410    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4105c06b-0719-43bd-a257-2a8ccbe0f80d-node-exporter-tls\") pod \"node-exporter-hg6j8\" (UID: \"4105c06b-0719-43bd-a257-2a8ccbe0f80d\") " pod="openshift-monitoring/node-exporter-hg6j8"
Jul 07 17:38:11.278613 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.278448    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/144e91d9-f4f8-421b-86c1-80dadfb4bb36-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-8q6n2\" (UID: \"144e91d9-f4f8-421b-86c1-80dadfb4bb36\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8q6n2"
Jul 07 17:38:11.278613 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.278468    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/144e91d9-f4f8-421b-86c1-80dadfb4bb36-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-8q6n2\" (UID: \"144e91d9-f4f8-421b-86c1-80dadfb4bb36\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8q6n2"
Jul 07 17:38:11.278613 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.278499    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4105c06b-0719-43bd-a257-2a8ccbe0f80d-node-exporter-textfile\") pod \"node-exporter-hg6j8\" (UID: \"4105c06b-0719-43bd-a257-2a8ccbe0f80d\") " pod="openshift-monitoring/node-exporter-hg6j8"
Jul 07 17:38:11.314296 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.314254    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:11.379420 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.379382    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4105c06b-0719-43bd-a257-2a8ccbe0f80d-node-exporter-textfile\") pod \"node-exporter-hg6j8\" (UID: \"4105c06b-0719-43bd-a257-2a8ccbe0f80d\") " pod="openshift-monitoring/node-exporter-hg6j8"
Jul 07 17:38:11.379706 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.379443    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4105c06b-0719-43bd-a257-2a8ccbe0f80d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hg6j8\" (UID: \"4105c06b-0719-43bd-a257-2a8ccbe0f80d\") " pod="openshift-monitoring/node-exporter-hg6j8"
Jul 07 17:38:11.379706 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.379475    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/144e91d9-f4f8-421b-86c1-80dadfb4bb36-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-8q6n2\" (UID: \"144e91d9-f4f8-421b-86c1-80dadfb4bb36\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8q6n2"
Jul 07 17:38:11.379706 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.379503    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4105c06b-0719-43bd-a257-2a8ccbe0f80d-metrics-client-ca\") pod \"node-exporter-hg6j8\" (UID: \"4105c06b-0719-43bd-a257-2a8ccbe0f80d\") " pod="openshift-monitoring/node-exporter-hg6j8"
Jul 07 17:38:11.379706 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.379540    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/144e91d9-f4f8-421b-86c1-80dadfb4bb36-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-8q6n2\" (UID: \"144e91d9-f4f8-421b-86c1-80dadfb4bb36\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8q6n2"
Jul 07 17:38:11.379706 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.379571    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4105c06b-0719-43bd-a257-2a8ccbe0f80d-node-exporter-wtmp\") pod \"node-exporter-hg6j8\" (UID: \"4105c06b-0719-43bd-a257-2a8ccbe0f80d\") " pod="openshift-monitoring/node-exporter-hg6j8"
Jul 07 17:38:11.379706 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.379600    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkvkn\" (UniqueName: \"kubernetes.io/projected/144e91d9-f4f8-421b-86c1-80dadfb4bb36-kube-api-access-bkvkn\") pod \"kube-state-metrics-7c9dbb8b7d-8q6n2\" (UID: \"144e91d9-f4f8-421b-86c1-80dadfb4bb36\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8q6n2"
Jul 07 17:38:11.379706 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.379624    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4105c06b-0719-43bd-a257-2a8ccbe0f80d-root\") pod \"node-exporter-hg6j8\" (UID: \"4105c06b-0719-43bd-a257-2a8ccbe0f80d\") " pod="openshift-monitoring/node-exporter-hg6j8"
Jul 07 17:38:11.379706 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.379648    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x6pp\" (UniqueName: \"kubernetes.io/projected/4105c06b-0719-43bd-a257-2a8ccbe0f80d-kube-api-access-7x6pp\") pod \"node-exporter-hg6j8\" (UID: \"4105c06b-0719-43bd-a257-2a8ccbe0f80d\") " pod="openshift-monitoring/node-exporter-hg6j8"
Jul 07 17:38:11.379706 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.379675    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4105c06b-0719-43bd-a257-2a8ccbe0f80d-sys\") pod \"node-exporter-hg6j8\" (UID: \"4105c06b-0719-43bd-a257-2a8ccbe0f80d\") " pod="openshift-monitoring/node-exporter-hg6j8"
Jul 07 17:38:11.379706 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.379700    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/144e91d9-f4f8-421b-86c1-80dadfb4bb36-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-8q6n2\" (UID: \"144e91d9-f4f8-421b-86c1-80dadfb4bb36\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8q6n2"
Jul 07 17:38:11.381123 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.379725    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4105c06b-0719-43bd-a257-2a8ccbe0f80d-node-exporter-accelerators-collector-config\") pod \"node-exporter-hg6j8\" (UID: \"4105c06b-0719-43bd-a257-2a8ccbe0f80d\") " pod="openshift-monitoring/node-exporter-hg6j8"
Jul 07 17:38:11.381123 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.379765    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4105c06b-0719-43bd-a257-2a8ccbe0f80d-node-exporter-tls\") pod \"node-exporter-hg6j8\" (UID: \"4105c06b-0719-43bd-a257-2a8ccbe0f80d\") " pod="openshift-monitoring/node-exporter-hg6j8"
Jul 07 17:38:11.381123 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.379802    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/144e91d9-f4f8-421b-86c1-80dadfb4bb36-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-8q6n2\" (UID: \"144e91d9-f4f8-421b-86c1-80dadfb4bb36\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8q6n2"
Jul 07 17:38:11.381123 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.379828    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/144e91d9-f4f8-421b-86c1-80dadfb4bb36-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-8q6n2\" (UID: \"144e91d9-f4f8-421b-86c1-80dadfb4bb36\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8q6n2"
Jul 07 17:38:11.381123 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.379866    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4105c06b-0719-43bd-a257-2a8ccbe0f80d-node-exporter-textfile\") pod \"node-exporter-hg6j8\" (UID: \"4105c06b-0719-43bd-a257-2a8ccbe0f80d\") " pod="openshift-monitoring/node-exporter-hg6j8"
Jul 07 17:38:11.381123 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.380094    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4105c06b-0719-43bd-a257-2a8ccbe0f80d-node-exporter-wtmp\") pod \"node-exporter-hg6j8\" (UID: \"4105c06b-0719-43bd-a257-2a8ccbe0f80d\") " pod="openshift-monitoring/node-exporter-hg6j8"
Jul 07 17:38:11.381123 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.380186    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4105c06b-0719-43bd-a257-2a8ccbe0f80d-root\") pod \"node-exporter-hg6j8\" (UID: \"4105c06b-0719-43bd-a257-2a8ccbe0f80d\") " pod="openshift-monitoring/node-exporter-hg6j8"
Jul 07 17:38:11.381123 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.380261    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4105c06b-0719-43bd-a257-2a8ccbe0f80d-metrics-client-ca\") pod \"node-exporter-hg6j8\" (UID: \"4105c06b-0719-43bd-a257-2a8ccbe0f80d\") " pod="openshift-monitoring/node-exporter-hg6j8"
Jul 07 17:38:11.381123 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.380348    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4105c06b-0719-43bd-a257-2a8ccbe0f80d-sys\") pod \"node-exporter-hg6j8\" (UID: \"4105c06b-0719-43bd-a257-2a8ccbe0f80d\") " pod="openshift-monitoring/node-exporter-hg6j8"
Jul 07 17:38:11.381123 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.380458    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/144e91d9-f4f8-421b-86c1-80dadfb4bb36-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-8q6n2\" (UID: \"144e91d9-f4f8-421b-86c1-80dadfb4bb36\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8q6n2"
Jul 07 17:38:11.381123 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.380500    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/144e91d9-f4f8-421b-86c1-80dadfb4bb36-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-8q6n2\" (UID: \"144e91d9-f4f8-421b-86c1-80dadfb4bb36\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8q6n2"
Jul 07 17:38:11.381123 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.380666    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/144e91d9-f4f8-421b-86c1-80dadfb4bb36-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-8q6n2\" (UID: \"144e91d9-f4f8-421b-86c1-80dadfb4bb36\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8q6n2"
Jul 07 17:38:11.381123 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.380693    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4105c06b-0719-43bd-a257-2a8ccbe0f80d-node-exporter-accelerators-collector-config\") pod \"node-exporter-hg6j8\" (UID: \"4105c06b-0719-43bd-a257-2a8ccbe0f80d\") " pod="openshift-monitoring/node-exporter-hg6j8"
Jul 07 17:38:11.382566 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.382542    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4105c06b-0719-43bd-a257-2a8ccbe0f80d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hg6j8\" (UID: \"4105c06b-0719-43bd-a257-2a8ccbe0f80d\") " pod="openshift-monitoring/node-exporter-hg6j8"
Jul 07 17:38:11.383447 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.383423    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/144e91d9-f4f8-421b-86c1-80dadfb4bb36-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-8q6n2\" (UID: \"144e91d9-f4f8-421b-86c1-80dadfb4bb36\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8q6n2"
Jul 07 17:38:11.383659 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.383636    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4105c06b-0719-43bd-a257-2a8ccbe0f80d-node-exporter-tls\") pod \"node-exporter-hg6j8\" (UID: \"4105c06b-0719-43bd-a257-2a8ccbe0f80d\") " pod="openshift-monitoring/node-exporter-hg6j8"
Jul 07 17:38:11.383882 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.383849    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/144e91d9-f4f8-421b-86c1-80dadfb4bb36-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-8q6n2\" (UID: \"144e91d9-f4f8-421b-86c1-80dadfb4bb36\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8q6n2"
Jul 07 17:38:11.390895 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.390871    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkvkn\" (UniqueName: \"kubernetes.io/projected/144e91d9-f4f8-421b-86c1-80dadfb4bb36-kube-api-access-bkvkn\") pod \"kube-state-metrics-7c9dbb8b7d-8q6n2\" (UID: \"144e91d9-f4f8-421b-86c1-80dadfb4bb36\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8q6n2"
Jul 07 17:38:11.391032 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.391002    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x6pp\" (UniqueName: \"kubernetes.io/projected/4105c06b-0719-43bd-a257-2a8ccbe0f80d-kube-api-access-7x6pp\") pod \"node-exporter-hg6j8\" (UID: \"4105c06b-0719-43bd-a257-2a8ccbe0f80d\") " pod="openshift-monitoring/node-exporter-hg6j8"
Jul 07 17:38:11.415502 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.415467    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:11.455091 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.455053    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8q6n2"
Jul 07 17:38:11.461655 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.461635    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hg6j8"
Jul 07 17:38:11.475200 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:38:11.475173    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4105c06b_0719_43bd_a257_2a8ccbe0f80d.slice/crio-e389d497ed138db02c71424924e64176684019abac5107d11dcc54ccc596fbc3 WatchSource:0}: Error finding container e389d497ed138db02c71424924e64176684019abac5107d11dcc54ccc596fbc3: Status 404 returned error can't find the container with id e389d497ed138db02c71424924e64176684019abac5107d11dcc54ccc596fbc3
Jul 07 17:38:11.517837 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.517747    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:11.533791 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.533714    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-576b9b5ff6-9w6mc" event={"ID":"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb","Type":"ContainerStarted","Data":"d72a0076270f0ee2d7dd09e88dd6870129d2df9d811e988c54db42ac60424ac9"}
Jul 07 17:38:11.535077 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.535050    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hg6j8" event={"ID":"4105c06b-0719-43bd-a257-2a8ccbe0f80d","Type":"ContainerStarted","Data":"e389d497ed138db02c71424924e64176684019abac5107d11dcc54ccc596fbc3"}
Jul 07 17:38:11.611569 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.611409    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-576b9b5ff6-9w6mc" podStartSLOduration=2.361154714 podStartE2EDuration="6.611391668s" totalImagesPullingTime="4.250236954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:38:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:38:11.551323212 +0000 UTC m=+91.066553549" watchObservedRunningTime="2026-07-07 17:38:11.611391668 +0000 UTC m=+91.126622004"
Jul 07 17:38:11.611569 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:11.611557    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8q6n2"]
Jul 07 17:38:11.613602 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:38:11.613578    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod144e91d9_f4f8_421b_86c1_80dadfb4bb36.slice/crio-95e9c7035b61a3f7f1e9327af22204e19b23f627796abf0f314a7fa67e1ee828 WatchSource:0}: Error finding container 95e9c7035b61a3f7f1e9327af22204e19b23f627796abf0f314a7fa67e1ee828: Status 404 returned error can't find the container with id 95e9c7035b61a3f7f1e9327af22204e19b23f627796abf0f314a7fa67e1ee828
Jul 07 17:38:12.105456 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:12.105391    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:12.206096 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:12.206059    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:12.312051 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:12.312012    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:12.541376 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:12.541297    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8q6n2" event={"ID":"144e91d9-f4f8-421b-86c1-80dadfb4bb36","Type":"ContainerStarted","Data":"95e9c7035b61a3f7f1e9327af22204e19b23f627796abf0f314a7fa67e1ee828"}
Jul 07 17:38:13.548430 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:13.548332    2559 generic.go:356] "Generic (PLEG): container finished" podID="4105c06b-0719-43bd-a257-2a8ccbe0f80d" containerID="387a1857d2d5931462ea915628d289b8fb78437dce3a5acc757674dc05c67495" exitCode=0
Jul 07 17:38:13.548872 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:13.548464    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hg6j8" event={"ID":"4105c06b-0719-43bd-a257-2a8ccbe0f80d","Type":"ContainerDied","Data":"387a1857d2d5931462ea915628d289b8fb78437dce3a5acc757674dc05c67495"}
Jul 07 17:38:13.551881 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:13.551735    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8q6n2" event={"ID":"144e91d9-f4f8-421b-86c1-80dadfb4bb36","Type":"ContainerStarted","Data":"eced121f6481e1fbf7f29b8d4cae33e43198458d4ac4ff199bd89904c37e51d4"}
Jul 07 17:38:13.551881 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:13.551808    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8q6n2" event={"ID":"144e91d9-f4f8-421b-86c1-80dadfb4bb36","Type":"ContainerStarted","Data":"864215aa9cd9dc6da27217659301ddd2f8ab307337236fa3409f888f7fc29db9"}
Jul 07 17:38:13.551881 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:13.551839    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8q6n2" event={"ID":"144e91d9-f4f8-421b-86c1-80dadfb4bb36","Type":"ContainerStarted","Data":"cae7b26a49c7a3d16de704d787e7e64a10c005608d9bf277e7345e115ab0983d"}
Jul 07 17:38:13.592528 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:13.592477    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8q6n2" podStartSLOduration=1.079579903 podStartE2EDuration="2.59245671s" totalImagesPullingTime="1.512876807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:38:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:38:13.592413043 +0000 UTC m=+93.107643378" watchObservedRunningTime="2026-07-07 17:38:13.59245671 +0000 UTC m=+93.107687048"
Jul 07 17:38:14.062203 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:14.062168    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:14.119984 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:14.119913    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:14.210540 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:14.210484    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:14.559603 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:14.559566    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hg6j8" event={"ID":"4105c06b-0719-43bd-a257-2a8ccbe0f80d","Type":"ContainerStarted","Data":"61a6815084f1084c5ebf14643603ef17ec4f88b6bc5d7812b23d7f7d6853155a"}
Jul 07 17:38:14.560094 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:14.559665    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hg6j8" event={"ID":"4105c06b-0719-43bd-a257-2a8ccbe0f80d","Type":"ContainerStarted","Data":"b90ab8df88e6cf7dde05ed7760c8edcd77b911f5ceb692179c3b6710861e5fd1"}
Jul 07 17:38:14.579640 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:14.579578    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hg6j8" podStartSLOduration=2.295942536 podStartE2EDuration="3.579554312s" totalImagesPullingTime="1.197044409s" totalInitContainerRuntime="86.567367ms" isStatefulPod=true podCreationTimestamp="2026-07-07 17:38:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:38:14.578051391 +0000 UTC m=+94.093281728" watchObservedRunningTime="2026-07-07 17:38:14.579554312 +0000 UTC m=+94.094784651"
Jul 07 17:38:14.728043 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:14.728010    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:15.926190 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:15.926137    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:16.024174 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:16.024136    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:16.208853 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:16.208773    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-576b9b5ff6-9w6mc"
Jul 07 17:38:16.208853 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:16.208843    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-576b9b5ff6-9w6mc"
Jul 07 17:38:16.214681 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:16.214648    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-576b9b5ff6-9w6mc"
Jul 07 17:38:16.439939 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:16.439908    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:16.576069 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:16.576000    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-576b9b5ff6-9w6mc"
Jul 07 17:38:17.142175 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:17.142118    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:17.244245 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:17.244198    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:17.388084 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:17.388015    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:17.523568 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:17.523475    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68bf769b9d-bdj8s"]
Jul 07 17:38:17.526801 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:17.526770    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:17.527931 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:17.527912    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68bf769b9d-bdj8s"
Jul 07 17:38:17.539115 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:17.539087    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68bf769b9d-bdj8s"]
Jul 07 17:38:17.596582 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:17.595689    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:17.635468 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:17.635435    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-oauth-serving-cert\") pod \"console-68bf769b9d-bdj8s\" (UID: \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\") " pod="openshift-console/console-68bf769b9d-bdj8s"
Jul 07 17:38:17.635664 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:17.635493    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-console-serving-cert\") pod \"console-68bf769b9d-bdj8s\" (UID: \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\") " pod="openshift-console/console-68bf769b9d-bdj8s"
Jul 07 17:38:17.635664 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:17.635583    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-trusted-ca-bundle\") pod \"console-68bf769b9d-bdj8s\" (UID: \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\") " pod="openshift-console/console-68bf769b9d-bdj8s"
Jul 07 17:38:17.635664 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:17.635630    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb8tq\" (UniqueName: \"kubernetes.io/projected/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-kube-api-access-jb8tq\") pod \"console-68bf769b9d-bdj8s\" (UID: \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\") " pod="openshift-console/console-68bf769b9d-bdj8s"
Jul 07 17:38:17.635825 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:17.635696    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-service-ca\") pod \"console-68bf769b9d-bdj8s\" (UID: \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\") " pod="openshift-console/console-68bf769b9d-bdj8s"
Jul 07 17:38:17.635825 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:17.635716    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-console-oauth-config\") pod \"console-68bf769b9d-bdj8s\" (UID: \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\") " pod="openshift-console/console-68bf769b9d-bdj8s"
Jul 07 17:38:17.635825 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:17.635745    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-console-config\") pod \"console-68bf769b9d-bdj8s\" (UID: \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\") " pod="openshift-console/console-68bf769b9d-bdj8s"
Jul 07 17:38:17.738398 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:17.738356    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-trusted-ca-bundle\") pod \"console-68bf769b9d-bdj8s\" (UID: \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\") " pod="openshift-console/console-68bf769b9d-bdj8s"
Jul 07 17:38:17.738578 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:17.738418    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb8tq\" (UniqueName: \"kubernetes.io/projected/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-kube-api-access-jb8tq\") pod \"console-68bf769b9d-bdj8s\" (UID: \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\") " pod="openshift-console/console-68bf769b9d-bdj8s"
Jul 07 17:38:17.738578 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:17.738496    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-service-ca\") pod \"console-68bf769b9d-bdj8s\" (UID: \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\") " pod="openshift-console/console-68bf769b9d-bdj8s"
Jul 07 17:38:17.738578 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:17.738527    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-console-oauth-config\") pod \"console-68bf769b9d-bdj8s\" (UID: \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\") " pod="openshift-console/console-68bf769b9d-bdj8s"
Jul 07 17:38:17.738578 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:17.738575    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-console-config\") pod \"console-68bf769b9d-bdj8s\" (UID: \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\") " pod="openshift-console/console-68bf769b9d-bdj8s"
Jul 07 17:38:17.738745 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:17.738644    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-oauth-serving-cert\") pod \"console-68bf769b9d-bdj8s\" (UID: \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\") " pod="openshift-console/console-68bf769b9d-bdj8s"
Jul 07 17:38:17.738745 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:17.738713    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-console-serving-cert\") pod \"console-68bf769b9d-bdj8s\" (UID: \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\") " pod="openshift-console/console-68bf769b9d-bdj8s"
Jul 07 17:38:17.740728 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:17.740117    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-console-config\") pod \"console-68bf769b9d-bdj8s\" (UID: \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\") " pod="openshift-console/console-68bf769b9d-bdj8s"
Jul 07 17:38:17.740728 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:17.740399    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-oauth-serving-cert\") pod \"console-68bf769b9d-bdj8s\" (UID: \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\") " pod="openshift-console/console-68bf769b9d-bdj8s"
Jul 07 17:38:17.740728 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:17.740482    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-trusted-ca-bundle\") pod \"console-68bf769b9d-bdj8s\" (UID: \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\") " pod="openshift-console/console-68bf769b9d-bdj8s"
Jul 07 17:38:17.740728 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:17.740566    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-service-ca\") pod \"console-68bf769b9d-bdj8s\" (UID: \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\") " pod="openshift-console/console-68bf769b9d-bdj8s"
Jul 07 17:38:17.741797 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:17.741772    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-console-serving-cert\") pod \"console-68bf769b9d-bdj8s\" (UID: \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\") " pod="openshift-console/console-68bf769b9d-bdj8s"
Jul 07 17:38:17.743146 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:17.743120    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-console-oauth-config\") pod \"console-68bf769b9d-bdj8s\" (UID: \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\") " pod="openshift-console/console-68bf769b9d-bdj8s"
Jul 07 17:38:17.749134 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:17.749103    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb8tq\" (UniqueName: \"kubernetes.io/projected/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-kube-api-access-jb8tq\") pod \"console-68bf769b9d-bdj8s\" (UID: \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\") " pod="openshift-console/console-68bf769b9d-bdj8s"
Jul 07 17:38:17.839671 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:17.839578    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68bf769b9d-bdj8s"
Jul 07 17:38:17.919571 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:17.919535    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:18.020159 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:18.020124    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:18.400920 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:18.400884    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vzqgz"
Jul 07 17:38:19.109410 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:19.109370    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:19.210912 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:19.210877    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:20.035179 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:20.035147    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:20.135908 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:20.135873    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:20.475348 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:20.475315    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6bd74b6444-5kgbr"
Jul 07 17:38:20.603343 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:20.603305    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:20.703693 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:20.703650    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:20.916372 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:20.916332    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:21.016509 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:21.016465    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:21.242123 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:21.242025    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:21.344750 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:21.344714    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:23.611077 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:23.610919    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68bf769b9d-bdj8s"]
Jul 07 17:38:23.613671 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:38:23.613643    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaf55638_3ca8_42cc_9b4d_6b4763f96c2f.slice/crio-d7904a7ecdca453933482b7121e07a11d73a4132cd59519f9c63737743493152 WatchSource:0}: Error finding container d7904a7ecdca453933482b7121e07a11d73a4132cd59519f9c63737743493152: Status 404 returned error can't find the container with id d7904a7ecdca453933482b7121e07a11d73a4132cd59519f9c63737743493152
Jul 07 17:38:24.609194 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:24.609156    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-xjgss" event={"ID":"c5896898-42be-4d32-86cf-12af1377ee5f","Type":"ContainerStarted","Data":"742c6aa9986fea0c1a30fcbcd5b01cc93cd198b9b4e253ffb2fb067f184bc6ce"}
Jul 07 17:38:24.609469 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:24.609438    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-xjgss"
Jul 07 17:38:24.611230 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:24.611198    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68bf769b9d-bdj8s" event={"ID":"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f","Type":"ContainerStarted","Data":"e7b203b7a9311e887414b1ca305d7465d12ad2dae852b3488366f1d6c24e15ba"}
Jul 07 17:38:24.611619 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:24.611255    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68bf769b9d-bdj8s" event={"ID":"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f","Type":"ContainerStarted","Data":"d7904a7ecdca453933482b7121e07a11d73a4132cd59519f9c63737743493152"}
Jul 07 17:38:24.625618 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:24.625556    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-xjgss" podStartSLOduration=1.414890908 podStartE2EDuration="27.625533742s" totalImagesPullingTime="26.210642834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:37:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:38:24.625463284 +0000 UTC m=+104.140693622" watchObservedRunningTime="2026-07-07 17:38:24.625533742 +0000 UTC m=+104.140764078"
Jul 07 17:38:24.627331 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:24.627304    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-xjgss"
Jul 07 17:38:24.642531 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:24.642464    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68bf769b9d-bdj8s" podStartSLOduration=7.64244051 podStartE2EDuration="7.64244051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:38:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:38:24.64071949 +0000 UTC m=+104.155949827" watchObservedRunningTime="2026-07-07 17:38:24.64244051 +0000 UTC m=+104.157670847"
Jul 07 17:38:27.840444 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:27.840402    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68bf769b9d-bdj8s"
Jul 07 17:38:27.840900 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:27.840480    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68bf769b9d-bdj8s"
Jul 07 17:38:27.846281 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:27.846247    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68bf769b9d-bdj8s"
Jul 07 17:38:28.633341 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:28.633312    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68bf769b9d-bdj8s"
Jul 07 17:38:28.679554 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:28.679512    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-576b9b5ff6-9w6mc"]
Jul 07 17:38:28.805258 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:28.805185    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:28.906023 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:28.905928    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:28.965407 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:28.965357    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:33.217421 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:33.217380    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:42.959768 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:42.959729    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:43.061086 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:43.061051    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:43.134473 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:43.134437    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:50.916028 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:50.915995    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:51.035147 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:51.035111    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:51.334999 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:51.334908    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:51.435041 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:51.435008    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:51.596383 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:51.596310    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:51.708089 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:51.708059    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:51.776773 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:51.776744    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:53.712009 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:53.711947    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-576b9b5ff6-9w6mc" podUID="98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb" containerName="console" containerID="cri-o://d72a0076270f0ee2d7dd09e88dd6870129d2df9d811e988c54db42ac60424ac9" gracePeriod=15
Jul 07 17:38:53.971794 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:53.971736    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-576b9b5ff6-9w6mc"
Jul 07 17:38:54.032892 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:54.032863    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-console-serving-cert\") pod \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\" (UID: \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\") "
Jul 07 17:38:54.033105 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:54.032940    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-trusted-ca-bundle\") pod \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\" (UID: \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\") "
Jul 07 17:38:54.033105 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:54.032991    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-oauth-serving-cert\") pod \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\" (UID: \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\") "
Jul 07 17:38:54.033105 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:54.033009    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-console-config\") pod \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\" (UID: \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\") "
Jul 07 17:38:54.033105 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:54.033032    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-service-ca\") pod \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\" (UID: \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\") "
Jul 07 17:38:54.033105 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:54.033059    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdc42\" (UniqueName: \"kubernetes.io/projected/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-kube-api-access-rdc42\") pod \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\" (UID: \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\") "
Jul 07 17:38:54.033105 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:54.033091    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-console-oauth-config\") pod \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\" (UID: \"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb\") "
Jul 07 17:38:54.033462 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:54.033435    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb" (UID: "98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:38:54.033524 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:54.033452    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb" (UID: "98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:38:54.033524 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:54.033463    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-service-ca" (OuterVolumeSpecName: "service-ca") pod "98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb" (UID: "98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:38:54.033524 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:54.033449    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-console-config" (OuterVolumeSpecName: "console-config") pod "98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb" (UID: "98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:38:54.035501 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:54.035473    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-kube-api-access-rdc42" (OuterVolumeSpecName: "kube-api-access-rdc42") pod "98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb" (UID: "98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb"). InnerVolumeSpecName "kube-api-access-rdc42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:38:54.035501 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:54.035487    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb" (UID: "98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:38:54.035638 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:54.035523    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb" (UID: "98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:38:54.134137 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:54.134101    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-console-oauth-config\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:38:54.134137 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:54.134132    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-console-serving-cert\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:38:54.134137 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:54.134141    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-trusted-ca-bundle\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:38:54.134371 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:54.134150    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-oauth-serving-cert\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:38:54.134371 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:54.134159    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-console-config\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:38:54.134371 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:54.134168    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-service-ca\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:38:54.134371 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:54.134176    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdc42\" (UniqueName: \"kubernetes.io/projected/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb-kube-api-access-rdc42\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:38:54.730661 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:54.730626    2559 generic.go:356] "Generic (PLEG): container finished" podID="98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb" containerID="d72a0076270f0ee2d7dd09e88dd6870129d2df9d811e988c54db42ac60424ac9" exitCode=0
Jul 07 17:38:54.731073 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:54.730675    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-576b9b5ff6-9w6mc"
Jul 07 17:38:54.731073 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:54.730709    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-576b9b5ff6-9w6mc" event={"ID":"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb","Type":"ContainerDied","Data":"d72a0076270f0ee2d7dd09e88dd6870129d2df9d811e988c54db42ac60424ac9"}
Jul 07 17:38:54.731073 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:54.730762    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-576b9b5ff6-9w6mc" event={"ID":"98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb","Type":"ContainerDied","Data":"d8f9eb43df065d7979c3270393c3c1001fd7a4a996f7f14dabe9a9402fb0416e"}
Jul 07 17:38:54.731073 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:54.730783    2559 scope.go:117] "RemoveContainer" containerID="d72a0076270f0ee2d7dd09e88dd6870129d2df9d811e988c54db42ac60424ac9"
Jul 07 17:38:54.739511 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:54.739494    2559 scope.go:117] "RemoveContainer" containerID="d72a0076270f0ee2d7dd09e88dd6870129d2df9d811e988c54db42ac60424ac9"
Jul 07 17:38:54.739778 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:38:54.739756    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d72a0076270f0ee2d7dd09e88dd6870129d2df9d811e988c54db42ac60424ac9\": container with ID starting with d72a0076270f0ee2d7dd09e88dd6870129d2df9d811e988c54db42ac60424ac9 not found: ID does not exist" containerID="d72a0076270f0ee2d7dd09e88dd6870129d2df9d811e988c54db42ac60424ac9"
Jul 07 17:38:54.739823 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:54.739788    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d72a0076270f0ee2d7dd09e88dd6870129d2df9d811e988c54db42ac60424ac9"} err="failed to get container status \"d72a0076270f0ee2d7dd09e88dd6870129d2df9d811e988c54db42ac60424ac9\": rpc error: code = NotFound desc = could not find container \"d72a0076270f0ee2d7dd09e88dd6870129d2df9d811e988c54db42ac60424ac9\": container with ID starting with d72a0076270f0ee2d7dd09e88dd6870129d2df9d811e988c54db42ac60424ac9 not found: ID does not exist"
Jul 07 17:38:54.749980 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:54.749940    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-576b9b5ff6-9w6mc"]
Jul 07 17:38:54.756995 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:54.756970    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-576b9b5ff6-9w6mc"]
Jul 07 17:38:55.006033 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:38:55.005942    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb" path="/var/lib/kubelet/pods/98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb/volumes"
Jul 07 17:39:30.385457 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:30.385406    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:30.754287 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:30.754127    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:36.902837 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:36.902753    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:39.201798 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.201764    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fb4f458c7-mrzfd"]
Jul 07 17:39:39.202225 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.202064    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb" containerName="console"
Jul 07 17:39:39.202225 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.202075    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb" containerName="console"
Jul 07 17:39:39.202225 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.202124    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="98a2d15f-69fb-4583-80a8-ab5f0e4bb3eb" containerName="console"
Jul 07 17:39:39.204068 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.204045    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb4f458c7-mrzfd"
Jul 07 17:39:39.220193 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.220172    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fb4f458c7-mrzfd"]
Jul 07 17:39:39.278214 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.278185    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:39.304412 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.304387    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/834c6880-818c-4a1b-a010-eb45a8744a5c-console-serving-cert\") pod \"console-fb4f458c7-mrzfd\" (UID: \"834c6880-818c-4a1b-a010-eb45a8744a5c\") " pod="openshift-console/console-fb4f458c7-mrzfd"
Jul 07 17:39:39.304494 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.304421    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/834c6880-818c-4a1b-a010-eb45a8744a5c-service-ca\") pod \"console-fb4f458c7-mrzfd\" (UID: \"834c6880-818c-4a1b-a010-eb45a8744a5c\") " pod="openshift-console/console-fb4f458c7-mrzfd"
Jul 07 17:39:39.304494 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.304436    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/834c6880-818c-4a1b-a010-eb45a8744a5c-oauth-serving-cert\") pod \"console-fb4f458c7-mrzfd\" (UID: \"834c6880-818c-4a1b-a010-eb45a8744a5c\") " pod="openshift-console/console-fb4f458c7-mrzfd"
Jul 07 17:39:39.304494 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.304452    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/834c6880-818c-4a1b-a010-eb45a8744a5c-trusted-ca-bundle\") pod \"console-fb4f458c7-mrzfd\" (UID: \"834c6880-818c-4a1b-a010-eb45a8744a5c\") " pod="openshift-console/console-fb4f458c7-mrzfd"
Jul 07 17:39:39.304639 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.304520    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/834c6880-818c-4a1b-a010-eb45a8744a5c-console-config\") pod \"console-fb4f458c7-mrzfd\" (UID: \"834c6880-818c-4a1b-a010-eb45a8744a5c\") " pod="openshift-console/console-fb4f458c7-mrzfd"
Jul 07 17:39:39.304639 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.304546    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74bvx\" (UniqueName: \"kubernetes.io/projected/834c6880-818c-4a1b-a010-eb45a8744a5c-kube-api-access-74bvx\") pod \"console-fb4f458c7-mrzfd\" (UID: \"834c6880-818c-4a1b-a010-eb45a8744a5c\") " pod="openshift-console/console-fb4f458c7-mrzfd"
Jul 07 17:39:39.304639 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.304599    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/834c6880-818c-4a1b-a010-eb45a8744a5c-console-oauth-config\") pod \"console-fb4f458c7-mrzfd\" (UID: \"834c6880-818c-4a1b-a010-eb45a8744a5c\") " pod="openshift-console/console-fb4f458c7-mrzfd"
Jul 07 17:39:39.387276 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.387243    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:39.405445 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.405424    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/834c6880-818c-4a1b-a010-eb45a8744a5c-console-serving-cert\") pod \"console-fb4f458c7-mrzfd\" (UID: \"834c6880-818c-4a1b-a010-eb45a8744a5c\") " pod="openshift-console/console-fb4f458c7-mrzfd"
Jul 07 17:39:39.405581 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.405455    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/834c6880-818c-4a1b-a010-eb45a8744a5c-service-ca\") pod \"console-fb4f458c7-mrzfd\" (UID: \"834c6880-818c-4a1b-a010-eb45a8744a5c\") " pod="openshift-console/console-fb4f458c7-mrzfd"
Jul 07 17:39:39.405581 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.405472    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/834c6880-818c-4a1b-a010-eb45a8744a5c-oauth-serving-cert\") pod \"console-fb4f458c7-mrzfd\" (UID: \"834c6880-818c-4a1b-a010-eb45a8744a5c\") " pod="openshift-console/console-fb4f458c7-mrzfd"
Jul 07 17:39:39.405581 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.405488    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/834c6880-818c-4a1b-a010-eb45a8744a5c-trusted-ca-bundle\") pod \"console-fb4f458c7-mrzfd\" (UID: \"834c6880-818c-4a1b-a010-eb45a8744a5c\") " pod="openshift-console/console-fb4f458c7-mrzfd"
Jul 07 17:39:39.405581 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.405513    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/834c6880-818c-4a1b-a010-eb45a8744a5c-console-config\") pod \"console-fb4f458c7-mrzfd\" (UID: \"834c6880-818c-4a1b-a010-eb45a8744a5c\") " pod="openshift-console/console-fb4f458c7-mrzfd"
Jul 07 17:39:39.405798 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.405686    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74bvx\" (UniqueName: \"kubernetes.io/projected/834c6880-818c-4a1b-a010-eb45a8744a5c-kube-api-access-74bvx\") pod \"console-fb4f458c7-mrzfd\" (UID: \"834c6880-818c-4a1b-a010-eb45a8744a5c\") " pod="openshift-console/console-fb4f458c7-mrzfd"
Jul 07 17:39:39.405798 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.405710    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/834c6880-818c-4a1b-a010-eb45a8744a5c-console-oauth-config\") pod \"console-fb4f458c7-mrzfd\" (UID: \"834c6880-818c-4a1b-a010-eb45a8744a5c\") " pod="openshift-console/console-fb4f458c7-mrzfd"
Jul 07 17:39:39.406192 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.406170    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/834c6880-818c-4a1b-a010-eb45a8744a5c-service-ca\") pod \"console-fb4f458c7-mrzfd\" (UID: \"834c6880-818c-4a1b-a010-eb45a8744a5c\") " pod="openshift-console/console-fb4f458c7-mrzfd"
Jul 07 17:39:39.406283 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.406192    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/834c6880-818c-4a1b-a010-eb45a8744a5c-oauth-serving-cert\") pod \"console-fb4f458c7-mrzfd\" (UID: \"834c6880-818c-4a1b-a010-eb45a8744a5c\") " pod="openshift-console/console-fb4f458c7-mrzfd"
Jul 07 17:39:39.406391 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.406371    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/834c6880-818c-4a1b-a010-eb45a8744a5c-console-config\") pod \"console-fb4f458c7-mrzfd\" (UID: \"834c6880-818c-4a1b-a010-eb45a8744a5c\") " pod="openshift-console/console-fb4f458c7-mrzfd"
Jul 07 17:39:39.406880 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.406859    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/834c6880-818c-4a1b-a010-eb45a8744a5c-trusted-ca-bundle\") pod \"console-fb4f458c7-mrzfd\" (UID: \"834c6880-818c-4a1b-a010-eb45a8744a5c\") " pod="openshift-console/console-fb4f458c7-mrzfd"
Jul 07 17:39:39.408154 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.408132    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/834c6880-818c-4a1b-a010-eb45a8744a5c-console-serving-cert\") pod \"console-fb4f458c7-mrzfd\" (UID: \"834c6880-818c-4a1b-a010-eb45a8744a5c\") " pod="openshift-console/console-fb4f458c7-mrzfd"
Jul 07 17:39:39.408254 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.408241    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/834c6880-818c-4a1b-a010-eb45a8744a5c-console-oauth-config\") pod \"console-fb4f458c7-mrzfd\" (UID: \"834c6880-818c-4a1b-a010-eb45a8744a5c\") " pod="openshift-console/console-fb4f458c7-mrzfd"
Jul 07 17:39:39.412944 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.412924    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74bvx\" (UniqueName: \"kubernetes.io/projected/834c6880-818c-4a1b-a010-eb45a8744a5c-kube-api-access-74bvx\") pod \"console-fb4f458c7-mrzfd\" (UID: \"834c6880-818c-4a1b-a010-eb45a8744a5c\") " pod="openshift-console/console-fb4f458c7-mrzfd"
Jul 07 17:39:39.512784 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.512718    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb4f458c7-mrzfd"
Jul 07 17:39:39.641965 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.641931    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fb4f458c7-mrzfd"]
Jul 07 17:39:39.646618 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:39:39.646588    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod834c6880_818c_4a1b_a010_eb45a8744a5c.slice/crio-75d855519e6abcd405a2e81b8c16698096205f30ca24e99de57a52b72542b10b WatchSource:0}: Error finding container 75d855519e6abcd405a2e81b8c16698096205f30ca24e99de57a52b72542b10b: Status 404 returned error can't find the container with id 75d855519e6abcd405a2e81b8c16698096205f30ca24e99de57a52b72542b10b
Jul 07 17:39:39.906991 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.906936    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb4f458c7-mrzfd" event={"ID":"834c6880-818c-4a1b-a010-eb45a8744a5c","Type":"ContainerStarted","Data":"d4a1ac38d82bb1bd4bdec36a5f956e354758d176b0c9ae25b43a6c775d7fd247"}
Jul 07 17:39:39.907168 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.907009    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb4f458c7-mrzfd" event={"ID":"834c6880-818c-4a1b-a010-eb45a8744a5c","Type":"ContainerStarted","Data":"75d855519e6abcd405a2e81b8c16698096205f30ca24e99de57a52b72542b10b"}
Jul 07 17:39:39.927639 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:39.927571    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fb4f458c7-mrzfd" podStartSLOduration=0.92754774 podStartE2EDuration="927.54774ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:39:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:39:39.92699159 +0000 UTC m=+179.442221927" watchObservedRunningTime="2026-07-07 17:39:39.92754774 +0000 UTC m=+179.442778077"
Jul 07 17:39:45.610447 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:45.610398    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:45.707502 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:45.707454    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:49.513016 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:49.512981    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fb4f458c7-mrzfd"
Jul 07 17:39:49.513403 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:49.513038    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fb4f458c7-mrzfd"
Jul 07 17:39:49.517699 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:49.517675    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fb4f458c7-mrzfd"
Jul 07 17:39:49.946949 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:49.946922    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fb4f458c7-mrzfd"
Jul 07 17:39:49.999121 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:49.999093    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68bf769b9d-bdj8s"]
Jul 07 17:39:50.078409 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:50.078361    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:50.106375 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:50.106338    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68b5cd5499-g8w2p"]
Jul 07 17:39:50.109326 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:50.109306    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68b5cd5499-g8w2p"
Jul 07 17:39:50.119743 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:50.119720    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68b5cd5499-g8w2p"]
Jul 07 17:39:50.195801 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:50.195766    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dedce612-68bc-40ef-a75f-d105668c35a0-oauth-serving-cert\") pod \"console-68b5cd5499-g8w2p\" (UID: \"dedce612-68bc-40ef-a75f-d105668c35a0\") " pod="openshift-console/console-68b5cd5499-g8w2p"
Jul 07 17:39:50.195801 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:50.195802    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dedce612-68bc-40ef-a75f-d105668c35a0-console-config\") pod \"console-68b5cd5499-g8w2p\" (UID: \"dedce612-68bc-40ef-a75f-d105668c35a0\") " pod="openshift-console/console-68b5cd5499-g8w2p"
Jul 07 17:39:50.196045 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:50.195834    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dedce612-68bc-40ef-a75f-d105668c35a0-console-oauth-config\") pod \"console-68b5cd5499-g8w2p\" (UID: \"dedce612-68bc-40ef-a75f-d105668c35a0\") " pod="openshift-console/console-68b5cd5499-g8w2p"
Jul 07 17:39:50.196045 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:50.195921    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dedce612-68bc-40ef-a75f-d105668c35a0-service-ca\") pod \"console-68b5cd5499-g8w2p\" (UID: \"dedce612-68bc-40ef-a75f-d105668c35a0\") " pod="openshift-console/console-68b5cd5499-g8w2p"
Jul 07 17:39:50.196045 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:50.196008    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dedce612-68bc-40ef-a75f-d105668c35a0-console-serving-cert\") pod \"console-68b5cd5499-g8w2p\" (UID: \"dedce612-68bc-40ef-a75f-d105668c35a0\") " pod="openshift-console/console-68b5cd5499-g8w2p"
Jul 07 17:39:50.196045 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:50.196042    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nnbg\" (UniqueName: \"kubernetes.io/projected/dedce612-68bc-40ef-a75f-d105668c35a0-kube-api-access-9nnbg\") pod \"console-68b5cd5499-g8w2p\" (UID: \"dedce612-68bc-40ef-a75f-d105668c35a0\") " pod="openshift-console/console-68b5cd5499-g8w2p"
Jul 07 17:39:50.196172 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:50.196059    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dedce612-68bc-40ef-a75f-d105668c35a0-trusted-ca-bundle\") pod \"console-68b5cd5499-g8w2p\" (UID: \"dedce612-68bc-40ef-a75f-d105668c35a0\") " pod="openshift-console/console-68b5cd5499-g8w2p"
Jul 07 17:39:50.220209 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:50.220130    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:50.297009 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:50.296938    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nnbg\" (UniqueName: \"kubernetes.io/projected/dedce612-68bc-40ef-a75f-d105668c35a0-kube-api-access-9nnbg\") pod \"console-68b5cd5499-g8w2p\" (UID: \"dedce612-68bc-40ef-a75f-d105668c35a0\") " pod="openshift-console/console-68b5cd5499-g8w2p"
Jul 07 17:39:50.297009 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:50.297007    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dedce612-68bc-40ef-a75f-d105668c35a0-trusted-ca-bundle\") pod \"console-68b5cd5499-g8w2p\" (UID: \"dedce612-68bc-40ef-a75f-d105668c35a0\") " pod="openshift-console/console-68b5cd5499-g8w2p"
Jul 07 17:39:50.297249 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:50.297026    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dedce612-68bc-40ef-a75f-d105668c35a0-oauth-serving-cert\") pod \"console-68b5cd5499-g8w2p\" (UID: \"dedce612-68bc-40ef-a75f-d105668c35a0\") " pod="openshift-console/console-68b5cd5499-g8w2p"
Jul 07 17:39:50.297249 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:50.297046    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dedce612-68bc-40ef-a75f-d105668c35a0-console-config\") pod \"console-68b5cd5499-g8w2p\" (UID: \"dedce612-68bc-40ef-a75f-d105668c35a0\") " pod="openshift-console/console-68b5cd5499-g8w2p"
Jul 07 17:39:50.297249 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:50.297068    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dedce612-68bc-40ef-a75f-d105668c35a0-console-oauth-config\") pod \"console-68b5cd5499-g8w2p\" (UID: \"dedce612-68bc-40ef-a75f-d105668c35a0\") " pod="openshift-console/console-68b5cd5499-g8w2p"
Jul 07 17:39:50.297249 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:50.297125    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dedce612-68bc-40ef-a75f-d105668c35a0-service-ca\") pod \"console-68b5cd5499-g8w2p\" (UID: \"dedce612-68bc-40ef-a75f-d105668c35a0\") " pod="openshift-console/console-68b5cd5499-g8w2p"
Jul 07 17:39:50.297249 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:50.297182    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dedce612-68bc-40ef-a75f-d105668c35a0-console-serving-cert\") pod \"console-68b5cd5499-g8w2p\" (UID: \"dedce612-68bc-40ef-a75f-d105668c35a0\") " pod="openshift-console/console-68b5cd5499-g8w2p"
Jul 07 17:39:50.297827 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:50.297790    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dedce612-68bc-40ef-a75f-d105668c35a0-oauth-serving-cert\") pod \"console-68b5cd5499-g8w2p\" (UID: \"dedce612-68bc-40ef-a75f-d105668c35a0\") " pod="openshift-console/console-68b5cd5499-g8w2p"
Jul 07 17:39:50.297827 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:50.297812    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dedce612-68bc-40ef-a75f-d105668c35a0-console-config\") pod \"console-68b5cd5499-g8w2p\" (UID: \"dedce612-68bc-40ef-a75f-d105668c35a0\") " pod="openshift-console/console-68b5cd5499-g8w2p"
Jul 07 17:39:50.297990 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:50.297873    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dedce612-68bc-40ef-a75f-d105668c35a0-service-ca\") pod \"console-68b5cd5499-g8w2p\" (UID: \"dedce612-68bc-40ef-a75f-d105668c35a0\") " pod="openshift-console/console-68b5cd5499-g8w2p"
Jul 07 17:39:50.298225 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:50.298201    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dedce612-68bc-40ef-a75f-d105668c35a0-trusted-ca-bundle\") pod \"console-68b5cd5499-g8w2p\" (UID: \"dedce612-68bc-40ef-a75f-d105668c35a0\") " pod="openshift-console/console-68b5cd5499-g8w2p"
Jul 07 17:39:50.299679 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:50.299661    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dedce612-68bc-40ef-a75f-d105668c35a0-console-oauth-config\") pod \"console-68b5cd5499-g8w2p\" (UID: \"dedce612-68bc-40ef-a75f-d105668c35a0\") " pod="openshift-console/console-68b5cd5499-g8w2p"
Jul 07 17:39:50.299868 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:50.299851    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dedce612-68bc-40ef-a75f-d105668c35a0-console-serving-cert\") pod \"console-68b5cd5499-g8w2p\" (UID: \"dedce612-68bc-40ef-a75f-d105668c35a0\") " pod="openshift-console/console-68b5cd5499-g8w2p"
Jul 07 17:39:50.305130 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:50.305108    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nnbg\" (UniqueName: \"kubernetes.io/projected/dedce612-68bc-40ef-a75f-d105668c35a0-kube-api-access-9nnbg\") pod \"console-68b5cd5499-g8w2p\" (UID: \"dedce612-68bc-40ef-a75f-d105668c35a0\") " pod="openshift-console/console-68b5cd5499-g8w2p"
Jul 07 17:39:50.418968 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:50.418928    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68b5cd5499-g8w2p"
Jul 07 17:39:50.458232 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:50.458170    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:50.550256 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:50.550230    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68b5cd5499-g8w2p"]
Jul 07 17:39:50.553023 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:39:50.552995    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddedce612_68bc_40ef_a75f_d105668c35a0.slice/crio-f14010cb163c56bc1175d4b3a40859acc9031a0690db3661371839849a4bb01b WatchSource:0}: Error finding container f14010cb163c56bc1175d4b3a40859acc9031a0690db3661371839849a4bb01b: Status 404 returned error can't find the container with id f14010cb163c56bc1175d4b3a40859acc9031a0690db3661371839849a4bb01b
Jul 07 17:39:50.947317 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:50.947278    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68b5cd5499-g8w2p" event={"ID":"dedce612-68bc-40ef-a75f-d105668c35a0","Type":"ContainerStarted","Data":"284e0fa3d4f7739140a97a10ff414e2dc0d3ce74e15ce36624f6592a117d85a8"}
Jul 07 17:39:50.947488 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:50.947332    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68b5cd5499-g8w2p" event={"ID":"dedce612-68bc-40ef-a75f-d105668c35a0","Type":"ContainerStarted","Data":"f14010cb163c56bc1175d4b3a40859acc9031a0690db3661371839849a4bb01b"}
Jul 07 17:39:50.964837 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:50.964799    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68b5cd5499-g8w2p" podStartSLOduration=0.964784838 podStartE2EDuration="964.784838ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:39:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:39:50.963799813 +0000 UTC m=+190.479030153" watchObservedRunningTime="2026-07-07 17:39:50.964784838 +0000 UTC m=+190.480015173"
Jul 07 17:39:51.046886 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:51.046855    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:51.147724 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:51.147698    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:51.846792 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:51.846762    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:51.947625 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:51.947593    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:57.533685 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:57.533652    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:57.604565 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:39:57.604531    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:40:00.419478 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:00.419427    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68b5cd5499-g8w2p"
Jul 07 17:40:00.419863 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:00.419532    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68b5cd5499-g8w2p"
Jul 07 17:40:00.424011 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:00.423989    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68b5cd5499-g8w2p"
Jul 07 17:40:00.987385 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:00.987361    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68b5cd5499-g8w2p"
Jul 07 17:40:01.031868 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:01.031843    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fb4f458c7-mrzfd"]
Jul 07 17:40:01.139701 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:01.139670    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:40:01.240280 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:01.240209    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:40:05.914251 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:05.914212    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:40:06.015811 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:06.015778    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:40:15.022811 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:15.022764    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-68bf769b9d-bdj8s" podUID="aaf55638-3ca8-42cc-9b4d-6b4763f96c2f" containerName="console" containerID="cri-o://e7b203b7a9311e887414b1ca305d7465d12ad2dae852b3488366f1d6c24e15ba" gracePeriod=15
Jul 07 17:40:15.267913 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:15.267890    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68bf769b9d-bdj8s"
Jul 07 17:40:15.403681 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:15.403648    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-oauth-serving-cert\") pod \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\" (UID: \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\") "
Jul 07 17:40:15.403865 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:15.403687    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-console-config\") pod \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\" (UID: \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\") "
Jul 07 17:40:15.403865 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:15.403764    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-console-serving-cert\") pod \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\" (UID: \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\") "
Jul 07 17:40:15.403865 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:15.403787    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jb8tq\" (UniqueName: \"kubernetes.io/projected/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-kube-api-access-jb8tq\") pod \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\" (UID: \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\") "
Jul 07 17:40:15.403865 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:15.403811    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-trusted-ca-bundle\") pod \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\" (UID: \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\") "
Jul 07 17:40:15.403865 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:15.403834    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-service-ca\") pod \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\" (UID: \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\") "
Jul 07 17:40:15.403865 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:15.403859    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-console-oauth-config\") pod \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\" (UID: \"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f\") "
Jul 07 17:40:15.404205 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:15.404144    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "aaf55638-3ca8-42cc-9b4d-6b4763f96c2f" (UID: "aaf55638-3ca8-42cc-9b4d-6b4763f96c2f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:40:15.404291 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:15.404261    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-console-config" (OuterVolumeSpecName: "console-config") pod "aaf55638-3ca8-42cc-9b4d-6b4763f96c2f" (UID: "aaf55638-3ca8-42cc-9b4d-6b4763f96c2f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:40:15.404377 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:15.404350    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-service-ca" (OuterVolumeSpecName: "service-ca") pod "aaf55638-3ca8-42cc-9b4d-6b4763f96c2f" (UID: "aaf55638-3ca8-42cc-9b4d-6b4763f96c2f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:40:15.404435 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:15.404368    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "aaf55638-3ca8-42cc-9b4d-6b4763f96c2f" (UID: "aaf55638-3ca8-42cc-9b4d-6b4763f96c2f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:40:15.406246 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:15.406214    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-kube-api-access-jb8tq" (OuterVolumeSpecName: "kube-api-access-jb8tq") pod "aaf55638-3ca8-42cc-9b4d-6b4763f96c2f" (UID: "aaf55638-3ca8-42cc-9b4d-6b4763f96c2f"). InnerVolumeSpecName "kube-api-access-jb8tq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:40:15.406246 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:15.406231    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "aaf55638-3ca8-42cc-9b4d-6b4763f96c2f" (UID: "aaf55638-3ca8-42cc-9b4d-6b4763f96c2f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:40:15.406379 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:15.406253    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "aaf55638-3ca8-42cc-9b4d-6b4763f96c2f" (UID: "aaf55638-3ca8-42cc-9b4d-6b4763f96c2f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:40:15.505406 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:15.505377    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-console-serving-cert\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:40:15.505406 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:15.505400    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jb8tq\" (UniqueName: \"kubernetes.io/projected/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-kube-api-access-jb8tq\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:40:15.505406 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:15.505410    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-trusted-ca-bundle\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:40:15.505618 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:15.505421    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-service-ca\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:40:15.505618 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:15.505432    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-console-oauth-config\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:40:15.505618 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:15.505442    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-oauth-serving-cert\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:40:15.505618 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:15.505449    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f-console-config\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:40:16.038847 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:16.038814    2559 generic.go:356] "Generic (PLEG): container finished" podID="aaf55638-3ca8-42cc-9b4d-6b4763f96c2f" containerID="e7b203b7a9311e887414b1ca305d7465d12ad2dae852b3488366f1d6c24e15ba" exitCode=0
Jul 07 17:40:16.038847 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:16.038849    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68bf769b9d-bdj8s" event={"ID":"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f","Type":"ContainerDied","Data":"e7b203b7a9311e887414b1ca305d7465d12ad2dae852b3488366f1d6c24e15ba"}
Jul 07 17:40:16.039315 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:16.038873    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68bf769b9d-bdj8s"
Jul 07 17:40:16.039315 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:16.038890    2559 scope.go:117] "RemoveContainer" containerID="e7b203b7a9311e887414b1ca305d7465d12ad2dae852b3488366f1d6c24e15ba"
Jul 07 17:40:16.039315 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:16.038880    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68bf769b9d-bdj8s" event={"ID":"aaf55638-3ca8-42cc-9b4d-6b4763f96c2f","Type":"ContainerDied","Data":"d7904a7ecdca453933482b7121e07a11d73a4132cd59519f9c63737743493152"}
Jul 07 17:40:16.047690 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:16.047673    2559 scope.go:117] "RemoveContainer" containerID="e7b203b7a9311e887414b1ca305d7465d12ad2dae852b3488366f1d6c24e15ba"
Jul 07 17:40:16.047940 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:40:16.047920    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7b203b7a9311e887414b1ca305d7465d12ad2dae852b3488366f1d6c24e15ba\": container with ID starting with e7b203b7a9311e887414b1ca305d7465d12ad2dae852b3488366f1d6c24e15ba not found: ID does not exist" containerID="e7b203b7a9311e887414b1ca305d7465d12ad2dae852b3488366f1d6c24e15ba"
Jul 07 17:40:16.048075 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:16.047975    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7b203b7a9311e887414b1ca305d7465d12ad2dae852b3488366f1d6c24e15ba"} err="failed to get container status \"e7b203b7a9311e887414b1ca305d7465d12ad2dae852b3488366f1d6c24e15ba\": rpc error: code = NotFound desc = could not find container \"e7b203b7a9311e887414b1ca305d7465d12ad2dae852b3488366f1d6c24e15ba\": container with ID starting with e7b203b7a9311e887414b1ca305d7465d12ad2dae852b3488366f1d6c24e15ba not found: ID does not exist"
Jul 07 17:40:16.060290 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:16.060257    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68bf769b9d-bdj8s"]
Jul 07 17:40:16.063758 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:16.063739    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68bf769b9d-bdj8s"]
Jul 07 17:40:17.005689 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:17.005652    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aaf55638-3ca8-42cc-9b4d-6b4763f96c2f" path="/var/lib/kubelet/pods/aaf55638-3ca8-42cc-9b4d-6b4763f96c2f/volumes"
Jul 07 17:40:26.054732 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:26.054691    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-fb4f458c7-mrzfd" podUID="834c6880-818c-4a1b-a010-eb45a8744a5c" containerName="console" containerID="cri-o://d4a1ac38d82bb1bd4bdec36a5f956e354758d176b0c9ae25b43a6c775d7fd247" gracePeriod=15
Jul 07 17:40:26.294877 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:26.294846    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb4f458c7-mrzfd"
Jul 07 17:40:26.393227 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:26.393191    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/834c6880-818c-4a1b-a010-eb45a8744a5c-trusted-ca-bundle\") pod \"834c6880-818c-4a1b-a010-eb45a8744a5c\" (UID: \"834c6880-818c-4a1b-a010-eb45a8744a5c\") "
Jul 07 17:40:26.393227 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:26.393229    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/834c6880-818c-4a1b-a010-eb45a8744a5c-console-oauth-config\") pod \"834c6880-818c-4a1b-a010-eb45a8744a5c\" (UID: \"834c6880-818c-4a1b-a010-eb45a8744a5c\") "
Jul 07 17:40:26.393481 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:26.393249    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/834c6880-818c-4a1b-a010-eb45a8744a5c-service-ca\") pod \"834c6880-818c-4a1b-a010-eb45a8744a5c\" (UID: \"834c6880-818c-4a1b-a010-eb45a8744a5c\") "
Jul 07 17:40:26.393481 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:26.393353    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/834c6880-818c-4a1b-a010-eb45a8744a5c-console-serving-cert\") pod \"834c6880-818c-4a1b-a010-eb45a8744a5c\" (UID: \"834c6880-818c-4a1b-a010-eb45a8744a5c\") "
Jul 07 17:40:26.393481 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:26.393415    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/834c6880-818c-4a1b-a010-eb45a8744a5c-console-config\") pod \"834c6880-818c-4a1b-a010-eb45a8744a5c\" (UID: \"834c6880-818c-4a1b-a010-eb45a8744a5c\") "
Jul 07 17:40:26.393481 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:26.393450    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/834c6880-818c-4a1b-a010-eb45a8744a5c-oauth-serving-cert\") pod \"834c6880-818c-4a1b-a010-eb45a8744a5c\" (UID: \"834c6880-818c-4a1b-a010-eb45a8744a5c\") "
Jul 07 17:40:26.393481 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:26.393475    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74bvx\" (UniqueName: \"kubernetes.io/projected/834c6880-818c-4a1b-a010-eb45a8744a5c-kube-api-access-74bvx\") pod \"834c6880-818c-4a1b-a010-eb45a8744a5c\" (UID: \"834c6880-818c-4a1b-a010-eb45a8744a5c\") "
Jul 07 17:40:26.393738 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:26.393594    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/834c6880-818c-4a1b-a010-eb45a8744a5c-service-ca" (OuterVolumeSpecName: "service-ca") pod "834c6880-818c-4a1b-a010-eb45a8744a5c" (UID: "834c6880-818c-4a1b-a010-eb45a8744a5c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:40:26.393738 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:26.393714    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/834c6880-818c-4a1b-a010-eb45a8744a5c-service-ca\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:40:26.393841 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:26.393798    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/834c6880-818c-4a1b-a010-eb45a8744a5c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "834c6880-818c-4a1b-a010-eb45a8744a5c" (UID: "834c6880-818c-4a1b-a010-eb45a8744a5c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:40:26.393979 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:26.393923    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/834c6880-818c-4a1b-a010-eb45a8744a5c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "834c6880-818c-4a1b-a010-eb45a8744a5c" (UID: "834c6880-818c-4a1b-a010-eb45a8744a5c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:40:26.393979 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:26.393928    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/834c6880-818c-4a1b-a010-eb45a8744a5c-console-config" (OuterVolumeSpecName: "console-config") pod "834c6880-818c-4a1b-a010-eb45a8744a5c" (UID: "834c6880-818c-4a1b-a010-eb45a8744a5c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:40:26.395778 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:26.395755    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/834c6880-818c-4a1b-a010-eb45a8744a5c-kube-api-access-74bvx" (OuterVolumeSpecName: "kube-api-access-74bvx") pod "834c6880-818c-4a1b-a010-eb45a8744a5c" (UID: "834c6880-818c-4a1b-a010-eb45a8744a5c"). InnerVolumeSpecName "kube-api-access-74bvx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:40:26.396070 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:26.396055    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/834c6880-818c-4a1b-a010-eb45a8744a5c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "834c6880-818c-4a1b-a010-eb45a8744a5c" (UID: "834c6880-818c-4a1b-a010-eb45a8744a5c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:40:26.396131 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:26.396094    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/834c6880-818c-4a1b-a010-eb45a8744a5c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "834c6880-818c-4a1b-a010-eb45a8744a5c" (UID: "834c6880-818c-4a1b-a010-eb45a8744a5c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:40:26.494868 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:26.494833    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/834c6880-818c-4a1b-a010-eb45a8744a5c-console-config\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:40:26.494868 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:26.494858    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/834c6880-818c-4a1b-a010-eb45a8744a5c-oauth-serving-cert\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:40:26.494868 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:26.494868    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74bvx\" (UniqueName: \"kubernetes.io/projected/834c6880-818c-4a1b-a010-eb45a8744a5c-kube-api-access-74bvx\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:40:26.494868 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:26.494876    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/834c6880-818c-4a1b-a010-eb45a8744a5c-trusted-ca-bundle\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:40:26.495153 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:26.494884    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/834c6880-818c-4a1b-a010-eb45a8744a5c-console-oauth-config\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:40:26.495153 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:26.494892    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/834c6880-818c-4a1b-a010-eb45a8744a5c-console-serving-cert\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:40:27.077369 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:27.077336    2559 generic.go:356] "Generic (PLEG): container finished" podID="834c6880-818c-4a1b-a010-eb45a8744a5c" containerID="d4a1ac38d82bb1bd4bdec36a5f956e354758d176b0c9ae25b43a6c775d7fd247" exitCode=0
Jul 07 17:40:27.077811 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:27.077384    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb4f458c7-mrzfd"
Jul 07 17:40:27.077811 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:27.077400    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb4f458c7-mrzfd" event={"ID":"834c6880-818c-4a1b-a010-eb45a8744a5c","Type":"ContainerDied","Data":"d4a1ac38d82bb1bd4bdec36a5f956e354758d176b0c9ae25b43a6c775d7fd247"}
Jul 07 17:40:27.077811 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:27.077438    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb4f458c7-mrzfd" event={"ID":"834c6880-818c-4a1b-a010-eb45a8744a5c","Type":"ContainerDied","Data":"75d855519e6abcd405a2e81b8c16698096205f30ca24e99de57a52b72542b10b"}
Jul 07 17:40:27.077811 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:27.077458    2559 scope.go:117] "RemoveContainer" containerID="d4a1ac38d82bb1bd4bdec36a5f956e354758d176b0c9ae25b43a6c775d7fd247"
Jul 07 17:40:27.085820 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:27.085798    2559 scope.go:117] "RemoveContainer" containerID="d4a1ac38d82bb1bd4bdec36a5f956e354758d176b0c9ae25b43a6c775d7fd247"
Jul 07 17:40:27.086129 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:40:27.086109    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4a1ac38d82bb1bd4bdec36a5f956e354758d176b0c9ae25b43a6c775d7fd247\": container with ID starting with d4a1ac38d82bb1bd4bdec36a5f956e354758d176b0c9ae25b43a6c775d7fd247 not found: ID does not exist" containerID="d4a1ac38d82bb1bd4bdec36a5f956e354758d176b0c9ae25b43a6c775d7fd247"
Jul 07 17:40:27.086202 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:27.086141    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4a1ac38d82bb1bd4bdec36a5f956e354758d176b0c9ae25b43a6c775d7fd247"} err="failed to get container status \"d4a1ac38d82bb1bd4bdec36a5f956e354758d176b0c9ae25b43a6c775d7fd247\": rpc error: code = NotFound desc = could not find container \"d4a1ac38d82bb1bd4bdec36a5f956e354758d176b0c9ae25b43a6c775d7fd247\": container with ID starting with d4a1ac38d82bb1bd4bdec36a5f956e354758d176b0c9ae25b43a6c775d7fd247 not found: ID does not exist"
Jul 07 17:40:27.092761 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:27.092740    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fb4f458c7-mrzfd"]
Jul 07 17:40:27.096583 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:27.096562    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fb4f458c7-mrzfd"]
Jul 07 17:40:29.006124 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:29.006082    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="834c6880-818c-4a1b-a010-eb45a8744a5c" path="/var/lib/kubelet/pods/834c6880-818c-4a1b-a010-eb45a8744a5c/volumes"
Jul 07 17:40:30.243154 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:30.243117    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:40:30.371686 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:40:30.371654    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:00.340115 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:00.340086    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:00.439122 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:00.439088    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:27.454371 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:27.454339    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:28.790533 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:28.790497    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:31.062275 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:31.062240    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:31.162252 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:31.162223    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:32.425495 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:32.425465    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:32.521203 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:32.521159    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:33.279639 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:33.279602    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:33.386088 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:33.386051    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:33.391637 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:33.391612    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-b5tkc"]
Jul 07 17:41:33.391888 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:33.391877    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaf55638-3ca8-42cc-9b4d-6b4763f96c2f" containerName="console"
Jul 07 17:41:33.391930 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:33.391891    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaf55638-3ca8-42cc-9b4d-6b4763f96c2f" containerName="console"
Jul 07 17:41:33.391930 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:33.391903    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="834c6880-818c-4a1b-a010-eb45a8744a5c" containerName="console"
Jul 07 17:41:33.391930 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:33.391909    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="834c6880-818c-4a1b-a010-eb45a8744a5c" containerName="console"
Jul 07 17:41:33.392054 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:33.391986    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="834c6880-818c-4a1b-a010-eb45a8744a5c" containerName="console"
Jul 07 17:41:33.392054 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:33.391994    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaf55638-3ca8-42cc-9b4d-6b4763f96c2f" containerName="console"
Jul 07 17:41:33.393789 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:33.393774    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-b5tkc"
Jul 07 17:41:33.396299 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:33.396278    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 07 17:41:33.396429 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:33.396409    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 07 17:41:33.403757 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:33.403735    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-b5tkc"]
Jul 07 17:41:33.496156 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:33.496127    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0bebc58-ddf9-4b0f-83da-16c81ce4e764-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-b5tkc\" (UID: \"f0bebc58-ddf9-4b0f-83da-16c81ce4e764\") " pod="cert-manager/cert-manager-webhook-6486ffd997-b5tkc"
Jul 07 17:41:33.496481 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:33.496163    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n78b7\" (UniqueName: \"kubernetes.io/projected/f0bebc58-ddf9-4b0f-83da-16c81ce4e764-kube-api-access-n78b7\") pod \"cert-manager-webhook-6486ffd997-b5tkc\" (UID: \"f0bebc58-ddf9-4b0f-83da-16c81ce4e764\") " pod="cert-manager/cert-manager-webhook-6486ffd997-b5tkc"
Jul 07 17:41:33.597173 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:33.597104    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0bebc58-ddf9-4b0f-83da-16c81ce4e764-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-b5tkc\" (UID: \"f0bebc58-ddf9-4b0f-83da-16c81ce4e764\") " pod="cert-manager/cert-manager-webhook-6486ffd997-b5tkc"
Jul 07 17:41:33.597173 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:33.597136    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n78b7\" (UniqueName: \"kubernetes.io/projected/f0bebc58-ddf9-4b0f-83da-16c81ce4e764-kube-api-access-n78b7\") pod \"cert-manager-webhook-6486ffd997-b5tkc\" (UID: \"f0bebc58-ddf9-4b0f-83da-16c81ce4e764\") " pod="cert-manager/cert-manager-webhook-6486ffd997-b5tkc"
Jul 07 17:41:33.607997 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:33.607977    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0bebc58-ddf9-4b0f-83da-16c81ce4e764-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-b5tkc\" (UID: \"f0bebc58-ddf9-4b0f-83da-16c81ce4e764\") " pod="cert-manager/cert-manager-webhook-6486ffd997-b5tkc"
Jul 07 17:41:33.608103 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:33.608037    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n78b7\" (UniqueName: \"kubernetes.io/projected/f0bebc58-ddf9-4b0f-83da-16c81ce4e764-kube-api-access-n78b7\") pod \"cert-manager-webhook-6486ffd997-b5tkc\" (UID: \"f0bebc58-ddf9-4b0f-83da-16c81ce4e764\") " pod="cert-manager/cert-manager-webhook-6486ffd997-b5tkc"
Jul 07 17:41:33.715053 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:33.715031    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-b5tkc"
Jul 07 17:41:33.845083 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:33.845060    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-b5tkc"]
Jul 07 17:41:33.847606 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:41:33.847546    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0bebc58_ddf9_4b0f_83da_16c81ce4e764.slice/crio-9095cab3668f4b0c0c742f6e24dad40a6b60f7d24d8b032666bb05433bd2f2f2 WatchSource:0}: Error finding container 9095cab3668f4b0c0c742f6e24dad40a6b60f7d24d8b032666bb05433bd2f2f2: Status 404 returned error can't find the container with id 9095cab3668f4b0c0c742f6e24dad40a6b60f7d24d8b032666bb05433bd2f2f2
Jul 07 17:41:34.331695 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:34.331657    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-b5tkc" event={"ID":"f0bebc58-ddf9-4b0f-83da-16c81ce4e764","Type":"ContainerStarted","Data":"9095cab3668f4b0c0c742f6e24dad40a6b60f7d24d8b032666bb05433bd2f2f2"}
Jul 07 17:41:35.525458 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:35.525383    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:35.703769 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:35.703729    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:37.345496 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:37.345462    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-b5tkc" event={"ID":"f0bebc58-ddf9-4b0f-83da-16c81ce4e764","Type":"ContainerStarted","Data":"5fdfea85c8a765e724524ec26276b2f8044274a0e2a53de320269c0b711e9b1d"}
Jul 07 17:41:37.345872 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:37.345598    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-b5tkc"
Jul 07 17:41:37.361361 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:37.361319    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-b5tkc" podStartSLOduration=1.358829434 podStartE2EDuration="4.361304476s" totalImagesPullingTime="3.002475042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:41:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:37.360195196 +0000 UTC m=+296.875425533" watchObservedRunningTime="2026-07-07 17:41:37.361304476 +0000 UTC m=+296.876534812"
Jul 07 17:41:37.848644 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:37.848604    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:37.911776 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:37.911742    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:40.842367 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:40.842342    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8s7h4_5f7bf700-4743-4276-b4b1-9245cd337343/ovn-acl-logging/0.log"
Jul 07 17:41:40.848480 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:40.848454    2559 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 17:41:40.849838 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:40.849786    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8s7h4_5f7bf700-4743-4276-b4b1-9245cd337343/ovn-acl-logging/0.log"
Jul 07 17:41:41.647104 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:41.647067    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:41.746548 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:41.746518    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:43.351460 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:43.351433    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-b5tkc"
Jul 07 17:41:43.743642 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:43.743608    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:49.700273 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:49.700231    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:49.802282 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:49.802246    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:51.542824 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:41:51.542786    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:01.777995 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:01.777946    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:03.191175 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:03.191142    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:09.444462 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:09.444432    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:09.544365 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:09.544328    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:10.059635 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.059595    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:10.249940 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.249895    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:10.354608 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.354517    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:10.376372 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.376342    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-6jbzk"]
Jul 07 17:42:10.419733 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.419695    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-6jbzk"]
Jul 07 17:42:10.419905 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.419814    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-6jbzk"
Jul 07 17:42:10.423901 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.423882    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 17:42:10.424120 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.424104    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 17:42:10.424193 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.424107    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lj49x\""
Jul 07 17:42:10.424193 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.424106    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 17:42:10.424193 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.424152    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 17:42:10.479529 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.479496    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8a9d4e60-8bce-41d9-8b43-61f59306b375-manifests\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-6jbzk\" (UID: \"8a9d4e60-8bce-41d9-8b43-61f59306b375\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-6jbzk"
Jul 07 17:42:10.479529 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.479528    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a9d4e60-8bce-41d9-8b43-61f59306b375-webhook-cert\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-6jbzk\" (UID: \"8a9d4e60-8bce-41d9-8b43-61f59306b375\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-6jbzk"
Jul 07 17:42:10.479930 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.479549    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a9d4e60-8bce-41d9-8b43-61f59306b375-tmp\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-6jbzk\" (UID: \"8a9d4e60-8bce-41d9-8b43-61f59306b375\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-6jbzk"
Jul 07 17:42:10.479930 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.479598    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8a9d4e60-8bce-41d9-8b43-61f59306b375-apiservice-cert\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-6jbzk\" (UID: \"8a9d4e60-8bce-41d9-8b43-61f59306b375\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-6jbzk"
Jul 07 17:42:10.479930 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.479617    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv9dn\" (UniqueName: \"kubernetes.io/projected/8a9d4e60-8bce-41d9-8b43-61f59306b375-kube-api-access-mv9dn\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-6jbzk\" (UID: \"8a9d4e60-8bce-41d9-8b43-61f59306b375\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-6jbzk"
Jul 07 17:42:10.546205 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.546169    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:10.580429 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.580398    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8a9d4e60-8bce-41d9-8b43-61f59306b375-manifests\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-6jbzk\" (UID: \"8a9d4e60-8bce-41d9-8b43-61f59306b375\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-6jbzk"
Jul 07 17:42:10.580560 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.580435    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a9d4e60-8bce-41d9-8b43-61f59306b375-webhook-cert\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-6jbzk\" (UID: \"8a9d4e60-8bce-41d9-8b43-61f59306b375\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-6jbzk"
Jul 07 17:42:10.580560 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.580454    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a9d4e60-8bce-41d9-8b43-61f59306b375-tmp\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-6jbzk\" (UID: \"8a9d4e60-8bce-41d9-8b43-61f59306b375\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-6jbzk"
Jul 07 17:42:10.580560 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.580492    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8a9d4e60-8bce-41d9-8b43-61f59306b375-apiservice-cert\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-6jbzk\" (UID: \"8a9d4e60-8bce-41d9-8b43-61f59306b375\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-6jbzk"
Jul 07 17:42:10.580560 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.580521    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv9dn\" (UniqueName: \"kubernetes.io/projected/8a9d4e60-8bce-41d9-8b43-61f59306b375-kube-api-access-mv9dn\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-6jbzk\" (UID: \"8a9d4e60-8bce-41d9-8b43-61f59306b375\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-6jbzk"
Jul 07 17:42:10.580943 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.580920    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8a9d4e60-8bce-41d9-8b43-61f59306b375-manifests\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-6jbzk\" (UID: \"8a9d4e60-8bce-41d9-8b43-61f59306b375\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-6jbzk"
Jul 07 17:42:10.582898 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.582875    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a9d4e60-8bce-41d9-8b43-61f59306b375-tmp\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-6jbzk\" (UID: \"8a9d4e60-8bce-41d9-8b43-61f59306b375\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-6jbzk"
Jul 07 17:42:10.583272 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.583250    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a9d4e60-8bce-41d9-8b43-61f59306b375-webhook-cert\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-6jbzk\" (UID: \"8a9d4e60-8bce-41d9-8b43-61f59306b375\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-6jbzk"
Jul 07 17:42:10.583319 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.583280    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8a9d4e60-8bce-41d9-8b43-61f59306b375-apiservice-cert\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-6jbzk\" (UID: \"8a9d4e60-8bce-41d9-8b43-61f59306b375\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-6jbzk"
Jul 07 17:42:10.591197 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.591178    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv9dn\" (UniqueName: \"kubernetes.io/projected/8a9d4e60-8bce-41d9-8b43-61f59306b375-kube-api-access-mv9dn\") pod \"opendatahub-operator-controller-manager-777cf5fb6f-6jbzk\" (UID: \"8a9d4e60-8bce-41d9-8b43-61f59306b375\") " pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-6jbzk"
Jul 07 17:42:10.648681 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.648645    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:10.730674 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.730635    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-6jbzk"
Jul 07 17:42:10.747118 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.747090    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:10.839987 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.839935    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:10.891042 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.891018    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-6jbzk"]
Jul 07 17:42:10.893468 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:42:10.893436    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a9d4e60_8bce_41d9_8b43_61f59306b375.slice/crio-5a2896c8f214330ea5adec6eee44fe3f436a52a5a5f613fd1f26960258187c84 WatchSource:0}: Error finding container 5a2896c8f214330ea5adec6eee44fe3f436a52a5a5f613fd1f26960258187c84: Status 404 returned error can't find the container with id 5a2896c8f214330ea5adec6eee44fe3f436a52a5a5f613fd1f26960258187c84
Jul 07 17:42:10.895024 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.895000    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:10.895569 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.895554    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 17:42:10.964594 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:10.964494    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:11.069034 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:11.069001    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:11.475533 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:11.475498    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-6jbzk" event={"ID":"8a9d4e60-8bce-41d9-8b43-61f59306b375","Type":"ContainerStarted","Data":"5a2896c8f214330ea5adec6eee44fe3f436a52a5a5f613fd1f26960258187c84"}
Jul 07 17:42:14.489583 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:14.489553    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-6jbzk" event={"ID":"8a9d4e60-8bce-41d9-8b43-61f59306b375","Type":"ContainerStarted","Data":"55439341c67b86f9a33ceb279bc0c4d9c621e55aeb23983e6d8665cac79207a1"}
Jul 07 17:42:15.495177 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:15.495098    2559 generic.go:356] "Generic (PLEG): container finished" podID="8a9d4e60-8bce-41d9-8b43-61f59306b375" containerID="55439341c67b86f9a33ceb279bc0c4d9c621e55aeb23983e6d8665cac79207a1" exitCode=0
Jul 07 17:42:15.495524 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:15.495185    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-6jbzk" event={"ID":"8a9d4e60-8bce-41d9-8b43-61f59306b375","Type":"ContainerDied","Data":"55439341c67b86f9a33ceb279bc0c4d9c621e55aeb23983e6d8665cac79207a1"}
Jul 07 17:42:16.502018 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:16.501989    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-6jbzk" event={"ID":"8a9d4e60-8bce-41d9-8b43-61f59306b375","Type":"ContainerStarted","Data":"41eba6dea6f947c202c232d4e3497bf440a19bd1171f0cc5fb0806541209a695"}
Jul 07 17:42:16.502402 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:16.502115    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-6jbzk"
Jul 07 17:42:16.526788 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:16.526740    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-6jbzk" podStartSLOduration=1.9218975839999999 podStartE2EDuration="6.526724978s" totalImagesPullingTime="3.523669312s" totalInitContainerRuntime="1.081158082s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:42:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:16.525416176 +0000 UTC m=+336.040646514" watchObservedRunningTime="2026-07-07 17:42:16.526724978 +0000 UTC m=+336.041955314"
Jul 07 17:42:21.734143 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:21.734108    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:21.832382 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:21.832346    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:22.055887 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:22.055807    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:22.154471 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:22.154444    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:23.601535 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:23.601503    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:23.702136 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:23.702100    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:27.396235 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:27.396204    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:27.454032 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:27.453992    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:27.508311 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:27.508284    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-777cf5fb6f-6jbzk"
Jul 07 17:42:29.639787 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:29.639752    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:29.759429 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:29.759393    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:30.159331 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.159300    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:30.242737 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.242701    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-99f6fd64d-ng6ld"]
Jul 07 17:42:30.251119 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.251098    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-99f6fd64d-ng6ld"
Jul 07 17:42:30.253550 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.253529    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 07 17:42:30.253709 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.253530    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 07 17:42:30.253880 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.253860    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-rv66s\""
Jul 07 17:42:30.254497 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.254478    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-99f6fd64d-ng6ld"]
Jul 07 17:42:30.345594 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.345563    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c59a7158-4432-49b6-9fc9-4d2f8dbc3b7c-tmp\") pod \"kube-auth-proxy-99f6fd64d-ng6ld\" (UID: \"c59a7158-4432-49b6-9fc9-4d2f8dbc3b7c\") " pod="openshift-ingress/kube-auth-proxy-99f6fd64d-ng6ld"
Jul 07 17:42:30.345744 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.345603    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c59a7158-4432-49b6-9fc9-4d2f8dbc3b7c-tls-certs\") pod \"kube-auth-proxy-99f6fd64d-ng6ld\" (UID: \"c59a7158-4432-49b6-9fc9-4d2f8dbc3b7c\") " pod="openshift-ingress/kube-auth-proxy-99f6fd64d-ng6ld"
Jul 07 17:42:30.345744 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.345626    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5fjb\" (UniqueName: \"kubernetes.io/projected/c59a7158-4432-49b6-9fc9-4d2f8dbc3b7c-kube-api-access-p5fjb\") pod \"kube-auth-proxy-99f6fd64d-ng6ld\" (UID: \"c59a7158-4432-49b6-9fc9-4d2f8dbc3b7c\") " pod="openshift-ingress/kube-auth-proxy-99f6fd64d-ng6ld"
Jul 07 17:42:30.370790 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.370762    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-qfq7t"]
Jul 07 17:42:30.374100 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.374084    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-qfq7t"
Jul 07 17:42:30.376496 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.376475    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 07 17:42:30.376573 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.376549    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-85vbt\""
Jul 07 17:42:30.384726 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.384707    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-qfq7t"]
Jul 07 17:42:30.418114 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.418033    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:30.446405 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.446372    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c59a7158-4432-49b6-9fc9-4d2f8dbc3b7c-tmp\") pod \"kube-auth-proxy-99f6fd64d-ng6ld\" (UID: \"c59a7158-4432-49b6-9fc9-4d2f8dbc3b7c\") " pod="openshift-ingress/kube-auth-proxy-99f6fd64d-ng6ld"
Jul 07 17:42:30.446555 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.446416    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c59a7158-4432-49b6-9fc9-4d2f8dbc3b7c-tls-certs\") pod \"kube-auth-proxy-99f6fd64d-ng6ld\" (UID: \"c59a7158-4432-49b6-9fc9-4d2f8dbc3b7c\") " pod="openshift-ingress/kube-auth-proxy-99f6fd64d-ng6ld"
Jul 07 17:42:30.446555 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.446437    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5fjb\" (UniqueName: \"kubernetes.io/projected/c59a7158-4432-49b6-9fc9-4d2f8dbc3b7c-kube-api-access-p5fjb\") pod \"kube-auth-proxy-99f6fd64d-ng6ld\" (UID: \"c59a7158-4432-49b6-9fc9-4d2f8dbc3b7c\") " pod="openshift-ingress/kube-auth-proxy-99f6fd64d-ng6ld"
Jul 07 17:42:30.446555 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.446468    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/440d0785-7575-407e-aa8c-eb8ad196c0e1-cert\") pod \"odh-model-controller-7998c67dc4-qfq7t\" (UID: \"440d0785-7575-407e-aa8c-eb8ad196c0e1\") " pod="opendatahub/odh-model-controller-7998c67dc4-qfq7t"
Jul 07 17:42:30.446555 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.446486    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbxhn\" (UniqueName: \"kubernetes.io/projected/440d0785-7575-407e-aa8c-eb8ad196c0e1-kube-api-access-lbxhn\") pod \"odh-model-controller-7998c67dc4-qfq7t\" (UID: \"440d0785-7575-407e-aa8c-eb8ad196c0e1\") " pod="opendatahub/odh-model-controller-7998c67dc4-qfq7t"
Jul 07 17:42:30.446555 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:42:30.446519    2559 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 07 17:42:30.446719 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:42:30.446586    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c59a7158-4432-49b6-9fc9-4d2f8dbc3b7c-tls-certs podName:c59a7158-4432-49b6-9fc9-4d2f8dbc3b7c nodeName:}" failed. No retries permitted until 2026-07-07 17:42:30.946565033 +0000 UTC m=+350.461795351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/c59a7158-4432-49b6-9fc9-4d2f8dbc3b7c-tls-certs") pod "kube-auth-proxy-99f6fd64d-ng6ld" (UID: "c59a7158-4432-49b6-9fc9-4d2f8dbc3b7c") : secret "kube-auth-proxy-tls" not found
Jul 07 17:42:30.448647 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.448621    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c59a7158-4432-49b6-9fc9-4d2f8dbc3b7c-tmp\") pod \"kube-auth-proxy-99f6fd64d-ng6ld\" (UID: \"c59a7158-4432-49b6-9fc9-4d2f8dbc3b7c\") " pod="openshift-ingress/kube-auth-proxy-99f6fd64d-ng6ld"
Jul 07 17:42:30.457831 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.457808    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5fjb\" (UniqueName: \"kubernetes.io/projected/c59a7158-4432-49b6-9fc9-4d2f8dbc3b7c-kube-api-access-p5fjb\") pod \"kube-auth-proxy-99f6fd64d-ng6ld\" (UID: \"c59a7158-4432-49b6-9fc9-4d2f8dbc3b7c\") " pod="openshift-ingress/kube-auth-proxy-99f6fd64d-ng6ld"
Jul 07 17:42:30.521056 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.521023    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:30.552517 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.552478    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/440d0785-7575-407e-aa8c-eb8ad196c0e1-cert\") pod \"odh-model-controller-7998c67dc4-qfq7t\" (UID: \"440d0785-7575-407e-aa8c-eb8ad196c0e1\") " pod="opendatahub/odh-model-controller-7998c67dc4-qfq7t"
Jul 07 17:42:30.552685 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.552537    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbxhn\" (UniqueName: \"kubernetes.io/projected/440d0785-7575-407e-aa8c-eb8ad196c0e1-kube-api-access-lbxhn\") pod \"odh-model-controller-7998c67dc4-qfq7t\" (UID: \"440d0785-7575-407e-aa8c-eb8ad196c0e1\") " pod="opendatahub/odh-model-controller-7998c67dc4-qfq7t"
Jul 07 17:42:30.555824 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.555793    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/440d0785-7575-407e-aa8c-eb8ad196c0e1-cert\") pod \"odh-model-controller-7998c67dc4-qfq7t\" (UID: \"440d0785-7575-407e-aa8c-eb8ad196c0e1\") " pod="opendatahub/odh-model-controller-7998c67dc4-qfq7t"
Jul 07 17:42:30.561220 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.561189    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbxhn\" (UniqueName: \"kubernetes.io/projected/440d0785-7575-407e-aa8c-eb8ad196c0e1-kube-api-access-lbxhn\") pod \"odh-model-controller-7998c67dc4-qfq7t\" (UID: \"440d0785-7575-407e-aa8c-eb8ad196c0e1\") " pod="opendatahub/odh-model-controller-7998c67dc4-qfq7t"
Jul 07 17:42:30.616579 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.616550    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:30.684576 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.684494    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-qfq7t"
Jul 07 17:42:30.715879 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.715848    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:30.834131 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.834109    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-qfq7t"]
Jul 07 17:42:30.836911 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:42:30.836888    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod440d0785_7575_407e_aa8c_eb8ad196c0e1.slice/crio-fc09733f11603ab812e2ec2d0815db52cd20b83ea7f8a0d7014ccc0f3fee79c8 WatchSource:0}: Error finding container fc09733f11603ab812e2ec2d0815db52cd20b83ea7f8a0d7014ccc0f3fee79c8: Status 404 returned error can't find the container with id fc09733f11603ab812e2ec2d0815db52cd20b83ea7f8a0d7014ccc0f3fee79c8
Jul 07 17:42:30.956100 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.956023    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c59a7158-4432-49b6-9fc9-4d2f8dbc3b7c-tls-certs\") pod \"kube-auth-proxy-99f6fd64d-ng6ld\" (UID: \"c59a7158-4432-49b6-9fc9-4d2f8dbc3b7c\") " pod="openshift-ingress/kube-auth-proxy-99f6fd64d-ng6ld"
Jul 07 17:42:30.958526 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.958499    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c59a7158-4432-49b6-9fc9-4d2f8dbc3b7c-tls-certs\") pod \"kube-auth-proxy-99f6fd64d-ng6ld\" (UID: \"c59a7158-4432-49b6-9fc9-4d2f8dbc3b7c\") " pod="openshift-ingress/kube-auth-proxy-99f6fd64d-ng6ld"
Jul 07 17:42:30.999337 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:30.999300    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:31.051817 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:31.051777    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-g6gkk"]
Jul 07 17:42:31.056590 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:31.056566    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-g6gkk"
Jul 07 17:42:31.059001 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:31.058948    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 07 17:42:31.059112 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:31.059095    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-tdc88\""
Jul 07 17:42:31.066515 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:31.066491    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-g6gkk"]
Jul 07 17:42:31.082794 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:31.082765    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:31.157936 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:31.157900    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10058684-46b9-443c-8d9f-99d58c073409-tls-certs\") pod \"model-serving-api-54d89bd5fc-g6gkk\" (UID: \"10058684-46b9-443c-8d9f-99d58c073409\") " pod="opendatahub/model-serving-api-54d89bd5fc-g6gkk"
Jul 07 17:42:31.158103 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:31.157991    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrksm\" (UniqueName: \"kubernetes.io/projected/10058684-46b9-443c-8d9f-99d58c073409-kube-api-access-rrksm\") pod \"model-serving-api-54d89bd5fc-g6gkk\" (UID: \"10058684-46b9-443c-8d9f-99d58c073409\") " pod="opendatahub/model-serving-api-54d89bd5fc-g6gkk"
Jul 07 17:42:31.160766 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:31.160748    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-99f6fd64d-ng6ld"
Jul 07 17:42:31.236769 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:31.236743    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:31.258377 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:31.258353    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrksm\" (UniqueName: \"kubernetes.io/projected/10058684-46b9-443c-8d9f-99d58c073409-kube-api-access-rrksm\") pod \"model-serving-api-54d89bd5fc-g6gkk\" (UID: \"10058684-46b9-443c-8d9f-99d58c073409\") " pod="opendatahub/model-serving-api-54d89bd5fc-g6gkk"
Jul 07 17:42:31.258478 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:31.258419    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10058684-46b9-443c-8d9f-99d58c073409-tls-certs\") pod \"model-serving-api-54d89bd5fc-g6gkk\" (UID: \"10058684-46b9-443c-8d9f-99d58c073409\") " pod="opendatahub/model-serving-api-54d89bd5fc-g6gkk"
Jul 07 17:42:31.261359 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:31.261337    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10058684-46b9-443c-8d9f-99d58c073409-tls-certs\") pod \"model-serving-api-54d89bd5fc-g6gkk\" (UID: \"10058684-46b9-443c-8d9f-99d58c073409\") " pod="opendatahub/model-serving-api-54d89bd5fc-g6gkk"
Jul 07 17:42:31.276085 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:31.275820    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrksm\" (UniqueName: \"kubernetes.io/projected/10058684-46b9-443c-8d9f-99d58c073409-kube-api-access-rrksm\") pod \"model-serving-api-54d89bd5fc-g6gkk\" (UID: \"10058684-46b9-443c-8d9f-99d58c073409\") " pod="opendatahub/model-serving-api-54d89bd5fc-g6gkk"
Jul 07 17:42:31.296561 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:31.296533    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:31.312148 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:31.312117    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-99f6fd64d-ng6ld"]
Jul 07 17:42:31.314500 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:42:31.314475    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc59a7158_4432_49b6_9fc9_4d2f8dbc3b7c.slice/crio-ae58cfec299d9b9b540a5d555bb173bab64cf719c9a26dc9126ccb06a8b96f30 WatchSource:0}: Error finding container ae58cfec299d9b9b540a5d555bb173bab64cf719c9a26dc9126ccb06a8b96f30: Status 404 returned error can't find the container with id ae58cfec299d9b9b540a5d555bb173bab64cf719c9a26dc9126ccb06a8b96f30
Jul 07 17:42:31.367654 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:31.367623    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-g6gkk"
Jul 07 17:42:31.508277 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:31.508253    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-g6gkk"]
Jul 07 17:42:31.510820 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:42:31.510793    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10058684_46b9_443c_8d9f_99d58c073409.slice/crio-140a2beb5c82291ad46d61338fec6524de5d154b96422f81ee7612f959f53599 WatchSource:0}: Error finding container 140a2beb5c82291ad46d61338fec6524de5d154b96422f81ee7612f959f53599: Status 404 returned error can't find the container with id 140a2beb5c82291ad46d61338fec6524de5d154b96422f81ee7612f959f53599
Jul 07 17:42:31.563191 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:31.563154    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-qfq7t" event={"ID":"440d0785-7575-407e-aa8c-eb8ad196c0e1","Type":"ContainerStarted","Data":"fc09733f11603ab812e2ec2d0815db52cd20b83ea7f8a0d7014ccc0f3fee79c8"}
Jul 07 17:42:31.564405 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:31.564376    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-g6gkk" event={"ID":"10058684-46b9-443c-8d9f-99d58c073409","Type":"ContainerStarted","Data":"140a2beb5c82291ad46d61338fec6524de5d154b96422f81ee7612f959f53599"}
Jul 07 17:42:31.565477 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:31.565454    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-99f6fd64d-ng6ld" event={"ID":"c59a7158-4432-49b6-9fc9-4d2f8dbc3b7c","Type":"ContainerStarted","Data":"ae58cfec299d9b9b540a5d555bb173bab64cf719c9a26dc9126ccb06a8b96f30"}
Jul 07 17:42:32.221385 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:32.221307    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:35.470671 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:35.470585    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:35.571972 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:35.571934    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:35.586430 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:35.586398    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-99f6fd64d-ng6ld" event={"ID":"c59a7158-4432-49b6-9fc9-4d2f8dbc3b7c","Type":"ContainerStarted","Data":"561582186e057c27109cf914d523db5ed20caf178d9c6b3baedd73c888e4da39"}
Jul 07 17:42:35.587851 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:35.587828    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-qfq7t" event={"ID":"440d0785-7575-407e-aa8c-eb8ad196c0e1","Type":"ContainerStarted","Data":"a8bc31e6b0a1caf872bc3c90fa5b80d319d3551a730b2ff65b6265297bac030b"}
Jul 07 17:42:35.588008 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:35.587907    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-qfq7t"
Jul 07 17:42:35.589155 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:35.589105    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-g6gkk" event={"ID":"10058684-46b9-443c-8d9f-99d58c073409","Type":"ContainerStarted","Data":"51280f4b6709e4cb519e56c9629918e7e577a55b821fee69043d91cf2a314b31"}
Jul 07 17:42:35.589268 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:35.589220    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-g6gkk"
Jul 07 17:42:35.605752 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:35.605709    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-99f6fd64d-ng6ld" podStartSLOduration=1.710073038 podStartE2EDuration="5.605697303s" totalImagesPullingTime="3.895624265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:42:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:35.604493719 +0000 UTC m=+355.119724055" watchObservedRunningTime="2026-07-07 17:42:35.605697303 +0000 UTC m=+355.120927638"
Jul 07 17:42:35.624971 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:35.624896    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-qfq7t" podStartSLOduration=1.250498992 podStartE2EDuration="5.62488168s" totalImagesPullingTime="4.374382688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:42:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:35.623264421 +0000 UTC m=+355.138494759" watchObservedRunningTime="2026-07-07 17:42:35.62488168 +0000 UTC m=+355.140112016"
Jul 07 17:42:35.641632 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:35.641585    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-g6gkk" podStartSLOduration=0.949458127 podStartE2EDuration="4.641569903s" totalImagesPullingTime="3.692111776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:42:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:35.64079135 +0000 UTC m=+355.156021687" watchObservedRunningTime="2026-07-07 17:42:35.641569903 +0000 UTC m=+355.156800238"
Jul 07 17:42:36.012749 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.012717    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"]
Jul 07 17:42:36.016406 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.016384    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"
Jul 07 17:42:36.018868 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.018847    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-sbvsg\""
Jul 07 17:42:36.019023 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.018851    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 17:42:36.026396 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.026370    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"]
Jul 07 17:42:36.039361 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.039335    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:36.100804 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.100764    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16706bdf-4979-4ebb-be7c-e00f674e4692-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678n5tf2\" (UID: \"16706bdf-4979-4ebb-be7c-e00f674e4692\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"
Jul 07 17:42:36.101009 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.100816    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16706bdf-4979-4ebb-be7c-e00f674e4692-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678n5tf2\" (UID: \"16706bdf-4979-4ebb-be7c-e00f674e4692\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"
Jul 07 17:42:36.101009 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.100896    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16706bdf-4979-4ebb-be7c-e00f674e4692-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678n5tf2\" (UID: \"16706bdf-4979-4ebb-be7c-e00f674e4692\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"
Jul 07 17:42:36.101009 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.100927    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16706bdf-4979-4ebb-be7c-e00f674e4692-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678n5tf2\" (UID: \"16706bdf-4979-4ebb-be7c-e00f674e4692\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"
Jul 07 17:42:36.101181 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.101042    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16706bdf-4979-4ebb-be7c-e00f674e4692-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678n5tf2\" (UID: \"16706bdf-4979-4ebb-be7c-e00f674e4692\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"
Jul 07 17:42:36.101181 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.101091    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16706bdf-4979-4ebb-be7c-e00f674e4692-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678n5tf2\" (UID: \"16706bdf-4979-4ebb-be7c-e00f674e4692\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"
Jul 07 17:42:36.101181 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.101123    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16706bdf-4979-4ebb-be7c-e00f674e4692-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678n5tf2\" (UID: \"16706bdf-4979-4ebb-be7c-e00f674e4692\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"
Jul 07 17:42:36.101316 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.101209    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhp4r\" (UniqueName: \"kubernetes.io/projected/16706bdf-4979-4ebb-be7c-e00f674e4692-kube-api-access-fhp4r\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678n5tf2\" (UID: \"16706bdf-4979-4ebb-be7c-e00f674e4692\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"
Jul 07 17:42:36.101316 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.101257    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16706bdf-4979-4ebb-be7c-e00f674e4692-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678n5tf2\" (UID: \"16706bdf-4979-4ebb-be7c-e00f674e4692\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"
Jul 07 17:42:36.202204 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.202165    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16706bdf-4979-4ebb-be7c-e00f674e4692-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678n5tf2\" (UID: \"16706bdf-4979-4ebb-be7c-e00f674e4692\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"
Jul 07 17:42:36.202373 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.202217    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16706bdf-4979-4ebb-be7c-e00f674e4692-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678n5tf2\" (UID: \"16706bdf-4979-4ebb-be7c-e00f674e4692\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"
Jul 07 17:42:36.202373 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.202267    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16706bdf-4979-4ebb-be7c-e00f674e4692-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678n5tf2\" (UID: \"16706bdf-4979-4ebb-be7c-e00f674e4692\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"
Jul 07 17:42:36.202373 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.202295    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16706bdf-4979-4ebb-be7c-e00f674e4692-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678n5tf2\" (UID: \"16706bdf-4979-4ebb-be7c-e00f674e4692\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"
Jul 07 17:42:36.202373 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.202331    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16706bdf-4979-4ebb-be7c-e00f674e4692-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678n5tf2\" (UID: \"16706bdf-4979-4ebb-be7c-e00f674e4692\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"
Jul 07 17:42:36.202601 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.202434    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16706bdf-4979-4ebb-be7c-e00f674e4692-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678n5tf2\" (UID: \"16706bdf-4979-4ebb-be7c-e00f674e4692\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"
Jul 07 17:42:36.202601 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.202476    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16706bdf-4979-4ebb-be7c-e00f674e4692-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678n5tf2\" (UID: \"16706bdf-4979-4ebb-be7c-e00f674e4692\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"
Jul 07 17:42:36.202601 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.202522    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhp4r\" (UniqueName: \"kubernetes.io/projected/16706bdf-4979-4ebb-be7c-e00f674e4692-kube-api-access-fhp4r\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678n5tf2\" (UID: \"16706bdf-4979-4ebb-be7c-e00f674e4692\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"
Jul 07 17:42:36.202601 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.202564    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16706bdf-4979-4ebb-be7c-e00f674e4692-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678n5tf2\" (UID: \"16706bdf-4979-4ebb-be7c-e00f674e4692\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"
Jul 07 17:42:36.202785 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.202688    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16706bdf-4979-4ebb-be7c-e00f674e4692-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678n5tf2\" (UID: \"16706bdf-4979-4ebb-be7c-e00f674e4692\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"
Jul 07 17:42:36.203095 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.203070    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16706bdf-4979-4ebb-be7c-e00f674e4692-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678n5tf2\" (UID: \"16706bdf-4979-4ebb-be7c-e00f674e4692\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"
Jul 07 17:42:36.203456 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.203170    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16706bdf-4979-4ebb-be7c-e00f674e4692-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678n5tf2\" (UID: \"16706bdf-4979-4ebb-be7c-e00f674e4692\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"
Jul 07 17:42:36.203456 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.203259    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16706bdf-4979-4ebb-be7c-e00f674e4692-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678n5tf2\" (UID: \"16706bdf-4979-4ebb-be7c-e00f674e4692\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"
Jul 07 17:42:36.203602 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.203464    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16706bdf-4979-4ebb-be7c-e00f674e4692-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678n5tf2\" (UID: \"16706bdf-4979-4ebb-be7c-e00f674e4692\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"
Jul 07 17:42:36.205140 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.205112    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16706bdf-4979-4ebb-be7c-e00f674e4692-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678n5tf2\" (UID: \"16706bdf-4979-4ebb-be7c-e00f674e4692\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"
Jul 07 17:42:36.205238 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.205163    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16706bdf-4979-4ebb-be7c-e00f674e4692-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678n5tf2\" (UID: \"16706bdf-4979-4ebb-be7c-e00f674e4692\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"
Jul 07 17:42:36.211016 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.210994    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhp4r\" (UniqueName: \"kubernetes.io/projected/16706bdf-4979-4ebb-be7c-e00f674e4692-kube-api-access-fhp4r\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678n5tf2\" (UID: \"16706bdf-4979-4ebb-be7c-e00f674e4692\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"
Jul 07 17:42:36.211098 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.211012    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16706bdf-4979-4ebb-be7c-e00f674e4692-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678n5tf2\" (UID: \"16706bdf-4979-4ebb-be7c-e00f674e4692\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"
Jul 07 17:42:36.302225 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.302135    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:36.330451 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.330417    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"
Jul 07 17:42:36.466586 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.466559    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"]
Jul 07 17:42:36.468720 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:42:36.468686    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16706bdf_4979_4ebb_be7c_e00f674e4692.slice/crio-5961291d40944e75c74b432bdeff41d86857faf4b022ba018cc1232a5bde793f WatchSource:0}: Error finding container 5961291d40944e75c74b432bdeff41d86857faf4b022ba018cc1232a5bde793f: Status 404 returned error can't find the container with id 5961291d40944e75c74b432bdeff41d86857faf4b022ba018cc1232a5bde793f
Jul 07 17:42:36.529232 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.529204    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:36.594565 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:36.594475    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2" event={"ID":"16706bdf-4979-4ebb-be7c-e00f674e4692","Type":"ContainerStarted","Data":"5961291d40944e75c74b432bdeff41d86857faf4b022ba018cc1232a5bde793f"}
Jul 07 17:42:37.703270 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:37.703240    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-55cbfbc7c9-4dtzx"]
Jul 07 17:42:37.706707 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:37.706686    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-4dtzx"
Jul 07 17:42:37.709314 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:37.709263    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 07 17:42:37.709427 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:37.709406    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 07 17:42:37.710312 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:37.710291    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 07 17:42:37.710488 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:37.710463    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 07 17:42:37.710595 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:37.710563    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-smfhc\""
Jul 07 17:42:37.710705 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:37.710693    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 07 17:42:37.715300 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:37.715229    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55cbfbc7c9-4dtzx"]
Jul 07 17:42:37.816104 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:37.816074    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab65a190-30f2-4a4a-97dc-449f018bc41e-cert\") pod \"lws-controller-manager-55cbfbc7c9-4dtzx\" (UID: \"ab65a190-30f2-4a4a-97dc-449f018bc41e\") " pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-4dtzx"
Jul 07 17:42:37.816302 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:37.816122    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab65a190-30f2-4a4a-97dc-449f018bc41e-metrics-cert\") pod \"lws-controller-manager-55cbfbc7c9-4dtzx\" (UID: \"ab65a190-30f2-4a4a-97dc-449f018bc41e\") " pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-4dtzx"
Jul 07 17:42:37.816302 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:37.816142    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ab65a190-30f2-4a4a-97dc-449f018bc41e-manager-config\") pod \"lws-controller-manager-55cbfbc7c9-4dtzx\" (UID: \"ab65a190-30f2-4a4a-97dc-449f018bc41e\") " pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-4dtzx"
Jul 07 17:42:37.816302 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:37.816241    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmtqp\" (UniqueName: \"kubernetes.io/projected/ab65a190-30f2-4a4a-97dc-449f018bc41e-kube-api-access-rmtqp\") pod \"lws-controller-manager-55cbfbc7c9-4dtzx\" (UID: \"ab65a190-30f2-4a4a-97dc-449f018bc41e\") " pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-4dtzx"
Jul 07 17:42:37.916692 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:37.916655    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab65a190-30f2-4a4a-97dc-449f018bc41e-cert\") pod \"lws-controller-manager-55cbfbc7c9-4dtzx\" (UID: \"ab65a190-30f2-4a4a-97dc-449f018bc41e\") " pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-4dtzx"
Jul 07 17:42:37.916692 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:37.916709    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab65a190-30f2-4a4a-97dc-449f018bc41e-metrics-cert\") pod \"lws-controller-manager-55cbfbc7c9-4dtzx\" (UID: \"ab65a190-30f2-4a4a-97dc-449f018bc41e\") " pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-4dtzx"
Jul 07 17:42:37.916936 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:37.916728    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ab65a190-30f2-4a4a-97dc-449f018bc41e-manager-config\") pod \"lws-controller-manager-55cbfbc7c9-4dtzx\" (UID: \"ab65a190-30f2-4a4a-97dc-449f018bc41e\") " pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-4dtzx"
Jul 07 17:42:37.916936 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:37.916791    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmtqp\" (UniqueName: \"kubernetes.io/projected/ab65a190-30f2-4a4a-97dc-449f018bc41e-kube-api-access-rmtqp\") pod \"lws-controller-manager-55cbfbc7c9-4dtzx\" (UID: \"ab65a190-30f2-4a4a-97dc-449f018bc41e\") " pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-4dtzx"
Jul 07 17:42:37.917821 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:37.917790    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ab65a190-30f2-4a4a-97dc-449f018bc41e-manager-config\") pod \"lws-controller-manager-55cbfbc7c9-4dtzx\" (UID: \"ab65a190-30f2-4a4a-97dc-449f018bc41e\") " pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-4dtzx"
Jul 07 17:42:37.919779 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:37.919756    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab65a190-30f2-4a4a-97dc-449f018bc41e-metrics-cert\") pod \"lws-controller-manager-55cbfbc7c9-4dtzx\" (UID: \"ab65a190-30f2-4a4a-97dc-449f018bc41e\") " pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-4dtzx"
Jul 07 17:42:37.919947 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:37.919919    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab65a190-30f2-4a4a-97dc-449f018bc41e-cert\") pod \"lws-controller-manager-55cbfbc7c9-4dtzx\" (UID: \"ab65a190-30f2-4a4a-97dc-449f018bc41e\") " pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-4dtzx"
Jul 07 17:42:37.925613 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:37.925590    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmtqp\" (UniqueName: \"kubernetes.io/projected/ab65a190-30f2-4a4a-97dc-449f018bc41e-kube-api-access-rmtqp\") pod \"lws-controller-manager-55cbfbc7c9-4dtzx\" (UID: \"ab65a190-30f2-4a4a-97dc-449f018bc41e\") " pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-4dtzx"
Jul 07 17:42:38.020159 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:38.020092    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-4dtzx"
Jul 07 17:42:38.178370 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:38.178296    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55cbfbc7c9-4dtzx"]
Jul 07 17:42:38.180580 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:42:38.180552    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab65a190_30f2_4a4a_97dc_449f018bc41e.slice/crio-f6c56d42cf5676380e3bb35c6024c166ca0cc2c074584ab01828755de3cc55f7 WatchSource:0}: Error finding container f6c56d42cf5676380e3bb35c6024c166ca0cc2c074584ab01828755de3cc55f7: Status 404 returned error can't find the container with id f6c56d42cf5676380e3bb35c6024c166ca0cc2c074584ab01828755de3cc55f7
Jul 07 17:42:38.606350 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:38.606313    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-4dtzx" event={"ID":"ab65a190-30f2-4a4a-97dc-449f018bc41e","Type":"ContainerStarted","Data":"f6c56d42cf5676380e3bb35c6024c166ca0cc2c074584ab01828755de3cc55f7"}
Jul 07 17:42:39.287047 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:39.286999    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 07 17:42:39.287435 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:39.287093    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 07 17:42:39.287435 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:39.287135    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 07 17:42:39.615293 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:39.615211    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2" event={"ID":"16706bdf-4979-4ebb-be7c-e00f674e4692","Type":"ContainerStarted","Data":"43ef774ec59cf64dbbd66800b2216d6e66c4843f61f8e36de063ad05ca8d6096"}
Jul 07 17:42:39.679794 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:39.679736    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2" podStartSLOduration=1.863815528 podStartE2EDuration="4.679719296s" totalImagesPullingTime="2.815903768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:42:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:39.678802973 +0000 UTC m=+359.194033310" watchObservedRunningTime="2026-07-07 17:42:39.679719296 +0000 UTC m=+359.194949709"
Jul 07 17:42:40.330888 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:40.330843    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"
Jul 07 17:42:40.337495 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:40.337467    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"
Jul 07 17:42:40.522647 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:40.522568    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:40.620261 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:40.620206    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"
Jul 07 17:42:40.621367 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:40.621345    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678n5tf2"
Jul 07 17:42:40.707023 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:40.706987    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:40.851235 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:40.851174    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:41.098878 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:41.098791    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:41.318704 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:41.318673    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:41.625664 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:41.625632    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-4dtzx" event={"ID":"ab65a190-30f2-4a4a-97dc-449f018bc41e","Type":"ContainerStarted","Data":"e2b2b2341e36346ccfa4351f62e928e2376dfabbe0c408cb4aa47c5ec1acb46d"}
Jul 07 17:42:41.626133 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:41.625797    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-4dtzx"
Jul 07 17:42:41.647567 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:41.647518    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-4dtzx" podStartSLOduration=1.603100344 podStartE2EDuration="4.647501677s" totalImagesPullingTime="3.044401333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:42:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:41.646416935 +0000 UTC m=+361.161647272" watchObservedRunningTime="2026-07-07 17:42:41.647501677 +0000 UTC m=+361.162732013"
Jul 07 17:42:41.871132 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:41.871090    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:41.972427 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:41.972349    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:42.082116 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:42.082080    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:46.596677 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:46.596646    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-qfq7t"
Jul 07 17:42:46.598823 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:46.598802    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-g6gkk"
Jul 07 17:42:52.638642 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:42:52.638604    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-55cbfbc7c9-4dtzx"
Jul 07 17:43:31.120101 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:43:31.120064    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:43:31.181982 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:43:31.181924    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:43:31.295555 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:43:31.295517    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:00.899082 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:44:00.899048    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:04.501553 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:44:04.501470    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:07.509576 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:44:07.509546    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:08.949091 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:44:08.949060    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:09.082644 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:44:09.082594    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:09.680976 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:44:09.680913    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:12.529460 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:44:12.529429    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:12.634390 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:44:12.634351    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:13.497876 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:44:13.497844    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:15.351171 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:44:15.351138    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:16.943737 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:44:16.943698    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:17.045622 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:44:17.045585    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:19.750929 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:44:19.750901    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:19.850689 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:44:19.850657    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:20.495255 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:44:20.495210    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:20.623904 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:44:20.623869    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:30.145773 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:44:30.145741    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:30.245255 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:44:30.245221    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:33.108854 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:44:33.108820    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:33.211155 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:44:33.211115    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:37.927141 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:44:37.927109    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:38.028033 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:44:38.027988    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:41.726825 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:44:41.726792    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:41.794472 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:44:41.794438    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:51.750833 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:44:51.750793    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:51.829065 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:44:51.829023    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:52.129831 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:44:52.129799    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:52.230316 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:44:52.230281    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:52.330220 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:44:52.330181    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:52.400013 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:44:52.399897    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:56.129257 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:44:56.129198    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:56.232889 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:44:56.232846    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:57.416286 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:44:57.416253    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:04.135297 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:04.135267    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:04.271650 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:04.271592    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:10.152259 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:10.152213    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:10.246397 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:10.246359    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:10.342834 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:10.342806    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:10.923098 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:10.923065    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-vr2bf"]
Jul 07 17:45:10.926488 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:10.926469    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vr2bf"
Jul 07 17:45:10.928657 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:10.928640    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 17:45:10.929463 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:10.929448    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 17:45:10.929549 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:10.929449    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8zcq4\""
Jul 07 17:45:10.933263 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:10.933236    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-vr2bf"]
Jul 07 17:45:10.969127 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:10.969093    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:11.023111 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:11.023078    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-vvkgv"]
Jul 07 17:45:11.026251 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:11.026236    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vvkgv"
Jul 07 17:45:11.032658 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:11.032627    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vvkgv"]
Jul 07 17:45:11.045785 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:11.045757    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:11.086986 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:11.086946    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gt2b\" (UniqueName: \"kubernetes.io/projected/79bef01e-c9c3-47b7-b8f9-3120e3083580-kube-api-access-7gt2b\") pod \"authorino-58cd955675-vr2bf\" (UID: \"79bef01e-c9c3-47b7-b8f9-3120e3083580\") " pod="kuadrant-system/authorino-58cd955675-vr2bf"
Jul 07 17:45:11.087087 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:11.086998    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dldrb\" (UniqueName: \"kubernetes.io/projected/f4e6ea57-bfcd-460b-9d38-396cb79c65dc-kube-api-access-dldrb\") pod \"authorino-75d556bd77-vvkgv\" (UID: \"f4e6ea57-bfcd-460b-9d38-396cb79c65dc\") " pod="kuadrant-system/authorino-75d556bd77-vvkgv"
Jul 07 17:45:11.187417 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:11.187337    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dldrb\" (UniqueName: \"kubernetes.io/projected/f4e6ea57-bfcd-460b-9d38-396cb79c65dc-kube-api-access-dldrb\") pod \"authorino-75d556bd77-vvkgv\" (UID: \"f4e6ea57-bfcd-460b-9d38-396cb79c65dc\") " pod="kuadrant-system/authorino-75d556bd77-vvkgv"
Jul 07 17:45:11.187417 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:11.187408    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gt2b\" (UniqueName: \"kubernetes.io/projected/79bef01e-c9c3-47b7-b8f9-3120e3083580-kube-api-access-7gt2b\") pod \"authorino-58cd955675-vr2bf\" (UID: \"79bef01e-c9c3-47b7-b8f9-3120e3083580\") " pod="kuadrant-system/authorino-58cd955675-vr2bf"
Jul 07 17:45:11.195338 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:11.195301    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gt2b\" (UniqueName: \"kubernetes.io/projected/79bef01e-c9c3-47b7-b8f9-3120e3083580-kube-api-access-7gt2b\") pod \"authorino-58cd955675-vr2bf\" (UID: \"79bef01e-c9c3-47b7-b8f9-3120e3083580\") " pod="kuadrant-system/authorino-58cd955675-vr2bf"
Jul 07 17:45:11.195466 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:11.195377    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dldrb\" (UniqueName: \"kubernetes.io/projected/f4e6ea57-bfcd-460b-9d38-396cb79c65dc-kube-api-access-dldrb\") pod \"authorino-75d556bd77-vvkgv\" (UID: \"f4e6ea57-bfcd-460b-9d38-396cb79c65dc\") " pod="kuadrant-system/authorino-75d556bd77-vvkgv"
Jul 07 17:45:11.236243 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:11.236217    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vr2bf"
Jul 07 17:45:11.336485 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:11.336457    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vvkgv"
Jul 07 17:45:11.369176 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:11.369146    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-vr2bf"]
Jul 07 17:45:11.372572 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:45:11.372547    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79bef01e_c9c3_47b7_b8f9_3120e3083580.slice/crio-33fc8598ecaa3bf0b0e6ea06f4da8bc167b3fdb549ca6f36f6f9a6295accf075 WatchSource:0}: Error finding container 33fc8598ecaa3bf0b0e6ea06f4da8bc167b3fdb549ca6f36f6f9a6295accf075: Status 404 returned error can't find the container with id 33fc8598ecaa3bf0b0e6ea06f4da8bc167b3fdb549ca6f36f6f9a6295accf075
Jul 07 17:45:11.467908 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:11.467883    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vvkgv"]
Jul 07 17:45:11.469630 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:45:11.469609    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4e6ea57_bfcd_460b_9d38_396cb79c65dc.slice/crio-3eb44a35dd94191db5c909055f7e2bdbd36b7dfbcca45247144026de032fa906 WatchSource:0}: Error finding container 3eb44a35dd94191db5c909055f7e2bdbd36b7dfbcca45247144026de032fa906: Status 404 returned error can't find the container with id 3eb44a35dd94191db5c909055f7e2bdbd36b7dfbcca45247144026de032fa906
Jul 07 17:45:12.277170 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:12.277130    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vr2bf" event={"ID":"79bef01e-c9c3-47b7-b8f9-3120e3083580","Type":"ContainerStarted","Data":"33fc8598ecaa3bf0b0e6ea06f4da8bc167b3fdb549ca6f36f6f9a6295accf075"}
Jul 07 17:45:12.285608 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:12.285575    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vvkgv" event={"ID":"f4e6ea57-bfcd-460b-9d38-396cb79c65dc","Type":"ContainerStarted","Data":"3eb44a35dd94191db5c909055f7e2bdbd36b7dfbcca45247144026de032fa906"}
Jul 07 17:45:15.303459 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:15.303373    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vr2bf" event={"ID":"79bef01e-c9c3-47b7-b8f9-3120e3083580","Type":"ContainerStarted","Data":"32fc8e80630d5a997c5a384e4fe88d39ca258b3b246ab81ab0807037ee50b634"}
Jul 07 17:45:15.304803 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:15.304781    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vvkgv" event={"ID":"f4e6ea57-bfcd-460b-9d38-396cb79c65dc","Type":"ContainerStarted","Data":"57bfafec1c1cc06f56ba2a916c50e0b9c11c1e5cd353cc72b19411d58b9740ba"}
Jul 07 17:45:15.319177 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:15.319132    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-vr2bf" podStartSLOduration=1.703349075 podStartE2EDuration="5.319119921s" totalImagesPullingTime="3.615770846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:45:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:45:15.318480542 +0000 UTC m=+514.833710878" watchObservedRunningTime="2026-07-07 17:45:15.319119921 +0000 UTC m=+514.834350257"
Jul 07 17:45:15.334115 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:15.334069    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-vvkgv" podStartSLOduration=0.802671568 podStartE2EDuration="4.334055027s" totalImagesPullingTime="3.531383459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:45:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:45:15.332380464 +0000 UTC m=+514.847610802" watchObservedRunningTime="2026-07-07 17:45:15.334055027 +0000 UTC m=+514.849285359"
Jul 07 17:45:15.357134 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:15.357105    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-vr2bf"]
Jul 07 17:45:17.312815 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:17.312777    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-vr2bf" podUID="79bef01e-c9c3-47b7-b8f9-3120e3083580" containerName="authorino" containerID="cri-o://32fc8e80630d5a997c5a384e4fe88d39ca258b3b246ab81ab0807037ee50b634" gracePeriod=30
Jul 07 17:45:17.563365 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:17.563310    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vr2bf"
Jul 07 17:45:17.648030 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:17.647997    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gt2b\" (UniqueName: \"kubernetes.io/projected/79bef01e-c9c3-47b7-b8f9-3120e3083580-kube-api-access-7gt2b\") pod \"79bef01e-c9c3-47b7-b8f9-3120e3083580\" (UID: \"79bef01e-c9c3-47b7-b8f9-3120e3083580\") "
Jul 07 17:45:17.650229 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:17.650200    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79bef01e-c9c3-47b7-b8f9-3120e3083580-kube-api-access-7gt2b" (OuterVolumeSpecName: "kube-api-access-7gt2b") pod "79bef01e-c9c3-47b7-b8f9-3120e3083580" (UID: "79bef01e-c9c3-47b7-b8f9-3120e3083580"). InnerVolumeSpecName "kube-api-access-7gt2b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:45:17.748722 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:17.748686    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gt2b\" (UniqueName: \"kubernetes.io/projected/79bef01e-c9c3-47b7-b8f9-3120e3083580-kube-api-access-7gt2b\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:45:18.318799 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:18.318764    2559 generic.go:356] "Generic (PLEG): container finished" podID="79bef01e-c9c3-47b7-b8f9-3120e3083580" containerID="32fc8e80630d5a997c5a384e4fe88d39ca258b3b246ab81ab0807037ee50b634" exitCode=0
Jul 07 17:45:18.319265 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:18.318807    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vr2bf"
Jul 07 17:45:18.319265 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:18.318857    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vr2bf" event={"ID":"79bef01e-c9c3-47b7-b8f9-3120e3083580","Type":"ContainerDied","Data":"32fc8e80630d5a997c5a384e4fe88d39ca258b3b246ab81ab0807037ee50b634"}
Jul 07 17:45:18.319265 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:18.318902    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vr2bf" event={"ID":"79bef01e-c9c3-47b7-b8f9-3120e3083580","Type":"ContainerDied","Data":"33fc8598ecaa3bf0b0e6ea06f4da8bc167b3fdb549ca6f36f6f9a6295accf075"}
Jul 07 17:45:18.319265 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:18.318924    2559 scope.go:117] "RemoveContainer" containerID="32fc8e80630d5a997c5a384e4fe88d39ca258b3b246ab81ab0807037ee50b634"
Jul 07 17:45:18.329148 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:18.329122    2559 scope.go:117] "RemoveContainer" containerID="32fc8e80630d5a997c5a384e4fe88d39ca258b3b246ab81ab0807037ee50b634"
Jul 07 17:45:18.329630 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:45:18.329597    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32fc8e80630d5a997c5a384e4fe88d39ca258b3b246ab81ab0807037ee50b634\": container with ID starting with 32fc8e80630d5a997c5a384e4fe88d39ca258b3b246ab81ab0807037ee50b634 not found: ID does not exist" containerID="32fc8e80630d5a997c5a384e4fe88d39ca258b3b246ab81ab0807037ee50b634"
Jul 07 17:45:18.329775 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:18.329643    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32fc8e80630d5a997c5a384e4fe88d39ca258b3b246ab81ab0807037ee50b634"} err="failed to get container status \"32fc8e80630d5a997c5a384e4fe88d39ca258b3b246ab81ab0807037ee50b634\": rpc error: code = NotFound desc = could not find container \"32fc8e80630d5a997c5a384e4fe88d39ca258b3b246ab81ab0807037ee50b634\": container with ID starting with 32fc8e80630d5a997c5a384e4fe88d39ca258b3b246ab81ab0807037ee50b634 not found: ID does not exist"
Jul 07 17:45:18.343947 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:18.343917    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-vr2bf"]
Jul 07 17:45:18.347394 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:18.347374    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-vr2bf"]
Jul 07 17:45:19.006885 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:19.006853    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79bef01e-c9c3-47b7-b8f9-3120e3083580" path="/var/lib/kubelet/pods/79bef01e-c9c3-47b7-b8f9-3120e3083580/volumes"
Jul 07 17:45:24.413483 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:24.413447    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:31.992821 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:31.992737    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:43.655076 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:43.655034    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:43.826554 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:43.826518    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:43.879501 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:43.879470    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w5fng"]
Jul 07 17:45:43.880351 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:43.880295    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79bef01e-c9c3-47b7-b8f9-3120e3083580" containerName="authorino"
Jul 07 17:45:43.880351 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:43.880329    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="79bef01e-c9c3-47b7-b8f9-3120e3083580" containerName="authorino"
Jul 07 17:45:43.882018 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:43.880601    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="79bef01e-c9c3-47b7-b8f9-3120e3083580" containerName="authorino"
Jul 07 17:45:43.885759 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:43.885735    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-w5fng"
Jul 07 17:45:43.890160 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:43.890133    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w5fng"]
Jul 07 17:45:43.979311 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:43.979219    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbkqs\" (UniqueName: \"kubernetes.io/projected/351c5920-c06f-47fb-b37d-30ec9d81a809-kube-api-access-pbkqs\") pod \"authorino-5d4b67c446-w5fng\" (UID: \"351c5920-c06f-47fb-b37d-30ec9d81a809\") " pod="kuadrant-system/authorino-5d4b67c446-w5fng"
Jul 07 17:45:44.080218 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:44.080176    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbkqs\" (UniqueName: \"kubernetes.io/projected/351c5920-c06f-47fb-b37d-30ec9d81a809-kube-api-access-pbkqs\") pod \"authorino-5d4b67c446-w5fng\" (UID: \"351c5920-c06f-47fb-b37d-30ec9d81a809\") " pod="kuadrant-system/authorino-5d4b67c446-w5fng"
Jul 07 17:45:44.090001 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:44.089950    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbkqs\" (UniqueName: \"kubernetes.io/projected/351c5920-c06f-47fb-b37d-30ec9d81a809-kube-api-access-pbkqs\") pod \"authorino-5d4b67c446-w5fng\" (UID: \"351c5920-c06f-47fb-b37d-30ec9d81a809\") " pod="kuadrant-system/authorino-5d4b67c446-w5fng"
Jul 07 17:45:44.175210 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:44.175168    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w5fng"]
Jul 07 17:45:44.175470 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:44.175454    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-w5fng"
Jul 07 17:45:44.307499 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:44.307477    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w5fng"]
Jul 07 17:45:44.309894 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:45:44.309863    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod351c5920_c06f_47fb_b37d_30ec9d81a809.slice/crio-58210ec6f69b922ff583c3b391997beef8b2f41fbcceed70a0d6820b15872886 WatchSource:0}: Error finding container 58210ec6f69b922ff583c3b391997beef8b2f41fbcceed70a0d6820b15872886: Status 404 returned error can't find the container with id 58210ec6f69b922ff583c3b391997beef8b2f41fbcceed70a0d6820b15872886
Jul 07 17:45:44.430992 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:44.430944    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-w5fng" event={"ID":"351c5920-c06f-47fb-b37d-30ec9d81a809","Type":"ContainerStarted","Data":"58210ec6f69b922ff583c3b391997beef8b2f41fbcceed70a0d6820b15872886"}
Jul 07 17:45:45.437315 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:45.437281    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-w5fng" event={"ID":"351c5920-c06f-47fb-b37d-30ec9d81a809","Type":"ContainerStarted","Data":"8d6ed0b56656d4b8910b1d2fe6ed7446e18a443de02b9ba70dbd988e71e5801f"}
Jul 07 17:45:45.437725 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:45.437353    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-w5fng" podUID="351c5920-c06f-47fb-b37d-30ec9d81a809" containerName="authorino" containerID="cri-o://8d6ed0b56656d4b8910b1d2fe6ed7446e18a443de02b9ba70dbd988e71e5801f" gracePeriod=30
Jul 07 17:45:45.451726 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:45.451676    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-w5fng" podStartSLOduration=1.976228312 podStartE2EDuration="2.451656921s" totalImagesPullingTime="475.428609ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:45:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:45:45.451018037 +0000 UTC m=+544.966248372" watchObservedRunningTime="2026-07-07 17:45:45.451656921 +0000 UTC m=+544.966887257"
Jul 07 17:45:45.694785 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:45.694726    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-w5fng"
Jul 07 17:45:45.795576 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:45.795544    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbkqs\" (UniqueName: \"kubernetes.io/projected/351c5920-c06f-47fb-b37d-30ec9d81a809-kube-api-access-pbkqs\") pod \"351c5920-c06f-47fb-b37d-30ec9d81a809\" (UID: \"351c5920-c06f-47fb-b37d-30ec9d81a809\") "
Jul 07 17:45:45.797762 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:45.797737    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/351c5920-c06f-47fb-b37d-30ec9d81a809-kube-api-access-pbkqs" (OuterVolumeSpecName: "kube-api-access-pbkqs") pod "351c5920-c06f-47fb-b37d-30ec9d81a809" (UID: "351c5920-c06f-47fb-b37d-30ec9d81a809"). InnerVolumeSpecName "kube-api-access-pbkqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:45:45.897170 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:45.897134    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbkqs\" (UniqueName: \"kubernetes.io/projected/351c5920-c06f-47fb-b37d-30ec9d81a809-kube-api-access-pbkqs\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:45:46.442280 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:46.442248    2559 generic.go:356] "Generic (PLEG): container finished" podID="351c5920-c06f-47fb-b37d-30ec9d81a809" containerID="8d6ed0b56656d4b8910b1d2fe6ed7446e18a443de02b9ba70dbd988e71e5801f" exitCode=0
Jul 07 17:45:46.442656 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:46.442292    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-w5fng"
Jul 07 17:45:46.442656 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:46.442331    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-w5fng" event={"ID":"351c5920-c06f-47fb-b37d-30ec9d81a809","Type":"ContainerDied","Data":"8d6ed0b56656d4b8910b1d2fe6ed7446e18a443de02b9ba70dbd988e71e5801f"}
Jul 07 17:45:46.442656 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:46.442370    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-w5fng" event={"ID":"351c5920-c06f-47fb-b37d-30ec9d81a809","Type":"ContainerDied","Data":"58210ec6f69b922ff583c3b391997beef8b2f41fbcceed70a0d6820b15872886"}
Jul 07 17:45:46.442656 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:46.442390    2559 scope.go:117] "RemoveContainer" containerID="8d6ed0b56656d4b8910b1d2fe6ed7446e18a443de02b9ba70dbd988e71e5801f"
Jul 07 17:45:46.451445 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:46.451431    2559 scope.go:117] "RemoveContainer" containerID="8d6ed0b56656d4b8910b1d2fe6ed7446e18a443de02b9ba70dbd988e71e5801f"
Jul 07 17:45:46.451674 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:45:46.451658    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d6ed0b56656d4b8910b1d2fe6ed7446e18a443de02b9ba70dbd988e71e5801f\": container with ID starting with 8d6ed0b56656d4b8910b1d2fe6ed7446e18a443de02b9ba70dbd988e71e5801f not found: ID does not exist" containerID="8d6ed0b56656d4b8910b1d2fe6ed7446e18a443de02b9ba70dbd988e71e5801f"
Jul 07 17:45:46.451746 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:46.451680    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d6ed0b56656d4b8910b1d2fe6ed7446e18a443de02b9ba70dbd988e71e5801f"} err="failed to get container status \"8d6ed0b56656d4b8910b1d2fe6ed7446e18a443de02b9ba70dbd988e71e5801f\": rpc error: code = NotFound desc = could not find container \"8d6ed0b56656d4b8910b1d2fe6ed7446e18a443de02b9ba70dbd988e71e5801f\": container with ID starting with 8d6ed0b56656d4b8910b1d2fe6ed7446e18a443de02b9ba70dbd988e71e5801f not found: ID does not exist"
Jul 07 17:45:46.461908 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:46.461886    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w5fng"]
Jul 07 17:45:46.465069 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:46.465047    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w5fng"]
Jul 07 17:45:47.006877 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:47.006848    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="351c5920-c06f-47fb-b37d-30ec9d81a809" path="/var/lib/kubelet/pods/351c5920-c06f-47fb-b37d-30ec9d81a809/volumes"
Jul 07 17:45:48.381575 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:48.381529    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vvkgv"]
Jul 07 17:45:48.382068 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:48.381745    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-vvkgv" podUID="f4e6ea57-bfcd-460b-9d38-396cb79c65dc" containerName="authorino" containerID="cri-o://57bfafec1c1cc06f56ba2a916c50e0b9c11c1e5cd353cc72b19411d58b9740ba" gracePeriod=30
Jul 07 17:45:48.623101 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:48.623077    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vvkgv"
Jul 07 17:45:48.719997 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:48.719896    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dldrb\" (UniqueName: \"kubernetes.io/projected/f4e6ea57-bfcd-460b-9d38-396cb79c65dc-kube-api-access-dldrb\") pod \"f4e6ea57-bfcd-460b-9d38-396cb79c65dc\" (UID: \"f4e6ea57-bfcd-460b-9d38-396cb79c65dc\") "
Jul 07 17:45:48.722095 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:48.722061    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4e6ea57-bfcd-460b-9d38-396cb79c65dc-kube-api-access-dldrb" (OuterVolumeSpecName: "kube-api-access-dldrb") pod "f4e6ea57-bfcd-460b-9d38-396cb79c65dc" (UID: "f4e6ea57-bfcd-460b-9d38-396cb79c65dc"). InnerVolumeSpecName "kube-api-access-dldrb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:45:48.821331 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:48.821303    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dldrb\" (UniqueName: \"kubernetes.io/projected/f4e6ea57-bfcd-460b-9d38-396cb79c65dc-kube-api-access-dldrb\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:45:49.457091 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:49.457059    2559 generic.go:356] "Generic (PLEG): container finished" podID="f4e6ea57-bfcd-460b-9d38-396cb79c65dc" containerID="57bfafec1c1cc06f56ba2a916c50e0b9c11c1e5cd353cc72b19411d58b9740ba" exitCode=0
Jul 07 17:45:49.457537 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:49.457119    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vvkgv"
Jul 07 17:45:49.457537 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:49.457144    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vvkgv" event={"ID":"f4e6ea57-bfcd-460b-9d38-396cb79c65dc","Type":"ContainerDied","Data":"57bfafec1c1cc06f56ba2a916c50e0b9c11c1e5cd353cc72b19411d58b9740ba"}
Jul 07 17:45:49.457537 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:49.457188    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vvkgv" event={"ID":"f4e6ea57-bfcd-460b-9d38-396cb79c65dc","Type":"ContainerDied","Data":"3eb44a35dd94191db5c909055f7e2bdbd36b7dfbcca45247144026de032fa906"}
Jul 07 17:45:49.457537 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:49.457205    2559 scope.go:117] "RemoveContainer" containerID="57bfafec1c1cc06f56ba2a916c50e0b9c11c1e5cd353cc72b19411d58b9740ba"
Jul 07 17:45:49.465314 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:49.465294    2559 scope.go:117] "RemoveContainer" containerID="57bfafec1c1cc06f56ba2a916c50e0b9c11c1e5cd353cc72b19411d58b9740ba"
Jul 07 17:45:49.465616 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:45:49.465594    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57bfafec1c1cc06f56ba2a916c50e0b9c11c1e5cd353cc72b19411d58b9740ba\": container with ID starting with 57bfafec1c1cc06f56ba2a916c50e0b9c11c1e5cd353cc72b19411d58b9740ba not found: ID does not exist" containerID="57bfafec1c1cc06f56ba2a916c50e0b9c11c1e5cd353cc72b19411d58b9740ba"
Jul 07 17:45:49.465687 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:49.465630    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57bfafec1c1cc06f56ba2a916c50e0b9c11c1e5cd353cc72b19411d58b9740ba"} err="failed to get container status \"57bfafec1c1cc06f56ba2a916c50e0b9c11c1e5cd353cc72b19411d58b9740ba\": rpc error: code = NotFound desc = could not find container \"57bfafec1c1cc06f56ba2a916c50e0b9c11c1e5cd353cc72b19411d58b9740ba\": container with ID starting with 57bfafec1c1cc06f56ba2a916c50e0b9c11c1e5cd353cc72b19411d58b9740ba not found: ID does not exist"
Jul 07 17:45:49.472456 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:49.472425    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vvkgv"]
Jul 07 17:45:49.474303 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:49.474285    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vvkgv"]
Jul 07 17:45:51.006674 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:51.006648    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4e6ea57-bfcd-460b-9d38-396cb79c65dc" path="/var/lib/kubelet/pods/f4e6ea57-bfcd-460b-9d38-396cb79c65dc/volumes"
Jul 07 17:45:52.714350 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:52.714321    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-586c86fdbc-b8cdw"]
Jul 07 17:45:52.714725 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:52.714645    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4e6ea57-bfcd-460b-9d38-396cb79c65dc" containerName="authorino"
Jul 07 17:45:52.714725 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:52.714655    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4e6ea57-bfcd-460b-9d38-396cb79c65dc" containerName="authorino"
Jul 07 17:45:52.714725 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:52.714674    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="351c5920-c06f-47fb-b37d-30ec9d81a809" containerName="authorino"
Jul 07 17:45:52.714725 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:52.714679    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="351c5920-c06f-47fb-b37d-30ec9d81a809" containerName="authorino"
Jul 07 17:45:52.714864 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:52.714739    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="351c5920-c06f-47fb-b37d-30ec9d81a809" containerName="authorino"
Jul 07 17:45:52.714864 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:52.714749    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4e6ea57-bfcd-460b-9d38-396cb79c65dc" containerName="authorino"
Jul 07 17:45:52.716715 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:52.716694    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-586c86fdbc-b8cdw"
Jul 07 17:45:52.717932 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:52.717909    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:52.718773 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:52.718754    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 17:45:52.718942 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:52.718925    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w64c2\""
Jul 07 17:45:52.719014 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:52.718925    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 17:45:52.726431 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:52.726410    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-586c86fdbc-b8cdw"]
Jul 07 17:45:52.813761 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:52.813722    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:52.857532 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:52.857506    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gjhb\" (UniqueName: \"kubernetes.io/projected/c8bbe48d-2e88-45e6-8931-c7a71fff15e8-kube-api-access-7gjhb\") pod \"maas-controller-586c86fdbc-b8cdw\" (UID: \"c8bbe48d-2e88-45e6-8931-c7a71fff15e8\") " pod="opendatahub/maas-controller-586c86fdbc-b8cdw"
Jul 07 17:45:52.857657 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:52.857540    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c8bbe48d-2e88-45e6-8931-c7a71fff15e8-webhook-cert\") pod \"maas-controller-586c86fdbc-b8cdw\" (UID: \"c8bbe48d-2e88-45e6-8931-c7a71fff15e8\") " pod="opendatahub/maas-controller-586c86fdbc-b8cdw"
Jul 07 17:45:52.887962 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:52.887917    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:52.891544 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:52.891521    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-dc6fc548d-p2f4f"]
Jul 07 17:45:52.893877 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:52.893862    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dc6fc548d-p2f4f"
Jul 07 17:45:52.904430 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:52.904409    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dc6fc548d-p2f4f"]
Jul 07 17:45:52.953023 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:52.952997    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:52.958185 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:52.958163    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gjhb\" (UniqueName: \"kubernetes.io/projected/c8bbe48d-2e88-45e6-8931-c7a71fff15e8-kube-api-access-7gjhb\") pod \"maas-controller-586c86fdbc-b8cdw\" (UID: \"c8bbe48d-2e88-45e6-8931-c7a71fff15e8\") " pod="opendatahub/maas-controller-586c86fdbc-b8cdw"
Jul 07 17:45:52.958283 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:52.958216    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c8bbe48d-2e88-45e6-8931-c7a71fff15e8-webhook-cert\") pod \"maas-controller-586c86fdbc-b8cdw\" (UID: \"c8bbe48d-2e88-45e6-8931-c7a71fff15e8\") " pod="opendatahub/maas-controller-586c86fdbc-b8cdw"
Jul 07 17:45:52.958283 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:52.958273    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e-webhook-cert\") pod \"maas-controller-dc6fc548d-p2f4f\" (UID: \"c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e\") " pod="opendatahub/maas-controller-dc6fc548d-p2f4f"
Jul 07 17:45:52.958393 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:52.958353    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbdkr\" (UniqueName: \"kubernetes.io/projected/c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e-kube-api-access-dbdkr\") pod \"maas-controller-dc6fc548d-p2f4f\" (UID: \"c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e\") " pod="opendatahub/maas-controller-dc6fc548d-p2f4f"
Jul 07 17:45:52.960708 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:52.960693    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c8bbe48d-2e88-45e6-8931-c7a71fff15e8-webhook-cert\") pod \"maas-controller-586c86fdbc-b8cdw\" (UID: \"c8bbe48d-2e88-45e6-8931-c7a71fff15e8\") " pod="opendatahub/maas-controller-586c86fdbc-b8cdw"
Jul 07 17:45:52.965785 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:52.965731    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gjhb\" (UniqueName: \"kubernetes.io/projected/c8bbe48d-2e88-45e6-8931-c7a71fff15e8-kube-api-access-7gjhb\") pod \"maas-controller-586c86fdbc-b8cdw\" (UID: \"c8bbe48d-2e88-45e6-8931-c7a71fff15e8\") " pod="opendatahub/maas-controller-586c86fdbc-b8cdw"
Jul 07 17:45:53.027852 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:53.027820    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-586c86fdbc-b8cdw"
Jul 07 17:45:53.059256 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:53.059212    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e-webhook-cert\") pod \"maas-controller-dc6fc548d-p2f4f\" (UID: \"c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e\") " pod="opendatahub/maas-controller-dc6fc548d-p2f4f"
Jul 07 17:45:53.059406 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:53.059325    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbdkr\" (UniqueName: \"kubernetes.io/projected/c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e-kube-api-access-dbdkr\") pod \"maas-controller-dc6fc548d-p2f4f\" (UID: \"c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e\") " pod="opendatahub/maas-controller-dc6fc548d-p2f4f"
Jul 07 17:45:53.061609 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:53.061586    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e-webhook-cert\") pod \"maas-controller-dc6fc548d-p2f4f\" (UID: \"c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e\") " pod="opendatahub/maas-controller-dc6fc548d-p2f4f"
Jul 07 17:45:53.066662 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:53.066611    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbdkr\" (UniqueName: \"kubernetes.io/projected/c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e-kube-api-access-dbdkr\") pod \"maas-controller-dc6fc548d-p2f4f\" (UID: \"c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e\") " pod="opendatahub/maas-controller-dc6fc548d-p2f4f"
Jul 07 17:45:53.158505 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:53.158477    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-586c86fdbc-b8cdw"]
Jul 07 17:45:53.160298 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:45:53.160268    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8bbe48d_2e88_45e6_8931_c7a71fff15e8.slice/crio-d929350f777def968ea2e53b5811464b048bc20d6b6f82e61fbd76de3ebdeb48 WatchSource:0}: Error finding container d929350f777def968ea2e53b5811464b048bc20d6b6f82e61fbd76de3ebdeb48: Status 404 returned error can't find the container with id d929350f777def968ea2e53b5811464b048bc20d6b6f82e61fbd76de3ebdeb48
Jul 07 17:45:53.203919 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:53.203879    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dc6fc548d-p2f4f"
Jul 07 17:45:53.330970 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:53.330928    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dc6fc548d-p2f4f"]
Jul 07 17:45:53.332781 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:45:53.332759    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4a9bc7d_e0ac_4dfe_a6a0_4be934db811e.slice/crio-7b7efadef7339c09dd09e610e1cb505000cbba56b676ae11d6404b8f4ea77a3b WatchSource:0}: Error finding container 7b7efadef7339c09dd09e610e1cb505000cbba56b676ae11d6404b8f4ea77a3b: Status 404 returned error can't find the container with id 7b7efadef7339c09dd09e610e1cb505000cbba56b676ae11d6404b8f4ea77a3b
Jul 07 17:45:53.476646 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:53.476612    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dc6fc548d-p2f4f" event={"ID":"c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e","Type":"ContainerStarted","Data":"7b7efadef7339c09dd09e610e1cb505000cbba56b676ae11d6404b8f4ea77a3b"}
Jul 07 17:45:53.477747 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:53.477724    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-586c86fdbc-b8cdw" event={"ID":"c8bbe48d-2e88-45e6-8931-c7a71fff15e8","Type":"ContainerStarted","Data":"d929350f777def968ea2e53b5811464b048bc20d6b6f82e61fbd76de3ebdeb48"}
Jul 07 17:45:55.472257 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:55.472219    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:55.492501 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:55.492416    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dc6fc548d-p2f4f" event={"ID":"c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e","Type":"ContainerStarted","Data":"7cd0a192b454833bb06dbc2770332ba092c63953de70a637c6eefcc204244ea7"}
Jul 07 17:45:55.492501 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:55.492482    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-dc6fc548d-p2f4f"
Jul 07 17:45:55.493968 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:55.493929    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-586c86fdbc-b8cdw" event={"ID":"c8bbe48d-2e88-45e6-8931-c7a71fff15e8","Type":"ContainerStarted","Data":"4f9296c318a5858601c0bda375f1b63829136627315b2d82a641e1ab6281ad4a"}
Jul 07 17:45:55.494100 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:55.494056    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-586c86fdbc-b8cdw"
Jul 07 17:45:55.514719 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:55.514669    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-dc6fc548d-p2f4f" podStartSLOduration=1.596447748 podStartE2EDuration="3.514655148s" totalImagesPullingTime="1.9182074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:45:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:45:55.513148467 +0000 UTC m=+555.028378803" watchObservedRunningTime="2026-07-07 17:45:55.514655148 +0000 UTC m=+555.029885482"
Jul 07 17:45:55.534366 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:55.534321    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-586c86fdbc-b8cdw" podStartSLOduration=1.453444849 podStartE2EDuration="3.534311635s" totalImagesPullingTime="2.080866786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:45:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:45:55.533455393 +0000 UTC m=+555.048685729" watchObservedRunningTime="2026-07-07 17:45:55.534311635 +0000 UTC m=+555.049541969"
Jul 07 17:45:55.562108 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:45:55.562072    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:46:03.005486 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:03.005443    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:46:06.505499 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:06.505467    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-586c86fdbc-b8cdw"
Jul 07 17:46:06.505937 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:06.505686    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-dc6fc548d-p2f4f"
Jul 07 17:46:06.567020 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:06.566989    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-586c86fdbc-b8cdw"]
Jul 07 17:46:06.567181 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:06.567158    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-586c86fdbc-b8cdw" podUID="c8bbe48d-2e88-45e6-8931-c7a71fff15e8" containerName="manager" containerID="cri-o://4f9296c318a5858601c0bda375f1b63829136627315b2d82a641e1ab6281ad4a" gracePeriod=30
Jul 07 17:46:06.806188 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:06.806166    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-586c86fdbc-b8cdw"
Jul 07 17:46:06.977517 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:06.977484    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gjhb\" (UniqueName: \"kubernetes.io/projected/c8bbe48d-2e88-45e6-8931-c7a71fff15e8-kube-api-access-7gjhb\") pod \"c8bbe48d-2e88-45e6-8931-c7a71fff15e8\" (UID: \"c8bbe48d-2e88-45e6-8931-c7a71fff15e8\") "
Jul 07 17:46:06.977680 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:06.977528    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c8bbe48d-2e88-45e6-8931-c7a71fff15e8-webhook-cert\") pod \"c8bbe48d-2e88-45e6-8931-c7a71fff15e8\" (UID: \"c8bbe48d-2e88-45e6-8931-c7a71fff15e8\") "
Jul 07 17:46:06.979766 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:06.979734    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8bbe48d-2e88-45e6-8931-c7a71fff15e8-kube-api-access-7gjhb" (OuterVolumeSpecName: "kube-api-access-7gjhb") pod "c8bbe48d-2e88-45e6-8931-c7a71fff15e8" (UID: "c8bbe48d-2e88-45e6-8931-c7a71fff15e8"). InnerVolumeSpecName "kube-api-access-7gjhb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:46:06.979888 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:06.979773    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8bbe48d-2e88-45e6-8931-c7a71fff15e8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c8bbe48d-2e88-45e6-8931-c7a71fff15e8" (UID: "c8bbe48d-2e88-45e6-8931-c7a71fff15e8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:46:07.078372 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:07.078308    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gjhb\" (UniqueName: \"kubernetes.io/projected/c8bbe48d-2e88-45e6-8931-c7a71fff15e8-kube-api-access-7gjhb\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:46:07.078372 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:07.078333    2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c8bbe48d-2e88-45e6-8931-c7a71fff15e8-webhook-cert\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:46:07.547477 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:07.547446    2559 generic.go:356] "Generic (PLEG): container finished" podID="c8bbe48d-2e88-45e6-8931-c7a71fff15e8" containerID="4f9296c318a5858601c0bda375f1b63829136627315b2d82a641e1ab6281ad4a" exitCode=0
Jul 07 17:46:07.547902 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:07.547492    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-586c86fdbc-b8cdw"
Jul 07 17:46:07.547902 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:07.547540    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-586c86fdbc-b8cdw" event={"ID":"c8bbe48d-2e88-45e6-8931-c7a71fff15e8","Type":"ContainerDied","Data":"4f9296c318a5858601c0bda375f1b63829136627315b2d82a641e1ab6281ad4a"}
Jul 07 17:46:07.547902 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:07.547589    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-586c86fdbc-b8cdw" event={"ID":"c8bbe48d-2e88-45e6-8931-c7a71fff15e8","Type":"ContainerDied","Data":"d929350f777def968ea2e53b5811464b048bc20d6b6f82e61fbd76de3ebdeb48"}
Jul 07 17:46:07.547902 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:07.547610    2559 scope.go:117] "RemoveContainer" containerID="4f9296c318a5858601c0bda375f1b63829136627315b2d82a641e1ab6281ad4a"
Jul 07 17:46:07.556163 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:07.556148    2559 scope.go:117] "RemoveContainer" containerID="4f9296c318a5858601c0bda375f1b63829136627315b2d82a641e1ab6281ad4a"
Jul 07 17:46:07.556355 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:46:07.556339    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f9296c318a5858601c0bda375f1b63829136627315b2d82a641e1ab6281ad4a\": container with ID starting with 4f9296c318a5858601c0bda375f1b63829136627315b2d82a641e1ab6281ad4a not found: ID does not exist" containerID="4f9296c318a5858601c0bda375f1b63829136627315b2d82a641e1ab6281ad4a"
Jul 07 17:46:07.556413 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:07.556363    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f9296c318a5858601c0bda375f1b63829136627315b2d82a641e1ab6281ad4a"} err="failed to get container status \"4f9296c318a5858601c0bda375f1b63829136627315b2d82a641e1ab6281ad4a\": rpc error: code = NotFound desc = could not find container \"4f9296c318a5858601c0bda375f1b63829136627315b2d82a641e1ab6281ad4a\": container with ID starting with 4f9296c318a5858601c0bda375f1b63829136627315b2d82a641e1ab6281ad4a not found: ID does not exist"
Jul 07 17:46:07.563829 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:07.563809    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-586c86fdbc-b8cdw"]
Jul 07 17:46:07.567261 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:07.567243    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-586c86fdbc-b8cdw"]
Jul 07 17:46:09.006272 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:09.006243    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8bbe48d-2e88-45e6-8931-c7a71fff15e8" path="/var/lib/kubelet/pods/c8bbe48d-2e88-45e6-8931-c7a71fff15e8/volumes"
Jul 07 17:46:24.593692 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:24.593644    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:46:24.992683 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:24.992646    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:46:25.394748 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:25.394710    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:46:25.493933 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:25.493901    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:46:25.515268 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:25.515238    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-xj2kr"]
Jul 07 17:46:25.515573 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:25.515562    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8bbe48d-2e88-45e6-8931-c7a71fff15e8" containerName="manager"
Jul 07 17:46:25.515619 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:25.515575    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8bbe48d-2e88-45e6-8931-c7a71fff15e8" containerName="manager"
Jul 07 17:46:25.515657 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:25.515628    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8bbe48d-2e88-45e6-8931-c7a71fff15e8" containerName="manager"
Jul 07 17:46:25.520058 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:25.520036    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-xj2kr"
Jul 07 17:46:25.522292 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:25.522273    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 07 17:46:25.522395 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:25.522275    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-bvjl5\""
Jul 07 17:46:25.525868 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:25.525844    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-xj2kr"]
Jul 07 17:46:25.579259 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:25.579228    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:46:25.619270 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:25.619240    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdjmm\" (UniqueName: \"kubernetes.io/projected/ea018a96-1d34-4aa7-bfd9-a99428e5d103-kube-api-access-rdjmm\") pod \"payload-pre-processing-7964457696-xj2kr\" (UID: \"ea018a96-1d34-4aa7-bfd9-a99428e5d103\") " pod="openshift-ingress/payload-pre-processing-7964457696-xj2kr"
Jul 07 17:46:25.619681 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:25.619328    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea018a96-1d34-4aa7-bfd9-a99428e5d103-plugins-config-volume\") pod \"payload-pre-processing-7964457696-xj2kr\" (UID: \"ea018a96-1d34-4aa7-bfd9-a99428e5d103\") " pod="openshift-ingress/payload-pre-processing-7964457696-xj2kr"
Jul 07 17:46:25.719977 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:25.719866    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdjmm\" (UniqueName: \"kubernetes.io/projected/ea018a96-1d34-4aa7-bfd9-a99428e5d103-kube-api-access-rdjmm\") pod \"payload-pre-processing-7964457696-xj2kr\" (UID: \"ea018a96-1d34-4aa7-bfd9-a99428e5d103\") " pod="openshift-ingress/payload-pre-processing-7964457696-xj2kr"
Jul 07 17:46:25.719977 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:25.719908    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea018a96-1d34-4aa7-bfd9-a99428e5d103-plugins-config-volume\") pod \"payload-pre-processing-7964457696-xj2kr\" (UID: \"ea018a96-1d34-4aa7-bfd9-a99428e5d103\") " pod="openshift-ingress/payload-pre-processing-7964457696-xj2kr"
Jul 07 17:46:25.720585 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:25.720565    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea018a96-1d34-4aa7-bfd9-a99428e5d103-plugins-config-volume\") pod \"payload-pre-processing-7964457696-xj2kr\" (UID: \"ea018a96-1d34-4aa7-bfd9-a99428e5d103\") " pod="openshift-ingress/payload-pre-processing-7964457696-xj2kr"
Jul 07 17:46:25.727244 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:25.727224    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdjmm\" (UniqueName: \"kubernetes.io/projected/ea018a96-1d34-4aa7-bfd9-a99428e5d103-kube-api-access-rdjmm\") pod \"payload-pre-processing-7964457696-xj2kr\" (UID: \"ea018a96-1d34-4aa7-bfd9-a99428e5d103\") " pod="openshift-ingress/payload-pre-processing-7964457696-xj2kr"
Jul 07 17:46:25.831273 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:25.831241    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-xj2kr"
Jul 07 17:46:25.979967 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:25.979931    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-xj2kr"]
Jul 07 17:46:25.982654 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:46:25.982623    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea018a96_1d34_4aa7_bfd9_a99428e5d103.slice/crio-622a472b2667a075507b9d30a6a47e24de34cb757a4b172e5e37a839fb4097fa WatchSource:0}: Error finding container 622a472b2667a075507b9d30a6a47e24de34cb757a4b172e5e37a839fb4097fa: Status 404 returned error can't find the container with id 622a472b2667a075507b9d30a6a47e24de34cb757a4b172e5e37a839fb4097fa
Jul 07 17:46:26.630137 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:26.630103    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-xj2kr" event={"ID":"ea018a96-1d34-4aa7-bfd9-a99428e5d103","Type":"ContainerStarted","Data":"622a472b2667a075507b9d30a6a47e24de34cb757a4b172e5e37a839fb4097fa"}
Jul 07 17:46:27.635520 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:27.635488    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-xj2kr" event={"ID":"ea018a96-1d34-4aa7-bfd9-a99428e5d103","Type":"ContainerStarted","Data":"d44848bb00fa3823ffcee0d0e00ddf0512f694df5c3674a6aa5e836afd9be2a3"}
Jul 07 17:46:27.635844 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:27.635607    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-xj2kr"
Jul 07 17:46:27.655548 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:27.655506    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-xj2kr" podStartSLOduration=1.123782269 podStartE2EDuration="2.655491761s" totalImagesPullingTime="1.531709492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:46:27.653527108 +0000 UTC m=+587.168757446" watchObservedRunningTime="2026-07-07 17:46:27.655491761 +0000 UTC m=+587.170722097"
Jul 07 17:46:35.296616 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:35.296574    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:46:35.395935 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:35.395879    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:46:38.641530 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:38.641503    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-xj2kr"
Jul 07 17:46:40.869097 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:40.869068    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8s7h4_5f7bf700-4743-4276-b4b1-9245cd337343/ovn-acl-logging/0.log"
Jul 07 17:46:40.878070 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:40.878049    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8s7h4_5f7bf700-4743-4276-b4b1-9245cd337343/ovn-acl-logging/0.log"
Jul 07 17:46:43.174197 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:43.174158    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:46:43.274625 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:43.274592    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:46:50.560405 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:50.560371    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf"]
Jul 07 17:46:50.564280 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:50.564259    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf"
Jul 07 17:46:50.567860 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:50.567818    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 07 17:46:50.567860 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:50.567845    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 17:46:50.568068 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:50.567850    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 17:46:50.568068 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:50.567818    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lvk68\""
Jul 07 17:46:50.571621 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:50.571551    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf"]
Jul 07 17:46:50.598851 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:50.598827    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:46:50.624641 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:50.624620    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1185796-8ddf-4182-bdd4-686d22b662bd-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf\" (UID: \"a1185796-8ddf-4182-bdd4-686d22b662bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf"
Jul 07 17:46:50.624757 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:50.624649    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1185796-8ddf-4182-bdd4-686d22b662bd-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf\" (UID: \"a1185796-8ddf-4182-bdd4-686d22b662bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf"
Jul 07 17:46:50.624757 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:50.624672    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcc8h\" (UniqueName: \"kubernetes.io/projected/a1185796-8ddf-4182-bdd4-686d22b662bd-kube-api-access-dcc8h\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf\" (UID: \"a1185796-8ddf-4182-bdd4-686d22b662bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf"
Jul 07 17:46:50.624757 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:50.624697    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1185796-8ddf-4182-bdd4-686d22b662bd-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf\" (UID: \"a1185796-8ddf-4182-bdd4-686d22b662bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf"
Jul 07 17:46:50.624757 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:50.624748    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1185796-8ddf-4182-bdd4-686d22b662bd-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf\" (UID: \"a1185796-8ddf-4182-bdd4-686d22b662bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf"
Jul 07 17:46:50.624938 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:50.624785    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1185796-8ddf-4182-bdd4-686d22b662bd-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf\" (UID: \"a1185796-8ddf-4182-bdd4-686d22b662bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf"
Jul 07 17:46:50.726138 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:50.726097    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1185796-8ddf-4182-bdd4-686d22b662bd-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf\" (UID: \"a1185796-8ddf-4182-bdd4-686d22b662bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf"
Jul 07 17:46:50.726361 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:50.726342    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1185796-8ddf-4182-bdd4-686d22b662bd-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf\" (UID: \"a1185796-8ddf-4182-bdd4-686d22b662bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf"
Jul 07 17:46:50.726484 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:50.726469    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcc8h\" (UniqueName: \"kubernetes.io/projected/a1185796-8ddf-4182-bdd4-686d22b662bd-kube-api-access-dcc8h\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf\" (UID: \"a1185796-8ddf-4182-bdd4-686d22b662bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf"
Jul 07 17:46:50.726595 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:50.726583    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1185796-8ddf-4182-bdd4-686d22b662bd-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf\" (UID: \"a1185796-8ddf-4182-bdd4-686d22b662bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf"
Jul 07 17:46:50.726712 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:50.726701    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1185796-8ddf-4182-bdd4-686d22b662bd-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf\" (UID: \"a1185796-8ddf-4182-bdd4-686d22b662bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf"
Jul 07 17:46:50.726825 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:50.726811    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1185796-8ddf-4182-bdd4-686d22b662bd-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf\" (UID: \"a1185796-8ddf-4182-bdd4-686d22b662bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf"
Jul 07 17:46:50.727290 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:50.727268    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1185796-8ddf-4182-bdd4-686d22b662bd-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf\" (UID: \"a1185796-8ddf-4182-bdd4-686d22b662bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf"
Jul 07 17:46:50.727556 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:50.726463    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1185796-8ddf-4182-bdd4-686d22b662bd-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf\" (UID: \"a1185796-8ddf-4182-bdd4-686d22b662bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf"
Jul 07 17:46:50.729992 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:50.728024    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1185796-8ddf-4182-bdd4-686d22b662bd-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf\" (UID: \"a1185796-8ddf-4182-bdd4-686d22b662bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf"
Jul 07 17:46:50.729992 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:50.729520    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1185796-8ddf-4182-bdd4-686d22b662bd-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf\" (UID: \"a1185796-8ddf-4182-bdd4-686d22b662bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf"
Jul 07 17:46:50.734403 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:50.734382    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1185796-8ddf-4182-bdd4-686d22b662bd-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf\" (UID: \"a1185796-8ddf-4182-bdd4-686d22b662bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf"
Jul 07 17:46:50.736123 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:50.736103    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcc8h\" (UniqueName: \"kubernetes.io/projected/a1185796-8ddf-4182-bdd4-686d22b662bd-kube-api-access-dcc8h\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf\" (UID: \"a1185796-8ddf-4182-bdd4-686d22b662bd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf"
Jul 07 17:46:50.875470 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:50.875434    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf"
Jul 07 17:46:51.011549 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:51.011359    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf"]
Jul 07 17:46:51.013929 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:46:51.013905    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1185796_8ddf_4182_bdd4_686d22b662bd.slice/crio-362980b8b3f8840f26293fba97108da06ae6af04e698381e74cc0f3586705e1c WatchSource:0}: Error finding container 362980b8b3f8840f26293fba97108da06ae6af04e698381e74cc0f3586705e1c: Status 404 returned error can't find the container with id 362980b8b3f8840f26293fba97108da06ae6af04e698381e74cc0f3586705e1c
Jul 07 17:46:51.748127 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:51.748084    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf" event={"ID":"a1185796-8ddf-4182-bdd4-686d22b662bd","Type":"ContainerStarted","Data":"362980b8b3f8840f26293fba97108da06ae6af04e698381e74cc0f3586705e1c"}
Jul 07 17:46:52.753790 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:52.753756    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf" event={"ID":"a1185796-8ddf-4182-bdd4-686d22b662bd","Type":"ContainerStarted","Data":"4996c25b6dfae54bd427ed903779fa9e724e93d9cac1b999f4342bd8e3778150"}
Jul 07 17:46:52.769593 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:46:52.769542    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf" podStartSLOduration=1.766702287 podStartE2EDuration="2.769526509s" totalImagesPullingTime="1.002824222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:46:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:46:52.769349619 +0000 UTC m=+612.284579956" watchObservedRunningTime="2026-07-07 17:46:52.769526509 +0000 UTC m=+612.284756845"
Jul 07 17:47:00.875556 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:00.875523    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf"
Jul 07 17:47:00.876010 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:00.875581    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf"
Jul 07 17:47:00.888240 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:00.888217    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf"
Jul 07 17:47:01.806254 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:01.806182    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf"
Jul 07 17:47:03.675986 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:03.675942    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:15.765716 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:15.765679    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-hjx4d"]
Jul 07 17:47:15.769561 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:15.769542    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hjx4d"
Jul 07 17:47:15.771901 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:15.771876    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 07 17:47:15.781822 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:15.781770    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-hjx4d"]
Jul 07 17:47:15.818057 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:15.818031    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:15.937899 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:15.937864    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/faa954ae-5c41-4e1b-98a8-f28f80735afa-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hjx4d\" (UID: \"faa954ae-5c41-4e1b-98a8-f28f80735afa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hjx4d"
Jul 07 17:47:15.937899 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:15.937905    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faa954ae-5c41-4e1b-98a8-f28f80735afa-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hjx4d\" (UID: \"faa954ae-5c41-4e1b-98a8-f28f80735afa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hjx4d"
Jul 07 17:47:15.938104 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:15.937920    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faa954ae-5c41-4e1b-98a8-f28f80735afa-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hjx4d\" (UID: \"faa954ae-5c41-4e1b-98a8-f28f80735afa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hjx4d"
Jul 07 17:47:15.938104 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:15.937984    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/faa954ae-5c41-4e1b-98a8-f28f80735afa-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hjx4d\" (UID: \"faa954ae-5c41-4e1b-98a8-f28f80735afa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hjx4d"
Jul 07 17:47:15.938104 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:15.938042    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd5kr\" (UniqueName: \"kubernetes.io/projected/faa954ae-5c41-4e1b-98a8-f28f80735afa-kube-api-access-nd5kr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hjx4d\" (UID: \"faa954ae-5c41-4e1b-98a8-f28f80735afa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hjx4d"
Jul 07 17:47:15.938104 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:15.938067    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/faa954ae-5c41-4e1b-98a8-f28f80735afa-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hjx4d\" (UID: \"faa954ae-5c41-4e1b-98a8-f28f80735afa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hjx4d"
Jul 07 17:47:16.039085 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:16.039014    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/faa954ae-5c41-4e1b-98a8-f28f80735afa-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hjx4d\" (UID: \"faa954ae-5c41-4e1b-98a8-f28f80735afa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hjx4d"
Jul 07 17:47:16.039085 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:16.039052    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faa954ae-5c41-4e1b-98a8-f28f80735afa-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hjx4d\" (UID: \"faa954ae-5c41-4e1b-98a8-f28f80735afa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hjx4d"
Jul 07 17:47:16.039085 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:16.039067    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faa954ae-5c41-4e1b-98a8-f28f80735afa-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hjx4d\" (UID: \"faa954ae-5c41-4e1b-98a8-f28f80735afa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hjx4d"
Jul 07 17:47:16.039276 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:16.039174    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/faa954ae-5c41-4e1b-98a8-f28f80735afa-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hjx4d\" (UID: \"faa954ae-5c41-4e1b-98a8-f28f80735afa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hjx4d"
Jul 07 17:47:16.039276 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:16.039235    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd5kr\" (UniqueName: \"kubernetes.io/projected/faa954ae-5c41-4e1b-98a8-f28f80735afa-kube-api-access-nd5kr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hjx4d\" (UID: \"faa954ae-5c41-4e1b-98a8-f28f80735afa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hjx4d"
Jul 07 17:47:16.039276 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:16.039269    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/faa954ae-5c41-4e1b-98a8-f28f80735afa-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hjx4d\" (UID: \"faa954ae-5c41-4e1b-98a8-f28f80735afa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hjx4d"
Jul 07 17:47:16.039453 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:16.039434    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faa954ae-5c41-4e1b-98a8-f28f80735afa-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hjx4d\" (UID: \"faa954ae-5c41-4e1b-98a8-f28f80735afa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hjx4d"
Jul 07 17:47:16.039500 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:16.039481    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/faa954ae-5c41-4e1b-98a8-f28f80735afa-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hjx4d\" (UID: \"faa954ae-5c41-4e1b-98a8-f28f80735afa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hjx4d"
Jul 07 17:47:16.039553 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:16.039534    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/faa954ae-5c41-4e1b-98a8-f28f80735afa-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hjx4d\" (UID: \"faa954ae-5c41-4e1b-98a8-f28f80735afa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hjx4d"
Jul 07 17:47:16.041460 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:16.041433    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/faa954ae-5c41-4e1b-98a8-f28f80735afa-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hjx4d\" (UID: \"faa954ae-5c41-4e1b-98a8-f28f80735afa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hjx4d"
Jul 07 17:47:16.041691 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:16.041673    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faa954ae-5c41-4e1b-98a8-f28f80735afa-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hjx4d\" (UID: \"faa954ae-5c41-4e1b-98a8-f28f80735afa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hjx4d"
Jul 07 17:47:16.048094 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:16.048075    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd5kr\" (UniqueName: \"kubernetes.io/projected/faa954ae-5c41-4e1b-98a8-f28f80735afa-kube-api-access-nd5kr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hjx4d\" (UID: \"faa954ae-5c41-4e1b-98a8-f28f80735afa\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hjx4d"
Jul 07 17:47:16.081028 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:16.080985    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hjx4d"
Jul 07 17:47:16.211664 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:16.211640    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-hjx4d"]
Jul 07 17:47:16.213577 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:47:16.213552    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaa954ae_5c41_4e1b_98a8_f28f80735afa.slice/crio-2c72f0230dbb97011213883fe8cb0a858582b3c6dc91800b9cb60cb250757bfd WatchSource:0}: Error finding container 2c72f0230dbb97011213883fe8cb0a858582b3c6dc91800b9cb60cb250757bfd: Status 404 returned error can't find the container with id 2c72f0230dbb97011213883fe8cb0a858582b3c6dc91800b9cb60cb250757bfd
Jul 07 17:47:16.214976 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:16.214945    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 17:47:16.861137 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:16.861107    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hjx4d" event={"ID":"faa954ae-5c41-4e1b-98a8-f28f80735afa","Type":"ContainerStarted","Data":"8fd4008ada58b31296c7332e6a0ce88747a9a4a77393390db105a51f6fecb32e"}
Jul 07 17:47:16.861526 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:16.861185    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hjx4d" event={"ID":"faa954ae-5c41-4e1b-98a8-f28f80735afa","Type":"ContainerStarted","Data":"2c72f0230dbb97011213883fe8cb0a858582b3c6dc91800b9cb60cb250757bfd"}
Jul 07 17:47:16.879083 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:16.879038    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hjx4d" podStartSLOduration=1.6168458970000001 podStartE2EDuration="1.879023994s" totalImagesPullingTime="262.178097ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:47:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:47:16.877759551 +0000 UTC m=+636.392989888" watchObservedRunningTime="2026-07-07 17:47:16.879023994 +0000 UTC m=+636.394254327"
Jul 07 17:47:20.712157 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:20.712116    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:20.957303 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:20.957273    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:25.495855 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:25.495821    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:26.081979 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:26.081915    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hjx4d"
Jul 07 17:47:26.082179 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:26.082010    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hjx4d"
Jul 07 17:47:26.094785 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:26.094755    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hjx4d"
Jul 07 17:47:26.336128 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:26.336053    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:26.917910 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:26.917880    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hjx4d"
Jul 07 17:47:28.056303 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:28.056273    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl"]
Jul 07 17:47:28.062653 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:28.062635    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl"
Jul 07 17:47:28.065054 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:28.065033    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 07 17:47:28.070675 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:28.070554    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl"]
Jul 07 17:47:28.088429 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:28.088398    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:28.132003 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:28.131975    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0876169c-a57c-4c59-8727-f9ef6044bea9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl\" (UID: \"0876169c-a57c-4c59-8727-f9ef6044bea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl"
Jul 07 17:47:28.132096 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:28.132076    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0876169c-a57c-4c59-8727-f9ef6044bea9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl\" (UID: \"0876169c-a57c-4c59-8727-f9ef6044bea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl"
Jul 07 17:47:28.132147 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:28.132108    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0876169c-a57c-4c59-8727-f9ef6044bea9-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl\" (UID: \"0876169c-a57c-4c59-8727-f9ef6044bea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl"
Jul 07 17:47:28.132147 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:28.132132    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nntw4\" (UniqueName: \"kubernetes.io/projected/0876169c-a57c-4c59-8727-f9ef6044bea9-kube-api-access-nntw4\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl\" (UID: \"0876169c-a57c-4c59-8727-f9ef6044bea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl"
Jul 07 17:47:28.132209 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:28.132150    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0876169c-a57c-4c59-8727-f9ef6044bea9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl\" (UID: \"0876169c-a57c-4c59-8727-f9ef6044bea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl"
Jul 07 17:47:28.132209 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:28.132200    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0876169c-a57c-4c59-8727-f9ef6044bea9-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl\" (UID: \"0876169c-a57c-4c59-8727-f9ef6044bea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl"
Jul 07 17:47:28.233102 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:28.233058    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0876169c-a57c-4c59-8727-f9ef6044bea9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl\" (UID: \"0876169c-a57c-4c59-8727-f9ef6044bea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl"
Jul 07 17:47:28.233102 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:28.233102    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0876169c-a57c-4c59-8727-f9ef6044bea9-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl\" (UID: \"0876169c-a57c-4c59-8727-f9ef6044bea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl"
Jul 07 17:47:28.233315 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:28.233139    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nntw4\" (UniqueName: \"kubernetes.io/projected/0876169c-a57c-4c59-8727-f9ef6044bea9-kube-api-access-nntw4\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl\" (UID: \"0876169c-a57c-4c59-8727-f9ef6044bea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl"
Jul 07 17:47:28.233315 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:28.233166    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0876169c-a57c-4c59-8727-f9ef6044bea9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl\" (UID: \"0876169c-a57c-4c59-8727-f9ef6044bea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl"
Jul 07 17:47:28.233315 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:28.233202    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0876169c-a57c-4c59-8727-f9ef6044bea9-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl\" (UID: \"0876169c-a57c-4c59-8727-f9ef6044bea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl"
Jul 07 17:47:28.233315 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:28.233271    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0876169c-a57c-4c59-8727-f9ef6044bea9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl\" (UID: \"0876169c-a57c-4c59-8727-f9ef6044bea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl"
Jul 07 17:47:28.233637 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:28.233602    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0876169c-a57c-4c59-8727-f9ef6044bea9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl\" (UID: \"0876169c-a57c-4c59-8727-f9ef6044bea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl"
Jul 07 17:47:28.233772 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:28.233605    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0876169c-a57c-4c59-8727-f9ef6044bea9-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl\" (UID: \"0876169c-a57c-4c59-8727-f9ef6044bea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl"
Jul 07 17:47:28.233772 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:28.233650    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0876169c-a57c-4c59-8727-f9ef6044bea9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl\" (UID: \"0876169c-a57c-4c59-8727-f9ef6044bea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl"
Jul 07 17:47:28.235629 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:28.235600    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0876169c-a57c-4c59-8727-f9ef6044bea9-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl\" (UID: \"0876169c-a57c-4c59-8727-f9ef6044bea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl"
Jul 07 17:47:28.235773 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:28.235756    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0876169c-a57c-4c59-8727-f9ef6044bea9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl\" (UID: \"0876169c-a57c-4c59-8727-f9ef6044bea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl"
Jul 07 17:47:28.244174 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:28.244145    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nntw4\" (UniqueName: \"kubernetes.io/projected/0876169c-a57c-4c59-8727-f9ef6044bea9-kube-api-access-nntw4\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl\" (UID: \"0876169c-a57c-4c59-8727-f9ef6044bea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl"
Jul 07 17:47:28.374971 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:28.374935    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl"
Jul 07 17:47:28.509205 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:28.509179    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl"]
Jul 07 17:47:28.511166 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:47:28.511135    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0876169c_a57c_4c59_8727_f9ef6044bea9.slice/crio-47eb8fa5b528d676d5b2b41a4616b03230ad425c136aac71947d6c8f229f49de WatchSource:0}: Error finding container 47eb8fa5b528d676d5b2b41a4616b03230ad425c136aac71947d6c8f229f49de: Status 404 returned error can't find the container with id 47eb8fa5b528d676d5b2b41a4616b03230ad425c136aac71947d6c8f229f49de
Jul 07 17:47:28.917237 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:28.917203    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl" event={"ID":"0876169c-a57c-4c59-8727-f9ef6044bea9","Type":"ContainerStarted","Data":"47fae2ebee79ce1a61e12d047c626939a9c9dcb1f5e1cd8f673d795c256516db"}
Jul 07 17:47:28.917430 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:28.917247    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl" event={"ID":"0876169c-a57c-4c59-8727-f9ef6044bea9","Type":"ContainerStarted","Data":"47eb8fa5b528d676d5b2b41a4616b03230ad425c136aac71947d6c8f229f49de"}
Jul 07 17:47:28.934256 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:28.934209    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl" podStartSLOduration=0.746815681 podStartE2EDuration="934.194091ms" totalImagesPullingTime="187.37841ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:47:28.933378241 +0000 UTC m=+648.448608578" watchObservedRunningTime="2026-07-07 17:47:28.934194091 +0000 UTC m=+648.449424420"
Jul 07 17:47:38.375994 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:38.375944    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl"
Jul 07 17:47:38.376448 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:38.376021    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl"
Jul 07 17:47:38.388093 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:38.388069    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl"
Jul 07 17:47:38.972623 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:47:38.972598    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl"
Jul 07 17:48:40.667721 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:48:40.667688    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6486bbd9ff-5cf82"]
Jul 07 17:48:40.671190 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:48:40.671171    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6486bbd9ff-5cf82"
Jul 07 17:48:40.673278 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:48:40.673252    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 17:48:40.674229 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:48:40.674214    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 07 17:48:40.674287 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:48:40.674275    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8zcq4\""
Jul 07 17:48:40.674395 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:48:40.674383    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 17:48:40.678868 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:48:40.678543    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6486bbd9ff-5cf82"]
Jul 07 17:48:40.758008 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:48:40.757944    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrdrj\" (UniqueName: \"kubernetes.io/projected/045e876b-8fd3-4511-9541-5a6027842737-kube-api-access-vrdrj\") pod \"authorino-6486bbd9ff-5cf82\" (UID: \"045e876b-8fd3-4511-9541-5a6027842737\") " pod="kuadrant-system/authorino-6486bbd9ff-5cf82"
Jul 07 17:48:40.758181 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:48:40.758096    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/045e876b-8fd3-4511-9541-5a6027842737-tls-cert\") pod \"authorino-6486bbd9ff-5cf82\" (UID: \"045e876b-8fd3-4511-9541-5a6027842737\") " pod="kuadrant-system/authorino-6486bbd9ff-5cf82"
Jul 07 17:48:40.859457 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:48:40.859429    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/045e876b-8fd3-4511-9541-5a6027842737-tls-cert\") pod \"authorino-6486bbd9ff-5cf82\" (UID: \"045e876b-8fd3-4511-9541-5a6027842737\") " pod="kuadrant-system/authorino-6486bbd9ff-5cf82"
Jul 07 17:48:40.859609 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:48:40.859480    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrdrj\" (UniqueName: \"kubernetes.io/projected/045e876b-8fd3-4511-9541-5a6027842737-kube-api-access-vrdrj\") pod \"authorino-6486bbd9ff-5cf82\" (UID: \"045e876b-8fd3-4511-9541-5a6027842737\") " pod="kuadrant-system/authorino-6486bbd9ff-5cf82"
Jul 07 17:48:40.862100 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:48:40.862082    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 07 17:48:40.867304 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:48:40.867284    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 17:48:40.872604 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:48:40.872587    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/045e876b-8fd3-4511-9541-5a6027842737-tls-cert\") pod \"authorino-6486bbd9ff-5cf82\" (UID: \"045e876b-8fd3-4511-9541-5a6027842737\") " pod="kuadrant-system/authorino-6486bbd9ff-5cf82"
Jul 07 17:48:40.877225 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:48:40.877205    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 17:48:40.888772 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:48:40.888749    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrdrj\" (UniqueName: \"kubernetes.io/projected/045e876b-8fd3-4511-9541-5a6027842737-kube-api-access-vrdrj\") pod \"authorino-6486bbd9ff-5cf82\" (UID: \"045e876b-8fd3-4511-9541-5a6027842737\") " pod="kuadrant-system/authorino-6486bbd9ff-5cf82"
Jul 07 17:48:40.983896 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:48:40.983832    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8zcq4\""
Jul 07 17:48:40.992605 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:48:40.992585    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6486bbd9ff-5cf82"
Jul 07 17:48:41.134491 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:48:41.134386    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6486bbd9ff-5cf82"]
Jul 07 17:48:41.136599 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:48:41.136573    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod045e876b_8fd3_4511_9541_5a6027842737.slice/crio-67f64a207ccac33e5d8384f60aed468655c9a58fe26775efc35b6fe2c405787f WatchSource:0}: Error finding container 67f64a207ccac33e5d8384f60aed468655c9a58fe26775efc35b6fe2c405787f: Status 404 returned error can't find the container with id 67f64a207ccac33e5d8384f60aed468655c9a58fe26775efc35b6fe2c405787f
Jul 07 17:48:41.253693 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:48:41.253605    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6486bbd9ff-5cf82" event={"ID":"045e876b-8fd3-4511-9541-5a6027842737","Type":"ContainerStarted","Data":"67f64a207ccac33e5d8384f60aed468655c9a58fe26775efc35b6fe2c405787f"}
Jul 07 17:48:42.261162 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:48:42.261126    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6486bbd9ff-5cf82" event={"ID":"045e876b-8fd3-4511-9541-5a6027842737","Type":"ContainerStarted","Data":"72d2bc3edb37f8ba18d51e3a13bee9f26a8fc25fcc156cd3909e8fc963bce017"}
Jul 07 17:48:42.278478 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:48:42.278412    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6486bbd9ff-5cf82" podStartSLOduration=1.890045789 podStartE2EDuration="2.278396671s" totalImagesPullingTime="388.350882ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:48:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:48:42.277983291 +0000 UTC m=+721.793213626" watchObservedRunningTime="2026-07-07 17:48:42.278396671 +0000 UTC m=+721.793627006"
Jul 07 17:48:42.831820 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:48:42.831777    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:42.931756 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:48:42.931716    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:44.023323 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:48:44.023287    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:44.123755 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:48:44.123719    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:49:52.875723 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:52.875689    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:49:52.931727 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:52.931701    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:49:55.327423 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:55.327385    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:49:55.438045 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:55.438007    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-dc6fc548d-p2f4f"]
Jul 07 17:49:55.438284 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:55.438229    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-dc6fc548d-p2f4f" podUID="c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e" containerName="manager" containerID="cri-o://7cd0a192b454833bb06dbc2770332ba092c63953de70a637c6eefcc204244ea7" gracePeriod=30
Jul 07 17:49:55.598433 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:55.598343    2559 generic.go:356] "Generic (PLEG): container finished" podID="c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e" containerID="7cd0a192b454833bb06dbc2770332ba092c63953de70a637c6eefcc204244ea7" exitCode=0
Jul 07 17:49:55.598433 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:55.598410    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dc6fc548d-p2f4f" event={"ID":"c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e","Type":"ContainerDied","Data":"7cd0a192b454833bb06dbc2770332ba092c63953de70a637c6eefcc204244ea7"}
Jul 07 17:49:55.690318 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:55.690293    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dc6fc548d-p2f4f"
Jul 07 17:49:55.813780 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:55.813753    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e-webhook-cert\") pod \"c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e\" (UID: \"c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e\") "
Jul 07 17:49:55.813944 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:55.813845    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbdkr\" (UniqueName: \"kubernetes.io/projected/c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e-kube-api-access-dbdkr\") pod \"c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e\" (UID: \"c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e\") "
Jul 07 17:49:55.815895 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:55.815863    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e-kube-api-access-dbdkr" (OuterVolumeSpecName: "kube-api-access-dbdkr") pod "c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e" (UID: "c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e"). InnerVolumeSpecName "kube-api-access-dbdkr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:49:55.815895 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:55.815870    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e" (UID: "c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:49:55.915127 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:55.915094    2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e-webhook-cert\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:49:55.915127 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:55.915125    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbdkr\" (UniqueName: \"kubernetes.io/projected/c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e-kube-api-access-dbdkr\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:49:56.603876 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:56.603837    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dc6fc548d-p2f4f" event={"ID":"c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e","Type":"ContainerDied","Data":"7b7efadef7339c09dd09e610e1cb505000cbba56b676ae11d6404b8f4ea77a3b"}
Jul 07 17:49:56.604327 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:56.603902    2559 scope.go:117] "RemoveContainer" containerID="7cd0a192b454833bb06dbc2770332ba092c63953de70a637c6eefcc204244ea7"
Jul 07 17:49:56.604327 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:56.603856    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dc6fc548d-p2f4f"
Jul 07 17:49:56.624195 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:56.624171    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-dc6fc548d-p2f4f"]
Jul 07 17:49:56.628254 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:56.628231    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-dc6fc548d-p2f4f"]
Jul 07 17:49:57.007217 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:57.007187    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e" path="/var/lib/kubelet/pods/c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e/volumes"
Jul 07 17:49:57.309064 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:57.308977    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:49:57.430009 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:57.429975    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-dc6fc548d-5jcvl"]
Jul 07 17:49:57.430340 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:57.430329    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e" containerName="manager"
Jul 07 17:49:57.430443 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:57.430342    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e" containerName="manager"
Jul 07 17:49:57.430443 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:57.430409    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4a9bc7d-e0ac-4dfe-a6a0-4be934db811e" containerName="manager"
Jul 07 17:49:57.434734 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:57.434717    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dc6fc548d-5jcvl"
Jul 07 17:49:57.438072 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:57.438050    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w64c2\""
Jul 07 17:49:57.438072 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:57.438060    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 17:49:57.438072 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:57.438054    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 17:49:57.443504 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:57.443484    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dc6fc548d-5jcvl"]
Jul 07 17:49:57.530442 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:57.530416    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwv6f\" (UniqueName: \"kubernetes.io/projected/450900f8-5a3d-4309-9175-550377bd8103-kube-api-access-hwv6f\") pod \"maas-controller-dc6fc548d-5jcvl\" (UID: \"450900f8-5a3d-4309-9175-550377bd8103\") " pod="opendatahub/maas-controller-dc6fc548d-5jcvl"
Jul 07 17:49:57.530595 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:57.530458    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/450900f8-5a3d-4309-9175-550377bd8103-webhook-cert\") pod \"maas-controller-dc6fc548d-5jcvl\" (UID: \"450900f8-5a3d-4309-9175-550377bd8103\") " pod="opendatahub/maas-controller-dc6fc548d-5jcvl"
Jul 07 17:49:57.631514 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:57.631480    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwv6f\" (UniqueName: \"kubernetes.io/projected/450900f8-5a3d-4309-9175-550377bd8103-kube-api-access-hwv6f\") pod \"maas-controller-dc6fc548d-5jcvl\" (UID: \"450900f8-5a3d-4309-9175-550377bd8103\") " pod="opendatahub/maas-controller-dc6fc548d-5jcvl"
Jul 07 17:49:57.631908 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:57.631536    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/450900f8-5a3d-4309-9175-550377bd8103-webhook-cert\") pod \"maas-controller-dc6fc548d-5jcvl\" (UID: \"450900f8-5a3d-4309-9175-550377bd8103\") " pod="opendatahub/maas-controller-dc6fc548d-5jcvl"
Jul 07 17:49:57.634213 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:57.634194    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/450900f8-5a3d-4309-9175-550377bd8103-webhook-cert\") pod \"maas-controller-dc6fc548d-5jcvl\" (UID: \"450900f8-5a3d-4309-9175-550377bd8103\") " pod="opendatahub/maas-controller-dc6fc548d-5jcvl"
Jul 07 17:49:57.638948 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:57.638925    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwv6f\" (UniqueName: \"kubernetes.io/projected/450900f8-5a3d-4309-9175-550377bd8103-kube-api-access-hwv6f\") pod \"maas-controller-dc6fc548d-5jcvl\" (UID: \"450900f8-5a3d-4309-9175-550377bd8103\") " pod="opendatahub/maas-controller-dc6fc548d-5jcvl"
Jul 07 17:49:57.746297 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:57.746256    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dc6fc548d-5jcvl"
Jul 07 17:49:57.886147 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:57.886119    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dc6fc548d-5jcvl"]
Jul 07 17:49:57.888370 ip-10-0-132-78 kubenswrapper[2559]: W0707 17:49:57.888343    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod450900f8_5a3d_4309_9175_550377bd8103.slice/crio-fe1f084b90e9928f6949a2ca3e39c16e4408726e14e3322ac3c843b85ea085e8 WatchSource:0}: Error finding container fe1f084b90e9928f6949a2ca3e39c16e4408726e14e3322ac3c843b85ea085e8: Status 404 returned error can't find the container with id fe1f084b90e9928f6949a2ca3e39c16e4408726e14e3322ac3c843b85ea085e8
Jul 07 17:49:58.615191 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:58.615143    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dc6fc548d-5jcvl" event={"ID":"450900f8-5a3d-4309-9175-550377bd8103","Type":"ContainerStarted","Data":"dd17ec0189b8e84fef36984c36388fc73756adb65769f81bc31154ab042854c6"}
Jul 07 17:49:58.615384 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:58.615230    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dc6fc548d-5jcvl" event={"ID":"450900f8-5a3d-4309-9175-550377bd8103","Type":"ContainerStarted","Data":"fe1f084b90e9928f6949a2ca3e39c16e4408726e14e3322ac3c843b85ea085e8"}
Jul 07 17:49:58.615384 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:58.615270    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-dc6fc548d-5jcvl"
Jul 07 17:49:58.631398 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:49:58.631355    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-dc6fc548d-5jcvl" podStartSLOduration=1.11074063 podStartE2EDuration="1.631341725s" totalImagesPullingTime="520.601095ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:49:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:49:58.630642502 +0000 UTC m=+798.145872839" watchObservedRunningTime="2026-07-07 17:49:58.631341725 +0000 UTC m=+798.146572060"
Jul 07 17:50:03.406987 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:03.406891    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68b5cd5499-g8w2p"]
Jul 07 17:50:03.546425 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:03.546395    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:50:03.648518 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:03.648485    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:50:09.624199 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:09.624169    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-dc6fc548d-5jcvl"
Jul 07 17:50:28.429232 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:28.429185    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-68b5cd5499-g8w2p" podUID="dedce612-68bc-40ef-a75f-d105668c35a0" containerName="console" containerID="cri-o://284e0fa3d4f7739140a97a10ff414e2dc0d3ce74e15ce36624f6592a117d85a8" gracePeriod=15
Jul 07 17:50:28.682547 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:28.682486    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68b5cd5499-g8w2p"
Jul 07 17:50:28.754754 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:28.754724    2559 generic.go:356] "Generic (PLEG): container finished" podID="dedce612-68bc-40ef-a75f-d105668c35a0" containerID="284e0fa3d4f7739140a97a10ff414e2dc0d3ce74e15ce36624f6592a117d85a8" exitCode=0
Jul 07 17:50:28.754935 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:28.754776    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68b5cd5499-g8w2p" event={"ID":"dedce612-68bc-40ef-a75f-d105668c35a0","Type":"ContainerDied","Data":"284e0fa3d4f7739140a97a10ff414e2dc0d3ce74e15ce36624f6592a117d85a8"}
Jul 07 17:50:28.754935 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:28.754811    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68b5cd5499-g8w2p" event={"ID":"dedce612-68bc-40ef-a75f-d105668c35a0","Type":"ContainerDied","Data":"f14010cb163c56bc1175d4b3a40859acc9031a0690db3661371839849a4bb01b"}
Jul 07 17:50:28.754935 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:28.754832    2559 scope.go:117] "RemoveContainer" containerID="284e0fa3d4f7739140a97a10ff414e2dc0d3ce74e15ce36624f6592a117d85a8"
Jul 07 17:50:28.754935 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:28.754778    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68b5cd5499-g8w2p"
Jul 07 17:50:28.763154 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:28.763140    2559 scope.go:117] "RemoveContainer" containerID="284e0fa3d4f7739140a97a10ff414e2dc0d3ce74e15ce36624f6592a117d85a8"
Jul 07 17:50:28.763404 ip-10-0-132-78 kubenswrapper[2559]: E0707 17:50:28.763381    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"284e0fa3d4f7739140a97a10ff414e2dc0d3ce74e15ce36624f6592a117d85a8\": container with ID starting with 284e0fa3d4f7739140a97a10ff414e2dc0d3ce74e15ce36624f6592a117d85a8 not found: ID does not exist" containerID="284e0fa3d4f7739140a97a10ff414e2dc0d3ce74e15ce36624f6592a117d85a8"
Jul 07 17:50:28.763450 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:28.763416    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"284e0fa3d4f7739140a97a10ff414e2dc0d3ce74e15ce36624f6592a117d85a8"} err="failed to get container status \"284e0fa3d4f7739140a97a10ff414e2dc0d3ce74e15ce36624f6592a117d85a8\": rpc error: code = NotFound desc = could not find container \"284e0fa3d4f7739140a97a10ff414e2dc0d3ce74e15ce36624f6592a117d85a8\": container with ID starting with 284e0fa3d4f7739140a97a10ff414e2dc0d3ce74e15ce36624f6592a117d85a8 not found: ID does not exist"
Jul 07 17:50:28.803851 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:28.803820    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dedce612-68bc-40ef-a75f-d105668c35a0-trusted-ca-bundle\") pod \"dedce612-68bc-40ef-a75f-d105668c35a0\" (UID: \"dedce612-68bc-40ef-a75f-d105668c35a0\") "
Jul 07 17:50:28.803930 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:28.803909    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nnbg\" (UniqueName: \"kubernetes.io/projected/dedce612-68bc-40ef-a75f-d105668c35a0-kube-api-access-9nnbg\") pod \"dedce612-68bc-40ef-a75f-d105668c35a0\" (UID: \"dedce612-68bc-40ef-a75f-d105668c35a0\") "
Jul 07 17:50:28.803998 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:28.803945    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dedce612-68bc-40ef-a75f-d105668c35a0-console-serving-cert\") pod \"dedce612-68bc-40ef-a75f-d105668c35a0\" (UID: \"dedce612-68bc-40ef-a75f-d105668c35a0\") "
Jul 07 17:50:28.804048 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:28.804003    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dedce612-68bc-40ef-a75f-d105668c35a0-service-ca\") pod \"dedce612-68bc-40ef-a75f-d105668c35a0\" (UID: \"dedce612-68bc-40ef-a75f-d105668c35a0\") "
Jul 07 17:50:28.804048 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:28.804036    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dedce612-68bc-40ef-a75f-d105668c35a0-console-oauth-config\") pod \"dedce612-68bc-40ef-a75f-d105668c35a0\" (UID: \"dedce612-68bc-40ef-a75f-d105668c35a0\") "
Jul 07 17:50:28.804148 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:28.804073    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dedce612-68bc-40ef-a75f-d105668c35a0-oauth-serving-cert\") pod \"dedce612-68bc-40ef-a75f-d105668c35a0\" (UID: \"dedce612-68bc-40ef-a75f-d105668c35a0\") "
Jul 07 17:50:28.804148 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:28.804137    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dedce612-68bc-40ef-a75f-d105668c35a0-console-config\") pod \"dedce612-68bc-40ef-a75f-d105668c35a0\" (UID: \"dedce612-68bc-40ef-a75f-d105668c35a0\") "
Jul 07 17:50:28.804285 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:28.804247    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dedce612-68bc-40ef-a75f-d105668c35a0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "dedce612-68bc-40ef-a75f-d105668c35a0" (UID: "dedce612-68bc-40ef-a75f-d105668c35a0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:50:28.804643 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:28.804424    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dedce612-68bc-40ef-a75f-d105668c35a0-trusted-ca-bundle\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:50:28.804643 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:28.804496    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dedce612-68bc-40ef-a75f-d105668c35a0-service-ca" (OuterVolumeSpecName: "service-ca") pod "dedce612-68bc-40ef-a75f-d105668c35a0" (UID: "dedce612-68bc-40ef-a75f-d105668c35a0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:50:28.804643 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:28.804528    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dedce612-68bc-40ef-a75f-d105668c35a0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dedce612-68bc-40ef-a75f-d105668c35a0" (UID: "dedce612-68bc-40ef-a75f-d105668c35a0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:50:28.804805 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:28.804635    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dedce612-68bc-40ef-a75f-d105668c35a0-console-config" (OuterVolumeSpecName: "console-config") pod "dedce612-68bc-40ef-a75f-d105668c35a0" (UID: "dedce612-68bc-40ef-a75f-d105668c35a0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:50:28.806360 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:28.806339    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dedce612-68bc-40ef-a75f-d105668c35a0-kube-api-access-9nnbg" (OuterVolumeSpecName: "kube-api-access-9nnbg") pod "dedce612-68bc-40ef-a75f-d105668c35a0" (UID: "dedce612-68bc-40ef-a75f-d105668c35a0"). InnerVolumeSpecName "kube-api-access-9nnbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:50:28.806734 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:28.806708    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dedce612-68bc-40ef-a75f-d105668c35a0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dedce612-68bc-40ef-a75f-d105668c35a0" (UID: "dedce612-68bc-40ef-a75f-d105668c35a0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:50:28.806818 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:28.806728    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dedce612-68bc-40ef-a75f-d105668c35a0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dedce612-68bc-40ef-a75f-d105668c35a0" (UID: "dedce612-68bc-40ef-a75f-d105668c35a0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:50:28.905050 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:28.905014    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nnbg\" (UniqueName: \"kubernetes.io/projected/dedce612-68bc-40ef-a75f-d105668c35a0-kube-api-access-9nnbg\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:50:28.905050 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:28.905042    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dedce612-68bc-40ef-a75f-d105668c35a0-console-serving-cert\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:50:28.905050 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:28.905055    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dedce612-68bc-40ef-a75f-d105668c35a0-service-ca\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:50:28.905285 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:28.905064    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dedce612-68bc-40ef-a75f-d105668c35a0-console-oauth-config\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:50:28.905285 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:28.905073    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dedce612-68bc-40ef-a75f-d105668c35a0-oauth-serving-cert\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:50:28.905285 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:28.905083    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dedce612-68bc-40ef-a75f-d105668c35a0-console-config\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 17:50:29.069932 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:29.069904    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68b5cd5499-g8w2p"]
Jul 07 17:50:29.073431 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:29.073407    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68b5cd5499-g8w2p"]
Jul 07 17:50:31.007104 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:31.007069    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dedce612-68bc-40ef-a75f-d105668c35a0" path="/var/lib/kubelet/pods/dedce612-68bc-40ef-a75f-d105668c35a0/volumes"
Jul 07 17:50:38.087928 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:38.087895    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:50:38.182559 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:38.182523    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:50:38.296139 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:38.296107    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:50:44.477109 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:44.477073    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:50:44.532023 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:44.531994    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:50:44.625940 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:44.625901    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:50:44.725833 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:44.725802    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:50:44.854349 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:44.854256    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:50:50.647762 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:50.647727    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:50:50.706818 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:50.706784    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:50:55.122789 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:50:55.122757    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:51:40.899651 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:51:40.899621    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8s7h4_5f7bf700-4743-4276-b4b1-9245cd337343/ovn-acl-logging/0.log"
Jul 07 17:51:40.905564 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:51:40.905545    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8s7h4_5f7bf700-4743-4276-b4b1-9245cd337343/ovn-acl-logging/0.log"
Jul 07 17:52:07.183340 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:52:07.183306    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:52:13.987725 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:52:13.987688    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:53:55.883289 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:53:55.883249    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:53:55.969585 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:53:55.969551    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:56:17.104430 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:56:17.104340    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 17:56:40.929783 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:56:40.929755    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8s7h4_5f7bf700-4743-4276-b4b1-9245cd337343/ovn-acl-logging/0.log"
Jul 07 17:56:40.932991 ip-10-0-132-78 kubenswrapper[2559]: I0707 17:56:40.932941    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8s7h4_5f7bf700-4743-4276-b4b1-9245cd337343/ovn-acl-logging/0.log"
Jul 07 18:00:00.411584 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:00:00.411531    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:00:25.212325 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:00:25.212277    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:01:03.103395 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:01:03.103354    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:01:03.201477 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:01:03.201443    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:01:21.226877 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:01:21.226843    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:01:28.990546 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:01:28.990497    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:01:38.591739 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:01:38.591697    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:01:40.958138 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:01:40.958108    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8s7h4_5f7bf700-4743-4276-b4b1-9245cd337343/ovn-acl-logging/0.log"
Jul 07 18:01:40.958893 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:01:40.958869    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8s7h4_5f7bf700-4743-4276-b4b1-9245cd337343/ovn-acl-logging/0.log"
Jul 07 18:01:46.915745 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:01:46.915701    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:01:52.655314 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:01:52.655263    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:01:54.845011 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:01:54.844938    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:01:54.945666 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:01:54.945624    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:01:55.316143 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:01:55.316110    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:01.132389 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:01.132345    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:01.243440 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:01.243408    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:01.453635 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:01.453589    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:01.522216 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:01.522179    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:02.693862 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:02.693822    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:02.832992 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:02.832938    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:03.017903 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:03.017821    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:03.224740 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:03.224705    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:03.322926 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:03.322836    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:05.446053 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:05.446014    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:07.660909 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:07.660873    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:07.877580 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:07.877536    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:07.981386 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:07.981283    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:08.056184 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:08.056147    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:11.345162 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:11.345118    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:13.670739 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:13.670699    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:13.779014 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:13.778967    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:13.865586 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:13.865551    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:13.952561 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:13.952472    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:14.974672 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:14.974617    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:15.064459 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:15.064423    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:15.139532 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:15.139486    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:15.441131 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:15.441076    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:15.614336 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:15.614297    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:15.714173 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:15.714084    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:17.066081 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:17.066046    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:20.116723 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:20.116687    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:20.530061 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:20.529941    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:26.212317 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:26.212279    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:26.325819 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:26.325773    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:28.068240 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:28.068208    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:32.244636 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:32.244603    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:32.304748 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:32.304712    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:32.443264 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:32.443222    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:32.508235 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:32.508149    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:33.553146 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:33.553109    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:33.652140 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:33.652099    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:33.751224 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:33.751178    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:33.851706 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:33.851604    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:34.206566 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:34.206535    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:34.307122 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:34.307086    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:35.827387 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:35.827357    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:38.037402 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:38.037368    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:38.314893 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:38.314809    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:38.482286 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:38.482247    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:40.439185 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:40.439150    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:44.091055 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:44.091010    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:44.191409 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:44.191378    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:44.566016 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:44.565975    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:44.647914 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:44.647875    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:44.729345 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:44.729310    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:46.168174 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:46.168142    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:52.167441 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:52.167400    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:52.264755 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:52.264709    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:52.364718 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:52.364682    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:52.465262 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:52.465170    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:02:52.855629 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:02:52.855539    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:03:18.905482 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:03:18.905441    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:03:24.751065 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:03:24.751013    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:03:24.856061 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:03:24.856024    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:03:24.952273 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:03:24.952233    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:03:40.845249 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:03:40.845208    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:03:46.677770 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:03:46.677727    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:03:46.761034 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:03:46.761000    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:03:46.853248 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:03:46.853216    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:03:57.405915 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:03:57.405884    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:03:58.194422 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:03:58.194386    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:04.001845 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:04.001796    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:04.102756 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:04.102716    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:04.202781 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:04.202739    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:04.303614 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:04.303526    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:05.230151 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:05.230111    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:05.330381 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:05.330344    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:07.027338 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:07.027292    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:12.863822 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:12.863781    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:12.935291 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:12.935250    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:13.521889 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:13.521849    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:19.606457 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:19.606417    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:19.706265 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:19.706229    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:19.872260 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:19.872170    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:20.131615 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.131516    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"]
Jul 07 18:04:20.132042 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.132021    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dedce612-68bc-40ef-a75f-d105668c35a0" containerName="console"
Jul 07 18:04:20.132042 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.132042    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="dedce612-68bc-40ef-a75f-d105668c35a0" containerName="console"
Jul 07 18:04:20.132299 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.132158    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="dedce612-68bc-40ef-a75f-d105668c35a0" containerName="console"
Jul 07 18:04:20.135238 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.135218    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:20.137579 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.137561    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-d2c24dd6-openshift-default-dockercfg-hlp7m\""
Jul 07 18:04:20.152896 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.152862    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"]
Jul 07 18:04:20.161282 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.161250    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:20.212113 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.212080    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4ds9\" (UniqueName: \"kubernetes.io/projected/83beb029-db41-4060-ba43-b32e052f8c13-kube-api-access-j4ds9\") pod \"e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") " pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:20.212113 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.212119    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83beb029-db41-4060-ba43-b32e052f8c13-istiod-ca-cert\") pod \"e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") " pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:20.212369 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.212142    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83beb029-db41-4060-ba43-b32e052f8c13-workload-certs\") pod \"e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") " pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:20.212369 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.212167    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83beb029-db41-4060-ba43-b32e052f8c13-istio-token\") pod \"e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") " pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:20.212369 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.212250    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83beb029-db41-4060-ba43-b32e052f8c13-istio-envoy\") pod \"e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") " pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:20.212369 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.212282    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83beb029-db41-4060-ba43-b32e052f8c13-istio-podinfo\") pod \"e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") " pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:20.212369 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.212328    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83beb029-db41-4060-ba43-b32e052f8c13-credential-socket\") pod \"e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") " pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:20.212369 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.212345    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83beb029-db41-4060-ba43-b32e052f8c13-istio-data\") pod \"e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") " pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:20.212573 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.212372    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83beb029-db41-4060-ba43-b32e052f8c13-workload-socket\") pod \"e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") " pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:20.313073 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.313032    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83beb029-db41-4060-ba43-b32e052f8c13-istio-envoy\") pod \"e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") " pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:20.313073 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.313077    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83beb029-db41-4060-ba43-b32e052f8c13-istio-podinfo\") pod \"e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") " pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:20.313352 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.313134    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83beb029-db41-4060-ba43-b32e052f8c13-credential-socket\") pod \"e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") " pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:20.313352 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.313160    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83beb029-db41-4060-ba43-b32e052f8c13-istio-data\") pod \"e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") " pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:20.313352 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.313192    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83beb029-db41-4060-ba43-b32e052f8c13-workload-socket\") pod \"e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") " pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:20.313352 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.313231    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4ds9\" (UniqueName: \"kubernetes.io/projected/83beb029-db41-4060-ba43-b32e052f8c13-kube-api-access-j4ds9\") pod \"e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") " pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:20.313352 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.313257    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83beb029-db41-4060-ba43-b32e052f8c13-istiod-ca-cert\") pod \"e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") " pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:20.313352 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.313288    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83beb029-db41-4060-ba43-b32e052f8c13-workload-certs\") pod \"e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") " pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:20.313352 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.313329    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83beb029-db41-4060-ba43-b32e052f8c13-istio-token\") pod \"e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") " pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:20.313811 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.313587    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83beb029-db41-4060-ba43-b32e052f8c13-istio-data\") pod \"e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") " pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:20.313811 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.313597    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83beb029-db41-4060-ba43-b32e052f8c13-credential-socket\") pod \"e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") " pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:20.314138 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.314007    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83beb029-db41-4060-ba43-b32e052f8c13-workload-socket\") pod \"e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") " pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:20.314138 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.314060    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83beb029-db41-4060-ba43-b32e052f8c13-istiod-ca-cert\") pod \"e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") " pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:20.314138 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.314097    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83beb029-db41-4060-ba43-b32e052f8c13-workload-certs\") pod \"e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") " pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:20.315546 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.315522    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83beb029-db41-4060-ba43-b32e052f8c13-istio-envoy\") pod \"e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") " pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:20.315751 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.315734    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83beb029-db41-4060-ba43-b32e052f8c13-istio-podinfo\") pod \"e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") " pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:20.322941 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.322912    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83beb029-db41-4060-ba43-b32e052f8c13-istio-token\") pod \"e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") " pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:20.323254 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.323235    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4ds9\" (UniqueName: \"kubernetes.io/projected/83beb029-db41-4060-ba43-b32e052f8c13-kube-api-access-j4ds9\") pod \"e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") " pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:20.340167 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.340125    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:20.446371 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.446276    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:20.600268 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.600244    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"]
Jul 07 18:04:20.601985 ip-10-0-132-78 kubenswrapper[2559]: W0707 18:04:20.601927    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83beb029_db41_4060_ba43_b32e052f8c13.slice/crio-50a92b5d4a05eccd0d03c0ef0c98055d759c1ff4a9580c302ce13b7de539a15a WatchSource:0}: Error finding container 50a92b5d4a05eccd0d03c0ef0c98055d759c1ff4a9580c302ce13b7de539a15a: Status 404 returned error can't find the container with id 50a92b5d4a05eccd0d03c0ef0c98055d759c1ff4a9580c302ce13b7de539a15a
Jul 07 18:04:20.604317 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.604281    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 07 18:04:20.604409 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.604367    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 07 18:04:20.604451 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:20.604409    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 07 18:04:21.573675 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:21.573640    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267" event={"ID":"83beb029-db41-4060-ba43-b32e052f8c13","Type":"ContainerStarted","Data":"710d2676a2a09ba1a3ed26df5912cf9c3e05b8e2ad4efe644d06622862e85dcc"}
Jul 07 18:04:21.574066 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:21.573697    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267" event={"ID":"83beb029-db41-4060-ba43-b32e052f8c13","Type":"ContainerStarted","Data":"50a92b5d4a05eccd0d03c0ef0c98055d759c1ff4a9580c302ce13b7de539a15a"}
Jul 07 18:04:21.595130 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:21.595083    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267" podStartSLOduration=1.595067859 podStartE2EDuration="1.595067859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:04:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:04:21.592527628 +0000 UTC m=+1661.107757965" watchObservedRunningTime="2026-07-07 18:04:21.595067859 +0000 UTC m=+1661.110298194"
Jul 07 18:04:22.447440 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:22.447401    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:22.452412 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:22.452387    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:22.578451 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:22.578426    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:22.579362 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:22.579342    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:23.583782 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:23.583744    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:23.674630 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:23.674582    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:23.747346 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:23.747306    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:24.135212 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:24.135176    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:24.239556 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:24.239514    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:24.384977 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:24.384923    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:28.018389 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:28.018344    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:28.672761 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:28.672724    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:28.774925 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:28.774879    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:29.120524 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:29.120487    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:35.236697 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:35.236658    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:35.344763 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:35.344725    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:35.679575 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:35.679530    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:35.965598 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:35.965509    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:36.060084 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:36.060045    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:36.657354 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:36.657322    2559 generic.go:356] "Generic (PLEG): container finished" podID="83beb029-db41-4060-ba43-b32e052f8c13" containerID="710d2676a2a09ba1a3ed26df5912cf9c3e05b8e2ad4efe644d06622862e85dcc" exitCode=0
Jul 07 18:04:36.657898 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:36.657401    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267" event={"ID":"83beb029-db41-4060-ba43-b32e052f8c13","Type":"ContainerDied","Data":"710d2676a2a09ba1a3ed26df5912cf9c3e05b8e2ad4efe644d06622862e85dcc"}
Jul 07 18:04:36.658001 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:36.657911    2559 scope.go:117] "RemoveContainer" containerID="710d2676a2a09ba1a3ed26df5912cf9c3e05b8e2ad4efe644d06622862e85dcc"
Jul 07 18:04:36.658901 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:36.658872    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 07 18:04:36.659035 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:36.658949    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 07 18:04:36.659035 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:36.659024    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 07 18:04:37.579120 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:37.579088    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:37.663655 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:37.663619    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267" event={"ID":"83beb029-db41-4060-ba43-b32e052f8c13","Type":"ContainerStarted","Data":"fd113d212e4c2413ce159e7e573cd334882534b1c4e4a090e21020fe089c4eb0"}
Jul 07 18:04:38.447150 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:38.447119    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:38.448304 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:38.448275    2559 patch_prober.go:28] interesting pod/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 07 18:04:38.448431 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:38.448327    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267" podUID="83beb029-db41-4060-ba43-b32e052f8c13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 07 18:04:39.447113 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:39.447080    2559 patch_prober.go:28] interesting pod/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 07 18:04:39.447501 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:39.447137    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267" podUID="83beb029-db41-4060-ba43-b32e052f8c13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 07 18:04:40.446914 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:40.446875    2559 patch_prober.go:28] interesting pod/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 07 18:04:40.447101 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:40.446930    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267" podUID="83beb029-db41-4060-ba43-b32e052f8c13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 07 18:04:41.447710 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:41.447672    2559 patch_prober.go:28] interesting pod/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 07 18:04:41.448138 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:41.447730    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267" podUID="83beb029-db41-4060-ba43-b32e052f8c13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 07 18:04:42.010449 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:42.010419    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:42.110810 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:42.110773    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:42.246706 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:42.246672    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"]
Jul 07 18:04:42.246899 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:42.246868    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267" podUID="83beb029-db41-4060-ba43-b32e052f8c13" containerName="istio-proxy" containerID="cri-o://fd113d212e4c2413ce159e7e573cd334882534b1c4e4a090e21020fe089c4eb0" gracePeriod=30
Jul 07 18:04:42.278938 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:42.278863    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:42.505176 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:42.505136    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:42.614651 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:42.614623    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:42.711342 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:42.711309    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:42.819795 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:42.819763    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:47.501807 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.501786    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:47.569519 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.569442    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4ds9\" (UniqueName: \"kubernetes.io/projected/83beb029-db41-4060-ba43-b32e052f8c13-kube-api-access-j4ds9\") pod \"83beb029-db41-4060-ba43-b32e052f8c13\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") "
Jul 07 18:04:47.569519 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.569479    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83beb029-db41-4060-ba43-b32e052f8c13-istio-token\") pod \"83beb029-db41-4060-ba43-b32e052f8c13\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") "
Jul 07 18:04:47.569519 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.569503    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83beb029-db41-4060-ba43-b32e052f8c13-credential-socket\") pod \"83beb029-db41-4060-ba43-b32e052f8c13\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") "
Jul 07 18:04:47.569783 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.569615    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83beb029-db41-4060-ba43-b32e052f8c13-istio-data\") pod \"83beb029-db41-4060-ba43-b32e052f8c13\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") "
Jul 07 18:04:47.569783 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.569648    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83beb029-db41-4060-ba43-b32e052f8c13-workload-socket\") pod \"83beb029-db41-4060-ba43-b32e052f8c13\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") "
Jul 07 18:04:47.569783 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.569676    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83beb029-db41-4060-ba43-b32e052f8c13-istio-podinfo\") pod \"83beb029-db41-4060-ba43-b32e052f8c13\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") "
Jul 07 18:04:47.569783 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.569710    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83beb029-db41-4060-ba43-b32e052f8c13-istiod-ca-cert\") pod \"83beb029-db41-4060-ba43-b32e052f8c13\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") "
Jul 07 18:04:47.569783 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.569728    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83beb029-db41-4060-ba43-b32e052f8c13-istio-envoy\") pod \"83beb029-db41-4060-ba43-b32e052f8c13\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") "
Jul 07 18:04:47.570128 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.569783    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83beb029-db41-4060-ba43-b32e052f8c13-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "83beb029-db41-4060-ba43-b32e052f8c13" (UID: "83beb029-db41-4060-ba43-b32e052f8c13"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:04:47.570128 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.569792    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83beb029-db41-4060-ba43-b32e052f8c13-workload-certs\") pod \"83beb029-db41-4060-ba43-b32e052f8c13\" (UID: \"83beb029-db41-4060-ba43-b32e052f8c13\") "
Jul 07 18:04:47.570128 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.570002    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83beb029-db41-4060-ba43-b32e052f8c13-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "83beb029-db41-4060-ba43-b32e052f8c13" (UID: "83beb029-db41-4060-ba43-b32e052f8c13"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:04:47.570128 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.570019    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83beb029-db41-4060-ba43-b32e052f8c13-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "83beb029-db41-4060-ba43-b32e052f8c13" (UID: "83beb029-db41-4060-ba43-b32e052f8c13"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:04:47.570508 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.570226    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83beb029-db41-4060-ba43-b32e052f8c13-workload-certs\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:04:47.570508 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.570245    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83beb029-db41-4060-ba43-b32e052f8c13-credential-socket\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:04:47.570508 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.570259    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83beb029-db41-4060-ba43-b32e052f8c13-workload-socket\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:04:47.570508 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.570315    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83beb029-db41-4060-ba43-b32e052f8c13-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "83beb029-db41-4060-ba43-b32e052f8c13" (UID: "83beb029-db41-4060-ba43-b32e052f8c13"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:04:47.570804 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.570770    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83beb029-db41-4060-ba43-b32e052f8c13-istio-data" (OuterVolumeSpecName: "istio-data") pod "83beb029-db41-4060-ba43-b32e052f8c13" (UID: "83beb029-db41-4060-ba43-b32e052f8c13"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:04:47.572071 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.572043    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83beb029-db41-4060-ba43-b32e052f8c13-kube-api-access-j4ds9" (OuterVolumeSpecName: "kube-api-access-j4ds9") pod "83beb029-db41-4060-ba43-b32e052f8c13" (UID: "83beb029-db41-4060-ba43-b32e052f8c13"). InnerVolumeSpecName "kube-api-access-j4ds9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:04:47.572071 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.572048    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/83beb029-db41-4060-ba43-b32e052f8c13-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "83beb029-db41-4060-ba43-b32e052f8c13" (UID: "83beb029-db41-4060-ba43-b32e052f8c13"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 18:04:47.572231 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.572070    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83beb029-db41-4060-ba43-b32e052f8c13-istio-token" (OuterVolumeSpecName: "istio-token") pod "83beb029-db41-4060-ba43-b32e052f8c13" (UID: "83beb029-db41-4060-ba43-b32e052f8c13"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:04:47.572231 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.572196    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83beb029-db41-4060-ba43-b32e052f8c13-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "83beb029-db41-4060-ba43-b32e052f8c13" (UID: "83beb029-db41-4060-ba43-b32e052f8c13"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:04:47.670915 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.670886    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83beb029-db41-4060-ba43-b32e052f8c13-istio-data\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:04:47.670915 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.670911    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83beb029-db41-4060-ba43-b32e052f8c13-istio-podinfo\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:04:47.671109 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.670925    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83beb029-db41-4060-ba43-b32e052f8c13-istiod-ca-cert\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:04:47.671109 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.670938    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83beb029-db41-4060-ba43-b32e052f8c13-istio-envoy\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:04:47.671109 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.670949    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4ds9\" (UniqueName: \"kubernetes.io/projected/83beb029-db41-4060-ba43-b32e052f8c13-kube-api-access-j4ds9\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:04:47.671109 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.670987    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83beb029-db41-4060-ba43-b32e052f8c13-istio-token\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:04:47.711670 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.711640    2559 generic.go:356] "Generic (PLEG): container finished" podID="83beb029-db41-4060-ba43-b32e052f8c13" containerID="fd113d212e4c2413ce159e7e573cd334882534b1c4e4a090e21020fe089c4eb0" exitCode=0
Jul 07 18:04:47.711862 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.711687    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267" event={"ID":"83beb029-db41-4060-ba43-b32e052f8c13","Type":"ContainerDied","Data":"fd113d212e4c2413ce159e7e573cd334882534b1c4e4a090e21020fe089c4eb0"}
Jul 07 18:04:47.711862 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.711698    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"
Jul 07 18:04:47.711862 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.711740    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267" event={"ID":"83beb029-db41-4060-ba43-b32e052f8c13","Type":"ContainerDied","Data":"50a92b5d4a05eccd0d03c0ef0c98055d759c1ff4a9580c302ce13b7de539a15a"}
Jul 07 18:04:47.711862 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.711772    2559 scope.go:117] "RemoveContainer" containerID="fd113d212e4c2413ce159e7e573cd334882534b1c4e4a090e21020fe089c4eb0"
Jul 07 18:04:47.722677 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.722662    2559 scope.go:117] "RemoveContainer" containerID="710d2676a2a09ba1a3ed26df5912cf9c3e05b8e2ad4efe644d06622862e85dcc"
Jul 07 18:04:47.732105 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.732071    2559 scope.go:117] "RemoveContainer" containerID="fd113d212e4c2413ce159e7e573cd334882534b1c4e4a090e21020fe089c4eb0"
Jul 07 18:04:47.732349 ip-10-0-132-78 kubenswrapper[2559]: E0707 18:04:47.732328    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd113d212e4c2413ce159e7e573cd334882534b1c4e4a090e21020fe089c4eb0\": container with ID starting with fd113d212e4c2413ce159e7e573cd334882534b1c4e4a090e21020fe089c4eb0 not found: ID does not exist" containerID="fd113d212e4c2413ce159e7e573cd334882534b1c4e4a090e21020fe089c4eb0"
Jul 07 18:04:47.732413 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.732355    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd113d212e4c2413ce159e7e573cd334882534b1c4e4a090e21020fe089c4eb0"} err="failed to get container status \"fd113d212e4c2413ce159e7e573cd334882534b1c4e4a090e21020fe089c4eb0\": rpc error: code = NotFound desc = could not find container \"fd113d212e4c2413ce159e7e573cd334882534b1c4e4a090e21020fe089c4eb0\": container with ID starting with fd113d212e4c2413ce159e7e573cd334882534b1c4e4a090e21020fe089c4eb0 not found: ID does not exist"
Jul 07 18:04:47.732413 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.732373    2559 scope.go:117] "RemoveContainer" containerID="710d2676a2a09ba1a3ed26df5912cf9c3e05b8e2ad4efe644d06622862e85dcc"
Jul 07 18:04:47.732601 ip-10-0-132-78 kubenswrapper[2559]: E0707 18:04:47.732584    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"710d2676a2a09ba1a3ed26df5912cf9c3e05b8e2ad4efe644d06622862e85dcc\": container with ID starting with 710d2676a2a09ba1a3ed26df5912cf9c3e05b8e2ad4efe644d06622862e85dcc not found: ID does not exist" containerID="710d2676a2a09ba1a3ed26df5912cf9c3e05b8e2ad4efe644d06622862e85dcc"
Jul 07 18:04:47.732662 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.732609    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"710d2676a2a09ba1a3ed26df5912cf9c3e05b8e2ad4efe644d06622862e85dcc"} err="failed to get container status \"710d2676a2a09ba1a3ed26df5912cf9c3e05b8e2ad4efe644d06622862e85dcc\": rpc error: code = NotFound desc = could not find container \"710d2676a2a09ba1a3ed26df5912cf9c3e05b8e2ad4efe644d06622862e85dcc\": container with ID starting with 710d2676a2a09ba1a3ed26df5912cf9c3e05b8e2ad4efe644d06622862e85dcc not found: ID does not exist"
Jul 07 18:04:47.733116 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.733096    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"]
Jul 07 18:04:47.737884 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:47.737865    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-d2c24dd6-openshift-default-6477686b67-sc267"]
Jul 07 18:04:48.638391 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:48.638355    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:48.753133 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:48.753103    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:48.876169 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:48.876131    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:49.007585 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:49.007505    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83beb029-db41-4060-ba43-b32e052f8c13" path="/var/lib/kubelet/pods/83beb029-db41-4060-ba43-b32e052f8c13/volumes"
Jul 07 18:04:49.015080 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:49.015048    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:54.971348 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:54.971317    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:04:55.041725 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:04:55.041689    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:05:01.803523 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:01.803437    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:05:02.085187 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.085100    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"]
Jul 07 18:05:02.085698 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.085677    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83beb029-db41-4060-ba43-b32e052f8c13" containerName="istio-proxy"
Jul 07 18:05:02.085784 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.085703    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="83beb029-db41-4060-ba43-b32e052f8c13" containerName="istio-proxy"
Jul 07 18:05:02.085784 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.085723    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83beb029-db41-4060-ba43-b32e052f8c13" containerName="istio-proxy"
Jul 07 18:05:02.085784 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.085731    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="83beb029-db41-4060-ba43-b32e052f8c13" containerName="istio-proxy"
Jul 07 18:05:02.085897 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.085821    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="83beb029-db41-4060-ba43-b32e052f8c13" containerName="istio-proxy"
Jul 07 18:05:02.090700 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.090679    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:02.092970 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.092930    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-9fc7c3b2-openshift-default-dockercfg-q7jmq\""
Jul 07 18:05:02.100118 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.100095    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"]
Jul 07 18:05:02.119737 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.119702    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:05:02.198715 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.198680    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26d66f99-9b7e-4caa-8fec-766020056f25-credential-socket\") pod \"e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") " pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:02.198715 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.198716    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26d66f99-9b7e-4caa-8fec-766020056f25-istio-envoy\") pod \"e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") " pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:02.198985 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.198745    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xztbk\" (UniqueName: \"kubernetes.io/projected/26d66f99-9b7e-4caa-8fec-766020056f25-kube-api-access-xztbk\") pod \"e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") " pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:02.198985 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.198829    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26d66f99-9b7e-4caa-8fec-766020056f25-workload-socket\") pod \"e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") " pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:02.198985 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.198884    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26d66f99-9b7e-4caa-8fec-766020056f25-workload-certs\") pod \"e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") " pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:02.198985 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.198924    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26d66f99-9b7e-4caa-8fec-766020056f25-istio-token\") pod \"e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") " pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:02.198985 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.198972    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26d66f99-9b7e-4caa-8fec-766020056f25-istio-podinfo\") pod \"e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") " pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:02.199194 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.199016    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26d66f99-9b7e-4caa-8fec-766020056f25-istiod-ca-cert\") pod \"e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") " pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:02.199194 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.199078    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26d66f99-9b7e-4caa-8fec-766020056f25-istio-data\") pod \"e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") " pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:02.218379 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.218341    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:05:02.299799 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.299754    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26d66f99-9b7e-4caa-8fec-766020056f25-istio-token\") pod \"e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") " pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:02.299799 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.299803    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26d66f99-9b7e-4caa-8fec-766020056f25-istio-podinfo\") pod \"e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") " pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:02.300093 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.299824    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26d66f99-9b7e-4caa-8fec-766020056f25-istiod-ca-cert\") pod \"e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") " pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:02.300093 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.299851    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26d66f99-9b7e-4caa-8fec-766020056f25-istio-data\") pod \"e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") " pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:02.300093 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.300035    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26d66f99-9b7e-4caa-8fec-766020056f25-credential-socket\") pod \"e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") " pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:02.300093 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.300079    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26d66f99-9b7e-4caa-8fec-766020056f25-istio-envoy\") pod \"e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") " pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:02.300299 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.300113    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xztbk\" (UniqueName: \"kubernetes.io/projected/26d66f99-9b7e-4caa-8fec-766020056f25-kube-api-access-xztbk\") pod \"e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") " pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:02.300299 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.300191    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26d66f99-9b7e-4caa-8fec-766020056f25-workload-socket\") pod \"e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") " pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:02.300299 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.300254    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26d66f99-9b7e-4caa-8fec-766020056f25-istio-data\") pod \"e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") " pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:02.300299 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.300262    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26d66f99-9b7e-4caa-8fec-766020056f25-workload-certs\") pod \"e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") " pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:02.300504 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.300384    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26d66f99-9b7e-4caa-8fec-766020056f25-credential-socket\") pod \"e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") " pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:02.300610 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.300571    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26d66f99-9b7e-4caa-8fec-766020056f25-workload-socket\") pod \"e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") " pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:02.300716 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.300606    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26d66f99-9b7e-4caa-8fec-766020056f25-workload-certs\") pod \"e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") " pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:02.301178 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.301159    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26d66f99-9b7e-4caa-8fec-766020056f25-istiod-ca-cert\") pod \"e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") " pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:02.302563 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.302544    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26d66f99-9b7e-4caa-8fec-766020056f25-istio-podinfo\") pod \"e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") " pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:02.302657 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.302640    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26d66f99-9b7e-4caa-8fec-766020056f25-istio-envoy\") pod \"e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") " pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:02.307274 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.307247    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26d66f99-9b7e-4caa-8fec-766020056f25-istio-token\") pod \"e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") " pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:02.307939 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.307919    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xztbk\" (UniqueName: \"kubernetes.io/projected/26d66f99-9b7e-4caa-8fec-766020056f25-kube-api-access-xztbk\") pod \"e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") " pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:02.404439 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.404394    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:02.577885 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.577855    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"]
Jul 07 18:05:02.581505 ip-10-0-132-78 kubenswrapper[2559]: W0707 18:05:02.581478    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26d66f99_9b7e_4caa_8fec_766020056f25.slice/crio-bf98a1fc044847d4a0b7c6dec0466aa757aee26b62382717368dcb8be18bdad3 WatchSource:0}: Error finding container bf98a1fc044847d4a0b7c6dec0466aa757aee26b62382717368dcb8be18bdad3: Status 404 returned error can't find the container with id bf98a1fc044847d4a0b7c6dec0466aa757aee26b62382717368dcb8be18bdad3
Jul 07 18:05:02.583817 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.583778    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 07 18:05:02.583917 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.583863    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 07 18:05:02.583917 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.583901    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 07 18:05:02.786516 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.786414    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt" event={"ID":"26d66f99-9b7e-4caa-8fec-766020056f25","Type":"ContainerStarted","Data":"3440bc5d497cf65260ac3d4a196b9121290cee3fc16aadc44e00c00aca407595"}
Jul 07 18:05:02.786516 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.786477    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt" event={"ID":"26d66f99-9b7e-4caa-8fec-766020056f25","Type":"ContainerStarted","Data":"bf98a1fc044847d4a0b7c6dec0466aa757aee26b62382717368dcb8be18bdad3"}
Jul 07 18:05:02.809578 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:02.809528    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt" podStartSLOduration=0.809508825 podStartE2EDuration="809.508825ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:05:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:05:02.807722314 +0000 UTC m=+1702.322952649" watchObservedRunningTime="2026-07-07 18:05:02.809508825 +0000 UTC m=+1702.324739162"
Jul 07 18:05:03.404899 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:03.404863    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:03.409746 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:03.409722    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:03.791504 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:03.791412    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:03.792437 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:03.792414    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:04.756386 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:04.756344    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:05:06.517519 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:06.517481    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:05:09.290551 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:09.290509    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:05:16.559844 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:16.559811    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss"]
Jul 07 18:05:16.566158 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:16.561079    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="83beb029-db41-4060-ba43-b32e052f8c13" containerName="istio-proxy"
Jul 07 18:05:16.568193 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:16.568168    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss"
Jul 07 18:05:16.571169 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:16.570944    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-9fc7c3b2\"/\"kube-root-ca.crt\""
Jul 07 18:05:16.571169 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:16.571009    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-9fc7c3b2\"/\"openshift-service-ca.crt\""
Jul 07 18:05:16.571384 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:16.571273    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-9fc7c3b2\"/\"e2e-lifecycle-model-9fc7c3b2-kserve-self-signed-certs\""
Jul 07 18:05:16.571636 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:16.571613    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-9fc7c3b2\"/\"default-dockercfg-mmk7q\""
Jul 07 18:05:16.573258 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:16.573228    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss"]
Jul 07 18:05:16.666802 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:16.666769    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:05:16.734707 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:16.734669    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b391a1f-9b29-40f5-bcea-85c9e729b481-tls-certs\") pod \"e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss\" (UID: \"0b391a1f-9b29-40f5-bcea-85c9e729b481\") " pod="ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss"
Jul 07 18:05:16.734916 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:16.734718    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b391a1f-9b29-40f5-bcea-85c9e729b481-home\") pod \"e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss\" (UID: \"0b391a1f-9b29-40f5-bcea-85c9e729b481\") " pod="ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss"
Jul 07 18:05:16.734916 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:16.734784    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b391a1f-9b29-40f5-bcea-85c9e729b481-model-cache\") pod \"e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss\" (UID: \"0b391a1f-9b29-40f5-bcea-85c9e729b481\") " pod="ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss"
Jul 07 18:05:16.734916 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:16.734882    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtrv6\" (UniqueName: \"kubernetes.io/projected/0b391a1f-9b29-40f5-bcea-85c9e729b481-kube-api-access-rtrv6\") pod \"e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss\" (UID: \"0b391a1f-9b29-40f5-bcea-85c9e729b481\") " pod="ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss"
Jul 07 18:05:16.735117 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:16.734916    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b391a1f-9b29-40f5-bcea-85c9e729b481-dshm\") pod \"e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss\" (UID: \"0b391a1f-9b29-40f5-bcea-85c9e729b481\") " pod="ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss"
Jul 07 18:05:16.735117 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:16.734986    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b391a1f-9b29-40f5-bcea-85c9e729b481-tmp-dir\") pod \"e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss\" (UID: \"0b391a1f-9b29-40f5-bcea-85c9e729b481\") " pod="ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss"
Jul 07 18:05:16.836109 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:16.836029    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtrv6\" (UniqueName: \"kubernetes.io/projected/0b391a1f-9b29-40f5-bcea-85c9e729b481-kube-api-access-rtrv6\") pod \"e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss\" (UID: \"0b391a1f-9b29-40f5-bcea-85c9e729b481\") " pod="ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss"
Jul 07 18:05:16.836109 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:16.836070    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b391a1f-9b29-40f5-bcea-85c9e729b481-dshm\") pod \"e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss\" (UID: \"0b391a1f-9b29-40f5-bcea-85c9e729b481\") " pod="ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss"
Jul 07 18:05:16.836109 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:16.836106    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b391a1f-9b29-40f5-bcea-85c9e729b481-tmp-dir\") pod \"e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss\" (UID: \"0b391a1f-9b29-40f5-bcea-85c9e729b481\") " pod="ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss"
Jul 07 18:05:16.836413 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:16.836142    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b391a1f-9b29-40f5-bcea-85c9e729b481-tls-certs\") pod \"e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss\" (UID: \"0b391a1f-9b29-40f5-bcea-85c9e729b481\") " pod="ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss"
Jul 07 18:05:16.836413 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:16.836185    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b391a1f-9b29-40f5-bcea-85c9e729b481-home\") pod \"e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss\" (UID: \"0b391a1f-9b29-40f5-bcea-85c9e729b481\") " pod="ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss"
Jul 07 18:05:16.836413 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:16.836237    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b391a1f-9b29-40f5-bcea-85c9e729b481-model-cache\") pod \"e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss\" (UID: \"0b391a1f-9b29-40f5-bcea-85c9e729b481\") " pod="ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss"
Jul 07 18:05:16.836612 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:16.836593    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b391a1f-9b29-40f5-bcea-85c9e729b481-tmp-dir\") pod \"e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss\" (UID: \"0b391a1f-9b29-40f5-bcea-85c9e729b481\") " pod="ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss"
Jul 07 18:05:16.836674 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:16.836653    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b391a1f-9b29-40f5-bcea-85c9e729b481-model-cache\") pod \"e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss\" (UID: \"0b391a1f-9b29-40f5-bcea-85c9e729b481\") " pod="ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss"
Jul 07 18:05:16.836740 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:16.836721    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b391a1f-9b29-40f5-bcea-85c9e729b481-home\") pod \"e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss\" (UID: \"0b391a1f-9b29-40f5-bcea-85c9e729b481\") " pod="ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss"
Jul 07 18:05:16.838630 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:16.838605    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b391a1f-9b29-40f5-bcea-85c9e729b481-dshm\") pod \"e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss\" (UID: \"0b391a1f-9b29-40f5-bcea-85c9e729b481\") " pod="ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss"
Jul 07 18:05:16.838855 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:16.838837    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b391a1f-9b29-40f5-bcea-85c9e729b481-tls-certs\") pod \"e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss\" (UID: \"0b391a1f-9b29-40f5-bcea-85c9e729b481\") " pod="ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss"
Jul 07 18:05:16.843783 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:16.843759    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtrv6\" (UniqueName: \"kubernetes.io/projected/0b391a1f-9b29-40f5-bcea-85c9e729b481-kube-api-access-rtrv6\") pod \"e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss\" (UID: \"0b391a1f-9b29-40f5-bcea-85c9e729b481\") " pod="ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss"
Jul 07 18:05:16.879383 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:16.879347    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss"
Jul 07 18:05:17.031020 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:17.030988    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss"]
Jul 07 18:05:17.033240 ip-10-0-132-78 kubenswrapper[2559]: W0707 18:05:17.033208    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b391a1f_9b29_40f5_bcea_85c9e729b481.slice/crio-a2174d84a918f7b818b20428fc2dbcdf8a58cb08fe2d3fef3ffc38ab164d61e6 WatchSource:0}: Error finding container a2174d84a918f7b818b20428fc2dbcdf8a58cb08fe2d3fef3ffc38ab164d61e6: Status 404 returned error can't find the container with id a2174d84a918f7b818b20428fc2dbcdf8a58cb08fe2d3fef3ffc38ab164d61e6
Jul 07 18:05:17.863751 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:17.863711    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss" event={"ID":"0b391a1f-9b29-40f5-bcea-85c9e729b481","Type":"ContainerStarted","Data":"f96f58187c0053496419d88362c3cc16dcca54eca2b8094f0ea54afa7eaf6c6e"}
Jul 07 18:05:17.864227 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:17.863770    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss" event={"ID":"0b391a1f-9b29-40f5-bcea-85c9e729b481","Type":"ContainerStarted","Data":"a2174d84a918f7b818b20428fc2dbcdf8a58cb08fe2d3fef3ffc38ab164d61e6"}
Jul 07 18:05:17.865312 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:17.865289    2559 generic.go:356] "Generic (PLEG): container finished" podID="26d66f99-9b7e-4caa-8fec-766020056f25" containerID="3440bc5d497cf65260ac3d4a196b9121290cee3fc16aadc44e00c00aca407595" exitCode=0
Jul 07 18:05:17.865413 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:17.865364    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt" event={"ID":"26d66f99-9b7e-4caa-8fec-766020056f25","Type":"ContainerDied","Data":"3440bc5d497cf65260ac3d4a196b9121290cee3fc16aadc44e00c00aca407595"}
Jul 07 18:05:17.865700 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:17.865687    2559 scope.go:117] "RemoveContainer" containerID="3440bc5d497cf65260ac3d4a196b9121290cee3fc16aadc44e00c00aca407595"
Jul 07 18:05:17.866615 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:17.866587    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 07 18:05:17.866698 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:17.866660    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 07 18:05:17.866698 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:17.866695    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 07 18:05:17.880978 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:17.880907    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss" podStartSLOduration=1.8808941959999999 podStartE2EDuration="1.880894196s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:05:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:05:17.879101633 +0000 UTC m=+1717.394331970" watchObservedRunningTime="2026-07-07 18:05:17.880894196 +0000 UTC m=+1717.396124558"
Jul 07 18:05:18.791677 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:18.791643    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:18.871942 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:18.871906    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt" event={"ID":"26d66f99-9b7e-4caa-8fec-766020056f25","Type":"ContainerStarted","Data":"dc36a4f512fefac5f900a794eb879f45cf560dc1b54a117fbebceb8fb1e63b05"}
Jul 07 18:05:18.920717 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:18.920637    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:05:19.023645 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:19.023604    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:05:19.406705 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:19.406382    2559 patch_prober.go:28] interesting pod/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 07 18:05:19.406705 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:19.406443    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt" podUID="26d66f99-9b7e-4caa-8fec-766020056f25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 07 18:05:19.407077 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:19.407060    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:20.405851 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:20.405417    2559 patch_prober.go:28] interesting pod/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 07 18:05:20.405851 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:20.405476    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt" podUID="26d66f99-9b7e-4caa-8fec-766020056f25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 07 18:05:21.405695 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:21.405656    2559 patch_prober.go:28] interesting pod/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 07 18:05:21.405999 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:21.405945    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt" podUID="26d66f99-9b7e-4caa-8fec-766020056f25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 07 18:05:22.405040 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:22.404991    2559 patch_prober.go:28] interesting pod/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 07 18:05:22.405249 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:22.405063    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt" podUID="26d66f99-9b7e-4caa-8fec-766020056f25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 07 18:05:23.409376 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:23.409348    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:23.409824 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:23.409632    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:23.410433 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:23.410418    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:05:26.879978 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:26.879925    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss"
Jul 07 18:05:26.880471 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:26.880005    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss"
Jul 07 18:05:26.893152 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:26.893126    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss"
Jul 07 18:05:26.916286 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:26.916247    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:05:26.924994 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:26.924964    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss"
Jul 07 18:05:27.012564 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:27.012530    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:05:41.759945 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:41.759911    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:05:42.056101 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:42.056010    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:05:47.884029 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:47.883989    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:05:52.865637 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:52.865602    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss"]
Jul 07 18:05:52.910562 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:05:52.910524    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:07.886464 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:07.886423    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss" podUID="0b391a1f-9b29-40f5-bcea-85c9e729b481" containerName="main" containerID="cri-o://f96f58187c0053496419d88362c3cc16dcca54eca2b8094f0ea54afa7eaf6c6e" gracePeriod=45
Jul 07 18:06:08.111385 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:08.111355    2559 generic.go:356] "Generic (PLEG): container finished" podID="0b391a1f-9b29-40f5-bcea-85c9e729b481" containerID="f96f58187c0053496419d88362c3cc16dcca54eca2b8094f0ea54afa7eaf6c6e" exitCode=0
Jul 07 18:06:08.111549 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:08.111390    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss" event={"ID":"0b391a1f-9b29-40f5-bcea-85c9e729b481","Type":"ContainerDied","Data":"f96f58187c0053496419d88362c3cc16dcca54eca2b8094f0ea54afa7eaf6c6e"}
Jul 07 18:06:08.139329 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:08.139269    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss"
Jul 07 18:06:08.203192 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:08.203157    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b391a1f-9b29-40f5-bcea-85c9e729b481-tmp-dir\") pod \"0b391a1f-9b29-40f5-bcea-85c9e729b481\" (UID: \"0b391a1f-9b29-40f5-bcea-85c9e729b481\") "
Jul 07 18:06:08.203374 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:08.203220    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b391a1f-9b29-40f5-bcea-85c9e729b481-model-cache\") pod \"0b391a1f-9b29-40f5-bcea-85c9e729b481\" (UID: \"0b391a1f-9b29-40f5-bcea-85c9e729b481\") "
Jul 07 18:06:08.203374 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:08.203275    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b391a1f-9b29-40f5-bcea-85c9e729b481-home\") pod \"0b391a1f-9b29-40f5-bcea-85c9e729b481\" (UID: \"0b391a1f-9b29-40f5-bcea-85c9e729b481\") "
Jul 07 18:06:08.203374 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:08.203321    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b391a1f-9b29-40f5-bcea-85c9e729b481-tls-certs\") pod \"0b391a1f-9b29-40f5-bcea-85c9e729b481\" (UID: \"0b391a1f-9b29-40f5-bcea-85c9e729b481\") "
Jul 07 18:06:08.203374 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:08.203350    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtrv6\" (UniqueName: \"kubernetes.io/projected/0b391a1f-9b29-40f5-bcea-85c9e729b481-kube-api-access-rtrv6\") pod \"0b391a1f-9b29-40f5-bcea-85c9e729b481\" (UID: \"0b391a1f-9b29-40f5-bcea-85c9e729b481\") "
Jul 07 18:06:08.203600 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:08.203393    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b391a1f-9b29-40f5-bcea-85c9e729b481-dshm\") pod \"0b391a1f-9b29-40f5-bcea-85c9e729b481\" (UID: \"0b391a1f-9b29-40f5-bcea-85c9e729b481\") "
Jul 07 18:06:08.203600 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:08.203463    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b391a1f-9b29-40f5-bcea-85c9e729b481-model-cache" (OuterVolumeSpecName: "model-cache") pod "0b391a1f-9b29-40f5-bcea-85c9e729b481" (UID: "0b391a1f-9b29-40f5-bcea-85c9e729b481"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:06:08.203600 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:08.203474    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b391a1f-9b29-40f5-bcea-85c9e729b481-home" (OuterVolumeSpecName: "home") pod "0b391a1f-9b29-40f5-bcea-85c9e729b481" (UID: "0b391a1f-9b29-40f5-bcea-85c9e729b481"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:06:08.203600 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:08.203488    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b391a1f-9b29-40f5-bcea-85c9e729b481-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0b391a1f-9b29-40f5-bcea-85c9e729b481" (UID: "0b391a1f-9b29-40f5-bcea-85c9e729b481"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:06:08.203800 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:08.203717    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b391a1f-9b29-40f5-bcea-85c9e729b481-model-cache\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:06:08.203800 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:08.203737    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b391a1f-9b29-40f5-bcea-85c9e729b481-home\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:06:08.203800 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:08.203752    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b391a1f-9b29-40f5-bcea-85c9e729b481-tmp-dir\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:06:08.205686 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:08.205653    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b391a1f-9b29-40f5-bcea-85c9e729b481-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0b391a1f-9b29-40f5-bcea-85c9e729b481" (UID: "0b391a1f-9b29-40f5-bcea-85c9e729b481"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:06:08.206211 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:08.206180    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b391a1f-9b29-40f5-bcea-85c9e729b481-dshm" (OuterVolumeSpecName: "dshm") pod "0b391a1f-9b29-40f5-bcea-85c9e729b481" (UID: "0b391a1f-9b29-40f5-bcea-85c9e729b481"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:06:08.206211 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:08.206184    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b391a1f-9b29-40f5-bcea-85c9e729b481-kube-api-access-rtrv6" (OuterVolumeSpecName: "kube-api-access-rtrv6") pod "0b391a1f-9b29-40f5-bcea-85c9e729b481" (UID: "0b391a1f-9b29-40f5-bcea-85c9e729b481"). InnerVolumeSpecName "kube-api-access-rtrv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:06:08.311193 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:08.311157    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b391a1f-9b29-40f5-bcea-85c9e729b481-tls-certs\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:06:08.311193 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:08.311186    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtrv6\" (UniqueName: \"kubernetes.io/projected/0b391a1f-9b29-40f5-bcea-85c9e729b481-kube-api-access-rtrv6\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:06:08.311193 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:08.311197    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b391a1f-9b29-40f5-bcea-85c9e729b481-dshm\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:06:09.116974 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:09.116935    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss"
Jul 07 18:06:09.117475 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:09.116926    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss" event={"ID":"0b391a1f-9b29-40f5-bcea-85c9e729b481","Type":"ContainerDied","Data":"a2174d84a918f7b818b20428fc2dbcdf8a58cb08fe2d3fef3ffc38ab164d61e6"}
Jul 07 18:06:09.117475 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:09.117093    2559 scope.go:117] "RemoveContainer" containerID="f96f58187c0053496419d88362c3cc16dcca54eca2b8094f0ea54afa7eaf6c6e"
Jul 07 18:06:09.132595 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:09.132562    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss"]
Jul 07 18:06:09.136086 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:09.136056    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-9fc7c3b2/e2e-lifecycle-model-9fc7c3b2-kserve-9bf5d4b9f-b4kss"]
Jul 07 18:06:11.008535 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:11.008503    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b391a1f-9b29-40f5-bcea-85c9e729b481" path="/var/lib/kubelet/pods/0b391a1f-9b29-40f5-bcea-85c9e729b481/volumes"
Jul 07 18:06:29.875448 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:29.875403    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:30.256122 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:30.256023    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:35.825130 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:35.825008    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:35.924213 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:35.924169    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:36.077965 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:36.077864    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"]
Jul 07 18:06:36.078148 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:36.078124    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt" podUID="26d66f99-9b7e-4caa-8fec-766020056f25" containerName="istio-proxy" containerID="cri-o://dc36a4f512fefac5f900a794eb879f45cf560dc1b54a117fbebceb8fb1e63b05" gracePeriod=30
Jul 07 18:06:36.099457 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:36.099427    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:36.340435 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:36.340341    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:37.446500 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:37.446463    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:37.544187 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:37.544145    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:37.644357 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:37.644312    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:38.372683 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:38.372646    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:38.412671 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:38.412633    2559 patch_prober.go:28] interesting pod/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 18:06:38.412823 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:38.412722    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt" podUID="26d66f99-9b7e-4caa-8fec-766020056f25" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 18:06:38.472434 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:38.472386    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:38.572436 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:38.572331    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:40.052403 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:40.052367    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:40.986409 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:40.986381    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8s7h4_5f7bf700-4743-4276-b4b1-9245cd337343/ovn-acl-logging/0.log"
Jul 07 18:06:40.986635 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:40.986614    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8s7h4_5f7bf700-4743-4276-b4b1-9245cd337343/ovn-acl-logging/0.log"
Jul 07 18:06:41.272082 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:41.272048    2559 generic.go:356] "Generic (PLEG): container finished" podID="26d66f99-9b7e-4caa-8fec-766020056f25" containerID="dc36a4f512fefac5f900a794eb879f45cf560dc1b54a117fbebceb8fb1e63b05" exitCode=0
Jul 07 18:06:41.272460 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:41.272125    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt" event={"ID":"26d66f99-9b7e-4caa-8fec-766020056f25","Type":"ContainerDied","Data":"dc36a4f512fefac5f900a794eb879f45cf560dc1b54a117fbebceb8fb1e63b05"}
Jul 07 18:06:41.272460 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:41.272185    2559 scope.go:117] "RemoveContainer" containerID="3440bc5d497cf65260ac3d4a196b9121290cee3fc16aadc44e00c00aca407595"
Jul 07 18:06:41.344554 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:41.344517    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:06:41.508028 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:41.507924    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26d66f99-9b7e-4caa-8fec-766020056f25-credential-socket\") pod \"26d66f99-9b7e-4caa-8fec-766020056f25\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") "
Jul 07 18:06:41.508230 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:41.508048    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xztbk\" (UniqueName: \"kubernetes.io/projected/26d66f99-9b7e-4caa-8fec-766020056f25-kube-api-access-xztbk\") pod \"26d66f99-9b7e-4caa-8fec-766020056f25\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") "
Jul 07 18:06:41.508230 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:41.508074    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26d66f99-9b7e-4caa-8fec-766020056f25-istio-token\") pod \"26d66f99-9b7e-4caa-8fec-766020056f25\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") "
Jul 07 18:06:41.508230 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:41.508109    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26d66f99-9b7e-4caa-8fec-766020056f25-istio-envoy\") pod \"26d66f99-9b7e-4caa-8fec-766020056f25\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") "
Jul 07 18:06:41.508230 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:41.508205    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26d66f99-9b7e-4caa-8fec-766020056f25-workload-certs\") pod \"26d66f99-9b7e-4caa-8fec-766020056f25\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") "
Jul 07 18:06:41.508455 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:41.508251    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26d66f99-9b7e-4caa-8fec-766020056f25-istiod-ca-cert\") pod \"26d66f99-9b7e-4caa-8fec-766020056f25\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") "
Jul 07 18:06:41.508455 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:41.508277    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26d66f99-9b7e-4caa-8fec-766020056f25-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "26d66f99-9b7e-4caa-8fec-766020056f25" (UID: "26d66f99-9b7e-4caa-8fec-766020056f25"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:06:41.508455 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:41.508288    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26d66f99-9b7e-4caa-8fec-766020056f25-istio-data\") pod \"26d66f99-9b7e-4caa-8fec-766020056f25\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") "
Jul 07 18:06:41.508455 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:41.508361    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26d66f99-9b7e-4caa-8fec-766020056f25-istio-podinfo\") pod \"26d66f99-9b7e-4caa-8fec-766020056f25\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") "
Jul 07 18:06:41.508455 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:41.508402    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26d66f99-9b7e-4caa-8fec-766020056f25-workload-socket\") pod \"26d66f99-9b7e-4caa-8fec-766020056f25\" (UID: \"26d66f99-9b7e-4caa-8fec-766020056f25\") "
Jul 07 18:06:41.508708 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:41.508573    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26d66f99-9b7e-4caa-8fec-766020056f25-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "26d66f99-9b7e-4caa-8fec-766020056f25" (UID: "26d66f99-9b7e-4caa-8fec-766020056f25"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:06:41.508762 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:41.508745    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26d66f99-9b7e-4caa-8fec-766020056f25-credential-socket\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:06:41.508816 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:41.508765    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26d66f99-9b7e-4caa-8fec-766020056f25-workload-certs\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:06:41.508816 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:41.508744    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26d66f99-9b7e-4caa-8fec-766020056f25-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "26d66f99-9b7e-4caa-8fec-766020056f25" (UID: "26d66f99-9b7e-4caa-8fec-766020056f25"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:06:41.509197 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:41.509174    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26d66f99-9b7e-4caa-8fec-766020056f25-istio-data" (OuterVolumeSpecName: "istio-data") pod "26d66f99-9b7e-4caa-8fec-766020056f25" (UID: "26d66f99-9b7e-4caa-8fec-766020056f25"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:06:41.509285 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:41.509249    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26d66f99-9b7e-4caa-8fec-766020056f25-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "26d66f99-9b7e-4caa-8fec-766020056f25" (UID: "26d66f99-9b7e-4caa-8fec-766020056f25"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:06:41.510624 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:41.510598    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26d66f99-9b7e-4caa-8fec-766020056f25-istio-token" (OuterVolumeSpecName: "istio-token") pod "26d66f99-9b7e-4caa-8fec-766020056f25" (UID: "26d66f99-9b7e-4caa-8fec-766020056f25"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:06:41.511095 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:41.511072    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26d66f99-9b7e-4caa-8fec-766020056f25-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "26d66f99-9b7e-4caa-8fec-766020056f25" (UID: "26d66f99-9b7e-4caa-8fec-766020056f25"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:06:41.511192 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:41.511078    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26d66f99-9b7e-4caa-8fec-766020056f25-kube-api-access-xztbk" (OuterVolumeSpecName: "kube-api-access-xztbk") pod "26d66f99-9b7e-4caa-8fec-766020056f25" (UID: "26d66f99-9b7e-4caa-8fec-766020056f25"). InnerVolumeSpecName "kube-api-access-xztbk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:06:41.511395 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:41.511373    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/26d66f99-9b7e-4caa-8fec-766020056f25-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "26d66f99-9b7e-4caa-8fec-766020056f25" (UID: "26d66f99-9b7e-4caa-8fec-766020056f25"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 18:06:41.609770 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:41.609726    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xztbk\" (UniqueName: \"kubernetes.io/projected/26d66f99-9b7e-4caa-8fec-766020056f25-kube-api-access-xztbk\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:06:41.609770 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:41.609759    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26d66f99-9b7e-4caa-8fec-766020056f25-istio-token\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:06:41.609770 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:41.609768    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26d66f99-9b7e-4caa-8fec-766020056f25-istio-envoy\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:06:41.609770 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:41.609775    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26d66f99-9b7e-4caa-8fec-766020056f25-istiod-ca-cert\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:06:41.609770 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:41.609783    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26d66f99-9b7e-4caa-8fec-766020056f25-istio-data\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:06:41.610123 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:41.609790    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26d66f99-9b7e-4caa-8fec-766020056f25-istio-podinfo\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:06:41.610123 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:41.609801    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26d66f99-9b7e-4caa-8fec-766020056f25-workload-socket\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:06:42.279759 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:42.279728    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"
Jul 07 18:06:42.279759 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:42.279753    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt" event={"ID":"26d66f99-9b7e-4caa-8fec-766020056f25","Type":"ContainerDied","Data":"bf98a1fc044847d4a0b7c6dec0466aa757aee26b62382717368dcb8be18bdad3"}
Jul 07 18:06:42.280360 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:42.279805    2559 scope.go:117] "RemoveContainer" containerID="dc36a4f512fefac5f900a794eb879f45cf560dc1b54a117fbebceb8fb1e63b05"
Jul 07 18:06:42.311806 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:42.311768    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"]
Jul 07 18:06:42.315634 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:42.315607    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-9fc7c3b2-openshift-default-6cb66d94bc-zhfzt"]
Jul 07 18:06:43.008192 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:43.008160    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26d66f99-9b7e-4caa-8fec-766020056f25" path="/var/lib/kubelet/pods/26d66f99-9b7e-4caa-8fec-766020056f25/volumes"
Jul 07 18:06:45.766221 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:45.766181    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:45.830389 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:45.830353    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:46.454773 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:46.454714    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:52.276863 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:52.276817    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:52.399321 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:52.399278    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:52.498889 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:06:52.498848    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:03.245677 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:03.245632    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:03.362642 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:03.362576    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:24.329005 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:24.328944    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:30.236497 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:30.236449    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:30.336842 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:30.336810    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:30.607059 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:30.607027    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:30.891560 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:30.891476    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"]
Jul 07 18:07:30.892083 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:30.892066    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26d66f99-9b7e-4caa-8fec-766020056f25" containerName="istio-proxy"
Jul 07 18:07:30.892131 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:30.892087    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="26d66f99-9b7e-4caa-8fec-766020056f25" containerName="istio-proxy"
Jul 07 18:07:30.892131 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:30.892104    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26d66f99-9b7e-4caa-8fec-766020056f25" containerName="istio-proxy"
Jul 07 18:07:30.892131 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:30.892112    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="26d66f99-9b7e-4caa-8fec-766020056f25" containerName="istio-proxy"
Jul 07 18:07:30.892224 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:30.892130    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b391a1f-9b29-40f5-bcea-85c9e729b481" containerName="main"
Jul 07 18:07:30.892224 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:30.892140    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b391a1f-9b29-40f5-bcea-85c9e729b481" containerName="main"
Jul 07 18:07:30.892286 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:30.892233    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="26d66f99-9b7e-4caa-8fec-766020056f25" containerName="istio-proxy"
Jul 07 18:07:30.892286 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:30.892244    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="26d66f99-9b7e-4caa-8fec-766020056f25" containerName="istio-proxy"
Jul 07 18:07:30.892286 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:30.892257    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b391a1f-9b29-40f5-bcea-85c9e729b481" containerName="main"
Jul 07 18:07:30.895587 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:30.895571    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:30.897869 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:30.897849    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-265893-openshift-default-dockercfg-j6gt8\""
Jul 07 18:07:30.904610 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:30.904588    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"]
Jul 07 18:07:30.926221 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:30.926190    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:31.029282 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.029245    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:31.052097 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.052057    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38445811-d4bd-4cc7-9d64-888d99a9298c-istio-envoy\") pod \"e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") " pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:31.052097 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.052097    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrrh4\" (UniqueName: \"kubernetes.io/projected/38445811-d4bd-4cc7-9d64-888d99a9298c-kube-api-access-qrrh4\") pod \"e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") " pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:31.052306 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.052142    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38445811-d4bd-4cc7-9d64-888d99a9298c-credential-socket\") pod \"e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") " pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:31.052306 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.052179    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38445811-d4bd-4cc7-9d64-888d99a9298c-workload-socket\") pod \"e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") " pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:31.052306 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.052198    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38445811-d4bd-4cc7-9d64-888d99a9298c-istio-data\") pod \"e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") " pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:31.052306 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.052276    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38445811-d4bd-4cc7-9d64-888d99a9298c-istio-token\") pod \"e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") " pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:31.052437 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.052311    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38445811-d4bd-4cc7-9d64-888d99a9298c-istio-podinfo\") pod \"e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") " pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:31.052437 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.052372    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38445811-d4bd-4cc7-9d64-888d99a9298c-istiod-ca-cert\") pod \"e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") " pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:31.052437 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.052401    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38445811-d4bd-4cc7-9d64-888d99a9298c-workload-certs\") pod \"e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") " pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:31.153644 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.153553    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38445811-d4bd-4cc7-9d64-888d99a9298c-workload-socket\") pod \"e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") " pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:31.153644 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.153594    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38445811-d4bd-4cc7-9d64-888d99a9298c-istio-data\") pod \"e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") " pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:31.153644 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.153619    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38445811-d4bd-4cc7-9d64-888d99a9298c-istio-token\") pod \"e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") " pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:31.153644 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.153646    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38445811-d4bd-4cc7-9d64-888d99a9298c-istio-podinfo\") pod \"e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") " pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:31.154006 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.153701    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38445811-d4bd-4cc7-9d64-888d99a9298c-istiod-ca-cert\") pod \"e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") " pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:31.154006 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.153731    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38445811-d4bd-4cc7-9d64-888d99a9298c-workload-certs\") pod \"e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") " pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:31.154121 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.154041    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38445811-d4bd-4cc7-9d64-888d99a9298c-istio-envoy\") pod \"e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") " pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:31.154121 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.154082    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrrh4\" (UniqueName: \"kubernetes.io/projected/38445811-d4bd-4cc7-9d64-888d99a9298c-kube-api-access-qrrh4\") pod \"e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") " pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:31.154227 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.154115    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38445811-d4bd-4cc7-9d64-888d99a9298c-istio-data\") pod \"e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") " pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:31.154227 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.154125    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38445811-d4bd-4cc7-9d64-888d99a9298c-credential-socket\") pod \"e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") " pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:31.154227 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.154081    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38445811-d4bd-4cc7-9d64-888d99a9298c-workload-socket\") pod \"e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") " pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:31.154227 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.154207    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38445811-d4bd-4cc7-9d64-888d99a9298c-workload-certs\") pod \"e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") " pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:31.154430 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.154394    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38445811-d4bd-4cc7-9d64-888d99a9298c-credential-socket\") pod \"e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") " pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:31.154485 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.154473    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38445811-d4bd-4cc7-9d64-888d99a9298c-istiod-ca-cert\") pod \"e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") " pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:31.156408 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.156386    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38445811-d4bd-4cc7-9d64-888d99a9298c-istio-podinfo\") pod \"e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") " pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:31.156508 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.156473    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38445811-d4bd-4cc7-9d64-888d99a9298c-istio-envoy\") pod \"e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") " pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:31.161052 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.161019    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38445811-d4bd-4cc7-9d64-888d99a9298c-istio-token\") pod \"e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") " pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:31.161236 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.161218    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrrh4\" (UniqueName: \"kubernetes.io/projected/38445811-d4bd-4cc7-9d64-888d99a9298c-kube-api-access-qrrh4\") pod \"e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") " pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:31.207251 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.207214    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:31.351780 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.351740    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"]
Jul 07 18:07:31.353702 ip-10-0-132-78 kubenswrapper[2559]: W0707 18:07:31.353673    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38445811_d4bd_4cc7_9d64_888d99a9298c.slice/crio-46ef8295b43de8e6f1d848906a4f2a5fe5989364a4add8f99f45aa7d99eaf2d2 WatchSource:0}: Error finding container 46ef8295b43de8e6f1d848906a4f2a5fe5989364a4add8f99f45aa7d99eaf2d2: Status 404 returned error can't find the container with id 46ef8295b43de8e6f1d848906a4f2a5fe5989364a4add8f99f45aa7d99eaf2d2
Jul 07 18:07:31.355812 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.355773    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 07 18:07:31.355926 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.355853    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 07 18:07:31.355926 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.355920    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 07 18:07:31.514933 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.514894    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc" event={"ID":"38445811-d4bd-4cc7-9d64-888d99a9298c","Type":"ContainerStarted","Data":"8ea9310ed67997c51efabf7a50388c817df29fa27d2528a088936fa92fa94904"}
Jul 07 18:07:31.515115 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.515009    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc" event={"ID":"38445811-d4bd-4cc7-9d64-888d99a9298c","Type":"ContainerStarted","Data":"46ef8295b43de8e6f1d848906a4f2a5fe5989364a4add8f99f45aa7d99eaf2d2"}
Jul 07 18:07:31.548870 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:31.548817    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc" podStartSLOduration=1.54880028 podStartE2EDuration="1.54880028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:07:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:07:31.546575334 +0000 UTC m=+1851.061805671" watchObservedRunningTime="2026-07-07 18:07:31.54880028 +0000 UTC m=+1851.064030617"
Jul 07 18:07:32.208035 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:32.208000    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:32.213607 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:32.213572    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:32.519704 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:32.519605    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:32.520558 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:32.520540    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:33.538808 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:33.538765    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:33.622754 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:33.622696    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:33.706800 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:33.706766    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:33.807540 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:33.807425    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:34.206320 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:34.206287    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:34.326752 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:34.326703    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:38.039470 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:38.039428    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:38.385058 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:38.385015    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:38.721600 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:38.721504    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:38.812547 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:38.812514    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:42.024685 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:42.024648    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:42.112200 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:42.112166    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:42.169997 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:42.169949    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:42.444700 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:42.444664    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:42.591309 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:42.591274    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:42.691437 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:42.691397    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:46.521352 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:46.521317    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:47.687236 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:47.686140    2559 patch_prober.go:28] interesting pod/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": read tcp 10.134.0.2:38964->10.134.0.44:15021: read: connection reset by peer" start-of-body=
Jul 07 18:07:47.687236 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:47.686201    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc" podUID="38445811-d4bd-4cc7-9d64-888d99a9298c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": read tcp 10.134.0.2:38964->10.134.0.44:15021: read: connection reset by peer"
Jul 07 18:07:48.606600 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:48.606566    2559 generic.go:356] "Generic (PLEG): container finished" podID="38445811-d4bd-4cc7-9d64-888d99a9298c" containerID="8ea9310ed67997c51efabf7a50388c817df29fa27d2528a088936fa92fa94904" exitCode=0
Jul 07 18:07:48.606786 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:48.606641    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc" event={"ID":"38445811-d4bd-4cc7-9d64-888d99a9298c","Type":"ContainerDied","Data":"8ea9310ed67997c51efabf7a50388c817df29fa27d2528a088936fa92fa94904"}
Jul 07 18:07:48.607073 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:48.607058    2559 scope.go:117] "RemoveContainer" containerID="8ea9310ed67997c51efabf7a50388c817df29fa27d2528a088936fa92fa94904"
Jul 07 18:07:48.608058 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:48.608033    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 07 18:07:48.608115 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:48.608098    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 07 18:07:48.608159 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:48.608131    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 07 18:07:49.617993 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:49.617930    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc" event={"ID":"38445811-d4bd-4cc7-9d64-888d99a9298c","Type":"ContainerStarted","Data":"94b7aa207e02f40c329e55c9220e6099e0484ccc0049829b2dd880b00bab62f3"}
Jul 07 18:07:50.208033 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:50.207925    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:50.208716 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:50.208689    2559 patch_prober.go:28] interesting pod/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 07 18:07:50.208920 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:50.208897    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc" podUID="38445811-d4bd-4cc7-9d64-888d99a9298c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 07 18:07:51.152029 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:51.151987    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576"]
Jul 07 18:07:51.156242 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:51.156219    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576"
Jul 07 18:07:51.160039 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:51.160014    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-265893\"/\"kube-root-ca.crt\""
Jul 07 18:07:51.160265 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:51.160250    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-265893\"/\"default-dockercfg-d5lgx\""
Jul 07 18:07:51.160347 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:51.160329    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-265893\"/\"openshift-service-ca.crt\""
Jul 07 18:07:51.160407 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:51.160353    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-265893\"/\"test-model-265893-kserve-self-signed-certs\""
Jul 07 18:07:51.164608 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:51.164582    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576"]
Jul 07 18:07:51.183336 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:51.183309    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:51.213981 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:51.211373    2559 patch_prober.go:28] interesting pod/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 07 18:07:51.213981 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:51.211435    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc" podUID="38445811-d4bd-4cc7-9d64-888d99a9298c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 07 18:07:51.240131 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:51.240096    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd54e277-df65-44ee-9237-d4b0a43e75c2-model-cache\") pod \"test-model-265893-kserve-796b55dc9f-mb576\" (UID: \"dd54e277-df65-44ee-9237-d4b0a43e75c2\") " pod="ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576"
Jul 07 18:07:51.240131 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:51.240135    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktstq\" (UniqueName: \"kubernetes.io/projected/dd54e277-df65-44ee-9237-d4b0a43e75c2-kube-api-access-ktstq\") pod \"test-model-265893-kserve-796b55dc9f-mb576\" (UID: \"dd54e277-df65-44ee-9237-d4b0a43e75c2\") " pod="ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576"
Jul 07 18:07:51.240403 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:51.240164    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd54e277-df65-44ee-9237-d4b0a43e75c2-dshm\") pod \"test-model-265893-kserve-796b55dc9f-mb576\" (UID: \"dd54e277-df65-44ee-9237-d4b0a43e75c2\") " pod="ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576"
Jul 07 18:07:51.240403 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:51.240281    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd54e277-df65-44ee-9237-d4b0a43e75c2-tmp-dir\") pod \"test-model-265893-kserve-796b55dc9f-mb576\" (UID: \"dd54e277-df65-44ee-9237-d4b0a43e75c2\") " pod="ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576"
Jul 07 18:07:51.240403 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:51.240313    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd54e277-df65-44ee-9237-d4b0a43e75c2-tls-certs\") pod \"test-model-265893-kserve-796b55dc9f-mb576\" (UID: \"dd54e277-df65-44ee-9237-d4b0a43e75c2\") " pod="ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576"
Jul 07 18:07:51.240403 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:51.240341    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd54e277-df65-44ee-9237-d4b0a43e75c2-home\") pod \"test-model-265893-kserve-796b55dc9f-mb576\" (UID: \"dd54e277-df65-44ee-9237-d4b0a43e75c2\") " pod="ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576"
Jul 07 18:07:51.341427 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:51.341395    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd54e277-df65-44ee-9237-d4b0a43e75c2-model-cache\") pod \"test-model-265893-kserve-796b55dc9f-mb576\" (UID: \"dd54e277-df65-44ee-9237-d4b0a43e75c2\") " pod="ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576"
Jul 07 18:07:51.341626 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:51.341435    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktstq\" (UniqueName: \"kubernetes.io/projected/dd54e277-df65-44ee-9237-d4b0a43e75c2-kube-api-access-ktstq\") pod \"test-model-265893-kserve-796b55dc9f-mb576\" (UID: \"dd54e277-df65-44ee-9237-d4b0a43e75c2\") " pod="ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576"
Jul 07 18:07:51.341626 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:51.341463    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd54e277-df65-44ee-9237-d4b0a43e75c2-dshm\") pod \"test-model-265893-kserve-796b55dc9f-mb576\" (UID: \"dd54e277-df65-44ee-9237-d4b0a43e75c2\") " pod="ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576"
Jul 07 18:07:51.341626 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:51.341495    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd54e277-df65-44ee-9237-d4b0a43e75c2-tmp-dir\") pod \"test-model-265893-kserve-796b55dc9f-mb576\" (UID: \"dd54e277-df65-44ee-9237-d4b0a43e75c2\") " pod="ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576"
Jul 07 18:07:51.341626 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:51.341510    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd54e277-df65-44ee-9237-d4b0a43e75c2-tls-certs\") pod \"test-model-265893-kserve-796b55dc9f-mb576\" (UID: \"dd54e277-df65-44ee-9237-d4b0a43e75c2\") " pod="ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576"
Jul 07 18:07:51.341626 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:51.341526    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd54e277-df65-44ee-9237-d4b0a43e75c2-home\") pod \"test-model-265893-kserve-796b55dc9f-mb576\" (UID: \"dd54e277-df65-44ee-9237-d4b0a43e75c2\") " pod="ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576"
Jul 07 18:07:51.341921 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:51.341841    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd54e277-df65-44ee-9237-d4b0a43e75c2-model-cache\") pod \"test-model-265893-kserve-796b55dc9f-mb576\" (UID: \"dd54e277-df65-44ee-9237-d4b0a43e75c2\") " pod="ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576"
Jul 07 18:07:51.341921 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:51.341902    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd54e277-df65-44ee-9237-d4b0a43e75c2-tmp-dir\") pod \"test-model-265893-kserve-796b55dc9f-mb576\" (UID: \"dd54e277-df65-44ee-9237-d4b0a43e75c2\") " pod="ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576"
Jul 07 18:07:51.342053 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:51.341924    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd54e277-df65-44ee-9237-d4b0a43e75c2-home\") pod \"test-model-265893-kserve-796b55dc9f-mb576\" (UID: \"dd54e277-df65-44ee-9237-d4b0a43e75c2\") " pod="ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576"
Jul 07 18:07:51.344013 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:51.343995    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd54e277-df65-44ee-9237-d4b0a43e75c2-dshm\") pod \"test-model-265893-kserve-796b55dc9f-mb576\" (UID: \"dd54e277-df65-44ee-9237-d4b0a43e75c2\") " pod="ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576"
Jul 07 18:07:51.344178 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:51.344163    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd54e277-df65-44ee-9237-d4b0a43e75c2-tls-certs\") pod \"test-model-265893-kserve-796b55dc9f-mb576\" (UID: \"dd54e277-df65-44ee-9237-d4b0a43e75c2\") " pod="ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576"
Jul 07 18:07:51.348795 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:51.348772    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktstq\" (UniqueName: \"kubernetes.io/projected/dd54e277-df65-44ee-9237-d4b0a43e75c2-kube-api-access-ktstq\") pod \"test-model-265893-kserve-796b55dc9f-mb576\" (UID: \"dd54e277-df65-44ee-9237-d4b0a43e75c2\") " pod="ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576"
Jul 07 18:07:51.466599 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:51.466503    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576"
Jul 07 18:07:51.650587 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:51.650560    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576"]
Jul 07 18:07:51.652450 ip-10-0-132-78 kubenswrapper[2559]: W0707 18:07:51.652424    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd54e277_df65_44ee_9237_d4b0a43e75c2.slice/crio-14d4f1918c18ba9cc92cd76b4604f475b0a573f7dbb6b3bed15855b171e866df WatchSource:0}: Error finding container 14d4f1918c18ba9cc92cd76b4604f475b0a573f7dbb6b3bed15855b171e866df: Status 404 returned error can't find the container with id 14d4f1918c18ba9cc92cd76b4604f475b0a573f7dbb6b3bed15855b171e866df
Jul 07 18:07:52.213987 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:52.212402    2559 patch_prober.go:28] interesting pod/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 07 18:07:52.213987 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:52.212481    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc" podUID="38445811-d4bd-4cc7-9d64-888d99a9298c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 07 18:07:52.645418 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:52.645381    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576" event={"ID":"dd54e277-df65-44ee-9237-d4b0a43e75c2","Type":"ContainerStarted","Data":"72d6beeb9a88b086fd03e8de9c4e6457bb0e479ecc3a10eaf2bb3e8d255cfad9"}
Jul 07 18:07:52.645636 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:52.645428    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576" event={"ID":"dd54e277-df65-44ee-9237-d4b0a43e75c2","Type":"ContainerStarted","Data":"14d4f1918c18ba9cc92cd76b4604f475b0a573f7dbb6b3bed15855b171e866df"}
Jul 07 18:07:52.665229 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:52.665179    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576" podStartSLOduration=1.665163788 podStartE2EDuration="1.665163788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:07:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:07:52.663318898 +0000 UTC m=+1872.178549230" watchObservedRunningTime="2026-07-07 18:07:52.665163788 +0000 UTC m=+1872.180394123"
Jul 07 18:07:53.213982 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:53.211388    2559 patch_prober.go:28] interesting pod/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 07 18:07:53.213982 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:53.211470    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc" podUID="38445811-d4bd-4cc7-9d64-888d99a9298c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 07 18:07:54.211552 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:54.211519    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:54.211939 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:54.211914    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:54.212719 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:54.212700    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:07:55.847942 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:55.847902    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:55.948200 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:07:55.948158    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:01.467213 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:01.467174    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576"
Jul 07 18:08:01.467695 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:01.467236    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576"
Jul 07 18:08:01.480009 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:01.479980    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576"
Jul 07 18:08:01.705474 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:01.705443    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576"
Jul 07 18:08:01.833914 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:01.833775    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:01.895280 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:01.895221    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:04.264597 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:04.264559    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:04.362540 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:04.362494    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:22.546113 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:22.546078    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:22.608262 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:22.608222    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:33.661410 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:33.661375    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6"]
Jul 07 18:08:33.665232 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:33.665210    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6"
Jul 07 18:08:33.668743 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:33.668721    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-24f3c9\"/\"openshift-service-ca.crt\""
Jul 07 18:08:33.668875 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:33.668738    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-24f3c9\"/\"test-model-24f3c9-kserve-self-signed-certs\""
Jul 07 18:08:33.668938 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:33.668889    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-24f3c9\"/\"default-dockercfg-ctqk2\""
Jul 07 18:08:33.669027 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:33.668979    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-24f3c9\"/\"kube-root-ca.crt\""
Jul 07 18:08:33.673364 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:33.673336    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6"]
Jul 07 18:08:33.686341 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:33.686308    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:33.721218 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:33.721186    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3465bee-9a09-45da-a67b-5c9271a39732-dshm\") pod \"test-model-24f3c9-kserve-78cb8dcd7-vpdt6\" (UID: \"d3465bee-9a09-45da-a67b-5c9271a39732\") " pod="ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6"
Jul 07 18:08:33.721380 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:33.721229    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3465bee-9a09-45da-a67b-5c9271a39732-model-cache\") pod \"test-model-24f3c9-kserve-78cb8dcd7-vpdt6\" (UID: \"d3465bee-9a09-45da-a67b-5c9271a39732\") " pod="ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6"
Jul 07 18:08:33.721380 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:33.721313    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3465bee-9a09-45da-a67b-5c9271a39732-home\") pod \"test-model-24f3c9-kserve-78cb8dcd7-vpdt6\" (UID: \"d3465bee-9a09-45da-a67b-5c9271a39732\") " pod="ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6"
Jul 07 18:08:33.721380 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:33.721335    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3465bee-9a09-45da-a67b-5c9271a39732-tls-certs\") pod \"test-model-24f3c9-kserve-78cb8dcd7-vpdt6\" (UID: \"d3465bee-9a09-45da-a67b-5c9271a39732\") " pod="ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6"
Jul 07 18:08:33.721540 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:33.721386    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3465bee-9a09-45da-a67b-5c9271a39732-tmp-dir\") pod \"test-model-24f3c9-kserve-78cb8dcd7-vpdt6\" (UID: \"d3465bee-9a09-45da-a67b-5c9271a39732\") " pod="ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6"
Jul 07 18:08:33.721540 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:33.721415    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj8kk\" (UniqueName: \"kubernetes.io/projected/d3465bee-9a09-45da-a67b-5c9271a39732-kube-api-access-jj8kk\") pod \"test-model-24f3c9-kserve-78cb8dcd7-vpdt6\" (UID: \"d3465bee-9a09-45da-a67b-5c9271a39732\") " pod="ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6"
Jul 07 18:08:33.822760 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:33.822725    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3465bee-9a09-45da-a67b-5c9271a39732-dshm\") pod \"test-model-24f3c9-kserve-78cb8dcd7-vpdt6\" (UID: \"d3465bee-9a09-45da-a67b-5c9271a39732\") " pod="ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6"
Jul 07 18:08:33.822995 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:33.822774    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3465bee-9a09-45da-a67b-5c9271a39732-model-cache\") pod \"test-model-24f3c9-kserve-78cb8dcd7-vpdt6\" (UID: \"d3465bee-9a09-45da-a67b-5c9271a39732\") " pod="ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6"
Jul 07 18:08:33.822995 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:33.822836    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3465bee-9a09-45da-a67b-5c9271a39732-home\") pod \"test-model-24f3c9-kserve-78cb8dcd7-vpdt6\" (UID: \"d3465bee-9a09-45da-a67b-5c9271a39732\") " pod="ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6"
Jul 07 18:08:33.822995 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:33.822859    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3465bee-9a09-45da-a67b-5c9271a39732-tls-certs\") pod \"test-model-24f3c9-kserve-78cb8dcd7-vpdt6\" (UID: \"d3465bee-9a09-45da-a67b-5c9271a39732\") " pod="ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6"
Jul 07 18:08:33.822995 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:33.822888    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3465bee-9a09-45da-a67b-5c9271a39732-tmp-dir\") pod \"test-model-24f3c9-kserve-78cb8dcd7-vpdt6\" (UID: \"d3465bee-9a09-45da-a67b-5c9271a39732\") " pod="ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6"
Jul 07 18:08:33.822995 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:33.822914    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj8kk\" (UniqueName: \"kubernetes.io/projected/d3465bee-9a09-45da-a67b-5c9271a39732-kube-api-access-jj8kk\") pod \"test-model-24f3c9-kserve-78cb8dcd7-vpdt6\" (UID: \"d3465bee-9a09-45da-a67b-5c9271a39732\") " pod="ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6"
Jul 07 18:08:33.823284 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:33.823260    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3465bee-9a09-45da-a67b-5c9271a39732-home\") pod \"test-model-24f3c9-kserve-78cb8dcd7-vpdt6\" (UID: \"d3465bee-9a09-45da-a67b-5c9271a39732\") " pod="ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6"
Jul 07 18:08:33.823351 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:33.823309    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3465bee-9a09-45da-a67b-5c9271a39732-model-cache\") pod \"test-model-24f3c9-kserve-78cb8dcd7-vpdt6\" (UID: \"d3465bee-9a09-45da-a67b-5c9271a39732\") " pod="ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6"
Jul 07 18:08:33.823351 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:33.823323    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3465bee-9a09-45da-a67b-5c9271a39732-tmp-dir\") pod \"test-model-24f3c9-kserve-78cb8dcd7-vpdt6\" (UID: \"d3465bee-9a09-45da-a67b-5c9271a39732\") " pod="ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6"
Jul 07 18:08:33.825423 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:33.825399    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3465bee-9a09-45da-a67b-5c9271a39732-dshm\") pod \"test-model-24f3c9-kserve-78cb8dcd7-vpdt6\" (UID: \"d3465bee-9a09-45da-a67b-5c9271a39732\") " pod="ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6"
Jul 07 18:08:33.825665 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:33.825649    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3465bee-9a09-45da-a67b-5c9271a39732-tls-certs\") pod \"test-model-24f3c9-kserve-78cb8dcd7-vpdt6\" (UID: \"d3465bee-9a09-45da-a67b-5c9271a39732\") " pod="ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6"
Jul 07 18:08:33.834444 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:33.834418    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj8kk\" (UniqueName: \"kubernetes.io/projected/d3465bee-9a09-45da-a67b-5c9271a39732-kube-api-access-jj8kk\") pod \"test-model-24f3c9-kserve-78cb8dcd7-vpdt6\" (UID: \"d3465bee-9a09-45da-a67b-5c9271a39732\") " pod="ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6"
Jul 07 18:08:33.976636 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:33.976545    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6"
Jul 07 18:08:34.122366 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:34.122333    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6"]
Jul 07 18:08:34.124013 ip-10-0-132-78 kubenswrapper[2559]: W0707 18:08:34.123984    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3465bee_9a09_45da_a67b_5c9271a39732.slice/crio-2234f6feb81c23ab2069e8d9a633effd74f8fd2fb1da40064b6c93a35ecb6e97 WatchSource:0}: Error finding container 2234f6feb81c23ab2069e8d9a633effd74f8fd2fb1da40064b6c93a35ecb6e97: Status 404 returned error can't find the container with id 2234f6feb81c23ab2069e8d9a633effd74f8fd2fb1da40064b6c93a35ecb6e97
Jul 07 18:08:34.848665 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:34.848622    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6" event={"ID":"d3465bee-9a09-45da-a67b-5c9271a39732","Type":"ContainerStarted","Data":"499068e9b4909d5706535d1ff4a045b7f56decefea54575e6d376b30fd00dcaa"}
Jul 07 18:08:34.848665 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:34.848664    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6" event={"ID":"d3465bee-9a09-45da-a67b-5c9271a39732","Type":"ContainerStarted","Data":"2234f6feb81c23ab2069e8d9a633effd74f8fd2fb1da40064b6c93a35ecb6e97"}
Jul 07 18:08:34.866422 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:34.866370    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6" podStartSLOduration=1.866353482 podStartE2EDuration="1.866353482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:08:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:08:34.864645329 +0000 UTC m=+1914.379875666" watchObservedRunningTime="2026-07-07 18:08:34.866353482 +0000 UTC m=+1914.381583819"
Jul 07 18:08:43.977410 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:43.977360    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6"
Jul 07 18:08:43.977858 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:43.977428    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6"
Jul 07 18:08:43.990365 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:43.990335    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6"
Jul 07 18:08:44.916398 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:44.916363    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6"
Jul 07 18:08:56.472969 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:08:56.472918    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:00.534272 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:00.534236    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:10.768791 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:10.768723    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576"]
Jul 07 18:09:10.788072 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:10.788036    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:11.710404 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:11.710317    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6"]
Jul 07 18:09:11.725422 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:11.725373    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:11.898750 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:11.898713    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:12.310091 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:12.310051    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:12.411120 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:12.411078    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:12.536226 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:12.536192    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:17.389839 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:17.389802    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:25.771422 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:25.771383    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:25.791433 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:25.791398    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576" podUID="dd54e277-df65-44ee-9237-d4b0a43e75c2" containerName="main" containerID="cri-o://72d6beeb9a88b086fd03e8de9c4e6457bb0e479ecc3a10eaf2bb3e8d255cfad9" gracePeriod=45
Jul 07 18:09:25.829065 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:25.829022    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:26.051274 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:26.051247    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576"
Jul 07 18:09:26.101319 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:26.101282    2559 generic.go:356] "Generic (PLEG): container finished" podID="dd54e277-df65-44ee-9237-d4b0a43e75c2" containerID="72d6beeb9a88b086fd03e8de9c4e6457bb0e479ecc3a10eaf2bb3e8d255cfad9" exitCode=0
Jul 07 18:09:26.101509 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:26.101338    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576"
Jul 07 18:09:26.101509 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:26.101371    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576" event={"ID":"dd54e277-df65-44ee-9237-d4b0a43e75c2","Type":"ContainerDied","Data":"72d6beeb9a88b086fd03e8de9c4e6457bb0e479ecc3a10eaf2bb3e8d255cfad9"}
Jul 07 18:09:26.101509 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:26.101415    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576" event={"ID":"dd54e277-df65-44ee-9237-d4b0a43e75c2","Type":"ContainerDied","Data":"14d4f1918c18ba9cc92cd76b4604f475b0a573f7dbb6b3bed15855b171e866df"}
Jul 07 18:09:26.101509 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:26.101432    2559 scope.go:117] "RemoveContainer" containerID="72d6beeb9a88b086fd03e8de9c4e6457bb0e479ecc3a10eaf2bb3e8d255cfad9"
Jul 07 18:09:26.104376 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:26.104353    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd54e277-df65-44ee-9237-d4b0a43e75c2-dshm\") pod \"dd54e277-df65-44ee-9237-d4b0a43e75c2\" (UID: \"dd54e277-df65-44ee-9237-d4b0a43e75c2\") "
Jul 07 18:09:26.104516 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:26.104383    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd54e277-df65-44ee-9237-d4b0a43e75c2-tmp-dir\") pod \"dd54e277-df65-44ee-9237-d4b0a43e75c2\" (UID: \"dd54e277-df65-44ee-9237-d4b0a43e75c2\") "
Jul 07 18:09:26.104516 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:26.104413    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd54e277-df65-44ee-9237-d4b0a43e75c2-home\") pod \"dd54e277-df65-44ee-9237-d4b0a43e75c2\" (UID: \"dd54e277-df65-44ee-9237-d4b0a43e75c2\") "
Jul 07 18:09:26.104516 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:26.104435    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd54e277-df65-44ee-9237-d4b0a43e75c2-model-cache\") pod \"dd54e277-df65-44ee-9237-d4b0a43e75c2\" (UID: \"dd54e277-df65-44ee-9237-d4b0a43e75c2\") "
Jul 07 18:09:26.104683 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:26.104524    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktstq\" (UniqueName: \"kubernetes.io/projected/dd54e277-df65-44ee-9237-d4b0a43e75c2-kube-api-access-ktstq\") pod \"dd54e277-df65-44ee-9237-d4b0a43e75c2\" (UID: \"dd54e277-df65-44ee-9237-d4b0a43e75c2\") "
Jul 07 18:09:26.104683 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:26.104616    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd54e277-df65-44ee-9237-d4b0a43e75c2-tls-certs\") pod \"dd54e277-df65-44ee-9237-d4b0a43e75c2\" (UID: \"dd54e277-df65-44ee-9237-d4b0a43e75c2\") "
Jul 07 18:09:26.104792 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:26.104681    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd54e277-df65-44ee-9237-d4b0a43e75c2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dd54e277-df65-44ee-9237-d4b0a43e75c2" (UID: "dd54e277-df65-44ee-9237-d4b0a43e75c2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:09:26.104792 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:26.104734    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd54e277-df65-44ee-9237-d4b0a43e75c2-home" (OuterVolumeSpecName: "home") pod "dd54e277-df65-44ee-9237-d4b0a43e75c2" (UID: "dd54e277-df65-44ee-9237-d4b0a43e75c2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:09:26.104998 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:26.104945    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd54e277-df65-44ee-9237-d4b0a43e75c2-tmp-dir\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:09:26.105092 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:26.105003    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd54e277-df65-44ee-9237-d4b0a43e75c2-home\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:09:26.105092 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:26.105044    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd54e277-df65-44ee-9237-d4b0a43e75c2-model-cache" (OuterVolumeSpecName: "model-cache") pod "dd54e277-df65-44ee-9237-d4b0a43e75c2" (UID: "dd54e277-df65-44ee-9237-d4b0a43e75c2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:09:26.107028 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:26.107004    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd54e277-df65-44ee-9237-d4b0a43e75c2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dd54e277-df65-44ee-9237-d4b0a43e75c2" (UID: "dd54e277-df65-44ee-9237-d4b0a43e75c2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:09:26.107147 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:26.107118    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd54e277-df65-44ee-9237-d4b0a43e75c2-kube-api-access-ktstq" (OuterVolumeSpecName: "kube-api-access-ktstq") pod "dd54e277-df65-44ee-9237-d4b0a43e75c2" (UID: "dd54e277-df65-44ee-9237-d4b0a43e75c2"). InnerVolumeSpecName "kube-api-access-ktstq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:09:26.107202 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:26.107151    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd54e277-df65-44ee-9237-d4b0a43e75c2-dshm" (OuterVolumeSpecName: "dshm") pod "dd54e277-df65-44ee-9237-d4b0a43e75c2" (UID: "dd54e277-df65-44ee-9237-d4b0a43e75c2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:09:26.110686 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:26.110666    2559 scope.go:117] "RemoveContainer" containerID="72d6beeb9a88b086fd03e8de9c4e6457bb0e479ecc3a10eaf2bb3e8d255cfad9"
Jul 07 18:09:26.110975 ip-10-0-132-78 kubenswrapper[2559]: E0707 18:09:26.110934    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72d6beeb9a88b086fd03e8de9c4e6457bb0e479ecc3a10eaf2bb3e8d255cfad9\": container with ID starting with 72d6beeb9a88b086fd03e8de9c4e6457bb0e479ecc3a10eaf2bb3e8d255cfad9 not found: ID does not exist" containerID="72d6beeb9a88b086fd03e8de9c4e6457bb0e479ecc3a10eaf2bb3e8d255cfad9"
Jul 07 18:09:26.111055 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:26.110981    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72d6beeb9a88b086fd03e8de9c4e6457bb0e479ecc3a10eaf2bb3e8d255cfad9"} err="failed to get container status \"72d6beeb9a88b086fd03e8de9c4e6457bb0e479ecc3a10eaf2bb3e8d255cfad9\": rpc error: code = NotFound desc = could not find container \"72d6beeb9a88b086fd03e8de9c4e6457bb0e479ecc3a10eaf2bb3e8d255cfad9\": container with ID starting with 72d6beeb9a88b086fd03e8de9c4e6457bb0e479ecc3a10eaf2bb3e8d255cfad9 not found: ID does not exist"
Jul 07 18:09:26.205603 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:26.205563    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktstq\" (UniqueName: \"kubernetes.io/projected/dd54e277-df65-44ee-9237-d4b0a43e75c2-kube-api-access-ktstq\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:09:26.205603 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:26.205598    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd54e277-df65-44ee-9237-d4b0a43e75c2-tls-certs\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:09:26.205603 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:26.205609    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd54e277-df65-44ee-9237-d4b0a43e75c2-dshm\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:09:26.205832 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:26.205617    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd54e277-df65-44ee-9237-d4b0a43e75c2-model-cache\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:09:26.423685 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:26.423649    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576"]
Jul 07 18:09:26.425372 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:26.425354    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-265893/test-model-265893-kserve-796b55dc9f-mb576"]
Jul 07 18:09:26.731648 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:26.731558    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6" podUID="d3465bee-9a09-45da-a67b-5c9271a39732" containerName="main" containerID="cri-o://499068e9b4909d5706535d1ff4a045b7f56decefea54575e6d376b30fd00dcaa" gracePeriod=45
Jul 07 18:09:26.994655 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:26.994589    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6"
Jul 07 18:09:27.007171 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:27.007141    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd54e277-df65-44ee-9237-d4b0a43e75c2" path="/var/lib/kubelet/pods/dd54e277-df65-44ee-9237-d4b0a43e75c2/volumes"
Jul 07 18:09:27.108887 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:27.108850    2559 generic.go:356] "Generic (PLEG): container finished" podID="d3465bee-9a09-45da-a67b-5c9271a39732" containerID="499068e9b4909d5706535d1ff4a045b7f56decefea54575e6d376b30fd00dcaa" exitCode=0
Jul 07 18:09:27.109101 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:27.108904    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6"
Jul 07 18:09:27.109101 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:27.108928    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6" event={"ID":"d3465bee-9a09-45da-a67b-5c9271a39732","Type":"ContainerDied","Data":"499068e9b4909d5706535d1ff4a045b7f56decefea54575e6d376b30fd00dcaa"}
Jul 07 18:09:27.109101 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:27.108990    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6" event={"ID":"d3465bee-9a09-45da-a67b-5c9271a39732","Type":"ContainerDied","Data":"2234f6feb81c23ab2069e8d9a633effd74f8fd2fb1da40064b6c93a35ecb6e97"}
Jul 07 18:09:27.109101 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:27.109007    2559 scope.go:117] "RemoveContainer" containerID="499068e9b4909d5706535d1ff4a045b7f56decefea54575e6d376b30fd00dcaa"
Jul 07 18:09:27.113133 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:27.113110    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3465bee-9a09-45da-a67b-5c9271a39732-dshm\") pod \"d3465bee-9a09-45da-a67b-5c9271a39732\" (UID: \"d3465bee-9a09-45da-a67b-5c9271a39732\") "
Jul 07 18:09:27.113237 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:27.113154    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3465bee-9a09-45da-a67b-5c9271a39732-model-cache\") pod \"d3465bee-9a09-45da-a67b-5c9271a39732\" (UID: \"d3465bee-9a09-45da-a67b-5c9271a39732\") "
Jul 07 18:09:27.113237 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:27.113182    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3465bee-9a09-45da-a67b-5c9271a39732-tls-certs\") pod \"d3465bee-9a09-45da-a67b-5c9271a39732\" (UID: \"d3465bee-9a09-45da-a67b-5c9271a39732\") "
Jul 07 18:09:27.113237 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:27.113219    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3465bee-9a09-45da-a67b-5c9271a39732-tmp-dir\") pod \"d3465bee-9a09-45da-a67b-5c9271a39732\" (UID: \"d3465bee-9a09-45da-a67b-5c9271a39732\") "
Jul 07 18:09:27.113401 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:27.113259    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3465bee-9a09-45da-a67b-5c9271a39732-home\") pod \"d3465bee-9a09-45da-a67b-5c9271a39732\" (UID: \"d3465bee-9a09-45da-a67b-5c9271a39732\") "
Jul 07 18:09:27.113401 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:27.113285    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jj8kk\" (UniqueName: \"kubernetes.io/projected/d3465bee-9a09-45da-a67b-5c9271a39732-kube-api-access-jj8kk\") pod \"d3465bee-9a09-45da-a67b-5c9271a39732\" (UID: \"d3465bee-9a09-45da-a67b-5c9271a39732\") "
Jul 07 18:09:27.113505 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:27.113400    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3465bee-9a09-45da-a67b-5c9271a39732-model-cache" (OuterVolumeSpecName: "model-cache") pod "d3465bee-9a09-45da-a67b-5c9271a39732" (UID: "d3465bee-9a09-45da-a67b-5c9271a39732"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:09:27.113603 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:27.113577    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3465bee-9a09-45da-a67b-5c9271a39732-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d3465bee-9a09-45da-a67b-5c9271a39732" (UID: "d3465bee-9a09-45da-a67b-5c9271a39732"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:09:27.113688 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:27.113601    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3465bee-9a09-45da-a67b-5c9271a39732-home" (OuterVolumeSpecName: "home") pod "d3465bee-9a09-45da-a67b-5c9271a39732" (UID: "d3465bee-9a09-45da-a67b-5c9271a39732"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:09:27.113688 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:27.113651    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3465bee-9a09-45da-a67b-5c9271a39732-model-cache\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:09:27.113688 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:27.113669    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3465bee-9a09-45da-a67b-5c9271a39732-tmp-dir\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:09:27.115672 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:27.115646    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3465bee-9a09-45da-a67b-5c9271a39732-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d3465bee-9a09-45da-a67b-5c9271a39732" (UID: "d3465bee-9a09-45da-a67b-5c9271a39732"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:09:27.115985 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:27.115941    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3465bee-9a09-45da-a67b-5c9271a39732-dshm" (OuterVolumeSpecName: "dshm") pod "d3465bee-9a09-45da-a67b-5c9271a39732" (UID: "d3465bee-9a09-45da-a67b-5c9271a39732"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:09:27.116097 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:27.116033    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3465bee-9a09-45da-a67b-5c9271a39732-kube-api-access-jj8kk" (OuterVolumeSpecName: "kube-api-access-jj8kk") pod "d3465bee-9a09-45da-a67b-5c9271a39732" (UID: "d3465bee-9a09-45da-a67b-5c9271a39732"). InnerVolumeSpecName "kube-api-access-jj8kk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:09:27.118375 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:27.118355    2559 scope.go:117] "RemoveContainer" containerID="499068e9b4909d5706535d1ff4a045b7f56decefea54575e6d376b30fd00dcaa"
Jul 07 18:09:27.118650 ip-10-0-132-78 kubenswrapper[2559]: E0707 18:09:27.118631    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"499068e9b4909d5706535d1ff4a045b7f56decefea54575e6d376b30fd00dcaa\": container with ID starting with 499068e9b4909d5706535d1ff4a045b7f56decefea54575e6d376b30fd00dcaa not found: ID does not exist" containerID="499068e9b4909d5706535d1ff4a045b7f56decefea54575e6d376b30fd00dcaa"
Jul 07 18:09:27.118727 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:27.118660    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"499068e9b4909d5706535d1ff4a045b7f56decefea54575e6d376b30fd00dcaa"} err="failed to get container status \"499068e9b4909d5706535d1ff4a045b7f56decefea54575e6d376b30fd00dcaa\": rpc error: code = NotFound desc = could not find container \"499068e9b4909d5706535d1ff4a045b7f56decefea54575e6d376b30fd00dcaa\": container with ID starting with 499068e9b4909d5706535d1ff4a045b7f56decefea54575e6d376b30fd00dcaa not found: ID does not exist"
Jul 07 18:09:27.214161 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:27.214123    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3465bee-9a09-45da-a67b-5c9271a39732-dshm\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:09:27.214161 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:27.214153    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3465bee-9a09-45da-a67b-5c9271a39732-tls-certs\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:09:27.214161 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:27.214164    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3465bee-9a09-45da-a67b-5c9271a39732-home\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:09:27.214161 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:27.214172    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jj8kk\" (UniqueName: \"kubernetes.io/projected/d3465bee-9a09-45da-a67b-5c9271a39732-kube-api-access-jj8kk\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:09:27.430698 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:27.430663    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6"]
Jul 07 18:09:27.434039 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:27.434014    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-24f3c9/test-model-24f3c9-kserve-78cb8dcd7-vpdt6"]
Jul 07 18:09:29.006874 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:29.006841    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3465bee-9a09-45da-a67b-5c9271a39732" path="/var/lib/kubelet/pods/d3465bee-9a09-45da-a67b-5c9271a39732/volumes"
Jul 07 18:09:54.165187 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:54.165148    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:54.410270 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:54.410236    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"]
Jul 07 18:09:54.410525 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:54.410499    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc" podUID="38445811-d4bd-4cc7-9d64-888d99a9298c" containerName="istio-proxy" containerID="cri-o://94b7aa207e02f40c329e55c9220e6099e0484ccc0049829b2dd880b00bab62f3" gracePeriod=30
Jul 07 18:09:54.446235 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:54.446132    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:54.667786 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:54.667745    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:54.859391 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:54.859350    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:55.379149 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:55.379118    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:55.540185 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:55.540149    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:55.641605 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:55.641509    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:55.767127 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:55.767082    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:59.658062 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:59.658028    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:09:59.814229 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:59.814146    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38445811-d4bd-4cc7-9d64-888d99a9298c-istio-envoy\") pod \"38445811-d4bd-4cc7-9d64-888d99a9298c\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") "
Jul 07 18:09:59.814229 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:59.814227    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38445811-d4bd-4cc7-9d64-888d99a9298c-credential-socket\") pod \"38445811-d4bd-4cc7-9d64-888d99a9298c\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") "
Jul 07 18:09:59.814550 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:59.814272    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38445811-d4bd-4cc7-9d64-888d99a9298c-istiod-ca-cert\") pod \"38445811-d4bd-4cc7-9d64-888d99a9298c\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") "
Jul 07 18:09:59.814550 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:59.814307    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrrh4\" (UniqueName: \"kubernetes.io/projected/38445811-d4bd-4cc7-9d64-888d99a9298c-kube-api-access-qrrh4\") pod \"38445811-d4bd-4cc7-9d64-888d99a9298c\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") "
Jul 07 18:09:59.814550 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:59.814336    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38445811-d4bd-4cc7-9d64-888d99a9298c-workload-certs\") pod \"38445811-d4bd-4cc7-9d64-888d99a9298c\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") "
Jul 07 18:09:59.814550 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:59.814385    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38445811-d4bd-4cc7-9d64-888d99a9298c-istio-data\") pod \"38445811-d4bd-4cc7-9d64-888d99a9298c\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") "
Jul 07 18:09:59.814550 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:59.814473    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38445811-d4bd-4cc7-9d64-888d99a9298c-workload-socket\") pod \"38445811-d4bd-4cc7-9d64-888d99a9298c\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") "
Jul 07 18:09:59.814550 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:59.814521    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38445811-d4bd-4cc7-9d64-888d99a9298c-istio-token\") pod \"38445811-d4bd-4cc7-9d64-888d99a9298c\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") "
Jul 07 18:09:59.814550 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:59.814552    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38445811-d4bd-4cc7-9d64-888d99a9298c-istio-podinfo\") pod \"38445811-d4bd-4cc7-9d64-888d99a9298c\" (UID: \"38445811-d4bd-4cc7-9d64-888d99a9298c\") "
Jul 07 18:09:59.814917 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:59.814641    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38445811-d4bd-4cc7-9d64-888d99a9298c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "38445811-d4bd-4cc7-9d64-888d99a9298c" (UID: "38445811-d4bd-4cc7-9d64-888d99a9298c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:09:59.814917 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:59.814775    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38445811-d4bd-4cc7-9d64-888d99a9298c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "38445811-d4bd-4cc7-9d64-888d99a9298c" (UID: "38445811-d4bd-4cc7-9d64-888d99a9298c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:09:59.814917 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:59.814790    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38445811-d4bd-4cc7-9d64-888d99a9298c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "38445811-d4bd-4cc7-9d64-888d99a9298c" (UID: "38445811-d4bd-4cc7-9d64-888d99a9298c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:09:59.814917 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:59.814889    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38445811-d4bd-4cc7-9d64-888d99a9298c-workload-socket\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:09:59.814917 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:59.814905    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38445811-d4bd-4cc7-9d64-888d99a9298c-istiod-ca-cert\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:09:59.814917 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:59.814917    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38445811-d4bd-4cc7-9d64-888d99a9298c-workload-certs\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:09:59.815442 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:59.815139    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38445811-d4bd-4cc7-9d64-888d99a9298c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "38445811-d4bd-4cc7-9d64-888d99a9298c" (UID: "38445811-d4bd-4cc7-9d64-888d99a9298c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:09:59.815605 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:59.815578    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38445811-d4bd-4cc7-9d64-888d99a9298c-istio-data" (OuterVolumeSpecName: "istio-data") pod "38445811-d4bd-4cc7-9d64-888d99a9298c" (UID: "38445811-d4bd-4cc7-9d64-888d99a9298c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:09:59.816637 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:59.816609    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38445811-d4bd-4cc7-9d64-888d99a9298c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "38445811-d4bd-4cc7-9d64-888d99a9298c" (UID: "38445811-d4bd-4cc7-9d64-888d99a9298c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:09:59.816787 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:59.816671    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38445811-d4bd-4cc7-9d64-888d99a9298c-kube-api-access-qrrh4" (OuterVolumeSpecName: "kube-api-access-qrrh4") pod "38445811-d4bd-4cc7-9d64-888d99a9298c" (UID: "38445811-d4bd-4cc7-9d64-888d99a9298c"). InnerVolumeSpecName "kube-api-access-qrrh4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:09:59.816787 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:59.816776    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38445811-d4bd-4cc7-9d64-888d99a9298c-istio-token" (OuterVolumeSpecName: "istio-token") pod "38445811-d4bd-4cc7-9d64-888d99a9298c" (UID: "38445811-d4bd-4cc7-9d64-888d99a9298c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:09:59.817064 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:59.817039    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/38445811-d4bd-4cc7-9d64-888d99a9298c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "38445811-d4bd-4cc7-9d64-888d99a9298c" (UID: "38445811-d4bd-4cc7-9d64-888d99a9298c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 18:09:59.915909 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:59.915870    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38445811-d4bd-4cc7-9d64-888d99a9298c-credential-socket\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:09:59.915909 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:59.915904    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrrh4\" (UniqueName: \"kubernetes.io/projected/38445811-d4bd-4cc7-9d64-888d99a9298c-kube-api-access-qrrh4\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:09:59.915909 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:59.915916    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38445811-d4bd-4cc7-9d64-888d99a9298c-istio-data\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:09:59.915909 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:59.915924    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38445811-d4bd-4cc7-9d64-888d99a9298c-istio-token\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:09:59.916227 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:59.915932    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38445811-d4bd-4cc7-9d64-888d99a9298c-istio-podinfo\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:09:59.916227 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:09:59.915939    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38445811-d4bd-4cc7-9d64-888d99a9298c-istio-envoy\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:10:00.265511 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:00.265480    2559 generic.go:356] "Generic (PLEG): container finished" podID="38445811-d4bd-4cc7-9d64-888d99a9298c" containerID="94b7aa207e02f40c329e55c9220e6099e0484ccc0049829b2dd880b00bab62f3" exitCode=0
Jul 07 18:10:00.265743 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:00.265534    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"
Jul 07 18:10:00.265743 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:00.265573    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc" event={"ID":"38445811-d4bd-4cc7-9d64-888d99a9298c","Type":"ContainerDied","Data":"94b7aa207e02f40c329e55c9220e6099e0484ccc0049829b2dd880b00bab62f3"}
Jul 07 18:10:00.265743 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:00.265627    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc" event={"ID":"38445811-d4bd-4cc7-9d64-888d99a9298c","Type":"ContainerDied","Data":"46ef8295b43de8e6f1d848906a4f2a5fe5989364a4add8f99f45aa7d99eaf2d2"}
Jul 07 18:10:00.265743 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:00.265649    2559 scope.go:117] "RemoveContainer" containerID="94b7aa207e02f40c329e55c9220e6099e0484ccc0049829b2dd880b00bab62f3"
Jul 07 18:10:00.274827 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:00.274808    2559 scope.go:117] "RemoveContainer" containerID="8ea9310ed67997c51efabf7a50388c817df29fa27d2528a088936fa92fa94904"
Jul 07 18:10:00.283155 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:00.283135    2559 scope.go:117] "RemoveContainer" containerID="94b7aa207e02f40c329e55c9220e6099e0484ccc0049829b2dd880b00bab62f3"
Jul 07 18:10:00.283444 ip-10-0-132-78 kubenswrapper[2559]: E0707 18:10:00.283422    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94b7aa207e02f40c329e55c9220e6099e0484ccc0049829b2dd880b00bab62f3\": container with ID starting with 94b7aa207e02f40c329e55c9220e6099e0484ccc0049829b2dd880b00bab62f3 not found: ID does not exist" containerID="94b7aa207e02f40c329e55c9220e6099e0484ccc0049829b2dd880b00bab62f3"
Jul 07 18:10:00.283492 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:00.283455    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94b7aa207e02f40c329e55c9220e6099e0484ccc0049829b2dd880b00bab62f3"} err="failed to get container status \"94b7aa207e02f40c329e55c9220e6099e0484ccc0049829b2dd880b00bab62f3\": rpc error: code = NotFound desc = could not find container \"94b7aa207e02f40c329e55c9220e6099e0484ccc0049829b2dd880b00bab62f3\": container with ID starting with 94b7aa207e02f40c329e55c9220e6099e0484ccc0049829b2dd880b00bab62f3 not found: ID does not exist"
Jul 07 18:10:00.283492 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:00.283475    2559 scope.go:117] "RemoveContainer" containerID="8ea9310ed67997c51efabf7a50388c817df29fa27d2528a088936fa92fa94904"
Jul 07 18:10:00.283737 ip-10-0-132-78 kubenswrapper[2559]: E0707 18:10:00.283719    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ea9310ed67997c51efabf7a50388c817df29fa27d2528a088936fa92fa94904\": container with ID starting with 8ea9310ed67997c51efabf7a50388c817df29fa27d2528a088936fa92fa94904 not found: ID does not exist" containerID="8ea9310ed67997c51efabf7a50388c817df29fa27d2528a088936fa92fa94904"
Jul 07 18:10:00.283789 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:00.283744    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ea9310ed67997c51efabf7a50388c817df29fa27d2528a088936fa92fa94904"} err="failed to get container status \"8ea9310ed67997c51efabf7a50388c817df29fa27d2528a088936fa92fa94904\": rpc error: code = NotFound desc = could not find container \"8ea9310ed67997c51efabf7a50388c817df29fa27d2528a088936fa92fa94904\": container with ID starting with 8ea9310ed67997c51efabf7a50388c817df29fa27d2528a088936fa92fa94904 not found: ID does not exist"
Jul 07 18:10:00.288500 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:00.288470    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"]
Jul 07 18:10:00.291897 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:00.291874    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-265893-openshift-default-6bb9ccd49f-jvstc"]
Jul 07 18:10:01.007385 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:01.007357    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38445811-d4bd-4cc7-9d64-888d99a9298c" path="/var/lib/kubelet/pods/38445811-d4bd-4cc7-9d64-888d99a9298c/volumes"
Jul 07 18:10:01.186715 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:01.186681    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:01.297244 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:01.297144    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:01.568793 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:01.568704    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:01.668725 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:01.668687    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:02.078348 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:02.078312    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:02.323098 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:02.323061    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:02.438705 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:02.438673    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:04.834599 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:04.834551    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:05.136472 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:05.136428    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:05.237113 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:05.237077    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:05.621817 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:05.621781    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:05.721466 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:05.721429    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:09.399455 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:09.399418    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:10.159126 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.159095    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"]
Jul 07 18:10:10.159467 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.159451    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd54e277-df65-44ee-9237-d4b0a43e75c2" containerName="main"
Jul 07 18:10:10.159467 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.159466    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd54e277-df65-44ee-9237-d4b0a43e75c2" containerName="main"
Jul 07 18:10:10.159636 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.159482    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38445811-d4bd-4cc7-9d64-888d99a9298c" containerName="istio-proxy"
Jul 07 18:10:10.159636 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.159488    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="38445811-d4bd-4cc7-9d64-888d99a9298c" containerName="istio-proxy"
Jul 07 18:10:10.159636 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.159495    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3465bee-9a09-45da-a67b-5c9271a39732" containerName="main"
Jul 07 18:10:10.159636 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.159503    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3465bee-9a09-45da-a67b-5c9271a39732" containerName="main"
Jul 07 18:10:10.159636 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.159523    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38445811-d4bd-4cc7-9d64-888d99a9298c" containerName="istio-proxy"
Jul 07 18:10:10.159636 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.159531    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="38445811-d4bd-4cc7-9d64-888d99a9298c" containerName="istio-proxy"
Jul 07 18:10:10.159636 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.159623    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd54e277-df65-44ee-9237-d4b0a43e75c2" containerName="main"
Jul 07 18:10:10.159636 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.159634    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3465bee-9a09-45da-a67b-5c9271a39732" containerName="main"
Jul 07 18:10:10.160098 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.159643    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="38445811-d4bd-4cc7-9d64-888d99a9298c" containerName="istio-proxy"
Jul 07 18:10:10.160098 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.159657    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="38445811-d4bd-4cc7-9d64-888d99a9298c" containerName="istio-proxy"
Jul 07 18:10:10.164358 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.164334    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:10.166670 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.166649    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-6020d0-openshift-default-dockercfg-vnlbd\""
Jul 07 18:10:10.173581 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.173561    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"]
Jul 07 18:10:10.196893 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.196866    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8777c7b-3616-456d-824e-6a7ea4036946-istio-podinfo\") pod \"e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") " pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:10.197092 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.196905    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8777c7b-3616-456d-824e-6a7ea4036946-istio-data\") pod \"e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") " pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:10.197092 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.196926    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8777c7b-3616-456d-824e-6a7ea4036946-credential-socket\") pod \"e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") " pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:10.197092 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.196965    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8777c7b-3616-456d-824e-6a7ea4036946-workload-certs\") pod \"e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") " pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:10.197092 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.197041    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8777c7b-3616-456d-824e-6a7ea4036946-istio-envoy\") pod \"e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") " pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:10.197092 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.197073    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8777c7b-3616-456d-824e-6a7ea4036946-istiod-ca-cert\") pod \"e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") " pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:10.197302 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.197099    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8777c7b-3616-456d-824e-6a7ea4036946-workload-socket\") pod \"e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") " pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:10.197302 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.197149    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8777c7b-3616-456d-824e-6a7ea4036946-istio-token\") pod \"e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") " pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:10.197302 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.197199    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkpql\" (UniqueName: \"kubernetes.io/projected/a8777c7b-3616-456d-824e-6a7ea4036946-kube-api-access-wkpql\") pod \"e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") " pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:10.298268 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.298233    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8777c7b-3616-456d-824e-6a7ea4036946-istio-envoy\") pod \"e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") " pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:10.298268 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.298275    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8777c7b-3616-456d-824e-6a7ea4036946-istiod-ca-cert\") pod \"e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") " pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:10.298514 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.298300    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8777c7b-3616-456d-824e-6a7ea4036946-workload-socket\") pod \"e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") " pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:10.298514 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.298325    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8777c7b-3616-456d-824e-6a7ea4036946-istio-token\") pod \"e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") " pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:10.298514 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.298363    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkpql\" (UniqueName: \"kubernetes.io/projected/a8777c7b-3616-456d-824e-6a7ea4036946-kube-api-access-wkpql\") pod \"e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") " pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:10.298514 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.298393    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8777c7b-3616-456d-824e-6a7ea4036946-istio-podinfo\") pod \"e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") " pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:10.298514 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.298433    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8777c7b-3616-456d-824e-6a7ea4036946-istio-data\") pod \"e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") " pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:10.298514 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.298463    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8777c7b-3616-456d-824e-6a7ea4036946-credential-socket\") pod \"e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") " pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:10.298514 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.298502    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8777c7b-3616-456d-824e-6a7ea4036946-workload-certs\") pod \"e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") " pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:10.298845 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.298727    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8777c7b-3616-456d-824e-6a7ea4036946-workload-socket\") pod \"e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") " pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:10.298845 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.298778    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8777c7b-3616-456d-824e-6a7ea4036946-istio-data\") pod \"e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") " pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:10.298988 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.298909    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8777c7b-3616-456d-824e-6a7ea4036946-credential-socket\") pod \"e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") " pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:10.299049 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.298992    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8777c7b-3616-456d-824e-6a7ea4036946-workload-certs\") pod \"e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") " pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:10.299251 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.299228    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8777c7b-3616-456d-824e-6a7ea4036946-istiod-ca-cert\") pod \"e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") " pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:10.300765 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.300744    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8777c7b-3616-456d-824e-6a7ea4036946-istio-envoy\") pod \"e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") " pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:10.301116 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.301097    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8777c7b-3616-456d-824e-6a7ea4036946-istio-podinfo\") pod \"e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") " pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:10.306544 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.306525    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8777c7b-3616-456d-824e-6a7ea4036946-istio-token\") pod \"e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") " pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:10.306903 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.306885    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkpql\" (UniqueName: \"kubernetes.io/projected/a8777c7b-3616-456d-824e-6a7ea4036946-kube-api-access-wkpql\") pod \"e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") " pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:10.477017 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.476906    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:10.605609 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.605558    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:10.614811 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.614791    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"]
Jul 07 18:10:10.616641 ip-10-0-132-78 kubenswrapper[2559]: W0707 18:10:10.616618    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8777c7b_3616_456d_824e_6a7ea4036946.slice/crio-dbffecad930f3eab7ce46539951c972f533f24a49150c712750dcbdf04ea8ec9 WatchSource:0}: Error finding container dbffecad930f3eab7ce46539951c972f533f24a49150c712750dcbdf04ea8ec9: Status 404 returned error can't find the container with id dbffecad930f3eab7ce46539951c972f533f24a49150c712750dcbdf04ea8ec9
Jul 07 18:10:10.618621 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.618593    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 07 18:10:10.618693 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.618649    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 07 18:10:10.618693 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:10.618677    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 07 18:10:11.320294 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:11.320256    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg" event={"ID":"a8777c7b-3616-456d-824e-6a7ea4036946","Type":"ContainerStarted","Data":"c1681b198e4fa88721dd845c350642a782fbf7d1d0431f3d58c4ae8ed2553d98"}
Jul 07 18:10:11.320513 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:11.320318    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg" event={"ID":"a8777c7b-3616-456d-824e-6a7ea4036946","Type":"ContainerStarted","Data":"dbffecad930f3eab7ce46539951c972f533f24a49150c712750dcbdf04ea8ec9"}
Jul 07 18:10:11.357355 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:11.357308    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg" podStartSLOduration=1.357292735 podStartE2EDuration="1.357292735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:10:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:10:11.355904259 +0000 UTC m=+2010.871134594" watchObservedRunningTime="2026-07-07 18:10:11.357292735 +0000 UTC m=+2010.872523071"
Jul 07 18:10:11.477405 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:11.477373    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:11.481821 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:11.481797    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:12.325034 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:12.324993    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:12.325944 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:12.325926    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:13.258746 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:13.258710    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:13.358275 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:13.358238    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:13.495424 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:13.495381    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:13.820234 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:13.820190    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:13.920325 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:13.920285    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:14.021070 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:14.021025    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:17.749504 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:17.749469    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:19.590604 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:19.590564    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:19.689565 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:19.689527    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:25.877461 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:25.877420    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:26.242229 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:26.242188    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:26.341390 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:26.341339    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:26.474619 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:26.474576    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:28.367104 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:28.367066    2559 patch_prober.go:28] interesting pod/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 07 18:10:28.367551 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:28.367144    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg" podUID="a8777c7b-3616-456d-824e-6a7ea4036946" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 07 18:10:29.403527 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:29.403492    2559 generic.go:356] "Generic (PLEG): container finished" podID="a8777c7b-3616-456d-824e-6a7ea4036946" containerID="c1681b198e4fa88721dd845c350642a782fbf7d1d0431f3d58c4ae8ed2553d98" exitCode=0
Jul 07 18:10:29.403947 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:29.403562    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg" event={"ID":"a8777c7b-3616-456d-824e-6a7ea4036946","Type":"ContainerDied","Data":"c1681b198e4fa88721dd845c350642a782fbf7d1d0431f3d58c4ae8ed2553d98"}
Jul 07 18:10:29.403947 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:29.403939    2559 scope.go:117] "RemoveContainer" containerID="c1681b198e4fa88721dd845c350642a782fbf7d1d0431f3d58c4ae8ed2553d98"
Jul 07 18:10:29.404984 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:29.404940    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 07 18:10:29.405037 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:29.405025    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 07 18:10:29.405081 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:29.405073    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 07 18:10:30.414316 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:30.414267    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg" event={"ID":"a8777c7b-3616-456d-824e-6a7ea4036946","Type":"ContainerStarted","Data":"8901a10e57fae2007a1d6f4ca4250c054f6654d9cbb881519ce99cbd3358f9a9"}
Jul 07 18:10:30.477829 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:30.477796    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:30.478028 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:30.477928    2559 patch_prober.go:28] interesting pod/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 07 18:10:30.478028 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:30.478005    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg" podUID="a8777c7b-3616-456d-824e-6a7ea4036946" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 07 18:10:31.477333 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:31.477297    2559 patch_prober.go:28] interesting pod/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 07 18:10:31.477826 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:31.477352    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg" podUID="a8777c7b-3616-456d-824e-6a7ea4036946" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 07 18:10:32.040548 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:32.040509    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:32.105775 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:32.105741    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:32.307846 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:32.307752    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:32.477758 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:32.477717    2559 patch_prober.go:28] interesting pod/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 07 18:10:32.478276 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:32.477775    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg" podUID="a8777c7b-3616-456d-824e-6a7ea4036946" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 07 18:10:32.545003 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:32.544943    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:32.716191 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:32.716152    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:33.103098 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:33.103001    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:33.202058 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:33.202015    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:33.306036 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:33.305999    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:33.423118 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:33.423081    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:33.478213 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:33.478175    2559 patch_prober.go:28] interesting pod/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 07 18:10:33.478755 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:33.478239    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg" podUID="a8777c7b-3616-456d-824e-6a7ea4036946" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 07 18:10:34.481488 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:34.481459    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:34.481892 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:34.481807    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:34.482610 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:34.482591    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:38.953978 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:38.953919    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:39.052663 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:39.052623    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:39.192666 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:39.192629    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"]
Jul 07 18:10:39.192875 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:39.192852    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg" podUID="a8777c7b-3616-456d-824e-6a7ea4036946" containerName="istio-proxy" containerID="cri-o://8901a10e57fae2007a1d6f4ca4250c054f6654d9cbb881519ce99cbd3358f9a9" gracePeriod=30
Jul 07 18:10:39.252158 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:39.252080    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:39.465966 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:39.465930    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:39.784638 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:39.784600    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:40.102829 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:40.102741    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:40.307653 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:40.307611    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:42.983919 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:42.983860    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:43.053432 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:43.053392    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:43.107388 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:43.107355    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:43.209620 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:43.209583    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:43.546629 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:43.546595    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:43.645513 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:43.645450    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:44.450336 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.450315    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:44.483860 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.483780    2559 generic.go:356] "Generic (PLEG): container finished" podID="a8777c7b-3616-456d-824e-6a7ea4036946" containerID="8901a10e57fae2007a1d6f4ca4250c054f6654d9cbb881519ce99cbd3358f9a9" exitCode=0
Jul 07 18:10:44.483860 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.483827    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"
Jul 07 18:10:44.484070 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.483863    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg" event={"ID":"a8777c7b-3616-456d-824e-6a7ea4036946","Type":"ContainerDied","Data":"8901a10e57fae2007a1d6f4ca4250c054f6654d9cbb881519ce99cbd3358f9a9"}
Jul 07 18:10:44.484070 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.483916    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg" event={"ID":"a8777c7b-3616-456d-824e-6a7ea4036946","Type":"ContainerDied","Data":"dbffecad930f3eab7ce46539951c972f533f24a49150c712750dcbdf04ea8ec9"}
Jul 07 18:10:44.484070 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.483939    2559 scope.go:117] "RemoveContainer" containerID="8901a10e57fae2007a1d6f4ca4250c054f6654d9cbb881519ce99cbd3358f9a9"
Jul 07 18:10:44.492666 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.492650    2559 scope.go:117] "RemoveContainer" containerID="c1681b198e4fa88721dd845c350642a782fbf7d1d0431f3d58c4ae8ed2553d98"
Jul 07 18:10:44.501000 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.500949    2559 scope.go:117] "RemoveContainer" containerID="8901a10e57fae2007a1d6f4ca4250c054f6654d9cbb881519ce99cbd3358f9a9"
Jul 07 18:10:44.501335 ip-10-0-132-78 kubenswrapper[2559]: E0707 18:10:44.501312    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8901a10e57fae2007a1d6f4ca4250c054f6654d9cbb881519ce99cbd3358f9a9\": container with ID starting with 8901a10e57fae2007a1d6f4ca4250c054f6654d9cbb881519ce99cbd3358f9a9 not found: ID does not exist" containerID="8901a10e57fae2007a1d6f4ca4250c054f6654d9cbb881519ce99cbd3358f9a9"
Jul 07 18:10:44.501413 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.501346    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8901a10e57fae2007a1d6f4ca4250c054f6654d9cbb881519ce99cbd3358f9a9"} err="failed to get container status \"8901a10e57fae2007a1d6f4ca4250c054f6654d9cbb881519ce99cbd3358f9a9\": rpc error: code = NotFound desc = could not find container \"8901a10e57fae2007a1d6f4ca4250c054f6654d9cbb881519ce99cbd3358f9a9\": container with ID starting with 8901a10e57fae2007a1d6f4ca4250c054f6654d9cbb881519ce99cbd3358f9a9 not found: ID does not exist"
Jul 07 18:10:44.501413 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.501365    2559 scope.go:117] "RemoveContainer" containerID="c1681b198e4fa88721dd845c350642a782fbf7d1d0431f3d58c4ae8ed2553d98"
Jul 07 18:10:44.501633 ip-10-0-132-78 kubenswrapper[2559]: E0707 18:10:44.501617    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1681b198e4fa88721dd845c350642a782fbf7d1d0431f3d58c4ae8ed2553d98\": container with ID starting with c1681b198e4fa88721dd845c350642a782fbf7d1d0431f3d58c4ae8ed2553d98 not found: ID does not exist" containerID="c1681b198e4fa88721dd845c350642a782fbf7d1d0431f3d58c4ae8ed2553d98"
Jul 07 18:10:44.501677 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.501637    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1681b198e4fa88721dd845c350642a782fbf7d1d0431f3d58c4ae8ed2553d98"} err="failed to get container status \"c1681b198e4fa88721dd845c350642a782fbf7d1d0431f3d58c4ae8ed2553d98\": rpc error: code = NotFound desc = could not find container \"c1681b198e4fa88721dd845c350642a782fbf7d1d0431f3d58c4ae8ed2553d98\": container with ID starting with c1681b198e4fa88721dd845c350642a782fbf7d1d0431f3d58c4ae8ed2553d98 not found: ID does not exist"
Jul 07 18:10:44.618317 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.618278    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8777c7b-3616-456d-824e-6a7ea4036946-istiod-ca-cert\") pod \"a8777c7b-3616-456d-824e-6a7ea4036946\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") "
Jul 07 18:10:44.618499 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.618325    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8777c7b-3616-456d-824e-6a7ea4036946-workload-socket\") pod \"a8777c7b-3616-456d-824e-6a7ea4036946\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") "
Jul 07 18:10:44.618499 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.618386    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8777c7b-3616-456d-824e-6a7ea4036946-istio-podinfo\") pod \"a8777c7b-3616-456d-824e-6a7ea4036946\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") "
Jul 07 18:10:44.618499 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.618416    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8777c7b-3616-456d-824e-6a7ea4036946-workload-certs\") pod \"a8777c7b-3616-456d-824e-6a7ea4036946\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") "
Jul 07 18:10:44.618499 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.618454    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkpql\" (UniqueName: \"kubernetes.io/projected/a8777c7b-3616-456d-824e-6a7ea4036946-kube-api-access-wkpql\") pod \"a8777c7b-3616-456d-824e-6a7ea4036946\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") "
Jul 07 18:10:44.618499 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.618486    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8777c7b-3616-456d-824e-6a7ea4036946-istio-envoy\") pod \"a8777c7b-3616-456d-824e-6a7ea4036946\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") "
Jul 07 18:10:44.618819 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.618533    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8777c7b-3616-456d-824e-6a7ea4036946-credential-socket\") pod \"a8777c7b-3616-456d-824e-6a7ea4036946\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") "
Jul 07 18:10:44.618819 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.618627    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8777c7b-3616-456d-824e-6a7ea4036946-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a8777c7b-3616-456d-824e-6a7ea4036946" (UID: "a8777c7b-3616-456d-824e-6a7ea4036946"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:10:44.618819 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.618691    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8777c7b-3616-456d-824e-6a7ea4036946-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a8777c7b-3616-456d-824e-6a7ea4036946" (UID: "a8777c7b-3616-456d-824e-6a7ea4036946"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:10:44.618819 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.618793    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8777c7b-3616-456d-824e-6a7ea4036946-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a8777c7b-3616-456d-824e-6a7ea4036946" (UID: "a8777c7b-3616-456d-824e-6a7ea4036946"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:10:44.619066 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.618834    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8777c7b-3616-456d-824e-6a7ea4036946-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a8777c7b-3616-456d-824e-6a7ea4036946" (UID: "a8777c7b-3616-456d-824e-6a7ea4036946"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:10:44.619066 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.618873    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8777c7b-3616-456d-824e-6a7ea4036946-istio-token\") pod \"a8777c7b-3616-456d-824e-6a7ea4036946\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") "
Jul 07 18:10:44.619066 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.618931    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8777c7b-3616-456d-824e-6a7ea4036946-istio-data\") pod \"a8777c7b-3616-456d-824e-6a7ea4036946\" (UID: \"a8777c7b-3616-456d-824e-6a7ea4036946\") "
Jul 07 18:10:44.619282 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.619266    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8777c7b-3616-456d-824e-6a7ea4036946-workload-certs\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:10:44.619367 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.619287    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8777c7b-3616-456d-824e-6a7ea4036946-credential-socket\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:10:44.619367 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.619300    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8777c7b-3616-456d-824e-6a7ea4036946-istiod-ca-cert\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:10:44.619367 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.619315    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8777c7b-3616-456d-824e-6a7ea4036946-workload-socket\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:10:44.620108 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.620085    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8777c7b-3616-456d-824e-6a7ea4036946-istio-data" (OuterVolumeSpecName: "istio-data") pod "a8777c7b-3616-456d-824e-6a7ea4036946" (UID: "a8777c7b-3616-456d-824e-6a7ea4036946"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:10:44.620747 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.620715    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8777c7b-3616-456d-824e-6a7ea4036946-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a8777c7b-3616-456d-824e-6a7ea4036946" (UID: "a8777c7b-3616-456d-824e-6a7ea4036946"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:10:44.621030 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.621000    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8777c7b-3616-456d-824e-6a7ea4036946-kube-api-access-wkpql" (OuterVolumeSpecName: "kube-api-access-wkpql") pod "a8777c7b-3616-456d-824e-6a7ea4036946" (UID: "a8777c7b-3616-456d-824e-6a7ea4036946"). InnerVolumeSpecName "kube-api-access-wkpql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:10:44.621311 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.621283    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8777c7b-3616-456d-824e-6a7ea4036946-istio-token" (OuterVolumeSpecName: "istio-token") pod "a8777c7b-3616-456d-824e-6a7ea4036946" (UID: "a8777c7b-3616-456d-824e-6a7ea4036946"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:10:44.621311 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.621297    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a8777c7b-3616-456d-824e-6a7ea4036946-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a8777c7b-3616-456d-824e-6a7ea4036946" (UID: "a8777c7b-3616-456d-824e-6a7ea4036946"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 18:10:44.720253 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.720223    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8777c7b-3616-456d-824e-6a7ea4036946-istio-podinfo\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:10:44.720253 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.720261    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkpql\" (UniqueName: \"kubernetes.io/projected/a8777c7b-3616-456d-824e-6a7ea4036946-kube-api-access-wkpql\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:10:44.720462 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.720274    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8777c7b-3616-456d-824e-6a7ea4036946-istio-envoy\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:10:44.720462 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.720284    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8777c7b-3616-456d-824e-6a7ea4036946-istio-token\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:10:44.720462 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.720291    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8777c7b-3616-456d-824e-6a7ea4036946-istio-data\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:10:44.804731 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.804699    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"]
Jul 07 18:10:44.808104 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:44.808079    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-6020d0-openshift-default-6fbb899b65-6gjfg"]
Jul 07 18:10:45.006382 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:45.006351    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8777c7b-3616-456d-824e-6a7ea4036946" path="/var/lib/kubelet/pods/a8777c7b-3616-456d-824e-6a7ea4036946/volumes"
Jul 07 18:10:47.497032 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:47.496995    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:47.819129 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:47.819044    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:48.101891 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:48.101792    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:48.305792 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:48.305754    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:51.038932 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:51.038873    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:51.139016 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:51.138974    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:51.283236 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:51.283200    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:51.822197 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:51.822161    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:51.922335 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:51.922306    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:52.022514 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:52.022474    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:55.554852 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:10:55.554815    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:11:04.214787 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:04.214687    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:11:04.312715 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:04.312676    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:11:12.550294 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:12.550264    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6"]
Jul 07 18:11:12.550762 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:12.550685    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8777c7b-3616-456d-824e-6a7ea4036946" containerName="istio-proxy"
Jul 07 18:11:12.550762 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:12.550697    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8777c7b-3616-456d-824e-6a7ea4036946" containerName="istio-proxy"
Jul 07 18:11:12.550883 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:12.550774    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8777c7b-3616-456d-824e-6a7ea4036946" containerName="istio-proxy"
Jul 07 18:11:12.553838 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:12.553818    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6"
Jul 07 18:11:12.556128 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:12.556106    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f78287\"/\"kube-root-ca.crt\""
Jul 07 18:11:12.557210 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:12.557188    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f78287\"/\"default-dockercfg-dp6sp\""
Jul 07 18:11:12.557328 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:12.557194    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f78287\"/\"openshift-service-ca.crt\""
Jul 07 18:11:12.557328 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:12.557255    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f78287\"/\"auth-test-model-f78287-kserve-self-signed-certs\""
Jul 07 18:11:12.565038 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:12.565017    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6"]
Jul 07 18:11:12.585839 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:12.585802    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:11:12.653569 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:12.653534    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0787826f-5b17-497e-afcb-aa879ca6d3ce-home\") pod \"auth-test-model-f78287-kserve-66fd8545bc-drwc6\" (UID: \"0787826f-5b17-497e-afcb-aa879ca6d3ce\") " pod="ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6"
Jul 07 18:11:12.653701 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:12.653586    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtx8b\" (UniqueName: \"kubernetes.io/projected/0787826f-5b17-497e-afcb-aa879ca6d3ce-kube-api-access-xtx8b\") pod \"auth-test-model-f78287-kserve-66fd8545bc-drwc6\" (UID: \"0787826f-5b17-497e-afcb-aa879ca6d3ce\") " pod="ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6"
Jul 07 18:11:12.653701 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:12.653659    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0787826f-5b17-497e-afcb-aa879ca6d3ce-tmp-dir\") pod \"auth-test-model-f78287-kserve-66fd8545bc-drwc6\" (UID: \"0787826f-5b17-497e-afcb-aa879ca6d3ce\") " pod="ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6"
Jul 07 18:11:12.653701 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:12.653676    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0787826f-5b17-497e-afcb-aa879ca6d3ce-tls-certs\") pod \"auth-test-model-f78287-kserve-66fd8545bc-drwc6\" (UID: \"0787826f-5b17-497e-afcb-aa879ca6d3ce\") " pod="ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6"
Jul 07 18:11:12.653814 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:12.653728    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0787826f-5b17-497e-afcb-aa879ca6d3ce-model-cache\") pod \"auth-test-model-f78287-kserve-66fd8545bc-drwc6\" (UID: \"0787826f-5b17-497e-afcb-aa879ca6d3ce\") " pod="ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6"
Jul 07 18:11:12.653814 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:12.653762    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0787826f-5b17-497e-afcb-aa879ca6d3ce-dshm\") pod \"auth-test-model-f78287-kserve-66fd8545bc-drwc6\" (UID: \"0787826f-5b17-497e-afcb-aa879ca6d3ce\") " pod="ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6"
Jul 07 18:11:12.754681 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:12.754644    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0787826f-5b17-497e-afcb-aa879ca6d3ce-model-cache\") pod \"auth-test-model-f78287-kserve-66fd8545bc-drwc6\" (UID: \"0787826f-5b17-497e-afcb-aa879ca6d3ce\") " pod="ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6"
Jul 07 18:11:12.754872 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:12.754693    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0787826f-5b17-497e-afcb-aa879ca6d3ce-dshm\") pod \"auth-test-model-f78287-kserve-66fd8545bc-drwc6\" (UID: \"0787826f-5b17-497e-afcb-aa879ca6d3ce\") " pod="ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6"
Jul 07 18:11:12.754872 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:12.754801    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0787826f-5b17-497e-afcb-aa879ca6d3ce-home\") pod \"auth-test-model-f78287-kserve-66fd8545bc-drwc6\" (UID: \"0787826f-5b17-497e-afcb-aa879ca6d3ce\") " pod="ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6"
Jul 07 18:11:12.754872 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:12.754870    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtx8b\" (UniqueName: \"kubernetes.io/projected/0787826f-5b17-497e-afcb-aa879ca6d3ce-kube-api-access-xtx8b\") pod \"auth-test-model-f78287-kserve-66fd8545bc-drwc6\" (UID: \"0787826f-5b17-497e-afcb-aa879ca6d3ce\") " pod="ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6"
Jul 07 18:11:12.755094 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:12.754934    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0787826f-5b17-497e-afcb-aa879ca6d3ce-tmp-dir\") pod \"auth-test-model-f78287-kserve-66fd8545bc-drwc6\" (UID: \"0787826f-5b17-497e-afcb-aa879ca6d3ce\") " pod="ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6"
Jul 07 18:11:12.755094 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:12.754983    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0787826f-5b17-497e-afcb-aa879ca6d3ce-tls-certs\") pod \"auth-test-model-f78287-kserve-66fd8545bc-drwc6\" (UID: \"0787826f-5b17-497e-afcb-aa879ca6d3ce\") " pod="ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6"
Jul 07 18:11:12.755236 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:12.755193    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0787826f-5b17-497e-afcb-aa879ca6d3ce-model-cache\") pod \"auth-test-model-f78287-kserve-66fd8545bc-drwc6\" (UID: \"0787826f-5b17-497e-afcb-aa879ca6d3ce\") " pod="ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6"
Jul 07 18:11:12.755355 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:12.755337    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0787826f-5b17-497e-afcb-aa879ca6d3ce-tmp-dir\") pod \"auth-test-model-f78287-kserve-66fd8545bc-drwc6\" (UID: \"0787826f-5b17-497e-afcb-aa879ca6d3ce\") " pod="ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6"
Jul 07 18:11:12.755424 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:12.755363    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0787826f-5b17-497e-afcb-aa879ca6d3ce-home\") pod \"auth-test-model-f78287-kserve-66fd8545bc-drwc6\" (UID: \"0787826f-5b17-497e-afcb-aa879ca6d3ce\") " pod="ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6"
Jul 07 18:11:12.757202 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:12.757182    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0787826f-5b17-497e-afcb-aa879ca6d3ce-dshm\") pod \"auth-test-model-f78287-kserve-66fd8545bc-drwc6\" (UID: \"0787826f-5b17-497e-afcb-aa879ca6d3ce\") " pod="ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6"
Jul 07 18:11:12.757540 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:12.757520    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0787826f-5b17-497e-afcb-aa879ca6d3ce-tls-certs\") pod \"auth-test-model-f78287-kserve-66fd8545bc-drwc6\" (UID: \"0787826f-5b17-497e-afcb-aa879ca6d3ce\") " pod="ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6"
Jul 07 18:11:12.762065 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:12.762036    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtx8b\" (UniqueName: \"kubernetes.io/projected/0787826f-5b17-497e-afcb-aa879ca6d3ce-kube-api-access-xtx8b\") pod \"auth-test-model-f78287-kserve-66fd8545bc-drwc6\" (UID: \"0787826f-5b17-497e-afcb-aa879ca6d3ce\") " pod="ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6"
Jul 07 18:11:12.864496 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:12.864452    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6"
Jul 07 18:11:12.997062 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:12.996877    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6"]
Jul 07 18:11:12.999374 ip-10-0-132-78 kubenswrapper[2559]: W0707 18:11:12.999345    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0787826f_5b17_497e_afcb_aa879ca6d3ce.slice/crio-479816f0e74996f9cf6ead14008ba18beeee15508ec7e847474d0a2160e6879b WatchSource:0}: Error finding container 479816f0e74996f9cf6ead14008ba18beeee15508ec7e847474d0a2160e6879b: Status 404 returned error can't find the container with id 479816f0e74996f9cf6ead14008ba18beeee15508ec7e847474d0a2160e6879b
Jul 07 18:11:13.327407 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:13.327313    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:11:13.428308 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:13.428275    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:11:13.618103 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:13.618072    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6" event={"ID":"0787826f-5b17-497e-afcb-aa879ca6d3ce","Type":"ContainerStarted","Data":"e1ac90bc618bc63ffc2654ada70c2a7d14567708073a954d07a2543387555273"}
Jul 07 18:11:13.618467 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:13.618118    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6" event={"ID":"0787826f-5b17-497e-afcb-aa879ca6d3ce","Type":"ContainerStarted","Data":"479816f0e74996f9cf6ead14008ba18beeee15508ec7e847474d0a2160e6879b"}
Jul 07 18:11:13.635820 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:13.635774    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6" podStartSLOduration=1.635761063 podStartE2EDuration="1.635761063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:11:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:11:13.633710358 +0000 UTC m=+2073.148940696" watchObservedRunningTime="2026-07-07 18:11:13.635761063 +0000 UTC m=+2073.150991398"
Jul 07 18:11:22.864965 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:22.864922    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6"
Jul 07 18:11:22.865395 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:22.865004    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6"
Jul 07 18:11:22.877613 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:22.877587    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6"
Jul 07 18:11:23.674799 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:23.674766    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6"
Jul 07 18:11:41.013752 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:41.013724    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8s7h4_5f7bf700-4743-4276-b4b1-9245cd337343/ovn-acl-logging/0.log"
Jul 07 18:11:41.015722 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:41.015702    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8s7h4_5f7bf700-4743-4276-b4b1-9245cd337343/ovn-acl-logging/0.log"
Jul 07 18:11:54.455679 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:54.455644    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n"]
Jul 07 18:11:54.456157 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:54.456055    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8777c7b-3616-456d-824e-6a7ea4036946" containerName="istio-proxy"
Jul 07 18:11:54.456157 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:54.456067    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8777c7b-3616-456d-824e-6a7ea4036946" containerName="istio-proxy"
Jul 07 18:11:54.456157 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:54.456134    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8777c7b-3616-456d-824e-6a7ea4036946" containerName="istio-proxy"
Jul 07 18:11:54.463332 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:54.463311    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n"
Jul 07 18:11:54.466903 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:54.466873    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5c379c\"/\"openshift-service-ca.crt\""
Jul 07 18:11:54.467041 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:54.466899    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5c379c\"/\"default-dockercfg-stjd4\""
Jul 07 18:11:54.467041 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:54.466873    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5c379c\"/\"auth-test-model-5c379c-kserve-self-signed-certs\""
Jul 07 18:11:54.467277 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:54.467260    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5c379c\"/\"kube-root-ca.crt\""
Jul 07 18:11:54.470435 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:54.470372    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n"]
Jul 07 18:11:54.494771 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:54.494739    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:11:54.514918 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:54.514891    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7680ffe7-9156-41f9-86ea-0ac714cd3f32-home\") pod \"auth-test-model-5c379c-kserve-574cc79979-9bc2n\" (UID: \"7680ffe7-9156-41f9-86ea-0ac714cd3f32\") " pod="ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n"
Jul 07 18:11:54.515076 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:54.514930    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7680ffe7-9156-41f9-86ea-0ac714cd3f32-dshm\") pod \"auth-test-model-5c379c-kserve-574cc79979-9bc2n\" (UID: \"7680ffe7-9156-41f9-86ea-0ac714cd3f32\") " pod="ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n"
Jul 07 18:11:54.515076 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:54.514949    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7680ffe7-9156-41f9-86ea-0ac714cd3f32-model-cache\") pod \"auth-test-model-5c379c-kserve-574cc79979-9bc2n\" (UID: \"7680ffe7-9156-41f9-86ea-0ac714cd3f32\") " pod="ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n"
Jul 07 18:11:54.515076 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:54.515057    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7680ffe7-9156-41f9-86ea-0ac714cd3f32-tls-certs\") pod \"auth-test-model-5c379c-kserve-574cc79979-9bc2n\" (UID: \"7680ffe7-9156-41f9-86ea-0ac714cd3f32\") " pod="ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n"
Jul 07 18:11:54.515187 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:54.515090    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7680ffe7-9156-41f9-86ea-0ac714cd3f32-tmp-dir\") pod \"auth-test-model-5c379c-kserve-574cc79979-9bc2n\" (UID: \"7680ffe7-9156-41f9-86ea-0ac714cd3f32\") " pod="ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n"
Jul 07 18:11:54.515187 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:54.515129    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db2h9\" (UniqueName: \"kubernetes.io/projected/7680ffe7-9156-41f9-86ea-0ac714cd3f32-kube-api-access-db2h9\") pod \"auth-test-model-5c379c-kserve-574cc79979-9bc2n\" (UID: \"7680ffe7-9156-41f9-86ea-0ac714cd3f32\") " pod="ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n"
Jul 07 18:11:54.616320 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:54.616282    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db2h9\" (UniqueName: \"kubernetes.io/projected/7680ffe7-9156-41f9-86ea-0ac714cd3f32-kube-api-access-db2h9\") pod \"auth-test-model-5c379c-kserve-574cc79979-9bc2n\" (UID: \"7680ffe7-9156-41f9-86ea-0ac714cd3f32\") " pod="ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n"
Jul 07 18:11:54.616505 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:54.616367    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7680ffe7-9156-41f9-86ea-0ac714cd3f32-home\") pod \"auth-test-model-5c379c-kserve-574cc79979-9bc2n\" (UID: \"7680ffe7-9156-41f9-86ea-0ac714cd3f32\") " pod="ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n"
Jul 07 18:11:54.616505 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:54.616411    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7680ffe7-9156-41f9-86ea-0ac714cd3f32-dshm\") pod \"auth-test-model-5c379c-kserve-574cc79979-9bc2n\" (UID: \"7680ffe7-9156-41f9-86ea-0ac714cd3f32\") " pod="ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n"
Jul 07 18:11:54.616505 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:54.616436    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7680ffe7-9156-41f9-86ea-0ac714cd3f32-model-cache\") pod \"auth-test-model-5c379c-kserve-574cc79979-9bc2n\" (UID: \"7680ffe7-9156-41f9-86ea-0ac714cd3f32\") " pod="ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n"
Jul 07 18:11:54.616505 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:54.616479    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7680ffe7-9156-41f9-86ea-0ac714cd3f32-tls-certs\") pod \"auth-test-model-5c379c-kserve-574cc79979-9bc2n\" (UID: \"7680ffe7-9156-41f9-86ea-0ac714cd3f32\") " pod="ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n"
Jul 07 18:11:54.616505 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:54.616503    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7680ffe7-9156-41f9-86ea-0ac714cd3f32-tmp-dir\") pod \"auth-test-model-5c379c-kserve-574cc79979-9bc2n\" (UID: \"7680ffe7-9156-41f9-86ea-0ac714cd3f32\") " pod="ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n"
Jul 07 18:11:54.616800 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:54.616776    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7680ffe7-9156-41f9-86ea-0ac714cd3f32-home\") pod \"auth-test-model-5c379c-kserve-574cc79979-9bc2n\" (UID: \"7680ffe7-9156-41f9-86ea-0ac714cd3f32\") " pod="ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n"
Jul 07 18:11:54.616916 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:54.616895    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7680ffe7-9156-41f9-86ea-0ac714cd3f32-model-cache\") pod \"auth-test-model-5c379c-kserve-574cc79979-9bc2n\" (UID: \"7680ffe7-9156-41f9-86ea-0ac714cd3f32\") " pod="ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n"
Jul 07 18:11:54.617008 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:54.616933    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7680ffe7-9156-41f9-86ea-0ac714cd3f32-tmp-dir\") pod \"auth-test-model-5c379c-kserve-574cc79979-9bc2n\" (UID: \"7680ffe7-9156-41f9-86ea-0ac714cd3f32\") " pod="ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n"
Jul 07 18:11:54.618841 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:54.618818    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7680ffe7-9156-41f9-86ea-0ac714cd3f32-dshm\") pod \"auth-test-model-5c379c-kserve-574cc79979-9bc2n\" (UID: \"7680ffe7-9156-41f9-86ea-0ac714cd3f32\") " pod="ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n"
Jul 07 18:11:54.619039 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:54.619023    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7680ffe7-9156-41f9-86ea-0ac714cd3f32-tls-certs\") pod \"auth-test-model-5c379c-kserve-574cc79979-9bc2n\" (UID: \"7680ffe7-9156-41f9-86ea-0ac714cd3f32\") " pod="ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n"
Jul 07 18:11:54.624397 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:54.624373    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-db2h9\" (UniqueName: \"kubernetes.io/projected/7680ffe7-9156-41f9-86ea-0ac714cd3f32-kube-api-access-db2h9\") pod \"auth-test-model-5c379c-kserve-574cc79979-9bc2n\" (UID: \"7680ffe7-9156-41f9-86ea-0ac714cd3f32\") " pod="ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n"
Jul 07 18:11:54.775209 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:54.775119    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n"
Jul 07 18:11:54.914138 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:54.914108    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n"]
Jul 07 18:11:54.916461 ip-10-0-132-78 kubenswrapper[2559]: W0707 18:11:54.916435    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7680ffe7_9156_41f9_86ea_0ac714cd3f32.slice/crio-22c1bad253bd1c604869be700744b0337dc080a717993b7166098f821016f084 WatchSource:0}: Error finding container 22c1bad253bd1c604869be700744b0337dc080a717993b7166098f821016f084: Status 404 returned error can't find the container with id 22c1bad253bd1c604869be700744b0337dc080a717993b7166098f821016f084
Jul 07 18:11:55.811226 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:55.811190    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n" event={"ID":"7680ffe7-9156-41f9-86ea-0ac714cd3f32","Type":"ContainerStarted","Data":"6a4192f130a328d92340248e03eb5b8572ea8c06bc286e014bfffedc4567d458"}
Jul 07 18:11:55.811627 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:55.811237    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n" event={"ID":"7680ffe7-9156-41f9-86ea-0ac714cd3f32","Type":"ContainerStarted","Data":"22c1bad253bd1c604869be700744b0337dc080a717993b7166098f821016f084"}
Jul 07 18:11:55.830639 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:11:55.830587    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n" podStartSLOduration=1.830571891 podStartE2EDuration="1.830571891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:11:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:11:55.829012469 +0000 UTC m=+2115.344242808" watchObservedRunningTime="2026-07-07 18:11:55.830571891 +0000 UTC m=+2115.345802227"
Jul 07 18:12:04.776107 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:12:04.776067    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n"
Jul 07 18:12:04.776605 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:12:04.776127    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n"
Jul 07 18:12:04.788011 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:12:04.787983    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n"
Jul 07 18:12:04.870619 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:12:04.870589    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n"
Jul 07 18:13:45.997034 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:13:45.997002    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6"]
Jul 07 18:13:46.059017 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:13:46.058950    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:13:46.958485 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:13:46.958454    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n"]
Jul 07 18:13:46.978181 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:13:46.978150    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:13:56.758823 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:13:56.758776    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc"]
Jul 07 18:13:56.762363 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:13:56.762341    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc"
Jul 07 18:13:56.765133 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:13:56.765106    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f78287\"/\"sub-test-model-f78287-kserve-self-signed-certs\""
Jul 07 18:13:56.773137 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:13:56.773112    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc"]
Jul 07 18:13:56.811834 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:13:56.811792    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:13:56.875209 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:13:56.875178    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53cc667e-978c-4671-b9ad-b1520fd01033-dshm\") pod \"sub-test-model-f78287-kserve-5fdc8458ff-qf2wc\" (UID: \"53cc667e-978c-4671-b9ad-b1520fd01033\") " pod="ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc"
Jul 07 18:13:56.875418 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:13:56.875214    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53cc667e-978c-4671-b9ad-b1520fd01033-home\") pod \"sub-test-model-f78287-kserve-5fdc8458ff-qf2wc\" (UID: \"53cc667e-978c-4671-b9ad-b1520fd01033\") " pod="ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc"
Jul 07 18:13:56.875418 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:13:56.875246    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8cn2\" (UniqueName: \"kubernetes.io/projected/53cc667e-978c-4671-b9ad-b1520fd01033-kube-api-access-s8cn2\") pod \"sub-test-model-f78287-kserve-5fdc8458ff-qf2wc\" (UID: \"53cc667e-978c-4671-b9ad-b1520fd01033\") " pod="ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc"
Jul 07 18:13:56.875418 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:13:56.875342    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53cc667e-978c-4671-b9ad-b1520fd01033-tls-certs\") pod \"sub-test-model-f78287-kserve-5fdc8458ff-qf2wc\" (UID: \"53cc667e-978c-4671-b9ad-b1520fd01033\") " pod="ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc"
Jul 07 18:13:56.875593 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:13:56.875417    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53cc667e-978c-4671-b9ad-b1520fd01033-tmp-dir\") pod \"sub-test-model-f78287-kserve-5fdc8458ff-qf2wc\" (UID: \"53cc667e-978c-4671-b9ad-b1520fd01033\") " pod="ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc"
Jul 07 18:13:56.875593 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:13:56.875476    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53cc667e-978c-4671-b9ad-b1520fd01033-model-cache\") pod \"sub-test-model-f78287-kserve-5fdc8458ff-qf2wc\" (UID: \"53cc667e-978c-4671-b9ad-b1520fd01033\") " pod="ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc"
Jul 07 18:13:56.976431 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:13:56.976391    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53cc667e-978c-4671-b9ad-b1520fd01033-model-cache\") pod \"sub-test-model-f78287-kserve-5fdc8458ff-qf2wc\" (UID: \"53cc667e-978c-4671-b9ad-b1520fd01033\") " pod="ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc"
Jul 07 18:13:56.976630 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:13:56.976438    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53cc667e-978c-4671-b9ad-b1520fd01033-dshm\") pod \"sub-test-model-f78287-kserve-5fdc8458ff-qf2wc\" (UID: \"53cc667e-978c-4671-b9ad-b1520fd01033\") " pod="ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc"
Jul 07 18:13:56.976630 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:13:56.976470    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53cc667e-978c-4671-b9ad-b1520fd01033-home\") pod \"sub-test-model-f78287-kserve-5fdc8458ff-qf2wc\" (UID: \"53cc667e-978c-4671-b9ad-b1520fd01033\") " pod="ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc"
Jul 07 18:13:56.976630 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:13:56.976502    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8cn2\" (UniqueName: \"kubernetes.io/projected/53cc667e-978c-4671-b9ad-b1520fd01033-kube-api-access-s8cn2\") pod \"sub-test-model-f78287-kserve-5fdc8458ff-qf2wc\" (UID: \"53cc667e-978c-4671-b9ad-b1520fd01033\") " pod="ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc"
Jul 07 18:13:56.976630 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:13:56.976551    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53cc667e-978c-4671-b9ad-b1520fd01033-tls-certs\") pod \"sub-test-model-f78287-kserve-5fdc8458ff-qf2wc\" (UID: \"53cc667e-978c-4671-b9ad-b1520fd01033\") " pod="ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc"
Jul 07 18:13:56.976630 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:13:56.976614    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53cc667e-978c-4671-b9ad-b1520fd01033-tmp-dir\") pod \"sub-test-model-f78287-kserve-5fdc8458ff-qf2wc\" (UID: \"53cc667e-978c-4671-b9ad-b1520fd01033\") " pod="ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc"
Jul 07 18:13:56.976900 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:13:56.976867    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53cc667e-978c-4671-b9ad-b1520fd01033-model-cache\") pod \"sub-test-model-f78287-kserve-5fdc8458ff-qf2wc\" (UID: \"53cc667e-978c-4671-b9ad-b1520fd01033\") " pod="ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc"
Jul 07 18:13:56.976990 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:13:56.976903    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53cc667e-978c-4671-b9ad-b1520fd01033-home\") pod \"sub-test-model-f78287-kserve-5fdc8458ff-qf2wc\" (UID: \"53cc667e-978c-4671-b9ad-b1520fd01033\") " pod="ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc"
Jul 07 18:13:56.977096 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:13:56.977078    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53cc667e-978c-4671-b9ad-b1520fd01033-tmp-dir\") pod \"sub-test-model-f78287-kserve-5fdc8458ff-qf2wc\" (UID: \"53cc667e-978c-4671-b9ad-b1520fd01033\") " pod="ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc"
Jul 07 18:13:56.979063 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:13:56.979035    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53cc667e-978c-4671-b9ad-b1520fd01033-dshm\") pod \"sub-test-model-f78287-kserve-5fdc8458ff-qf2wc\" (UID: \"53cc667e-978c-4671-b9ad-b1520fd01033\") " pod="ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc"
Jul 07 18:13:56.979226 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:13:56.979207    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53cc667e-978c-4671-b9ad-b1520fd01033-tls-certs\") pod \"sub-test-model-f78287-kserve-5fdc8458ff-qf2wc\" (UID: \"53cc667e-978c-4671-b9ad-b1520fd01033\") " pod="ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc"
Jul 07 18:13:56.984645 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:13:56.984622    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8cn2\" (UniqueName: \"kubernetes.io/projected/53cc667e-978c-4671-b9ad-b1520fd01033-kube-api-access-s8cn2\") pod \"sub-test-model-f78287-kserve-5fdc8458ff-qf2wc\" (UID: \"53cc667e-978c-4671-b9ad-b1520fd01033\") " pod="ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc"
Jul 07 18:13:57.075562 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:13:57.075465    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc"
Jul 07 18:13:57.216732 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:13:57.216701    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc"]
Jul 07 18:13:57.218517 ip-10-0-132-78 kubenswrapper[2559]: W0707 18:13:57.218486    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53cc667e_978c_4671_b9ad_b1520fd01033.slice/crio-5159fc04ba64fe4d14f0472720041934057c9200ccd5da5e4412aa085009185b WatchSource:0}: Error finding container 5159fc04ba64fe4d14f0472720041934057c9200ccd5da5e4412aa085009185b: Status 404 returned error can't find the container with id 5159fc04ba64fe4d14f0472720041934057c9200ccd5da5e4412aa085009185b
Jul 07 18:13:57.369387 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:13:57.369348    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc" event={"ID":"53cc667e-978c-4671-b9ad-b1520fd01033","Type":"ContainerStarted","Data":"57c44445be0318a9bff76510201f62b665e14fbe546a921ab7cc815c03653c33"}
Jul 07 18:13:57.369566 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:13:57.369399    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc" event={"ID":"53cc667e-978c-4671-b9ad-b1520fd01033","Type":"ContainerStarted","Data":"5159fc04ba64fe4d14f0472720041934057c9200ccd5da5e4412aa085009185b"}
Jul 07 18:13:57.385258 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:13:57.385209    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc" podStartSLOduration=1.385194551 podStartE2EDuration="1.385194551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:13:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:13:57.384905635 +0000 UTC m=+2236.900135971" watchObservedRunningTime="2026-07-07 18:13:57.385194551 +0000 UTC m=+2236.900424886"
Jul 07 18:14:01.020310 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:01.020255    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6" podUID="0787826f-5b17-497e-afcb-aa879ca6d3ce" containerName="main" containerID="cri-o://e1ac90bc618bc63ffc2654ada70c2a7d14567708073a954d07a2543387555273" gracePeriod=45
Jul 07 18:14:01.262641 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:01.262614    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6"
Jul 07 18:14:01.318912 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:01.318831    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0787826f-5b17-497e-afcb-aa879ca6d3ce-dshm\") pod \"0787826f-5b17-497e-afcb-aa879ca6d3ce\" (UID: \"0787826f-5b17-497e-afcb-aa879ca6d3ce\") "
Jul 07 18:14:01.318912 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:01.318899    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0787826f-5b17-497e-afcb-aa879ca6d3ce-tls-certs\") pod \"0787826f-5b17-497e-afcb-aa879ca6d3ce\" (UID: \"0787826f-5b17-497e-afcb-aa879ca6d3ce\") "
Jul 07 18:14:01.319123 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:01.318926    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtx8b\" (UniqueName: \"kubernetes.io/projected/0787826f-5b17-497e-afcb-aa879ca6d3ce-kube-api-access-xtx8b\") pod \"0787826f-5b17-497e-afcb-aa879ca6d3ce\" (UID: \"0787826f-5b17-497e-afcb-aa879ca6d3ce\") "
Jul 07 18:14:01.319123 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:01.318972    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0787826f-5b17-497e-afcb-aa879ca6d3ce-home\") pod \"0787826f-5b17-497e-afcb-aa879ca6d3ce\" (UID: \"0787826f-5b17-497e-afcb-aa879ca6d3ce\") "
Jul 07 18:14:01.319123 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:01.318998    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0787826f-5b17-497e-afcb-aa879ca6d3ce-model-cache\") pod \"0787826f-5b17-497e-afcb-aa879ca6d3ce\" (UID: \"0787826f-5b17-497e-afcb-aa879ca6d3ce\") "
Jul 07 18:14:01.319123 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:01.319052    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0787826f-5b17-497e-afcb-aa879ca6d3ce-tmp-dir\") pod \"0787826f-5b17-497e-afcb-aa879ca6d3ce\" (UID: \"0787826f-5b17-497e-afcb-aa879ca6d3ce\") "
Jul 07 18:14:01.319327 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:01.319236    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0787826f-5b17-497e-afcb-aa879ca6d3ce-home" (OuterVolumeSpecName: "home") pod "0787826f-5b17-497e-afcb-aa879ca6d3ce" (UID: "0787826f-5b17-497e-afcb-aa879ca6d3ce"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:14:01.319387 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:01.319316    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0787826f-5b17-497e-afcb-aa879ca6d3ce-model-cache" (OuterVolumeSpecName: "model-cache") pod "0787826f-5b17-497e-afcb-aa879ca6d3ce" (UID: "0787826f-5b17-497e-afcb-aa879ca6d3ce"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:14:01.319443 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:01.319397    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0787826f-5b17-497e-afcb-aa879ca6d3ce-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0787826f-5b17-497e-afcb-aa879ca6d3ce" (UID: "0787826f-5b17-497e-afcb-aa879ca6d3ce"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:14:01.321282 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:01.321255    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0787826f-5b17-497e-afcb-aa879ca6d3ce-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0787826f-5b17-497e-afcb-aa879ca6d3ce" (UID: "0787826f-5b17-497e-afcb-aa879ca6d3ce"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:14:01.321405 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:01.321250    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0787826f-5b17-497e-afcb-aa879ca6d3ce-dshm" (OuterVolumeSpecName: "dshm") pod "0787826f-5b17-497e-afcb-aa879ca6d3ce" (UID: "0787826f-5b17-497e-afcb-aa879ca6d3ce"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:14:01.321405 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:01.321305    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0787826f-5b17-497e-afcb-aa879ca6d3ce-kube-api-access-xtx8b" (OuterVolumeSpecName: "kube-api-access-xtx8b") pod "0787826f-5b17-497e-afcb-aa879ca6d3ce" (UID: "0787826f-5b17-497e-afcb-aa879ca6d3ce"). InnerVolumeSpecName "kube-api-access-xtx8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:14:01.391159 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:01.391122    2559 generic.go:356] "Generic (PLEG): container finished" podID="0787826f-5b17-497e-afcb-aa879ca6d3ce" containerID="e1ac90bc618bc63ffc2654ada70c2a7d14567708073a954d07a2543387555273" exitCode=0
Jul 07 18:14:01.391339 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:01.391169    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6"
Jul 07 18:14:01.391339 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:01.391205    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6" event={"ID":"0787826f-5b17-497e-afcb-aa879ca6d3ce","Type":"ContainerDied","Data":"e1ac90bc618bc63ffc2654ada70c2a7d14567708073a954d07a2543387555273"}
Jul 07 18:14:01.391339 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:01.391245    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6" event={"ID":"0787826f-5b17-497e-afcb-aa879ca6d3ce","Type":"ContainerDied","Data":"479816f0e74996f9cf6ead14008ba18beeee15508ec7e847474d0a2160e6879b"}
Jul 07 18:14:01.391339 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:01.391262    2559 scope.go:117] "RemoveContainer" containerID="e1ac90bc618bc63ffc2654ada70c2a7d14567708073a954d07a2543387555273"
Jul 07 18:14:01.400000 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:01.399982    2559 scope.go:117] "RemoveContainer" containerID="e1ac90bc618bc63ffc2654ada70c2a7d14567708073a954d07a2543387555273"
Jul 07 18:14:01.400277 ip-10-0-132-78 kubenswrapper[2559]: E0707 18:14:01.400258    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1ac90bc618bc63ffc2654ada70c2a7d14567708073a954d07a2543387555273\": container with ID starting with e1ac90bc618bc63ffc2654ada70c2a7d14567708073a954d07a2543387555273 not found: ID does not exist" containerID="e1ac90bc618bc63ffc2654ada70c2a7d14567708073a954d07a2543387555273"
Jul 07 18:14:01.400328 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:01.400286    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1ac90bc618bc63ffc2654ada70c2a7d14567708073a954d07a2543387555273"} err="failed to get container status \"e1ac90bc618bc63ffc2654ada70c2a7d14567708073a954d07a2543387555273\": rpc error: code = NotFound desc = could not find container \"e1ac90bc618bc63ffc2654ada70c2a7d14567708073a954d07a2543387555273\": container with ID starting with e1ac90bc618bc63ffc2654ada70c2a7d14567708073a954d07a2543387555273 not found: ID does not exist"
Jul 07 18:14:01.411183 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:01.411155    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6"]
Jul 07 18:14:01.412891 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:01.412869    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-f78287/auth-test-model-f78287-kserve-66fd8545bc-drwc6"]
Jul 07 18:14:01.419832 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:01.419806    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0787826f-5b17-497e-afcb-aa879ca6d3ce-tls-certs\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:14:01.419832 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:01.419831    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtx8b\" (UniqueName: \"kubernetes.io/projected/0787826f-5b17-497e-afcb-aa879ca6d3ce-kube-api-access-xtx8b\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:14:01.419929 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:01.419841    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0787826f-5b17-497e-afcb-aa879ca6d3ce-home\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:14:01.419929 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:01.419849    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0787826f-5b17-497e-afcb-aa879ca6d3ce-model-cache\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:14:01.419929 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:01.419857    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0787826f-5b17-497e-afcb-aa879ca6d3ce-tmp-dir\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:14:01.419929 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:01.419864    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0787826f-5b17-497e-afcb-aa879ca6d3ce-dshm\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:14:01.979799 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:01.979698    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n" podUID="7680ffe7-9156-41f9-86ea-0ac714cd3f32" containerName="main" containerID="cri-o://6a4192f130a328d92340248e03eb5b8572ea8c06bc286e014bfffedc4567d458" gracePeriod=45
Jul 07 18:14:02.239483 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:02.239427    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n"
Jul 07 18:14:02.327325 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:02.327295    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-db2h9\" (UniqueName: \"kubernetes.io/projected/7680ffe7-9156-41f9-86ea-0ac714cd3f32-kube-api-access-db2h9\") pod \"7680ffe7-9156-41f9-86ea-0ac714cd3f32\" (UID: \"7680ffe7-9156-41f9-86ea-0ac714cd3f32\") "
Jul 07 18:14:02.327486 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:02.327339    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7680ffe7-9156-41f9-86ea-0ac714cd3f32-dshm\") pod \"7680ffe7-9156-41f9-86ea-0ac714cd3f32\" (UID: \"7680ffe7-9156-41f9-86ea-0ac714cd3f32\") "
Jul 07 18:14:02.327529 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:02.327495    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7680ffe7-9156-41f9-86ea-0ac714cd3f32-tmp-dir\") pod \"7680ffe7-9156-41f9-86ea-0ac714cd3f32\" (UID: \"7680ffe7-9156-41f9-86ea-0ac714cd3f32\") "
Jul 07 18:14:02.327585 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:02.327573    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7680ffe7-9156-41f9-86ea-0ac714cd3f32-tls-certs\") pod \"7680ffe7-9156-41f9-86ea-0ac714cd3f32\" (UID: \"7680ffe7-9156-41f9-86ea-0ac714cd3f32\") "
Jul 07 18:14:02.327622 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:02.327597    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7680ffe7-9156-41f9-86ea-0ac714cd3f32-home\") pod \"7680ffe7-9156-41f9-86ea-0ac714cd3f32\" (UID: \"7680ffe7-9156-41f9-86ea-0ac714cd3f32\") "
Jul 07 18:14:02.327721 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:02.327669    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7680ffe7-9156-41f9-86ea-0ac714cd3f32-model-cache\") pod \"7680ffe7-9156-41f9-86ea-0ac714cd3f32\" (UID: \"7680ffe7-9156-41f9-86ea-0ac714cd3f32\") "
Jul 07 18:14:02.327779 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:02.327754    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7680ffe7-9156-41f9-86ea-0ac714cd3f32-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7680ffe7-9156-41f9-86ea-0ac714cd3f32" (UID: "7680ffe7-9156-41f9-86ea-0ac714cd3f32"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:14:02.327970 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:02.327927    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7680ffe7-9156-41f9-86ea-0ac714cd3f32-home" (OuterVolumeSpecName: "home") pod "7680ffe7-9156-41f9-86ea-0ac714cd3f32" (UID: "7680ffe7-9156-41f9-86ea-0ac714cd3f32"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:14:02.328207 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:02.328182    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7680ffe7-9156-41f9-86ea-0ac714cd3f32-model-cache" (OuterVolumeSpecName: "model-cache") pod "7680ffe7-9156-41f9-86ea-0ac714cd3f32" (UID: "7680ffe7-9156-41f9-86ea-0ac714cd3f32"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:14:02.328261 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:02.328194    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7680ffe7-9156-41f9-86ea-0ac714cd3f32-tmp-dir\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:14:02.328261 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:02.328238    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7680ffe7-9156-41f9-86ea-0ac714cd3f32-home\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:14:02.329711 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:02.329692    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7680ffe7-9156-41f9-86ea-0ac714cd3f32-kube-api-access-db2h9" (OuterVolumeSpecName: "kube-api-access-db2h9") pod "7680ffe7-9156-41f9-86ea-0ac714cd3f32" (UID: "7680ffe7-9156-41f9-86ea-0ac714cd3f32"). InnerVolumeSpecName "kube-api-access-db2h9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:14:02.329766 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:02.329726    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7680ffe7-9156-41f9-86ea-0ac714cd3f32-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7680ffe7-9156-41f9-86ea-0ac714cd3f32" (UID: "7680ffe7-9156-41f9-86ea-0ac714cd3f32"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:14:02.329766 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:02.329750    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7680ffe7-9156-41f9-86ea-0ac714cd3f32-dshm" (OuterVolumeSpecName: "dshm") pod "7680ffe7-9156-41f9-86ea-0ac714cd3f32" (UID: "7680ffe7-9156-41f9-86ea-0ac714cd3f32"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:14:02.398514 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:02.398474    2559 generic.go:356] "Generic (PLEG): container finished" podID="7680ffe7-9156-41f9-86ea-0ac714cd3f32" containerID="6a4192f130a328d92340248e03eb5b8572ea8c06bc286e014bfffedc4567d458" exitCode=0
Jul 07 18:14:02.398676 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:02.398520    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n"
Jul 07 18:14:02.398676 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:02.398555    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n" event={"ID":"7680ffe7-9156-41f9-86ea-0ac714cd3f32","Type":"ContainerDied","Data":"6a4192f130a328d92340248e03eb5b8572ea8c06bc286e014bfffedc4567d458"}
Jul 07 18:14:02.398676 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:02.398601    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n" event={"ID":"7680ffe7-9156-41f9-86ea-0ac714cd3f32","Type":"ContainerDied","Data":"22c1bad253bd1c604869be700744b0337dc080a717993b7166098f821016f084"}
Jul 07 18:14:02.398676 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:02.398620    2559 scope.go:117] "RemoveContainer" containerID="6a4192f130a328d92340248e03eb5b8572ea8c06bc286e014bfffedc4567d458"
Jul 07 18:14:02.407741 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:02.407723    2559 scope.go:117] "RemoveContainer" containerID="6a4192f130a328d92340248e03eb5b8572ea8c06bc286e014bfffedc4567d458"
Jul 07 18:14:02.408015 ip-10-0-132-78 kubenswrapper[2559]: E0707 18:14:02.407998    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a4192f130a328d92340248e03eb5b8572ea8c06bc286e014bfffedc4567d458\": container with ID starting with 6a4192f130a328d92340248e03eb5b8572ea8c06bc286e014bfffedc4567d458 not found: ID does not exist" containerID="6a4192f130a328d92340248e03eb5b8572ea8c06bc286e014bfffedc4567d458"
Jul 07 18:14:02.408060 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:02.408023    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a4192f130a328d92340248e03eb5b8572ea8c06bc286e014bfffedc4567d458"} err="failed to get container status \"6a4192f130a328d92340248e03eb5b8572ea8c06bc286e014bfffedc4567d458\": rpc error: code = NotFound desc = could not find container \"6a4192f130a328d92340248e03eb5b8572ea8c06bc286e014bfffedc4567d458\": container with ID starting with 6a4192f130a328d92340248e03eb5b8572ea8c06bc286e014bfffedc4567d458 not found: ID does not exist"
Jul 07 18:14:02.417660 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:02.417635    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n"]
Jul 07 18:14:02.421080 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:02.421051    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-5c379c/auth-test-model-5c379c-kserve-574cc79979-9bc2n"]
Jul 07 18:14:02.428651 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:02.428629    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-db2h9\" (UniqueName: \"kubernetes.io/projected/7680ffe7-9156-41f9-86ea-0ac714cd3f32-kube-api-access-db2h9\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:14:02.428721 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:02.428655    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7680ffe7-9156-41f9-86ea-0ac714cd3f32-dshm\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:14:02.428721 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:02.428665    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7680ffe7-9156-41f9-86ea-0ac714cd3f32-tls-certs\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:14:02.428721 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:02.428673    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7680ffe7-9156-41f9-86ea-0ac714cd3f32-model-cache\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:14:03.006889 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:03.006855    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0787826f-5b17-497e-afcb-aa879ca6d3ce" path="/var/lib/kubelet/pods/0787826f-5b17-497e-afcb-aa879ca6d3ce/volumes"
Jul 07 18:14:03.007333 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:03.007317    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7680ffe7-9156-41f9-86ea-0ac714cd3f32" path="/var/lib/kubelet/pods/7680ffe7-9156-41f9-86ea-0ac714cd3f32/volumes"
Jul 07 18:14:07.075859 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:07.075806    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc"
Jul 07 18:14:07.076267 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:07.076093    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc"
Jul 07 18:14:07.088396 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:07.088366    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc"
Jul 07 18:14:07.435926 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:07.435893    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc"
Jul 07 18:14:16.861066 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:16.861024    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:17.659115 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:17.659082    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g"]
Jul 07 18:14:17.659463 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:17.659447    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7680ffe7-9156-41f9-86ea-0ac714cd3f32" containerName="main"
Jul 07 18:14:17.659463 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:17.659462    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7680ffe7-9156-41f9-86ea-0ac714cd3f32" containerName="main"
Jul 07 18:14:17.659604 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:17.659476    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0787826f-5b17-497e-afcb-aa879ca6d3ce" containerName="main"
Jul 07 18:14:17.659604 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:17.659482    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0787826f-5b17-497e-afcb-aa879ca6d3ce" containerName="main"
Jul 07 18:14:17.659604 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:17.659537    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7680ffe7-9156-41f9-86ea-0ac714cd3f32" containerName="main"
Jul 07 18:14:17.659604 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:17.659545    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0787826f-5b17-497e-afcb-aa879ca6d3ce" containerName="main"
Jul 07 18:14:17.662199 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:17.662180    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g"
Jul 07 18:14:17.665568 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:17.665537    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5c379c\"/\"default-dockercfg-stjd4\""
Jul 07 18:14:17.665683 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:17.665571    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5c379c\"/\"openshift-service-ca.crt\""
Jul 07 18:14:17.665683 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:17.665605    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5c379c\"/\"kube-root-ca.crt\""
Jul 07 18:14:17.665980 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:17.665946    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5c379c\"/\"sub-test-model-5c379c-kserve-self-signed-certs\""
Jul 07 18:14:17.672174 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:17.672152    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g"]
Jul 07 18:14:17.689477 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:17.689447    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:17.770947 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:17.770902    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98ad589a-7b19-46c9-89fe-90bd9ece51c7-dshm\") pod \"sub-test-model-5c379c-kserve-554cfb89ff-2ph5g\" (UID: \"98ad589a-7b19-46c9-89fe-90bd9ece51c7\") " pod="ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g"
Jul 07 18:14:17.771155 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:17.770997    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98ad589a-7b19-46c9-89fe-90bd9ece51c7-tls-certs\") pod \"sub-test-model-5c379c-kserve-554cfb89ff-2ph5g\" (UID: \"98ad589a-7b19-46c9-89fe-90bd9ece51c7\") " pod="ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g"
Jul 07 18:14:17.771155 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:17.771024    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98ad589a-7b19-46c9-89fe-90bd9ece51c7-model-cache\") pod \"sub-test-model-5c379c-kserve-554cfb89ff-2ph5g\" (UID: \"98ad589a-7b19-46c9-89fe-90bd9ece51c7\") " pod="ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g"
Jul 07 18:14:17.771155 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:17.771052    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drzdw\" (UniqueName: \"kubernetes.io/projected/98ad589a-7b19-46c9-89fe-90bd9ece51c7-kube-api-access-drzdw\") pod \"sub-test-model-5c379c-kserve-554cfb89ff-2ph5g\" (UID: \"98ad589a-7b19-46c9-89fe-90bd9ece51c7\") " pod="ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g"
Jul 07 18:14:17.771155 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:17.771102    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98ad589a-7b19-46c9-89fe-90bd9ece51c7-home\") pod \"sub-test-model-5c379c-kserve-554cfb89ff-2ph5g\" (UID: \"98ad589a-7b19-46c9-89fe-90bd9ece51c7\") " pod="ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g"
Jul 07 18:14:17.771318 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:17.771156    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98ad589a-7b19-46c9-89fe-90bd9ece51c7-tmp-dir\") pod \"sub-test-model-5c379c-kserve-554cfb89ff-2ph5g\" (UID: \"98ad589a-7b19-46c9-89fe-90bd9ece51c7\") " pod="ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g"
Jul 07 18:14:17.872549 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:17.872508    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98ad589a-7b19-46c9-89fe-90bd9ece51c7-tmp-dir\") pod \"sub-test-model-5c379c-kserve-554cfb89ff-2ph5g\" (UID: \"98ad589a-7b19-46c9-89fe-90bd9ece51c7\") " pod="ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g"
Jul 07 18:14:17.873042 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:17.872579    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98ad589a-7b19-46c9-89fe-90bd9ece51c7-dshm\") pod \"sub-test-model-5c379c-kserve-554cfb89ff-2ph5g\" (UID: \"98ad589a-7b19-46c9-89fe-90bd9ece51c7\") " pod="ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g"
Jul 07 18:14:17.873042 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:17.872612    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98ad589a-7b19-46c9-89fe-90bd9ece51c7-tls-certs\") pod \"sub-test-model-5c379c-kserve-554cfb89ff-2ph5g\" (UID: \"98ad589a-7b19-46c9-89fe-90bd9ece51c7\") " pod="ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g"
Jul 07 18:14:17.873042 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:17.872638    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98ad589a-7b19-46c9-89fe-90bd9ece51c7-model-cache\") pod \"sub-test-model-5c379c-kserve-554cfb89ff-2ph5g\" (UID: \"98ad589a-7b19-46c9-89fe-90bd9ece51c7\") " pod="ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g"
Jul 07 18:14:17.873042 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:17.872672    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drzdw\" (UniqueName: \"kubernetes.io/projected/98ad589a-7b19-46c9-89fe-90bd9ece51c7-kube-api-access-drzdw\") pod \"sub-test-model-5c379c-kserve-554cfb89ff-2ph5g\" (UID: \"98ad589a-7b19-46c9-89fe-90bd9ece51c7\") " pod="ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g"
Jul 07 18:14:17.873042 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:17.872715    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98ad589a-7b19-46c9-89fe-90bd9ece51c7-home\") pod \"sub-test-model-5c379c-kserve-554cfb89ff-2ph5g\" (UID: \"98ad589a-7b19-46c9-89fe-90bd9ece51c7\") " pod="ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g"
Jul 07 18:14:17.873042 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:17.873007    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98ad589a-7b19-46c9-89fe-90bd9ece51c7-tmp-dir\") pod \"sub-test-model-5c379c-kserve-554cfb89ff-2ph5g\" (UID: \"98ad589a-7b19-46c9-89fe-90bd9ece51c7\") " pod="ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g"
Jul 07 18:14:17.873347 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:17.873046    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98ad589a-7b19-46c9-89fe-90bd9ece51c7-model-cache\") pod \"sub-test-model-5c379c-kserve-554cfb89ff-2ph5g\" (UID: \"98ad589a-7b19-46c9-89fe-90bd9ece51c7\") " pod="ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g"
Jul 07 18:14:17.873347 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:17.873176    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98ad589a-7b19-46c9-89fe-90bd9ece51c7-home\") pod \"sub-test-model-5c379c-kserve-554cfb89ff-2ph5g\" (UID: \"98ad589a-7b19-46c9-89fe-90bd9ece51c7\") " pod="ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g"
Jul 07 18:14:17.875169 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:17.875149    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98ad589a-7b19-46c9-89fe-90bd9ece51c7-dshm\") pod \"sub-test-model-5c379c-kserve-554cfb89ff-2ph5g\" (UID: \"98ad589a-7b19-46c9-89fe-90bd9ece51c7\") " pod="ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g"
Jul 07 18:14:17.875267 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:17.875252    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98ad589a-7b19-46c9-89fe-90bd9ece51c7-tls-certs\") pod \"sub-test-model-5c379c-kserve-554cfb89ff-2ph5g\" (UID: \"98ad589a-7b19-46c9-89fe-90bd9ece51c7\") " pod="ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g"
Jul 07 18:14:17.880611 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:17.880593    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drzdw\" (UniqueName: \"kubernetes.io/projected/98ad589a-7b19-46c9-89fe-90bd9ece51c7-kube-api-access-drzdw\") pod \"sub-test-model-5c379c-kserve-554cfb89ff-2ph5g\" (UID: \"98ad589a-7b19-46c9-89fe-90bd9ece51c7\") " pod="ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g"
Jul 07 18:14:17.972618 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:17.972525    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g"
Jul 07 18:14:18.110806 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:18.110781    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g"]
Jul 07 18:14:18.112893 ip-10-0-132-78 kubenswrapper[2559]: W0707 18:14:18.112866    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod98ad589a_7b19_46c9_89fe_90bd9ece51c7.slice/crio-31fe7cfbf604e348931b6f360ae202ed764b154794e0d4a4cf3e945ebf1c7e94 WatchSource:0}: Error finding container 31fe7cfbf604e348931b6f360ae202ed764b154794e0d4a4cf3e945ebf1c7e94: Status 404 returned error can't find the container with id 31fe7cfbf604e348931b6f360ae202ed764b154794e0d4a4cf3e945ebf1c7e94
Jul 07 18:14:18.474929 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:18.474896    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g" event={"ID":"98ad589a-7b19-46c9-89fe-90bd9ece51c7","Type":"ContainerStarted","Data":"b9d36df019b408de311b60d8b20f44ddd504e7d68f00e6478bd13f1d7690c0cc"}
Jul 07 18:14:18.474929 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:18.474937    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g" event={"ID":"98ad589a-7b19-46c9-89fe-90bd9ece51c7","Type":"ContainerStarted","Data":"31fe7cfbf604e348931b6f360ae202ed764b154794e0d4a4cf3e945ebf1c7e94"}
Jul 07 18:14:18.492597 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:18.492546    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g" podStartSLOduration=1.492532133 podStartE2EDuration="1.492532133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:14:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:14:18.490488612 +0000 UTC m=+2258.005718951" watchObservedRunningTime="2026-07-07 18:14:18.492532133 +0000 UTC m=+2258.007762469"
Jul 07 18:14:27.973639 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:27.973585    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g"
Jul 07 18:14:27.974072 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:27.973652    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g"
Jul 07 18:14:27.986067 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:27.986040    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g"
Jul 07 18:14:28.535915 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:28.535882    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g"
Jul 07 18:14:58.540078 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:58.540040    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc"]
Jul 07 18:14:58.559665 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:58.559610    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:59.460755 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:59.460719    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g"]
Jul 07 18:14:59.488568 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:14:59.488528    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:06.353846 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:06.353816    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf"]
Jul 07 18:15:06.357227 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:06.357209    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf"
Jul 07 18:15:06.359780 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:06.359757    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f78287\"/\"rate-test-model-f78287-kserve-self-signed-certs\""
Jul 07 18:15:06.366861 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:06.366837    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf"]
Jul 07 18:15:06.381689 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:06.381652    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:06.526380 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:06.526348    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbjsh\" (UniqueName: \"kubernetes.io/projected/c3a56c65-3f39-4f01-9091-d2b5eea0afef-kube-api-access-wbjsh\") pod \"rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf\" (UID: \"c3a56c65-3f39-4f01-9091-d2b5eea0afef\") " pod="ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf"
Jul 07 18:15:06.526380 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:06.526390    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3a56c65-3f39-4f01-9091-d2b5eea0afef-home\") pod \"rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf\" (UID: \"c3a56c65-3f39-4f01-9091-d2b5eea0afef\") " pod="ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf"
Jul 07 18:15:06.526620 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:06.526421    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3a56c65-3f39-4f01-9091-d2b5eea0afef-dshm\") pod \"rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf\" (UID: \"c3a56c65-3f39-4f01-9091-d2b5eea0afef\") " pod="ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf"
Jul 07 18:15:06.526620 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:06.526463    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3a56c65-3f39-4f01-9091-d2b5eea0afef-model-cache\") pod \"rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf\" (UID: \"c3a56c65-3f39-4f01-9091-d2b5eea0afef\") " pod="ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf"
Jul 07 18:15:06.526620 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:06.526483    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3a56c65-3f39-4f01-9091-d2b5eea0afef-tmp-dir\") pod \"rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf\" (UID: \"c3a56c65-3f39-4f01-9091-d2b5eea0afef\") " pod="ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf"
Jul 07 18:15:06.526620 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:06.526508    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3a56c65-3f39-4f01-9091-d2b5eea0afef-tls-certs\") pod \"rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf\" (UID: \"c3a56c65-3f39-4f01-9091-d2b5eea0afef\") " pod="ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf"
Jul 07 18:15:06.627398 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:06.627359    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbjsh\" (UniqueName: \"kubernetes.io/projected/c3a56c65-3f39-4f01-9091-d2b5eea0afef-kube-api-access-wbjsh\") pod \"rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf\" (UID: \"c3a56c65-3f39-4f01-9091-d2b5eea0afef\") " pod="ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf"
Jul 07 18:15:06.627398 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:06.627405    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3a56c65-3f39-4f01-9091-d2b5eea0afef-home\") pod \"rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf\" (UID: \"c3a56c65-3f39-4f01-9091-d2b5eea0afef\") " pod="ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf"
Jul 07 18:15:06.627618 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:06.627506    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3a56c65-3f39-4f01-9091-d2b5eea0afef-dshm\") pod \"rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf\" (UID: \"c3a56c65-3f39-4f01-9091-d2b5eea0afef\") " pod="ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf"
Jul 07 18:15:06.627618 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:06.627589    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3a56c65-3f39-4f01-9091-d2b5eea0afef-model-cache\") pod \"rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf\" (UID: \"c3a56c65-3f39-4f01-9091-d2b5eea0afef\") " pod="ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf"
Jul 07 18:15:06.627728 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:06.627627    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3a56c65-3f39-4f01-9091-d2b5eea0afef-tmp-dir\") pod \"rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf\" (UID: \"c3a56c65-3f39-4f01-9091-d2b5eea0afef\") " pod="ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf"
Jul 07 18:15:06.627728 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:06.627672    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3a56c65-3f39-4f01-9091-d2b5eea0afef-tls-certs\") pod \"rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf\" (UID: \"c3a56c65-3f39-4f01-9091-d2b5eea0afef\") " pod="ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf"
Jul 07 18:15:06.627858 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:06.627836    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3a56c65-3f39-4f01-9091-d2b5eea0afef-home\") pod \"rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf\" (UID: \"c3a56c65-3f39-4f01-9091-d2b5eea0afef\") " pod="ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf"
Jul 07 18:15:06.627989 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:06.627970    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3a56c65-3f39-4f01-9091-d2b5eea0afef-model-cache\") pod \"rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf\" (UID: \"c3a56c65-3f39-4f01-9091-d2b5eea0afef\") " pod="ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf"
Jul 07 18:15:06.628057 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:06.628028    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3a56c65-3f39-4f01-9091-d2b5eea0afef-tmp-dir\") pod \"rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf\" (UID: \"c3a56c65-3f39-4f01-9091-d2b5eea0afef\") " pod="ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf"
Jul 07 18:15:06.629878 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:06.629849    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3a56c65-3f39-4f01-9091-d2b5eea0afef-dshm\") pod \"rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf\" (UID: \"c3a56c65-3f39-4f01-9091-d2b5eea0afef\") " pod="ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf"
Jul 07 18:15:06.630300 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:06.630280    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3a56c65-3f39-4f01-9091-d2b5eea0afef-tls-certs\") pod \"rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf\" (UID: \"c3a56c65-3f39-4f01-9091-d2b5eea0afef\") " pod="ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf"
Jul 07 18:15:06.634870 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:06.634846    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbjsh\" (UniqueName: \"kubernetes.io/projected/c3a56c65-3f39-4f01-9091-d2b5eea0afef-kube-api-access-wbjsh\") pod \"rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf\" (UID: \"c3a56c65-3f39-4f01-9091-d2b5eea0afef\") " pod="ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf"
Jul 07 18:15:06.667939 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:06.667903    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf"
Jul 07 18:15:06.808064 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:06.808039    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf"]
Jul 07 18:15:06.809948 ip-10-0-132-78 kubenswrapper[2559]: W0707 18:15:06.809923    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3a56c65_3f39_4f01_9091_d2b5eea0afef.slice/crio-8f354b0c3d441fc3e5dd946a18bc20de8509346c48d550e0fb9cf71c10cc8d21 WatchSource:0}: Error finding container 8f354b0c3d441fc3e5dd946a18bc20de8509346c48d550e0fb9cf71c10cc8d21: Status 404 returned error can't find the container with id 8f354b0c3d441fc3e5dd946a18bc20de8509346c48d550e0fb9cf71c10cc8d21
Jul 07 18:15:07.712022 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:07.711988    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf" event={"ID":"c3a56c65-3f39-4f01-9091-d2b5eea0afef","Type":"ContainerStarted","Data":"441301ed5b8fcd8317a6e7c57bdc0d25a9b1118799ac1c6f29a37a7b915414a0"}
Jul 07 18:15:07.712419 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:07.712030    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf" event={"ID":"c3a56c65-3f39-4f01-9091-d2b5eea0afef","Type":"ContainerStarted","Data":"8f354b0c3d441fc3e5dd946a18bc20de8509346c48d550e0fb9cf71c10cc8d21"}
Jul 07 18:15:07.729756 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:07.729707    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf" podStartSLOduration=1.7296917569999999 podStartE2EDuration="1.729691757s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:15:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:15:07.727699637 +0000 UTC m=+2307.242929974" watchObservedRunningTime="2026-07-07 18:15:07.729691757 +0000 UTC m=+2307.244922093"
Jul 07 18:15:10.125975 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:10.125934    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:13.561194 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:13.561153    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc" podUID="53cc667e-978c-4671-b9ad-b1520fd01033" containerName="main" containerID="cri-o://57c44445be0318a9bff76510201f62b665e14fbe546a921ab7cc815c03653c33" gracePeriod=45
Jul 07 18:15:13.743786 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:13.743756    2559 generic.go:356] "Generic (PLEG): container finished" podID="53cc667e-978c-4671-b9ad-b1520fd01033" containerID="57c44445be0318a9bff76510201f62b665e14fbe546a921ab7cc815c03653c33" exitCode=0
Jul 07 18:15:13.743918 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:13.743796    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc" event={"ID":"53cc667e-978c-4671-b9ad-b1520fd01033","Type":"ContainerDied","Data":"57c44445be0318a9bff76510201f62b665e14fbe546a921ab7cc815c03653c33"}
Jul 07 18:15:13.819365 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:13.819310    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc"
Jul 07 18:15:13.892870 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:13.892839    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53cc667e-978c-4671-b9ad-b1520fd01033-dshm\") pod \"53cc667e-978c-4671-b9ad-b1520fd01033\" (UID: \"53cc667e-978c-4671-b9ad-b1520fd01033\") "
Jul 07 18:15:13.893094 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:13.892896    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53cc667e-978c-4671-b9ad-b1520fd01033-model-cache\") pod \"53cc667e-978c-4671-b9ad-b1520fd01033\" (UID: \"53cc667e-978c-4671-b9ad-b1520fd01033\") "
Jul 07 18:15:13.893094 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:13.892927    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8cn2\" (UniqueName: \"kubernetes.io/projected/53cc667e-978c-4671-b9ad-b1520fd01033-kube-api-access-s8cn2\") pod \"53cc667e-978c-4671-b9ad-b1520fd01033\" (UID: \"53cc667e-978c-4671-b9ad-b1520fd01033\") "
Jul 07 18:15:13.893094 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:13.892996    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53cc667e-978c-4671-b9ad-b1520fd01033-tmp-dir\") pod \"53cc667e-978c-4671-b9ad-b1520fd01033\" (UID: \"53cc667e-978c-4671-b9ad-b1520fd01033\") "
Jul 07 18:15:13.893094 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:13.893042    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53cc667e-978c-4671-b9ad-b1520fd01033-tls-certs\") pod \"53cc667e-978c-4671-b9ad-b1520fd01033\" (UID: \"53cc667e-978c-4671-b9ad-b1520fd01033\") "
Jul 07 18:15:13.893374 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:13.893096    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53cc667e-978c-4671-b9ad-b1520fd01033-home\") pod \"53cc667e-978c-4671-b9ad-b1520fd01033\" (UID: \"53cc667e-978c-4671-b9ad-b1520fd01033\") "
Jul 07 18:15:13.893374 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:13.893231    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53cc667e-978c-4671-b9ad-b1520fd01033-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "53cc667e-978c-4671-b9ad-b1520fd01033" (UID: "53cc667e-978c-4671-b9ad-b1520fd01033"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:15:13.893374 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:13.893247    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53cc667e-978c-4671-b9ad-b1520fd01033-model-cache" (OuterVolumeSpecName: "model-cache") pod "53cc667e-978c-4671-b9ad-b1520fd01033" (UID: "53cc667e-978c-4671-b9ad-b1520fd01033"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:15:13.893506 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:13.893374    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53cc667e-978c-4671-b9ad-b1520fd01033-home" (OuterVolumeSpecName: "home") pod "53cc667e-978c-4671-b9ad-b1520fd01033" (UID: "53cc667e-978c-4671-b9ad-b1520fd01033"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:15:13.893506 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:13.893396    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53cc667e-978c-4671-b9ad-b1520fd01033-model-cache\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:15:13.893506 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:13.893423    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53cc667e-978c-4671-b9ad-b1520fd01033-tmp-dir\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:15:13.895056 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:13.895022    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53cc667e-978c-4671-b9ad-b1520fd01033-dshm" (OuterVolumeSpecName: "dshm") pod "53cc667e-978c-4671-b9ad-b1520fd01033" (UID: "53cc667e-978c-4671-b9ad-b1520fd01033"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:15:13.895223 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:13.895203    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53cc667e-978c-4671-b9ad-b1520fd01033-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "53cc667e-978c-4671-b9ad-b1520fd01033" (UID: "53cc667e-978c-4671-b9ad-b1520fd01033"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:15:13.895314 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:13.895296    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53cc667e-978c-4671-b9ad-b1520fd01033-kube-api-access-s8cn2" (OuterVolumeSpecName: "kube-api-access-s8cn2") pod "53cc667e-978c-4671-b9ad-b1520fd01033" (UID: "53cc667e-978c-4671-b9ad-b1520fd01033"). InnerVolumeSpecName "kube-api-access-s8cn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:15:13.994247 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:13.994213    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53cc667e-978c-4671-b9ad-b1520fd01033-home\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:15:13.994247 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:13.994242    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53cc667e-978c-4671-b9ad-b1520fd01033-dshm\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:15:13.994247 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:13.994251    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8cn2\" (UniqueName: \"kubernetes.io/projected/53cc667e-978c-4671-b9ad-b1520fd01033-kube-api-access-s8cn2\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:15:13.994477 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:13.994261    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53cc667e-978c-4671-b9ad-b1520fd01033-tls-certs\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:15:14.482630 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:14.482586    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g" podUID="98ad589a-7b19-46c9-89fe-90bd9ece51c7" containerName="main" containerID="cri-o://b9d36df019b408de311b60d8b20f44ddd504e7d68f00e6478bd13f1d7690c0cc" gracePeriod=45
Jul 07 18:15:14.746364 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:14.746287    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g"
Jul 07 18:15:14.748675 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:14.748650    2559 generic.go:356] "Generic (PLEG): container finished" podID="98ad589a-7b19-46c9-89fe-90bd9ece51c7" containerID="b9d36df019b408de311b60d8b20f44ddd504e7d68f00e6478bd13f1d7690c0cc" exitCode=0
Jul 07 18:15:14.748779 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:14.748686    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g"
Jul 07 18:15:14.748779 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:14.748723    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g" event={"ID":"98ad589a-7b19-46c9-89fe-90bd9ece51c7","Type":"ContainerDied","Data":"b9d36df019b408de311b60d8b20f44ddd504e7d68f00e6478bd13f1d7690c0cc"}
Jul 07 18:15:14.748779 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:14.748766    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g" event={"ID":"98ad589a-7b19-46c9-89fe-90bd9ece51c7","Type":"ContainerDied","Data":"31fe7cfbf604e348931b6f360ae202ed764b154794e0d4a4cf3e945ebf1c7e94"}
Jul 07 18:15:14.748918 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:14.748785    2559 scope.go:117] "RemoveContainer" containerID="b9d36df019b408de311b60d8b20f44ddd504e7d68f00e6478bd13f1d7690c0cc"
Jul 07 18:15:14.750061 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:14.750046    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc"
Jul 07 18:15:14.750147 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:14.750046    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc" event={"ID":"53cc667e-978c-4671-b9ad-b1520fd01033","Type":"ContainerDied","Data":"5159fc04ba64fe4d14f0472720041934057c9200ccd5da5e4412aa085009185b"}
Jul 07 18:15:14.759297 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:14.759280    2559 scope.go:117] "RemoveContainer" containerID="b9d36df019b408de311b60d8b20f44ddd504e7d68f00e6478bd13f1d7690c0cc"
Jul 07 18:15:14.759572 ip-10-0-132-78 kubenswrapper[2559]: E0707 18:15:14.759553    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9d36df019b408de311b60d8b20f44ddd504e7d68f00e6478bd13f1d7690c0cc\": container with ID starting with b9d36df019b408de311b60d8b20f44ddd504e7d68f00e6478bd13f1d7690c0cc not found: ID does not exist" containerID="b9d36df019b408de311b60d8b20f44ddd504e7d68f00e6478bd13f1d7690c0cc"
Jul 07 18:15:14.759623 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:14.759581    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9d36df019b408de311b60d8b20f44ddd504e7d68f00e6478bd13f1d7690c0cc"} err="failed to get container status \"b9d36df019b408de311b60d8b20f44ddd504e7d68f00e6478bd13f1d7690c0cc\": rpc error: code = NotFound desc = could not find container \"b9d36df019b408de311b60d8b20f44ddd504e7d68f00e6478bd13f1d7690c0cc\": container with ID starting with b9d36df019b408de311b60d8b20f44ddd504e7d68f00e6478bd13f1d7690c0cc not found: ID does not exist"
Jul 07 18:15:14.759623 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:14.759600    2559 scope.go:117] "RemoveContainer" containerID="57c44445be0318a9bff76510201f62b665e14fbe546a921ab7cc815c03653c33"
Jul 07 18:15:14.774206 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:14.774178    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc"]
Jul 07 18:15:14.777183 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:14.777160    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-f78287/sub-test-model-f78287-kserve-5fdc8458ff-qf2wc"]
Jul 07 18:15:14.801073 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:14.801038    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drzdw\" (UniqueName: \"kubernetes.io/projected/98ad589a-7b19-46c9-89fe-90bd9ece51c7-kube-api-access-drzdw\") pod \"98ad589a-7b19-46c9-89fe-90bd9ece51c7\" (UID: \"98ad589a-7b19-46c9-89fe-90bd9ece51c7\") "
Jul 07 18:15:14.801221 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:14.801081    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98ad589a-7b19-46c9-89fe-90bd9ece51c7-tmp-dir\") pod \"98ad589a-7b19-46c9-89fe-90bd9ece51c7\" (UID: \"98ad589a-7b19-46c9-89fe-90bd9ece51c7\") "
Jul 07 18:15:14.801221 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:14.801110    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98ad589a-7b19-46c9-89fe-90bd9ece51c7-home\") pod \"98ad589a-7b19-46c9-89fe-90bd9ece51c7\" (UID: \"98ad589a-7b19-46c9-89fe-90bd9ece51c7\") "
Jul 07 18:15:14.801221 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:14.801149    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98ad589a-7b19-46c9-89fe-90bd9ece51c7-tls-certs\") pod \"98ad589a-7b19-46c9-89fe-90bd9ece51c7\" (UID: \"98ad589a-7b19-46c9-89fe-90bd9ece51c7\") "
Jul 07 18:15:14.801221 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:14.801172    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98ad589a-7b19-46c9-89fe-90bd9ece51c7-model-cache\") pod \"98ad589a-7b19-46c9-89fe-90bd9ece51c7\" (UID: \"98ad589a-7b19-46c9-89fe-90bd9ece51c7\") "
Jul 07 18:15:14.801221 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:14.801189    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98ad589a-7b19-46c9-89fe-90bd9ece51c7-dshm\") pod \"98ad589a-7b19-46c9-89fe-90bd9ece51c7\" (UID: \"98ad589a-7b19-46c9-89fe-90bd9ece51c7\") "
Jul 07 18:15:14.801479 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:14.801425    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98ad589a-7b19-46c9-89fe-90bd9ece51c7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "98ad589a-7b19-46c9-89fe-90bd9ece51c7" (UID: "98ad589a-7b19-46c9-89fe-90bd9ece51c7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:15:14.801479 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:14.801451    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98ad589a-7b19-46c9-89fe-90bd9ece51c7-model-cache" (OuterVolumeSpecName: "model-cache") pod "98ad589a-7b19-46c9-89fe-90bd9ece51c7" (UID: "98ad589a-7b19-46c9-89fe-90bd9ece51c7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:15:14.801479 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:14.801464    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98ad589a-7b19-46c9-89fe-90bd9ece51c7-home" (OuterVolumeSpecName: "home") pod "98ad589a-7b19-46c9-89fe-90bd9ece51c7" (UID: "98ad589a-7b19-46c9-89fe-90bd9ece51c7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:15:14.803379 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:14.803354    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98ad589a-7b19-46c9-89fe-90bd9ece51c7-dshm" (OuterVolumeSpecName: "dshm") pod "98ad589a-7b19-46c9-89fe-90bd9ece51c7" (UID: "98ad589a-7b19-46c9-89fe-90bd9ece51c7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:15:14.803477 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:14.803422    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98ad589a-7b19-46c9-89fe-90bd9ece51c7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "98ad589a-7b19-46c9-89fe-90bd9ece51c7" (UID: "98ad589a-7b19-46c9-89fe-90bd9ece51c7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:15:14.803477 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:14.803435    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98ad589a-7b19-46c9-89fe-90bd9ece51c7-kube-api-access-drzdw" (OuterVolumeSpecName: "kube-api-access-drzdw") pod "98ad589a-7b19-46c9-89fe-90bd9ece51c7" (UID: "98ad589a-7b19-46c9-89fe-90bd9ece51c7"). InnerVolumeSpecName "kube-api-access-drzdw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:15:14.902179 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:14.902144    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drzdw\" (UniqueName: \"kubernetes.io/projected/98ad589a-7b19-46c9-89fe-90bd9ece51c7-kube-api-access-drzdw\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:15:14.902179 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:14.902174    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98ad589a-7b19-46c9-89fe-90bd9ece51c7-tmp-dir\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:15:14.902179 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:14.902185    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98ad589a-7b19-46c9-89fe-90bd9ece51c7-home\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:15:14.902420 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:14.902194    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98ad589a-7b19-46c9-89fe-90bd9ece51c7-tls-certs\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:15:14.902420 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:14.902204    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98ad589a-7b19-46c9-89fe-90bd9ece51c7-model-cache\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:15:14.902420 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:14.902211    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98ad589a-7b19-46c9-89fe-90bd9ece51c7-dshm\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:15:15.007366 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:15.007289    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53cc667e-978c-4671-b9ad-b1520fd01033" path="/var/lib/kubelet/pods/53cc667e-978c-4671-b9ad-b1520fd01033/volumes"
Jul 07 18:15:15.063619 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:15.063594    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g"]
Jul 07 18:15:15.067140 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:15.067116    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-5c379c/sub-test-model-5c379c-kserve-554cfb89ff-2ph5g"]
Jul 07 18:15:16.668085 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:16.668041    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf"
Jul 07 18:15:16.668085 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:16.668093    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf"
Jul 07 18:15:16.680676 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:16.680648    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf"
Jul 07 18:15:16.771717 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:16.771691    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf"
Jul 07 18:15:17.007382 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:17.007302    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98ad589a-7b19-46c9-89fe-90bd9ece51c7" path="/var/lib/kubelet/pods/98ad589a-7b19-46c9-89fe-90bd9ece51c7/volumes"
Jul 07 18:15:20.245670 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:20.245625    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:21.830723 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:21.830685    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:32.855458 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:32.855366    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st"]
Jul 07 18:15:32.858048 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:32.856081    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53cc667e-978c-4671-b9ad-b1520fd01033" containerName="main"
Jul 07 18:15:32.858048 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:32.856098    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="53cc667e-978c-4671-b9ad-b1520fd01033" containerName="main"
Jul 07 18:15:32.858048 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:32.856110    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98ad589a-7b19-46c9-89fe-90bd9ece51c7" containerName="main"
Jul 07 18:15:32.858048 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:32.856116    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="98ad589a-7b19-46c9-89fe-90bd9ece51c7" containerName="main"
Jul 07 18:15:32.858048 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:32.856190    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="53cc667e-978c-4671-b9ad-b1520fd01033" containerName="main"
Jul 07 18:15:32.858048 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:32.856201    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="98ad589a-7b19-46c9-89fe-90bd9ece51c7" containerName="main"
Jul 07 18:15:32.859057 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:32.859028    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st"
Jul 07 18:15:32.862361 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:32.862337    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5c379c\"/\"openshift-service-ca.crt\""
Jul 07 18:15:32.862487 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:32.862363    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5c379c\"/\"default-dockercfg-stjd4\""
Jul 07 18:15:32.862487 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:32.862446    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5c379c\"/\"rate-test-model-5c379c-kserve-self-signed-certs\""
Jul 07 18:15:32.862487 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:32.862444    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5c379c\"/\"kube-root-ca.crt\""
Jul 07 18:15:32.866591 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:32.866565    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st"]
Jul 07 18:15:32.882669 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:32.882618    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:32.963703 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:32.963669    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee42fa8e-be02-4de7-8cc9-035d0a17977c-tmp-dir\") pod \"rate-test-model-5c379c-kserve-597ddc7555-8d8st\" (UID: \"ee42fa8e-be02-4de7-8cc9-035d0a17977c\") " pod="ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st"
Jul 07 18:15:32.963878 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:32.963713    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee42fa8e-be02-4de7-8cc9-035d0a17977c-model-cache\") pod \"rate-test-model-5c379c-kserve-597ddc7555-8d8st\" (UID: \"ee42fa8e-be02-4de7-8cc9-035d0a17977c\") " pod="ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st"
Jul 07 18:15:32.963878 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:32.963739    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee42fa8e-be02-4de7-8cc9-035d0a17977c-home\") pod \"rate-test-model-5c379c-kserve-597ddc7555-8d8st\" (UID: \"ee42fa8e-be02-4de7-8cc9-035d0a17977c\") " pod="ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st"
Jul 07 18:15:32.963878 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:32.963755    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee42fa8e-be02-4de7-8cc9-035d0a17977c-dshm\") pod \"rate-test-model-5c379c-kserve-597ddc7555-8d8st\" (UID: \"ee42fa8e-be02-4de7-8cc9-035d0a17977c\") " pod="ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st"
Jul 07 18:15:32.963878 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:32.963813    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj6tx\" (UniqueName: \"kubernetes.io/projected/ee42fa8e-be02-4de7-8cc9-035d0a17977c-kube-api-access-mj6tx\") pod \"rate-test-model-5c379c-kserve-597ddc7555-8d8st\" (UID: \"ee42fa8e-be02-4de7-8cc9-035d0a17977c\") " pod="ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st"
Jul 07 18:15:32.964145 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:32.963899    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee42fa8e-be02-4de7-8cc9-035d0a17977c-tls-certs\") pod \"rate-test-model-5c379c-kserve-597ddc7555-8d8st\" (UID: \"ee42fa8e-be02-4de7-8cc9-035d0a17977c\") " pod="ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st"
Jul 07 18:15:33.064590 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:33.064548    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee42fa8e-be02-4de7-8cc9-035d0a17977c-home\") pod \"rate-test-model-5c379c-kserve-597ddc7555-8d8st\" (UID: \"ee42fa8e-be02-4de7-8cc9-035d0a17977c\") " pod="ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st"
Jul 07 18:15:33.064590 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:33.064591    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee42fa8e-be02-4de7-8cc9-035d0a17977c-dshm\") pod \"rate-test-model-5c379c-kserve-597ddc7555-8d8st\" (UID: \"ee42fa8e-be02-4de7-8cc9-035d0a17977c\") " pod="ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st"
Jul 07 18:15:33.064847 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:33.064705    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj6tx\" (UniqueName: \"kubernetes.io/projected/ee42fa8e-be02-4de7-8cc9-035d0a17977c-kube-api-access-mj6tx\") pod \"rate-test-model-5c379c-kserve-597ddc7555-8d8st\" (UID: \"ee42fa8e-be02-4de7-8cc9-035d0a17977c\") " pod="ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st"
Jul 07 18:15:33.064847 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:33.064773    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee42fa8e-be02-4de7-8cc9-035d0a17977c-tls-certs\") pod \"rate-test-model-5c379c-kserve-597ddc7555-8d8st\" (UID: \"ee42fa8e-be02-4de7-8cc9-035d0a17977c\") " pod="ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st"
Jul 07 18:15:33.064847 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:33.064833    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee42fa8e-be02-4de7-8cc9-035d0a17977c-tmp-dir\") pod \"rate-test-model-5c379c-kserve-597ddc7555-8d8st\" (UID: \"ee42fa8e-be02-4de7-8cc9-035d0a17977c\") " pod="ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st"
Jul 07 18:15:33.065038 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:33.064887    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee42fa8e-be02-4de7-8cc9-035d0a17977c-model-cache\") pod \"rate-test-model-5c379c-kserve-597ddc7555-8d8st\" (UID: \"ee42fa8e-be02-4de7-8cc9-035d0a17977c\") " pod="ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st"
Jul 07 18:15:33.065038 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:33.064902    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee42fa8e-be02-4de7-8cc9-035d0a17977c-home\") pod \"rate-test-model-5c379c-kserve-597ddc7555-8d8st\" (UID: \"ee42fa8e-be02-4de7-8cc9-035d0a17977c\") " pod="ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st"
Jul 07 18:15:33.065278 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:33.065256    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee42fa8e-be02-4de7-8cc9-035d0a17977c-model-cache\") pod \"rate-test-model-5c379c-kserve-597ddc7555-8d8st\" (UID: \"ee42fa8e-be02-4de7-8cc9-035d0a17977c\") " pod="ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st"
Jul 07 18:15:33.065349 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:33.065267    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee42fa8e-be02-4de7-8cc9-035d0a17977c-tmp-dir\") pod \"rate-test-model-5c379c-kserve-597ddc7555-8d8st\" (UID: \"ee42fa8e-be02-4de7-8cc9-035d0a17977c\") " pod="ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st"
Jul 07 18:15:33.067005 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:33.066985    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee42fa8e-be02-4de7-8cc9-035d0a17977c-dshm\") pod \"rate-test-model-5c379c-kserve-597ddc7555-8d8st\" (UID: \"ee42fa8e-be02-4de7-8cc9-035d0a17977c\") " pod="ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st"
Jul 07 18:15:33.067442 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:33.067424    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee42fa8e-be02-4de7-8cc9-035d0a17977c-tls-certs\") pod \"rate-test-model-5c379c-kserve-597ddc7555-8d8st\" (UID: \"ee42fa8e-be02-4de7-8cc9-035d0a17977c\") " pod="ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st"
Jul 07 18:15:33.071994 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:33.071946    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj6tx\" (UniqueName: \"kubernetes.io/projected/ee42fa8e-be02-4de7-8cc9-035d0a17977c-kube-api-access-mj6tx\") pod \"rate-test-model-5c379c-kserve-597ddc7555-8d8st\" (UID: \"ee42fa8e-be02-4de7-8cc9-035d0a17977c\") " pod="ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st"
Jul 07 18:15:33.169273 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:33.169239    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st"
Jul 07 18:15:33.308572 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:33.308546    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st"]
Jul 07 18:15:33.311148 ip-10-0-132-78 kubenswrapper[2559]: W0707 18:15:33.311125    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee42fa8e_be02_4de7_8cc9_035d0a17977c.slice/crio-08e6a8da528e68b10af0d1543dc4f42b8846344bf21411b28fbc4bf1c5dab0b3 WatchSource:0}: Error finding container 08e6a8da528e68b10af0d1543dc4f42b8846344bf21411b28fbc4bf1c5dab0b3: Status 404 returned error can't find the container with id 08e6a8da528e68b10af0d1543dc4f42b8846344bf21411b28fbc4bf1c5dab0b3
Jul 07 18:15:33.843898 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:33.843860    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st" event={"ID":"ee42fa8e-be02-4de7-8cc9-035d0a17977c","Type":"ContainerStarted","Data":"597438a585c3e7c73b55f32ebaa06665113e81d4c7a41af133ec64f60cd7055a"}
Jul 07 18:15:33.843898 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:33.843901    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st" event={"ID":"ee42fa8e-be02-4de7-8cc9-035d0a17977c","Type":"ContainerStarted","Data":"08e6a8da528e68b10af0d1543dc4f42b8846344bf21411b28fbc4bf1c5dab0b3"}
Jul 07 18:15:33.860189 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:33.860139    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st" podStartSLOduration=1.860124756 podStartE2EDuration="1.860124756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:15:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:15:33.858920684 +0000 UTC m=+2333.374151025" watchObservedRunningTime="2026-07-07 18:15:33.860124756 +0000 UTC m=+2333.375355093"
Jul 07 18:15:43.169903 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:43.169866    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st"
Jul 07 18:15:43.170323 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:43.169995    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st"
Jul 07 18:15:43.183076 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:43.183050    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st"
Jul 07 18:15:43.902867 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:15:43.902833    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st"
Jul 07 18:16:04.881371 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:04.881331    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:16:04.979068 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:04.979034    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:16:13.997429 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:13.997378    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:16:14.095058 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:14.095023    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:16:23.842187 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:23.842135    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf"]
Jul 07 18:16:23.858786 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:23.858744    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:16:24.667725 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:24.667690    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st"]
Jul 07 18:16:24.686335 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:24.686301    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:16:25.739220 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:25.739178    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:16:26.150228 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:26.150193    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:16:26.251229 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:26.251190    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:16:26.386079 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:26.386046    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:16:31.232699 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:31.232663    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:16:38.862906 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:38.862849    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf" podUID="c3a56c65-3f39-4f01-9091-d2b5eea0afef" containerName="main" containerID="cri-o://441301ed5b8fcd8317a6e7c57bdc0d25a9b1118799ac1c6f29a37a7b915414a0" gracePeriod=45
Jul 07 18:16:39.116876 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:39.116809    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf"
Jul 07 18:16:39.142804 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:39.142778    2559 generic.go:356] "Generic (PLEG): container finished" podID="c3a56c65-3f39-4f01-9091-d2b5eea0afef" containerID="441301ed5b8fcd8317a6e7c57bdc0d25a9b1118799ac1c6f29a37a7b915414a0" exitCode=0
Jul 07 18:16:39.142929 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:39.142829    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf"
Jul 07 18:16:39.142929 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:39.142856    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf" event={"ID":"c3a56c65-3f39-4f01-9091-d2b5eea0afef","Type":"ContainerDied","Data":"441301ed5b8fcd8317a6e7c57bdc0d25a9b1118799ac1c6f29a37a7b915414a0"}
Jul 07 18:16:39.142929 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:39.142896    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf" event={"ID":"c3a56c65-3f39-4f01-9091-d2b5eea0afef","Type":"ContainerDied","Data":"8f354b0c3d441fc3e5dd946a18bc20de8509346c48d550e0fb9cf71c10cc8d21"}
Jul 07 18:16:39.142929 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:39.142916    2559 scope.go:117] "RemoveContainer" containerID="441301ed5b8fcd8317a6e7c57bdc0d25a9b1118799ac1c6f29a37a7b915414a0"
Jul 07 18:16:39.151631 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:39.151611    2559 scope.go:117] "RemoveContainer" containerID="441301ed5b8fcd8317a6e7c57bdc0d25a9b1118799ac1c6f29a37a7b915414a0"
Jul 07 18:16:39.151914 ip-10-0-132-78 kubenswrapper[2559]: E0707 18:16:39.151894    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"441301ed5b8fcd8317a6e7c57bdc0d25a9b1118799ac1c6f29a37a7b915414a0\": container with ID starting with 441301ed5b8fcd8317a6e7c57bdc0d25a9b1118799ac1c6f29a37a7b915414a0 not found: ID does not exist" containerID="441301ed5b8fcd8317a6e7c57bdc0d25a9b1118799ac1c6f29a37a7b915414a0"
Jul 07 18:16:39.151983 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:39.151934    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"441301ed5b8fcd8317a6e7c57bdc0d25a9b1118799ac1c6f29a37a7b915414a0"} err="failed to get container status \"441301ed5b8fcd8317a6e7c57bdc0d25a9b1118799ac1c6f29a37a7b915414a0\": rpc error: code = NotFound desc = could not find container \"441301ed5b8fcd8317a6e7c57bdc0d25a9b1118799ac1c6f29a37a7b915414a0\": container with ID starting with 441301ed5b8fcd8317a6e7c57bdc0d25a9b1118799ac1c6f29a37a7b915414a0 not found: ID does not exist"
Jul 07 18:16:39.251344 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:39.251320    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3a56c65-3f39-4f01-9091-d2b5eea0afef-dshm\") pod \"c3a56c65-3f39-4f01-9091-d2b5eea0afef\" (UID: \"c3a56c65-3f39-4f01-9091-d2b5eea0afef\") "
Jul 07 18:16:39.251472 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:39.251351    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3a56c65-3f39-4f01-9091-d2b5eea0afef-tmp-dir\") pod \"c3a56c65-3f39-4f01-9091-d2b5eea0afef\" (UID: \"c3a56c65-3f39-4f01-9091-d2b5eea0afef\") "
Jul 07 18:16:39.251472 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:39.251381    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbjsh\" (UniqueName: \"kubernetes.io/projected/c3a56c65-3f39-4f01-9091-d2b5eea0afef-kube-api-access-wbjsh\") pod \"c3a56c65-3f39-4f01-9091-d2b5eea0afef\" (UID: \"c3a56c65-3f39-4f01-9091-d2b5eea0afef\") "
Jul 07 18:16:39.251472 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:39.251408    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3a56c65-3f39-4f01-9091-d2b5eea0afef-model-cache\") pod \"c3a56c65-3f39-4f01-9091-d2b5eea0afef\" (UID: \"c3a56c65-3f39-4f01-9091-d2b5eea0afef\") "
Jul 07 18:16:39.251472 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:39.251425    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3a56c65-3f39-4f01-9091-d2b5eea0afef-home\") pod \"c3a56c65-3f39-4f01-9091-d2b5eea0afef\" (UID: \"c3a56c65-3f39-4f01-9091-d2b5eea0afef\") "
Jul 07 18:16:39.251691 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:39.251508    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3a56c65-3f39-4f01-9091-d2b5eea0afef-tls-certs\") pod \"c3a56c65-3f39-4f01-9091-d2b5eea0afef\" (UID: \"c3a56c65-3f39-4f01-9091-d2b5eea0afef\") "
Jul 07 18:16:39.251691 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:39.251676    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3a56c65-3f39-4f01-9091-d2b5eea0afef-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c3a56c65-3f39-4f01-9091-d2b5eea0afef" (UID: "c3a56c65-3f39-4f01-9091-d2b5eea0afef"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:16:39.251807 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:39.251710    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3a56c65-3f39-4f01-9091-d2b5eea0afef-model-cache" (OuterVolumeSpecName: "model-cache") pod "c3a56c65-3f39-4f01-9091-d2b5eea0afef" (UID: "c3a56c65-3f39-4f01-9091-d2b5eea0afef"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:16:39.251859 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:39.251811    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3a56c65-3f39-4f01-9091-d2b5eea0afef-home" (OuterVolumeSpecName: "home") pod "c3a56c65-3f39-4f01-9091-d2b5eea0afef" (UID: "c3a56c65-3f39-4f01-9091-d2b5eea0afef"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:16:39.251859 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:39.251852    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3a56c65-3f39-4f01-9091-d2b5eea0afef-model-cache\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:16:39.252000 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:39.251872    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3a56c65-3f39-4f01-9091-d2b5eea0afef-tmp-dir\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:16:39.253633 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:39.253608    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3a56c65-3f39-4f01-9091-d2b5eea0afef-dshm" (OuterVolumeSpecName: "dshm") pod "c3a56c65-3f39-4f01-9091-d2b5eea0afef" (UID: "c3a56c65-3f39-4f01-9091-d2b5eea0afef"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:16:39.253728 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:39.253656    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3a56c65-3f39-4f01-9091-d2b5eea0afef-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c3a56c65-3f39-4f01-9091-d2b5eea0afef" (UID: "c3a56c65-3f39-4f01-9091-d2b5eea0afef"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:16:39.253728 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:39.253686    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3a56c65-3f39-4f01-9091-d2b5eea0afef-kube-api-access-wbjsh" (OuterVolumeSpecName: "kube-api-access-wbjsh") pod "c3a56c65-3f39-4f01-9091-d2b5eea0afef" (UID: "c3a56c65-3f39-4f01-9091-d2b5eea0afef"). InnerVolumeSpecName "kube-api-access-wbjsh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:16:39.353125 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:39.353095    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3a56c65-3f39-4f01-9091-d2b5eea0afef-tls-certs\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:16:39.353125 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:39.353124    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3a56c65-3f39-4f01-9091-d2b5eea0afef-dshm\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:16:39.353125 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:39.353135    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbjsh\" (UniqueName: \"kubernetes.io/projected/c3a56c65-3f39-4f01-9091-d2b5eea0afef-kube-api-access-wbjsh\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:16:39.353341 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:39.353145    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3a56c65-3f39-4f01-9091-d2b5eea0afef-home\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:16:39.463069 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:39.463038    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf"]
Jul 07 18:16:39.466508 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:39.466478    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-f78287/rate-test-model-f78287-kserve-6fcffcfdbc-fj8cf"]
Jul 07 18:16:39.688503 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:39.688447    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st" podUID="ee42fa8e-be02-4de7-8cc9-035d0a17977c" containerName="main" containerID="cri-o://597438a585c3e7c73b55f32ebaa06665113e81d4c7a41af133ec64f60cd7055a" gracePeriod=45
Jul 07 18:16:39.943890 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:39.943869    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st"
Jul 07 18:16:40.059716 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:40.059635    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mj6tx\" (UniqueName: \"kubernetes.io/projected/ee42fa8e-be02-4de7-8cc9-035d0a17977c-kube-api-access-mj6tx\") pod \"ee42fa8e-be02-4de7-8cc9-035d0a17977c\" (UID: \"ee42fa8e-be02-4de7-8cc9-035d0a17977c\") "
Jul 07 18:16:40.059716 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:40.059672    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee42fa8e-be02-4de7-8cc9-035d0a17977c-tmp-dir\") pod \"ee42fa8e-be02-4de7-8cc9-035d0a17977c\" (UID: \"ee42fa8e-be02-4de7-8cc9-035d0a17977c\") "
Jul 07 18:16:40.059716 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:40.059692    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee42fa8e-be02-4de7-8cc9-035d0a17977c-dshm\") pod \"ee42fa8e-be02-4de7-8cc9-035d0a17977c\" (UID: \"ee42fa8e-be02-4de7-8cc9-035d0a17977c\") "
Jul 07 18:16:40.059716 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:40.059706    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee42fa8e-be02-4de7-8cc9-035d0a17977c-home\") pod \"ee42fa8e-be02-4de7-8cc9-035d0a17977c\" (UID: \"ee42fa8e-be02-4de7-8cc9-035d0a17977c\") "
Jul 07 18:16:40.060085 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:40.059761    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee42fa8e-be02-4de7-8cc9-035d0a17977c-model-cache\") pod \"ee42fa8e-be02-4de7-8cc9-035d0a17977c\" (UID: \"ee42fa8e-be02-4de7-8cc9-035d0a17977c\") "
Jul 07 18:16:40.060085 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:40.059870    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee42fa8e-be02-4de7-8cc9-035d0a17977c-tls-certs\") pod \"ee42fa8e-be02-4de7-8cc9-035d0a17977c\" (UID: \"ee42fa8e-be02-4de7-8cc9-035d0a17977c\") "
Jul 07 18:16:40.060085 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:40.059903    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee42fa8e-be02-4de7-8cc9-035d0a17977c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ee42fa8e-be02-4de7-8cc9-035d0a17977c" (UID: "ee42fa8e-be02-4de7-8cc9-035d0a17977c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:16:40.060085 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:40.060048    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee42fa8e-be02-4de7-8cc9-035d0a17977c-home" (OuterVolumeSpecName: "home") pod "ee42fa8e-be02-4de7-8cc9-035d0a17977c" (UID: "ee42fa8e-be02-4de7-8cc9-035d0a17977c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:16:40.060277 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:40.060080    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee42fa8e-be02-4de7-8cc9-035d0a17977c-model-cache" (OuterVolumeSpecName: "model-cache") pod "ee42fa8e-be02-4de7-8cc9-035d0a17977c" (UID: "ee42fa8e-be02-4de7-8cc9-035d0a17977c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:16:40.060277 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:40.060204    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee42fa8e-be02-4de7-8cc9-035d0a17977c-tmp-dir\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:16:40.060277 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:40.060224    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee42fa8e-be02-4de7-8cc9-035d0a17977c-home\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:16:40.060277 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:40.060236    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee42fa8e-be02-4de7-8cc9-035d0a17977c-model-cache\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:16:40.061944 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:40.061915    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee42fa8e-be02-4de7-8cc9-035d0a17977c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ee42fa8e-be02-4de7-8cc9-035d0a17977c" (UID: "ee42fa8e-be02-4de7-8cc9-035d0a17977c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:16:40.061944 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:40.061922    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee42fa8e-be02-4de7-8cc9-035d0a17977c-dshm" (OuterVolumeSpecName: "dshm") pod "ee42fa8e-be02-4de7-8cc9-035d0a17977c" (UID: "ee42fa8e-be02-4de7-8cc9-035d0a17977c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:16:40.062151 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:40.062018    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee42fa8e-be02-4de7-8cc9-035d0a17977c-kube-api-access-mj6tx" (OuterVolumeSpecName: "kube-api-access-mj6tx") pod "ee42fa8e-be02-4de7-8cc9-035d0a17977c" (UID: "ee42fa8e-be02-4de7-8cc9-035d0a17977c"). InnerVolumeSpecName "kube-api-access-mj6tx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:16:40.149522 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:40.149492    2559 generic.go:356] "Generic (PLEG): container finished" podID="ee42fa8e-be02-4de7-8cc9-035d0a17977c" containerID="597438a585c3e7c73b55f32ebaa06665113e81d4c7a41af133ec64f60cd7055a" exitCode=0
Jul 07 18:16:40.149707 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:40.149545    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st"
Jul 07 18:16:40.149707 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:40.149586    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st" event={"ID":"ee42fa8e-be02-4de7-8cc9-035d0a17977c","Type":"ContainerDied","Data":"597438a585c3e7c73b55f32ebaa06665113e81d4c7a41af133ec64f60cd7055a"}
Jul 07 18:16:40.149707 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:40.149630    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st" event={"ID":"ee42fa8e-be02-4de7-8cc9-035d0a17977c","Type":"ContainerDied","Data":"08e6a8da528e68b10af0d1543dc4f42b8846344bf21411b28fbc4bf1c5dab0b3"}
Jul 07 18:16:40.149707 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:40.149655    2559 scope.go:117] "RemoveContainer" containerID="597438a585c3e7c73b55f32ebaa06665113e81d4c7a41af133ec64f60cd7055a"
Jul 07 18:16:40.158589 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:40.158568    2559 scope.go:117] "RemoveContainer" containerID="597438a585c3e7c73b55f32ebaa06665113e81d4c7a41af133ec64f60cd7055a"
Jul 07 18:16:40.158841 ip-10-0-132-78 kubenswrapper[2559]: E0707 18:16:40.158821    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"597438a585c3e7c73b55f32ebaa06665113e81d4c7a41af133ec64f60cd7055a\": container with ID starting with 597438a585c3e7c73b55f32ebaa06665113e81d4c7a41af133ec64f60cd7055a not found: ID does not exist" containerID="597438a585c3e7c73b55f32ebaa06665113e81d4c7a41af133ec64f60cd7055a"
Jul 07 18:16:40.158911 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:40.158850    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"597438a585c3e7c73b55f32ebaa06665113e81d4c7a41af133ec64f60cd7055a"} err="failed to get container status \"597438a585c3e7c73b55f32ebaa06665113e81d4c7a41af133ec64f60cd7055a\": rpc error: code = NotFound desc = could not find container \"597438a585c3e7c73b55f32ebaa06665113e81d4c7a41af133ec64f60cd7055a\": container with ID starting with 597438a585c3e7c73b55f32ebaa06665113e81d4c7a41af133ec64f60cd7055a not found: ID does not exist"
Jul 07 18:16:40.160815 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:40.160800    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee42fa8e-be02-4de7-8cc9-035d0a17977c-tls-certs\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:16:40.160888 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:40.160817    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mj6tx\" (UniqueName: \"kubernetes.io/projected/ee42fa8e-be02-4de7-8cc9-035d0a17977c-kube-api-access-mj6tx\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:16:40.160888 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:40.160827    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee42fa8e-be02-4de7-8cc9-035d0a17977c-dshm\") on node \"ip-10-0-132-78.ec2.internal\" DevicePath \"\""
Jul 07 18:16:40.172351 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:40.172328    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st"]
Jul 07 18:16:40.174112 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:40.174094    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-5c379c/rate-test-model-5c379c-kserve-597ddc7555-8d8st"]
Jul 07 18:16:41.008458 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:41.008422    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3a56c65-3f39-4f01-9091-d2b5eea0afef" path="/var/lib/kubelet/pods/c3a56c65-3f39-4f01-9091-d2b5eea0afef/volumes"
Jul 07 18:16:41.008802 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:41.008782    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee42fa8e-be02-4de7-8cc9-035d0a17977c" path="/var/lib/kubelet/pods/ee42fa8e-be02-4de7-8cc9-035d0a17977c/volumes"
Jul 07 18:16:41.042551 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:41.042520    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8s7h4_5f7bf700-4743-4276-b4b1-9245cd337343/ovn-acl-logging/0.log"
Jul 07 18:16:41.044879 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:41.044857    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8s7h4_5f7bf700-4743-4276-b4b1-9245cd337343/ovn-acl-logging/0.log"
Jul 07 18:16:42.162764 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:16:42.162719    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:17:07.964132 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:07.964050    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:17:08.259387 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:08.259304    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:17:08.503248 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:08.503213    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:17:08.681127 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:08.681090    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:17:09.101343 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:09.101256    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:17:09.201630 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:09.201596    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:17:09.308197 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:09.308163    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:17:14.988591 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:14.988554    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:17:15.061269 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:15.061234    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:17:15.274576 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:15.274488    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:17:15.524775 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:15.524673    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:17:16.055813 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:16.055780    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6486bbd9ff-5cf82_045e876b-8fd3-4511-9541-5a6027842737/authorino/0.log"
Jul 07 18:17:23.101428 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:23.101392    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-dc6fc548d-5jcvl_450900f8-5a3d-4309-9175-550377bd8103/manager/0.log"
Jul 07 18:17:23.220236 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:23.220203    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-g6gkk_10058684-46b9-443c-8d9f-99d58c073409/server/0.log"
Jul 07 18:17:23.343083 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:23.343054    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-qfq7t_440d0785-7575-407e-aa8c-eb8ad196c0e1/manager/0.log"
Jul 07 18:17:23.464531 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:23.464498    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-777cf5fb6f-6jbzk_8a9d4e60-8bce-41d9-8b43-61f59306b375/copy-manifests/0.log"
Jul 07 18:17:23.474511 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:23.474486    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-777cf5fb6f-6jbzk_8a9d4e60-8bce-41d9-8b43-61f59306b375/manager/0.log"
Jul 07 18:17:25.249174 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:25.249133    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6486bbd9ff-5cf82_045e876b-8fd3-4511-9541-5a6027842737/authorino/0.log"
Jul 07 18:17:26.515642 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:26.515609    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678n5tf2_16706bdf-4979-4ebb-be7c-e00f674e4692/istio-proxy/0.log"
Jul 07 18:17:26.779413 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:26.779339    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-99f6fd64d-ng6ld_c59a7158-4432-49b6-9fc9-4d2f8dbc3b7c/kube-auth-proxy/0.log"
Jul 07 18:17:27.154628 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:27.154598    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-xj2kr_ea018a96-1d34-4aa7-bfd9-a99428e5d103/payload-pre-processing/0.log"
Jul 07 18:17:27.397848 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:27.397822    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75f79f56bf-jktn5_9c349ce7-0bb4-42be-bccc-ec6129edb764/router/0.log"
Jul 07 18:17:27.774566 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:27.774539    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-c88hf_a1185796-8ddf-4182-bdd4-686d22b662bd/main/0.log"
Jul 07 18:17:28.012127 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:28.012098    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-hjx4d_faa954ae-5c41-4e1b-98a8-f28f80735afa/main/0.log"
Jul 07 18:17:28.399134 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:28.399103    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-gpjsl_0876169c-a57c-4c59-8727-f9ef6044bea9/main/0.log"
Jul 07 18:17:32.867051 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:32.867018    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:17:32.966347 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:32.966313    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log" limit=1024
Jul 07 18:17:35.696993 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:35.696945    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5r9p6_8eb6fe4b-fba4-4c80-b328-93ff6b880816/global-pull-secret-syncer/0.log"
Jul 07 18:17:35.816757 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:35.816719    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-47mnk_fd1252ab-8a9b-4f7b-b121-7e144ad610f4/konnectivity-agent/0.log"
Jul 07 18:17:35.919628 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:35.919601    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-78.ec2.internal_d1173d55afe0841f3da9d7bed0dfe65d/haproxy/0.log"
Jul 07 18:17:42.036519 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:42.036483    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6486bbd9ff-5cf82_045e876b-8fd3-4511-9541-5a6027842737/authorino/0.log"
Jul 07 18:17:44.312936 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:44.312906    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-8q6n2_144e91d9-f4f8-421b-86c1-80dadfb4bb36/kube-state-metrics/0.log"
Jul 07 18:17:44.333670 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:44.333641    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-8q6n2_144e91d9-f4f8-421b-86c1-80dadfb4bb36/kube-rbac-proxy-main/0.log"
Jul 07 18:17:44.354773 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:44.354744    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-8q6n2_144e91d9-f4f8-421b-86c1-80dadfb4bb36/kube-rbac-proxy-self/0.log"
Jul 07 18:17:44.434335 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:44.434306    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hg6j8_4105c06b-0719-43bd-a257-2a8ccbe0f80d/node-exporter/0.log"
Jul 07 18:17:44.457887 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:44.457857    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hg6j8_4105c06b-0719-43bd-a257-2a8ccbe0f80d/kube-rbac-proxy/0.log"
Jul 07 18:17:44.478819 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:44.478794    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hg6j8_4105c06b-0719-43bd-a257-2a8ccbe0f80d/init-textfile/0.log"
Jul 07 18:17:44.919427 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:44.919395    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-5jnx9_f6eab0c8-907e-4b95-b4ac-6aed563559b8/prometheus-operator/0.log"
Jul 07 18:17:44.937459 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:44.937434    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-5jnx9_f6eab0c8-907e-4b95-b4ac-6aed563559b8/kube-rbac-proxy/0.log"
Jul 07 18:17:44.958284 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:44.958255    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-zf2kf_068d5512-2338-417e-805d-4e45523bc2b2/prometheus-operator-admission-webhook/0.log"
Jul 07 18:17:46.215339 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:46.215307    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-9gvhn_afebc539-17cc-4174-8c80-499c0e3652d3/networking-console-plugin/0.log"
Jul 07 18:17:46.623860 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:46.623824    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4gck5/perf-node-gather-daemonset-bqp5m"]
Jul 07 18:17:46.624251 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:46.624230    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee42fa8e-be02-4de7-8cc9-035d0a17977c" containerName="main"
Jul 07 18:17:46.624251 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:46.624249    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee42fa8e-be02-4de7-8cc9-035d0a17977c" containerName="main"
Jul 07 18:17:46.624428 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:46.624281    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3a56c65-3f39-4f01-9091-d2b5eea0afef" containerName="main"
Jul 07 18:17:46.624428 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:46.624286    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3a56c65-3f39-4f01-9091-d2b5eea0afef" containerName="main"
Jul 07 18:17:46.624428 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:46.624341    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3a56c65-3f39-4f01-9091-d2b5eea0afef" containerName="main"
Jul 07 18:17:46.624428 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:46.624349    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee42fa8e-be02-4de7-8cc9-035d0a17977c" containerName="main"
Jul 07 18:17:46.627337 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:46.627318    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-bqp5m"
Jul 07 18:17:46.629509 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:46.629491    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4gck5\"/\"default-dockercfg-4gjgh\""
Jul 07 18:17:46.629632 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:46.629562    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4gck5\"/\"openshift-service-ca.crt\""
Jul 07 18:17:46.630530 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:46.630515    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4gck5\"/\"kube-root-ca.crt\""
Jul 07 18:17:46.636782 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:46.636756    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4gck5/perf-node-gather-daemonset-bqp5m"]
Jul 07 18:17:46.636894 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:46.636813    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/853b458c-537f-456a-b478-a155437af119-proc\") pod \"perf-node-gather-daemonset-bqp5m\" (UID: \"853b458c-537f-456a-b478-a155437af119\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-bqp5m"
Jul 07 18:17:46.636894 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:46.636848    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/853b458c-537f-456a-b478-a155437af119-podres\") pod \"perf-node-gather-daemonset-bqp5m\" (UID: \"853b458c-537f-456a-b478-a155437af119\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-bqp5m"
Jul 07 18:17:46.636894 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:46.636884    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/853b458c-537f-456a-b478-a155437af119-lib-modules\") pod \"perf-node-gather-daemonset-bqp5m\" (UID: \"853b458c-537f-456a-b478-a155437af119\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-bqp5m"
Jul 07 18:17:46.637119 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:46.636914    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/853b458c-537f-456a-b478-a155437af119-sys\") pod \"perf-node-gather-daemonset-bqp5m\" (UID: \"853b458c-537f-456a-b478-a155437af119\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-bqp5m"
Jul 07 18:17:46.637119 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:46.636989    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg7lx\" (UniqueName: \"kubernetes.io/projected/853b458c-537f-456a-b478-a155437af119-kube-api-access-lg7lx\") pod \"perf-node-gather-daemonset-bqp5m\" (UID: \"853b458c-537f-456a-b478-a155437af119\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-bqp5m"
Jul 07 18:17:46.737382 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:46.737351    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/853b458c-537f-456a-b478-a155437af119-proc\") pod \"perf-node-gather-daemonset-bqp5m\" (UID: \"853b458c-537f-456a-b478-a155437af119\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-bqp5m"
Jul 07 18:17:46.737382 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:46.737396    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/853b458c-537f-456a-b478-a155437af119-podres\") pod \"perf-node-gather-daemonset-bqp5m\" (UID: \"853b458c-537f-456a-b478-a155437af119\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-bqp5m"
Jul 07 18:17:46.737609 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:46.737479    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/853b458c-537f-456a-b478-a155437af119-proc\") pod \"perf-node-gather-daemonset-bqp5m\" (UID: \"853b458c-537f-456a-b478-a155437af119\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-bqp5m"
Jul 07 18:17:46.737609 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:46.737515    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/853b458c-537f-456a-b478-a155437af119-podres\") pod \"perf-node-gather-daemonset-bqp5m\" (UID: \"853b458c-537f-456a-b478-a155437af119\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-bqp5m"
Jul 07 18:17:46.737609 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:46.737535    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/853b458c-537f-456a-b478-a155437af119-lib-modules\") pod \"perf-node-gather-daemonset-bqp5m\" (UID: \"853b458c-537f-456a-b478-a155437af119\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-bqp5m"
Jul 07 18:17:46.737609 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:46.737572    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/853b458c-537f-456a-b478-a155437af119-sys\") pod \"perf-node-gather-daemonset-bqp5m\" (UID: \"853b458c-537f-456a-b478-a155437af119\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-bqp5m"
Jul 07 18:17:46.737771 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:46.737638    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg7lx\" (UniqueName: \"kubernetes.io/projected/853b458c-537f-456a-b478-a155437af119-kube-api-access-lg7lx\") pod \"perf-node-gather-daemonset-bqp5m\" (UID: \"853b458c-537f-456a-b478-a155437af119\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-bqp5m"
Jul 07 18:17:46.737771 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:46.737701    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/853b458c-537f-456a-b478-a155437af119-sys\") pod \"perf-node-gather-daemonset-bqp5m\" (UID: \"853b458c-537f-456a-b478-a155437af119\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-bqp5m"
Jul 07 18:17:46.737771 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:46.737701    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/853b458c-537f-456a-b478-a155437af119-lib-modules\") pod \"perf-node-gather-daemonset-bqp5m\" (UID: \"853b458c-537f-456a-b478-a155437af119\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-bqp5m"
Jul 07 18:17:46.745816 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:46.745781    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg7lx\" (UniqueName: \"kubernetes.io/projected/853b458c-537f-456a-b478-a155437af119-kube-api-access-lg7lx\") pod \"perf-node-gather-daemonset-bqp5m\" (UID: \"853b458c-537f-456a-b478-a155437af119\") " pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-bqp5m"
Jul 07 18:17:46.938296 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:46.938195    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-bqp5m"
Jul 07 18:17:47.077435 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:47.077397    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4gck5/perf-node-gather-daemonset-bqp5m"]
Jul 07 18:17:47.078242 ip-10-0-132-78 kubenswrapper[2559]: W0707 18:17:47.078214    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod853b458c_537f_456a_b478_a155437af119.slice/crio-06ed4670050cb11858cf905b089cad64b3b3003b123c00a2463dee6652b52aa8 WatchSource:0}: Error finding container 06ed4670050cb11858cf905b089cad64b3b3003b123c00a2463dee6652b52aa8: Status 404 returned error can't find the container with id 06ed4670050cb11858cf905b089cad64b3b3003b123c00a2463dee6652b52aa8
Jul 07 18:17:47.403456 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:47.403422    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-xjgss_c5896898-42be-4d32-86cf-12af1377ee5f/download-server/0.log"
Jul 07 18:17:47.460790 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:47.460698    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-bqp5m" event={"ID":"853b458c-537f-456a-b478-a155437af119","Type":"ContainerStarted","Data":"b006a6663ccd28d064cda4dd2ff119c2b5ec8a7b543567b77d0a839ab274ac6e"}
Jul 07 18:17:47.460790 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:47.460750    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-bqp5m" event={"ID":"853b458c-537f-456a-b478-a155437af119","Type":"ContainerStarted","Data":"06ed4670050cb11858cf905b089cad64b3b3003b123c00a2463dee6652b52aa8"}
Jul 07 18:17:47.461010 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:47.460839    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-bqp5m"
Jul 07 18:17:48.878166 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:48.878137    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8mj9d_704699f9-7e17-4a8b-a4df-7259aed03300/dns/0.log"
Jul 07 18:17:48.897151 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:48.897120    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8mj9d_704699f9-7e17-4a8b-a4df-7259aed03300/kube-rbac-proxy/0.log"
Jul 07 18:17:49.035362 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:49.035332    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hwbkw_9a0fe013-4d37-461e-a883-7889017895c0/dns-node-resolver/0.log"
Jul 07 18:17:49.563740 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:49.563687    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6bd74b6444-5kgbr_171b9a5c-37f2-446b-8c0e-a2417516e3b8/registry/0.log"
Jul 07 18:17:49.628305 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:49.628277    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rn66n_0fe8e6ad-d639-4924-807d-8893d085d71c/node-ca/0.log"
Jul 07 18:17:50.541940 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:50.541910    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678n5tf2_16706bdf-4979-4ebb-be7c-e00f674e4692/istio-proxy/0.log"
Jul 07 18:17:50.669331 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:50.669303    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-99f6fd64d-ng6ld_c59a7158-4432-49b6-9fc9-4d2f8dbc3b7c/kube-auth-proxy/0.log"
Jul 07 18:17:50.780721 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:50.780681    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-xj2kr_ea018a96-1d34-4aa7-bfd9-a99428e5d103/payload-pre-processing/0.log"
Jul 07 18:17:50.847736 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:50.847634    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75f79f56bf-jktn5_9c349ce7-0bb4-42be-bccc-ec6129edb764/router/0.log"
Jul 07 18:17:51.513240 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:51.513209    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pbgbb_26673412-89bb-4709-99d3-938900fbb332/serve-healthcheck-canary/0.log"
Jul 07 18:17:51.998798 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:51.998767    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-brl7n_ad442bfc-df96-4c50-a0f1-28c1adf66895/kube-rbac-proxy/0.log"
Jul 07 18:17:52.018911 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:52.018885    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-brl7n_ad442bfc-df96-4c50-a0f1-28c1adf66895/exporter/0.log"
Jul 07 18:17:52.039632 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:52.039599    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-brl7n_ad442bfc-df96-4c50-a0f1-28c1adf66895/extractor/0.log"
Jul 07 18:17:53.476227 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:53.476198    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-bqp5m"
Jul 07 18:17:53.490820 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:53.490770    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4gck5/perf-node-gather-daemonset-bqp5m" podStartSLOduration=7.490751106 podStartE2EDuration="7.490751106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:17:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:17:47.475154261 +0000 UTC m=+2466.990384597" watchObservedRunningTime="2026-07-07 18:17:53.490751106 +0000 UTC m=+2473.005981443"
Jul 07 18:17:54.524678 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:54.524644    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-dc6fc548d-5jcvl_450900f8-5a3d-4309-9175-550377bd8103/manager/0.log"
Jul 07 18:17:54.545514 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:54.545485    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-g6gkk_10058684-46b9-443c-8d9f-99d58c073409/server/0.log"
Jul 07 18:17:54.608193 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:54.608158    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-qfq7t_440d0785-7575-407e-aa8c-eb8ad196c0e1/manager/0.log"
Jul 07 18:17:54.629417 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:54.629382    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-777cf5fb6f-6jbzk_8a9d4e60-8bce-41d9-8b43-61f59306b375/manager/0.log"
Jul 07 18:17:54.648997 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:54.648949    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-777cf5fb6f-6jbzk_8a9d4e60-8bce-41d9-8b43-61f59306b375/copy-manifests/0.log"
Jul 07 18:17:56.266946 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:56.266865    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-55cbfbc7c9-4dtzx_ab65a190-30f2-4a4a-97dc-449f018bc41e/manager/0.log"
Jul 07 18:17:57.272588 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:57.272554    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678n5tf2_16706bdf-4979-4ebb-be7c-e00f674e4692/istio-proxy/0.log"
Jul 07 18:17:57.380917 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:57.380889    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-99f6fd64d-ng6ld_c59a7158-4432-49b6-9fc9-4d2f8dbc3b7c/kube-auth-proxy/0.log"
Jul 07 18:17:57.473057 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:57.473017    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-xj2kr_ea018a96-1d34-4aa7-bfd9-a99428e5d103/payload-pre-processing/0.log"
Jul 07 18:17:57.539322 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:57.539247    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75f79f56bf-jktn5_9c349ce7-0bb4-42be-bccc-ec6129edb764/router/0.log"
Jul 07 18:17:58.653594 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:58.653567    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678n5tf2_16706bdf-4979-4ebb-be7c-e00f674e4692/istio-proxy/0.log"
Jul 07 18:17:58.769893 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:58.769866    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-99f6fd64d-ng6ld_c59a7158-4432-49b6-9fc9-4d2f8dbc3b7c/kube-auth-proxy/0.log"
Jul 07 18:17:58.879307 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:58.879287    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-xj2kr_ea018a96-1d34-4aa7-bfd9-a99428e5d103/payload-pre-processing/0.log"
Jul 07 18:17:58.936394 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:17:58.936344    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75f79f56bf-jktn5_9c349ce7-0bb4-42be-bccc-ec6129edb764/router/0.log"
Jul 07 18:18:01.182069 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:18:01.182037    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-l7mgf_c5ba8132-627a-4818-bc23-ee762901434f/migrator/0.log"
Jul 07 18:18:01.200553 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:18:01.200526    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-l7mgf_c5ba8132-627a-4818-bc23-ee762901434f/graceful-termination/0.log"
Jul 07 18:18:02.533292 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:18:02.533258    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6svr4_503f5710-ce38-4a88-b125-043754ab1a51/kube-multus/0.log"
Jul 07 18:18:02.842287 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:18:02.842206    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hd255_0819ed1d-2fe9-4bf5-b986-96f59fb24a8b/kube-multus-additional-cni-plugins/0.log"
Jul 07 18:18:02.861101 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:18:02.861072    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hd255_0819ed1d-2fe9-4bf5-b986-96f59fb24a8b/egress-router-binary-copy/0.log"
Jul 07 18:18:02.879547 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:18:02.879518    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hd255_0819ed1d-2fe9-4bf5-b986-96f59fb24a8b/cni-plugins/0.log"
Jul 07 18:18:02.899010 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:18:02.898983    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hd255_0819ed1d-2fe9-4bf5-b986-96f59fb24a8b/bond-cni-plugin/0.log"
Jul 07 18:18:02.918898 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:18:02.918869    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hd255_0819ed1d-2fe9-4bf5-b986-96f59fb24a8b/routeoverride-cni/0.log"
Jul 07 18:18:02.936771 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:18:02.936741    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hd255_0819ed1d-2fe9-4bf5-b986-96f59fb24a8b/whereabouts-cni-bincopy/0.log"
Jul 07 18:18:02.954908 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:18:02.954881    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hd255_0819ed1d-2fe9-4bf5-b986-96f59fb24a8b/whereabouts-cni/0.log"
Jul 07 18:18:03.045385 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:18:03.045361    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ltf2l_14607182-3f75-4121-b763-1acf8e7e3c4c/network-metrics-daemon/0.log"
Jul 07 18:18:03.065287 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:18:03.065261    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ltf2l_14607182-3f75-4121-b763-1acf8e7e3c4c/kube-rbac-proxy/0.log"
Jul 07 18:18:04.110201 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:18:04.110171    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8s7h4_5f7bf700-4743-4276-b4b1-9245cd337343/ovn-controller/0.log"
Jul 07 18:18:04.126386 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:18:04.126356    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8s7h4_5f7bf700-4743-4276-b4b1-9245cd337343/ovn-acl-logging/1.log"
Jul 07 18:18:04.126386 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:18:04.126394    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8s7h4_5f7bf700-4743-4276-b4b1-9245cd337343/ovn-acl-logging/0.log"
Jul 07 18:18:04.143112 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:18:04.143084    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8s7h4_5f7bf700-4743-4276-b4b1-9245cd337343/kube-rbac-proxy-node/0.log"
Jul 07 18:18:04.165484 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:18:04.165451    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8s7h4_5f7bf700-4743-4276-b4b1-9245cd337343/kube-rbac-proxy-ovn-metrics/0.log"
Jul 07 18:18:04.183721 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:18:04.183695    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8s7h4_5f7bf700-4743-4276-b4b1-9245cd337343/northd/0.log"
Jul 07 18:18:04.202626 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:18:04.202598    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8s7h4_5f7bf700-4743-4276-b4b1-9245cd337343/nbdb/0.log"
Jul 07 18:18:04.221180 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:18:04.221152    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8s7h4_5f7bf700-4743-4276-b4b1-9245cd337343/sbdb/0.log"
Jul 07 18:18:04.268621 ip-10-0-132-78 kubenswrapper[2559]: I0707 18:18:04.268586    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8s7h4_5f7bf700-4743-4276-b4b1-9245cd337343/ovnkube-controller/0.log"