Jul 10 14:07:56.450216 ip-10-0-135-64 systemd[1]: Starting Kubernetes Kubelet... Jul 10 14:07:56.942062 ip-10-0-135-64 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 14:07:56.942062 ip-10-0-135-64 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 10 14:07:56.942062 ip-10-0-135-64 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 14:07:56.942062 ip-10-0-135-64 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 10 14:07:56.942062 ip-10-0-135-64 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 14:07:56.942062 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.926912 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 10 14:07:56.942062 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.931944 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 14:07:56.942062 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.931975 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 14:07:56.942062 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.931981 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 14:07:56.942062 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.931985 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 14:07:56.942062 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.931989 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 14:07:56.942062 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.931994 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 14:07:56.942062 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.931998 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 14:07:56.942062 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932001 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 14:07:56.946715 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932005 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 14:07:56.946715 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932009 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 14:07:56.946715 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932013 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 14:07:56.946715 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932017 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 14:07:56.946715 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932023 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 14:07:56.946715 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932030 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 14:07:56.946715 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932035 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 14:07:56.946715 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932041 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 14:07:56.946715 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932046 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 14:07:56.946715 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932051 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 14:07:56.946715 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932055 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 14:07:56.946715 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932059 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 14:07:56.946715 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932063 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 14:07:56.946715 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932068 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 14:07:56.946715 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932072 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 14:07:56.946715 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932076 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 14:07:56.946715 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932081 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 14:07:56.946715 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932084 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 10 14:07:56.946715 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932088 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 14:07:56.967053 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932094 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 14:07:56.967053 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932098 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 14:07:56.967053 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932102 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 14:07:56.967053 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932106 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 14:07:56.967053 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932110 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 14:07:56.967053 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932114 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 14:07:56.967053 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932118 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 14:07:56.967053 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932122 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 14:07:56.967053 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932125 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 14:07:56.967053 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932129 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 14:07:56.967053 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932133 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 14:07:56.967053 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932137 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 14:07:56.967053 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932140 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 14:07:56.967053 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932144 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 14:07:56.967053 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932148 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 14:07:56.967053 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932151 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 14:07:56.967053 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932155 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 14:07:56.967053 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932159 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 14:07:56.967053 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932163 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 14:07:56.967053 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932167 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 14:07:56.969747 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932170 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 14:07:56.969747 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932175 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 14:07:56.969747 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932178 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 14:07:56.969747 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932181 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 14:07:56.969747 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932185 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 14:07:56.969747 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932189 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 14:07:56.969747 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932193 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 14:07:56.969747 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932197 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 14:07:56.969747 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932200 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 14:07:56.969747 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932204 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 14:07:56.969747 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932208 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 14:07:56.969747 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932212 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 14:07:56.969747 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932216 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 14:07:56.969747 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932220 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 14:07:56.969747 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932225 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 14:07:56.969747 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932229 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 14:07:56.969747 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932233 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 14:07:56.969747 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932237 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 14:07:56.969747 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932241 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 14:07:56.969747 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932245 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 14:07:56.973315 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932249 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 14:07:56.973315 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932253 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 14:07:56.973315 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932257 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 14:07:56.973315 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932261 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 14:07:56.973315 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932265 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 14:07:56.973315 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932271 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 14:07:56.973315 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932275 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 14:07:56.973315 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932279 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 14:07:56.973315 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932284 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 14:07:56.973315 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932288 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 14:07:56.973315 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932292 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 14:07:56.973315 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932296 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 14:07:56.973315 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932301 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 14:07:56.973315 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932305 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 14:07:56.973315 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932309 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 14:07:56.973315 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932313 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 14:07:56.973315 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932317 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 14:07:56.973315 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932320 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 14:07:56.973315 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932324 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 14:07:56.973315 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932330 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 14:07:57.135996 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932333 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 14:07:57.135996 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932337 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 14:07:57.135996 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932341 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 14:07:57.135996 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932345 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 14:07:57.135996 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932349 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 14:07:57.135996 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932352 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 14:07:57.135996 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932358 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 14:07:57.135996 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932362 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 14:07:57.135996 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932365 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 14:07:57.135996 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932369 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 14:07:57.135996 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932373 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 14:07:57.135996 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.932377 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 14:07:57.135996 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934431 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 14:07:57.135996 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934441 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 14:07:57.135996 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934447 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 14:07:57.135996 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934453 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 14:07:57.135996 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934458 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 14:07:57.135996 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934463 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 14:07:57.135996 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934469 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 14:07:57.135996 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934474 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 14:07:57.007848 ip-10-0-135-64 systemd[1]: Started Kubernetes Kubelet. Jul 10 14:07:57.154158 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934479 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 14:07:57.154158 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934483 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 14:07:57.154158 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934488 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 14:07:57.154158 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934492 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 14:07:57.154158 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934497 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 14:07:57.154158 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934501 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 14:07:57.154158 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934505 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 14:07:57.154158 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934509 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 14:07:57.154158 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934513 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 14:07:57.154158 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934517 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 14:07:57.154158 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934521 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 14:07:57.154158 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934524 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 14:07:57.154158 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934529 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 14:07:57.154158 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934533 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 14:07:57.154158 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934537 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 14:07:57.154158 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934541 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 14:07:57.154158 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934545 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 14:07:57.154158 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934548 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 14:07:57.154158 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934553 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 14:07:57.154158 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934558 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 14:07:57.161482 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934562 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 14:07:57.161482 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934566 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 14:07:57.161482 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934570 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 14:07:57.161482 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934574 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 14:07:57.161482 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934577 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 14:07:57.161482 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934581 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 14:07:57.161482 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934585 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 14:07:57.161482 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934589 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 14:07:57.161482 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934593 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 14:07:57.161482 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934597 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 14:07:57.161482 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934601 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 14:07:57.161482 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934605 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 14:07:57.161482 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934609 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 14:07:57.161482 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934612 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 14:07:57.161482 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934616 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 14:07:57.161482 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934619 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 14:07:57.161482 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934623 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 14:07:57.161482 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934627 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 14:07:57.161482 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934631 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 14:07:57.161482 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934635 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 14:07:57.162494 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934639 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 14:07:57.162494 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934643 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 14:07:57.162494 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934647 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 14:07:57.162494 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934651 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 14:07:57.162494 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934655 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 14:07:57.162494 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934659 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 14:07:57.162494 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934663 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 14:07:57.162494 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934666 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 14:07:57.162494 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934670 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 14:07:57.162494 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934675 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 14:07:57.162494 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934679 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 14:07:57.162494 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934684 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 14:07:57.162494 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934688 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 14:07:57.162494 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934693 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 14:07:57.162494 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934696 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 14:07:57.162494 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934700 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 14:07:57.162494 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934705 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 14:07:57.162494 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934709 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 14:07:57.162494 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934712 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 14:07:57.162494 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934716 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 14:07:57.165410 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934721 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 10 14:07:57.165410 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934725 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 14:07:57.165410 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934728 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 14:07:57.165410 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934732 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 14:07:57.165410 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934736 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 14:07:57.165410 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934740 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 14:07:57.165410 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934743 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 14:07:57.165410 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934747 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 14:07:57.165410 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934751 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 14:07:57.165410 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934755 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 14:07:57.165410 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934759 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 14:07:57.165410 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934762 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 14:07:57.165410 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934768 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 14:07:57.165410 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934774 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 14:07:57.165410 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934777 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 14:07:57.165410 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934781 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 14:07:57.165410 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934785 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 14:07:57.165410 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934789 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 14:07:57.165410 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934793 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 14:07:57.165410 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934796 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 14:07:57.166218 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934800 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 14:07:57.166218 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934804 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 14:07:57.166218 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934808 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 14:07:57.166218 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934812 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 14:07:57.166218 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934816 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 14:07:57.166218 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934822 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 14:07:57.166218 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934825 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 14:07:57.166218 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934831 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 14:07:57.166218 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934836 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 14:07:57.166218 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934841 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 14:07:57.166218 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.934845 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 14:07:57.166218 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935381 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 14:07:57.166218 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935389 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 14:07:57.166218 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935394 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 14:07:57.166218 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935398 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 14:07:57.166218 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935402 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 14:07:57.166218 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935406 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 14:07:57.166218 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935411 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 14:07:57.166218 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935415 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 14:07:57.273211 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935419 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 14:07:57.273211 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935422 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 14:07:57.273211 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935427 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 14:07:57.273211 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935431 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 14:07:57.273211 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935434 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 14:07:57.273211 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935438 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 14:07:57.273211 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935442 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 14:07:57.273211 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935447 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 14:07:57.273211 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935451 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 14:07:57.273211 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935455 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 14:07:57.273211 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935459 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 14:07:57.273211 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935463 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 14:07:57.273211 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935467 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 14:07:57.273211 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935470 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 14:07:57.273211 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935474 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 14:07:57.273211 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935477 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 14:07:57.273211 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935481 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 14:07:57.273211 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935486 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 14:07:57.273211 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935490 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 14:07:57.274401 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935494 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 14:07:57.274401 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935498 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 14:07:57.274401 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935502 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 14:07:57.274401 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935505 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 14:07:57.274401 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935509 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 14:07:57.274401 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935513 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 14:07:57.274401 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935516 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 14:07:57.274401 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935520 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 14:07:57.274401 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935524 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 14:07:57.274401 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935528 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 14:07:57.274401 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935532 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 14:07:57.274401 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935536 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 14:07:57.274401 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935540 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 14:07:57.274401 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935544 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 14:07:57.274401 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935548 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 14:07:57.274401 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935552 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 14:07:57.274401 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935556 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 14:07:57.274401 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935560 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 14:07:57.274401 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935563 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 14:07:57.275214 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935567 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 14:07:57.275214 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935572 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 14:07:57.275214 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935576 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 14:07:57.275214 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935580 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 14:07:57.275214 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935583 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 14:07:57.275214 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935587 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 14:07:57.275214 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935591 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 14:07:57.275214 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935595 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 14:07:57.275214 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935599 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 14:07:57.275214 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935603 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 14:07:57.275214 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935608 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 14:07:57.275214 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935612 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 14:07:57.275214 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935615 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 14:07:57.275214 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935621 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 14:07:57.275214 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935625 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 14:07:57.275214 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935628 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 14:07:57.275214 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935632 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 14:07:57.275214 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935637 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 14:07:57.275214 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935641 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 14:07:57.275214 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935644 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 14:07:57.275214 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935648 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 14:07:57.277356 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935653 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 14:07:57.277356 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935657 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 14:07:57.277356 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935661 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 14:07:57.277356 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935665 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 10 14:07:57.277356 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935669 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 14:07:57.277356 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935674 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 14:07:57.277356 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935677 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 14:07:57.277356 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935681 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 14:07:57.277356 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935685 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 14:07:57.277356 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935688 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 14:07:57.277356 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935692 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 14:07:57.277356 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935696 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 14:07:57.277356 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935700 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 14:07:57.277356 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935704 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 14:07:57.277356 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935710 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 14:07:57.277356 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935729 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 14:07:57.277356 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935735 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 14:07:57.277356 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935739 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 14:07:57.277356 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935743 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 14:07:57.278151 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935749 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 14:07:57.278151 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935753 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 14:07:57.278151 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935757 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 14:07:57.278151 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935760 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 14:07:57.278151 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935765 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 14:07:57.278151 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935768 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 14:07:57.278151 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935773 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 14:07:57.278151 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935778 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 14:07:57.278151 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935783 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 14:07:57.278151 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935787 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 14:07:57.278151 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935792 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 14:07:57.278151 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935796 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 14:07:57.278151 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.935800 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 14:07:57.278151 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.935882 2579 flags.go:64] FLAG: --address="0.0.0.0" Jul 10 14:07:57.278151 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.935891 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 10 14:07:57.278151 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.935899 2579 flags.go:64] FLAG: --anonymous-auth="true" Jul 10 14:07:57.278151 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.935906 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 10 14:07:57.278151 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.935912 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 10 14:07:57.278151 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.935917 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 10 14:07:57.278151 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.935923 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 10 14:07:57.278151 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.935929 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 10 14:07:57.279382 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.935933 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 10 14:07:57.279382 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.935942 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 10 14:07:57.279382 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.935962 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 10 14:07:57.279382 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.935968 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 10 14:07:57.279382 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.935972 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 10 14:07:57.279382 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.935977 2579 flags.go:64] FLAG: --cgroup-root="" Jul 10 14:07:57.279382 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.935981 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 10 14:07:57.279382 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.935986 2579 flags.go:64] FLAG: --client-ca-file="" Jul 10 14:07:57.279382 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.935989 2579 flags.go:64] FLAG: --cloud-provider="external" Jul 10 14:07:57.279382 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.935993 2579 flags.go:64] FLAG: --cluster-dns="[]" Jul 10 14:07:57.279382 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.935999 2579 flags.go:64] FLAG: --cluster-domain="" Jul 10 14:07:57.279382 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936005 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 10 14:07:57.279382 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936011 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 10 14:07:57.279382 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936015 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 10 14:07:57.279382 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936020 2579 flags.go:64] FLAG: --container-log-max-files="5" Jul 10 14:07:57.279382 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936025 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 10 14:07:57.279382 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936029 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 10 14:07:57.279382 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936034 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 10 14:07:57.279382 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936040 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 10 14:07:57.279382 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936045 2579 flags.go:64] FLAG: --contention-profiling="false" Jul 10 14:07:57.279382 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936049 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 10 14:07:57.279382 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936053 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 10 14:07:57.279382 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936057 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 10 14:07:57.279382 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936062 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 10 14:07:57.280197 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936067 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 10 14:07:57.280197 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936072 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 10 14:07:57.280197 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936076 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 10 14:07:57.280197 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936080 2579 flags.go:64] FLAG: --enable-load-reader="false" Jul 10 14:07:57.280197 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936084 2579 flags.go:64] FLAG: --enable-server="true" Jul 10 14:07:57.280197 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936089 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 10 14:07:57.280197 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936096 2579 flags.go:64] FLAG: --event-burst="100" Jul 10 14:07:57.280197 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936100 2579 flags.go:64] FLAG: --event-qps="50" Jul 10 14:07:57.280197 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936104 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 10 14:07:57.280197 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936111 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 10 14:07:57.280197 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936116 2579 flags.go:64] FLAG: --eviction-hard="" Jul 10 14:07:57.280197 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936121 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 10 14:07:57.280197 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936125 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 10 14:07:57.280197 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936129 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 10 14:07:57.280197 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936133 2579 flags.go:64] FLAG: --eviction-soft="" Jul 10 14:07:57.280197 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936138 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 10 14:07:57.280197 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936142 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 10 14:07:57.280197 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936146 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 10 14:07:57.280197 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936151 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jul 10 14:07:57.280197 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936156 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 10 14:07:57.280197 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936161 2579 flags.go:64] FLAG: --fail-swap-on="true" Jul 10 14:07:57.280197 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936165 2579 flags.go:64] FLAG: --feature-gates="" Jul 10 14:07:57.280197 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936170 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jul 10 14:07:57.280197 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936175 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 10 14:07:57.280197 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936179 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 10 14:07:57.281368 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936184 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 10 14:07:57.281368 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936188 2579 flags.go:64] FLAG: --healthz-port="10248" Jul 10 14:07:57.281368 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936193 2579 flags.go:64] FLAG: --help="false" Jul 10 14:07:57.281368 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936198 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-135-64.ec2.internal" Jul 10 14:07:57.281368 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936202 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 10 14:07:57.281368 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936206 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jul 10 14:07:57.281368 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936211 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 10 14:07:57.281368 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936216 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 10 14:07:57.281368 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936221 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 10 14:07:57.281368 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936225 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 10 14:07:57.281368 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936229 2579 flags.go:64] FLAG: --image-service-endpoint="" Jul 10 14:07:57.281368 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936234 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 10 14:07:57.281368 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936238 2579 flags.go:64] FLAG: --kube-api-burst="100" Jul 10 14:07:57.281368 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936242 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 10 14:07:57.281368 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936247 2579 flags.go:64] FLAG: --kube-api-qps="50" Jul 10 14:07:57.281368 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936251 2579 flags.go:64] FLAG: --kube-reserved="" Jul 10 14:07:57.281368 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936256 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 10 14:07:57.281368 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936260 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 10 14:07:57.281368 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936265 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jul 10 14:07:57.281368 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936269 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 10 14:07:57.281368 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936273 2579 flags.go:64] FLAG: --lock-file="" Jul 10 14:07:57.281368 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936277 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 10 14:07:57.281368 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936282 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 10 14:07:57.281368 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936286 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 10 14:07:57.283432 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936294 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jul 10 14:07:57.283432 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936298 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 10 14:07:57.283432 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936304 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jul 10 14:07:57.283432 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936308 2579 flags.go:64] FLAG: --logging-format="text" Jul 10 14:07:57.283432 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936312 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 10 14:07:57.283432 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936317 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 10 14:07:57.283432 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936321 2579 flags.go:64] FLAG: --manifest-url="" Jul 10 14:07:57.283432 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936325 2579 flags.go:64] FLAG: --manifest-url-header="" Jul 10 14:07:57.283432 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936331 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 10 14:07:57.283432 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936335 2579 flags.go:64] FLAG: --max-open-files="1000000" Jul 10 14:07:57.283432 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936341 2579 flags.go:64] FLAG: --max-pods="110" Jul 10 14:07:57.283432 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936347 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 10 14:07:57.283432 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936351 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 10 14:07:57.283432 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936355 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jul 10 14:07:57.283432 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936359 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 10 14:07:57.283432 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936363 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 10 14:07:57.283432 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936367 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 10 14:07:57.283432 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936371 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 10 14:07:57.283432 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936382 2579 flags.go:64] FLAG: --node-status-max-images="50" Jul 10 14:07:57.283432 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936387 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 10 14:07:57.283432 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936391 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jul 10 14:07:57.283432 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936395 2579 flags.go:64] FLAG: --pod-cidr="" Jul 10 14:07:57.283432 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936400 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 10 14:07:57.284036 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936407 2579 flags.go:64] FLAG: --pod-manifest-path="" Jul 10 14:07:57.284036 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936411 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jul 10 14:07:57.284036 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936417 2579 flags.go:64] FLAG: --pods-per-core="0" Jul 10 14:07:57.284036 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936421 2579 flags.go:64] FLAG: --port="10250" Jul 10 14:07:57.284036 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936426 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 10 14:07:57.284036 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936431 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09965b79448920a79" Jul 10 14:07:57.284036 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936436 2579 flags.go:64] FLAG: --qos-reserved="" Jul 10 14:07:57.284036 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936441 2579 flags.go:64] FLAG: --read-only-port="10255" Jul 10 14:07:57.284036 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936445 2579 flags.go:64] FLAG: --register-node="true" Jul 10 14:07:57.284036 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936449 2579 flags.go:64] FLAG: --register-with-taints="" Jul 10 14:07:57.284036 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936455 2579 flags.go:64] FLAG: --registry-burst="10" Jul 10 14:07:57.284036 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936460 2579 flags.go:64] FLAG: --registry-qps="5" Jul 10 14:07:57.284036 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936464 2579 flags.go:64] FLAG: --reserved-cpus="" Jul 10 14:07:57.284036 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936469 2579 flags.go:64] FLAG: --reserved-memory="" Jul 10 14:07:57.284036 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936474 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 10 14:07:57.284036 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936478 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 10 14:07:57.284036 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936482 2579 flags.go:64] FLAG: --rotate-certificates="false" Jul 10 14:07:57.284036 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936486 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 10 14:07:57.284036 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936490 2579 flags.go:64] FLAG: --runonce="false" Jul 10 14:07:57.284036 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936495 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 10 14:07:57.284036 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936499 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 10 14:07:57.284036 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936509 2579 flags.go:64] FLAG: --seccomp-default="false" Jul 10 14:07:57.284036 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936513 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 10 14:07:57.284036 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936518 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 10 14:07:57.284036 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936522 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 10 14:07:57.284036 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936527 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 10 14:07:57.284677 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936531 2579 flags.go:64] FLAG: --storage-driver-password="root" Jul 10 14:07:57.284677 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936535 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jul 10 14:07:57.284677 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936539 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jul 10 14:07:57.284677 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936543 2579 flags.go:64] FLAG: --storage-driver-user="root" Jul 10 14:07:57.284677 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936547 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 10 14:07:57.284677 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936552 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 10 14:07:57.284677 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936556 2579 flags.go:64] FLAG: --system-cgroups="" Jul 10 14:07:57.284677 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936561 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 10 14:07:57.284677 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936570 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 10 14:07:57.284677 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936574 2579 flags.go:64] FLAG: --tls-cert-file="" Jul 10 14:07:57.284677 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936578 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 10 14:07:57.284677 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936584 2579 flags.go:64] FLAG: --tls-min-version="" Jul 10 14:07:57.284677 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936588 2579 flags.go:64] FLAG: --tls-private-key-file="" Jul 10 14:07:57.284677 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936592 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jul 10 14:07:57.284677 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936597 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 10 14:07:57.284677 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936601 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jul 10 14:07:57.284677 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936604 2579 flags.go:64] FLAG: --v="2" Jul 10 14:07:57.284677 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936612 2579 flags.go:64] FLAG: --version="false" Jul 10 14:07:57.284677 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936618 2579 flags.go:64] FLAG: --vmodule="" Jul 10 14:07:57.284677 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936623 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 10 14:07:57.284677 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.936628 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 10 14:07:57.284677 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937706 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 14:07:57.284677 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937723 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 14:07:57.284677 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937730 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 14:07:57.285310 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937735 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 14:07:57.285310 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937740 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 14:07:57.285310 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937744 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 14:07:57.285310 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937749 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 14:07:57.285310 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937753 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 14:07:57.285310 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937759 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 14:07:57.285310 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937770 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 14:07:57.285310 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937774 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 14:07:57.285310 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937779 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 14:07:57.285310 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937783 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 14:07:57.285310 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937787 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 14:07:57.285310 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937792 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 14:07:57.285310 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937796 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 14:07:57.285310 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937800 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 14:07:57.285310 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937804 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 14:07:57.285310 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937809 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 14:07:57.285310 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937813 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 14:07:57.285310 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937818 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 14:07:57.285310 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937822 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 14:07:57.285310 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937832 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 14:07:57.285806 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937836 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 14:07:57.285806 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937843 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 14:07:57.285806 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937849 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 14:07:57.285806 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937854 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 14:07:57.285806 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937858 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 14:07:57.285806 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937862 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 14:07:57.285806 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937867 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 14:07:57.285806 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937871 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 14:07:57.285806 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937875 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 14:07:57.285806 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937879 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 14:07:57.285806 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937888 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 14:07:57.285806 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937898 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 14:07:57.285806 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937902 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 14:07:57.285806 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937907 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 14:07:57.285806 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937911 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 14:07:57.285806 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937915 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 14:07:57.285806 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937920 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 14:07:57.285806 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937924 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 14:07:57.285806 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937928 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 14:07:57.286299 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937933 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 14:07:57.286299 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937937 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 14:07:57.286299 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937941 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 14:07:57.286299 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937944 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 14:07:57.286299 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937964 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 14:07:57.286299 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937974 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 14:07:57.286299 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937978 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 14:07:57.286299 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937982 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 14:07:57.286299 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937987 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 14:07:57.286299 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937991 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 14:07:57.286299 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.937995 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 14:07:57.286299 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938000 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 14:07:57.286299 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938004 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 14:07:57.286299 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938008 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 14:07:57.286299 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938012 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 14:07:57.286299 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938016 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 14:07:57.286299 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938020 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 14:07:57.286299 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938029 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 14:07:57.286299 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938033 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 14:07:57.286299 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938482 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 14:07:57.286801 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938501 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 14:07:57.286801 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938507 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 14:07:57.286801 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938510 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 10 14:07:57.286801 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938514 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 14:07:57.286801 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938517 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 14:07:57.286801 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938521 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 14:07:57.286801 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938524 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 14:07:57.286801 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938527 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 14:07:57.286801 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938530 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 14:07:57.286801 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938533 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 14:07:57.286801 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938536 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 14:07:57.286801 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938539 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 14:07:57.286801 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938546 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 14:07:57.286801 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938548 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 14:07:57.286801 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938551 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 14:07:57.286801 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938554 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 14:07:57.286801 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938557 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 14:07:57.286801 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938560 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 14:07:57.286801 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938563 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 14:07:57.286801 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938566 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 14:07:57.287309 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938571 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 14:07:57.287309 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938596 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 14:07:57.287309 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938599 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 14:07:57.287309 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938604 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 14:07:57.287309 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938611 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 14:07:57.287309 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938615 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 14:07:57.287309 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938623 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 14:07:57.287309 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938626 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 14:07:57.287309 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938629 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 14:07:57.287309 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938632 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 14:07:57.287309 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938635 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 14:07:57.287309 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938637 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 14:07:57.287309 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938641 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 14:07:57.287309 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938644 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 14:07:57.287309 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938647 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 14:07:57.287309 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938650 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 14:07:57.287309 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.938656 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 14:07:57.287722 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.939399 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 14:07:57.287722 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.947784 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 10 14:07:57.287722 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.947798 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 10 14:07:57.287722 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.947817 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 10 14:07:57.287722 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.947827 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 10 14:07:57.287722 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947878 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 14:07:57.287722 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947884 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 14:07:57.287722 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947887 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 14:07:57.287722 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947890 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 14:07:57.287722 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947893 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 14:07:57.287722 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947896 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 14:07:57.287722 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947899 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 14:07:57.287722 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947902 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 14:07:57.287722 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947905 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 14:07:57.287722 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947907 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 14:07:57.288111 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947910 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 14:07:57.288111 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947913 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 14:07:57.288111 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947916 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 14:07:57.288111 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947918 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 10 14:07:57.288111 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947921 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 14:07:57.288111 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947923 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 14:07:57.288111 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947926 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 14:07:57.288111 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947928 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 14:07:57.288111 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947931 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 14:07:57.288111 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947933 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 14:07:57.288111 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947936 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 14:07:57.288111 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947939 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 14:07:57.288111 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947942 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 14:07:57.288111 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947945 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 14:07:57.288111 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947967 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 14:07:57.288111 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947970 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 14:07:57.288111 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947972 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 14:07:57.288111 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947976 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 14:07:57.288111 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947979 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 14:07:57.288111 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947981 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 14:07:57.288612 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947984 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 14:07:57.288612 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947987 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 14:07:57.288612 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947989 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 14:07:57.288612 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947992 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 14:07:57.288612 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947994 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 14:07:57.288612 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.947997 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 14:07:57.288612 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948000 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 14:07:57.288612 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948004 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 14:07:57.288612 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948009 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 14:07:57.288612 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948013 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 14:07:57.288612 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948016 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 14:07:57.288612 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948019 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 14:07:57.288612 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948022 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 14:07:57.288612 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948025 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 14:07:57.288612 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948028 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 14:07:57.288612 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948031 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 14:07:57.288612 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948033 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 14:07:57.288612 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948036 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 14:07:57.288612 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948038 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 14:07:57.289088 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948041 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 14:07:57.289088 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948043 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 14:07:57.289088 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948046 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 14:07:57.289088 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948049 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 14:07:57.289088 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948052 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 14:07:57.289088 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948055 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 14:07:57.289088 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948057 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 14:07:57.289088 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948060 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 14:07:57.289088 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948063 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 14:07:57.289088 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948066 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 14:07:57.289088 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948071 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 14:07:57.289088 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948073 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 14:07:57.289088 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948076 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 14:07:57.289088 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948079 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 14:07:57.289088 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948081 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 14:07:57.289088 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948084 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 14:07:57.289088 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948087 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 14:07:57.289088 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948089 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 14:07:57.289088 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948092 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 14:07:57.289088 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948094 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 14:07:57.289582 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948098 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 14:07:57.289582 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948101 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 14:07:57.289582 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948104 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 14:07:57.289582 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948108 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 14:07:57.289582 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948112 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 14:07:57.289582 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948115 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 14:07:57.289582 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948118 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 14:07:57.289582 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948120 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 14:07:57.289582 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948124 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 14:07:57.289582 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948127 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 14:07:57.289582 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948129 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 14:07:57.289582 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948132 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 14:07:57.289582 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948134 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 14:07:57.289582 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948137 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 14:07:57.289582 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948139 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 14:07:57.289582 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948143 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 14:07:57.289582 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948145 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 14:07:57.289582 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948148 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 14:07:57.289582 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948150 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 14:07:57.290069 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948153 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 14:07:57.290069 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948156 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 14:07:57.290069 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948158 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 14:07:57.290069 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948164 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 14:07:57.290069 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948167 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 14:07:57.290069 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948169 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 14:07:57.290069 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948172 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 14:07:57.290069 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948174 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 14:07:57.290069 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948177 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 14:07:57.290069 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948180 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 14:07:57.290069 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948182 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 14:07:57.290069 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.948187 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 14:07:57.290069 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948302 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 14:07:57.290069 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948307 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 14:07:57.290069 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948310 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 14:07:57.290485 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948313 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 14:07:57.290485 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948315 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 14:07:57.290485 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948318 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 14:07:57.290485 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948321 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 14:07:57.290485 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948323 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 14:07:57.290485 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948326 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 14:07:57.290485 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948328 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 14:07:57.290485 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948331 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 14:07:57.290485 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948334 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 14:07:57.290485 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948337 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 14:07:57.290485 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948339 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 14:07:57.290485 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948343 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 14:07:57.290485 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948345 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 14:07:57.290485 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948348 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 14:07:57.290485 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948350 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 14:07:57.290485 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948353 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 14:07:57.290485 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948355 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 14:07:57.290485 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948358 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 14:07:57.290485 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948361 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 14:07:57.290964 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948363 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 14:07:57.290964 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948366 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 14:07:57.290964 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948369 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 14:07:57.290964 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948372 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 14:07:57.290964 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948375 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 14:07:57.290964 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948377 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 14:07:57.290964 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948380 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 10 14:07:57.290964 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948383 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 14:07:57.290964 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948385 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 14:07:57.290964 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948387 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 14:07:57.290964 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948390 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 14:07:57.290964 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948392 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 14:07:57.290964 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948395 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 14:07:57.290964 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948397 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 14:07:57.290964 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948400 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 14:07:57.290964 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948403 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 14:07:57.290964 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948409 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 14:07:57.290964 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948414 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 14:07:57.290964 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948417 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 14:07:57.290964 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948420 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 14:07:57.291459 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948422 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 14:07:57.291459 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948426 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 14:07:57.291459 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948429 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 14:07:57.291459 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948432 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 14:07:57.291459 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948435 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 14:07:57.291459 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948438 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 14:07:57.291459 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948441 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 14:07:57.291459 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948444 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 14:07:57.291459 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948446 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 14:07:57.291459 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948449 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 14:07:57.291459 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948451 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 14:07:57.291459 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948454 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 14:07:57.291459 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948456 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 14:07:57.291459 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948459 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 14:07:57.291459 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948463 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 14:07:57.291459 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948465 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 14:07:57.291459 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948468 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 14:07:57.291459 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948471 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 14:07:57.291459 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948473 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 14:07:57.291459 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948476 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 14:07:57.291932 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948478 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 14:07:57.291932 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948481 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 14:07:57.291932 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948483 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 14:07:57.291932 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948486 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 14:07:57.291932 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948488 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 14:07:57.291932 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948491 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 14:07:57.291932 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948495 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 14:07:57.291932 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948498 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 14:07:57.291932 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948501 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 14:07:57.291932 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948503 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 14:07:57.291932 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948506 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 14:07:57.291932 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948508 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 14:07:57.291932 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948511 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 14:07:57.291932 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948514 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 14:07:57.291932 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948519 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 14:07:57.291932 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948522 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 14:07:57.291932 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948525 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 14:07:57.291932 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948528 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 14:07:57.291932 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948531 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 14:07:57.291932 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948533 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 14:07:57.292428 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948536 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 14:07:57.292428 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948538 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 14:07:57.292428 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948541 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 14:07:57.292428 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948543 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 14:07:57.292428 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948546 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 14:07:57.292428 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948548 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 14:07:57.292428 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948552 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 14:07:57.292428 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948554 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 14:07:57.292428 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948557 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 14:07:57.292428 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948559 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 14:07:57.292428 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948562 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 14:07:57.292428 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948565 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 14:07:57.292428 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948567 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 14:07:57.292428 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948569 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 14:07:57.292428 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948572 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 14:07:57.292428 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948574 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 14:07:57.292428 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:56.948577 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 14:07:57.292834 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.948582 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 14:07:57.292834 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.948675 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jul 10 14:07:57.292834 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.951031 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 10 14:07:57.292834 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.952810 2579 server.go:1019] "Starting client certificate rotation" Jul 10 14:07:57.292834 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.952940 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 14:07:57.292834 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.952993 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 14:07:57.292834 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.956658 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 14:07:57.292834 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.959266 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 14:07:57.292834 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.969357 2579 log.go:25] "Validated CRI v1 runtime API" Jul 10 14:07:57.292834 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.973440 2579 log.go:25] "Validated CRI v1 image API" Jul 10 14:07:57.292834 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.974364 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 10 14:07:57.292834 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.977839 2579 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 963e5638-c01b-494d-80b1-a9e665ec23ea:/dev/nvme0n1p4 f6b3079a-07fb-48fa-8c95-f63a1cfdb175:/dev/nvme0n1p3] Jul 10 14:07:57.293153 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.977853 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 10 14:07:57.293186 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.984098 2579 manager.go:216] Machine: {Timestamp:2026-07-10 14:07:56.982671366 +0000 UTC m=+0.408895677 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099156 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ccae86607a9ddd410b83c19047e19 SystemUUID:ec2ccae8-6607-a9dd-d410-b83c19047e19 BootID:3c7c9a6e-577a-46d4-84b6-887563a18d58 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b4:b2:ec:a9:ad Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b4:b2:ec:a9:ad Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1e:ac:14:c1:28:a2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 10 14:07:57.293186 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.984195 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 10 14:07:57.293186 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.984266 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 10 14:07:57.293186 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.987679 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 10 14:07:57.293186 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.987702 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-64.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 10 14:07:57.293186 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.987903 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 14:07:57.293186 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.988566 2579 topology_manager.go:138] "Creating topology manager with none policy" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.988577 2579 container_manager_linux.go:309] "Creating device plugin manager" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.988588 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.990235 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.992054 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.996659 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.996772 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.996798 2579 kubelet.go:486] "Attempting to sync node with API server" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.996807 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.996817 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.996827 2579 kubelet.go:398] "Adding apiserver pod source" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.996837 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.997146 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.997162 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:56.999460 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.002024 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.002051 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.002240 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.002254 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.002260 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.002265 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.002273 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.002282 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.002883 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.002895 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.002905 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.002913 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.002926 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.002937 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.003853 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.003863 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.007035 2579 server.go:1268] "Started kubelet" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.007164 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.007143 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.007806 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-64.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:57.007809 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-64.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:57.007824 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.007868 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.009262 2579 server.go:310] "Adding debug handlers to kubelet server" Jul 10 14:07:57.293396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.011151 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 10 14:07:57.294376 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:57.014478 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-64.ec2.internal.18c0f2db808a0e25 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-64.ec2.internal,UID:ip-10-0-135-64.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-64.ec2.internal,},FirstTimestamp:2026-07-10 14:07:57.007007269 +0000 UTC m=+0.433231580,LastTimestamp:2026-07-10 14:07:57.007007269 +0000 UTC m=+0.433231580,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-64.ec2.internal,}" Jul 10 14:07:57.294376 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:57.020014 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 10 14:07:57.294376 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.025697 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 10 14:07:57.294376 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.025720 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 10 14:07:57.294376 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:57.025790 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-64.ec2.internal\" not found" Jul 10 14:07:57.294376 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.026416 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 10 14:07:57.294376 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.026419 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 10 14:07:57.294376 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.026438 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 10 14:07:57.294376 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.026511 2579 reconstruct.go:97] "Volume reconstruction finished" Jul 10 14:07:57.294376 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.026522 2579 reconciler.go:29] "Reconciler: start to sync state" Jul 10 14:07:57.294376 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.026526 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 10 14:07:57.294376 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.026537 2579 factory.go:55] Registering systemd factory Jul 10 14:07:57.294376 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.026546 2579 factory.go:223] Registration of the systemd container factory successfully Jul 10 14:07:57.294376 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.026776 2579 factory.go:153] Registering CRI-O factory Jul 10 14:07:57.294376 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.026786 2579 factory.go:223] Registration of the crio container factory successfully Jul 10 14:07:57.294376 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.026802 2579 factory.go:103] Registering Raw factory Jul 10 14:07:57.294376 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.026811 2579 manager.go:1196] Started watching for new ooms in manager Jul 10 14:07:57.294376 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.027190 2579 manager.go:349] Starting recovery of all containers Jul 10 14:07:57.294376 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:57.027939 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 10 14:07:57.294376 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:57.027975 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-64.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 10 14:07:57.294376 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.036541 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f96lq" Jul 10 14:07:57.294376 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.037432 2579 manager.go:354] Recovery completed Jul 10 14:07:57.294376 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.041122 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 14:07:57.294376 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.042761 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-64.ec2.internal" event="NodeHasSufficientMemory" Jul 10 14:07:57.294376 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.042785 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 14:07:57.294376 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.042797 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-64.ec2.internal" event="NodeHasSufficientPID" Jul 10 14:07:57.294376 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.043296 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 10 14:07:57.294376 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.043307 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 14:07:57.294376 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.043308 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 10 14:07:57.294376 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.043342 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 10 14:07:57.294376 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.043915 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-64.ec2.internal" event="NodeHasSufficientMemory" Jul 10 14:07:57.294376 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.043940 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 14:07:57.295186 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.043969 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-64.ec2.internal" event="NodeHasSufficientPID" Jul 10 14:07:57.295186 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.043972 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f96lq" Jul 10 14:07:57.295186 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.045511 2579 policy_none.go:49] "None policy: Start" Jul 10 14:07:57.295186 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.045523 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 10 14:07:57.295186 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.045533 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 10 14:07:57.295186 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.047493 2579 policy_none.go:47] "Start" Jul 10 14:07:57.295186 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.093711 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 10 14:07:57.295186 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.094796 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 10 14:07:57.295186 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.094824 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 10 14:07:57.295186 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.094847 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jul 10 14:07:57.295186 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:57.094876 2579 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jul 10 14:07:57.295186 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.097021 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 14:07:57.295186 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:57.125944 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-64.ec2.internal\" not found" Jul 10 14:07:57.295186 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:57.195987 2579 kubelet.go:2472] "Skipping pod synchronization" err="container runtime status check may not have completed yet" Jul 10 14:07:57.295186 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:57.226102 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-64.ec2.internal\" not found" Jul 10 14:07:57.326486 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:57.326451 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-64.ec2.internal\" not found" Jul 10 14:07:57.359639 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.359622 2579 manager.go:337] "Starting Device Plugin manager" Jul 10 14:07:57.359744 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:57.359729 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 10 14:07:57.359798 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.359747 2579 server.go:87] "Starting device plugin registration server" Jul 10 14:07:57.360079 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.360066 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 10 14:07:57.360137 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.360083 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 10 14:07:57.360200 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.360169 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 10 14:07:57.360287 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.360260 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 10 14:07:57.360287 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.360278 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 10 14:07:57.360763 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:57.360743 2579 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-64.ec2.internal\" not found" node="ip-10-0-135-64.ec2.internal" Jul 10 14:07:57.361403 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:57.361389 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 10 14:07:57.361471 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:57.361440 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-64.ec2.internal\" not found" Jul 10 14:07:57.396772 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.396698 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-64.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-64.ec2.internal"] Jul 10 14:07:57.396851 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.396781 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 14:07:57.397600 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.397586 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-64.ec2.internal" event="NodeHasSufficientMemory" Jul 10 14:07:57.397679 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.397617 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 14:07:57.397679 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.397632 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-64.ec2.internal" event="NodeHasSufficientPID" Jul 10 14:07:57.399875 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.399861 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 14:07:57.399994 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.399979 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-64.ec2.internal" Jul 10 14:07:57.400050 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.400006 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 14:07:57.400555 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.400541 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-64.ec2.internal" event="NodeHasSufficientMemory" Jul 10 14:07:57.400555 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.400562 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 14:07:57.400651 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.400571 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-64.ec2.internal" event="NodeHasSufficientPID" Jul 10 14:07:57.400651 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.400547 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-64.ec2.internal" event="NodeHasSufficientMemory" Jul 10 14:07:57.400651 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.400601 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 14:07:57.400651 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.400614 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-64.ec2.internal" event="NodeHasSufficientPID" Jul 10 14:07:57.402776 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.402761 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-64.ec2.internal" Jul 10 14:07:57.402838 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.402785 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 14:07:57.403372 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.403359 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-64.ec2.internal" event="NodeHasSufficientMemory" Jul 10 14:07:57.403443 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.403387 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 14:07:57.403443 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.403401 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-64.ec2.internal" event="NodeHasSufficientPID" Jul 10 14:07:57.416450 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:57.416432 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-64.ec2.internal\" not found" node="ip-10-0-135-64.ec2.internal" Jul 10 14:07:57.420625 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:57.420609 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-64.ec2.internal\" not found" node="ip-10-0-135-64.ec2.internal" Jul 10 14:07:57.428100 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.428086 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d42f5dcd4d345727f40495ab04e52e31-config\") pod \"kube-apiserver-proxy-ip-10-0-135-64.ec2.internal\" (UID: \"d42f5dcd4d345727f40495ab04e52e31\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-64.ec2.internal" Jul 10 14:07:57.428141 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.428110 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c765b849ad0a81fa60921a3583c3c8d3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-64.ec2.internal\" (UID: \"c765b849ad0a81fa60921a3583c3c8d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-64.ec2.internal" Jul 10 14:07:57.428141 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.428135 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c765b849ad0a81fa60921a3583c3c8d3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-64.ec2.internal\" (UID: \"c765b849ad0a81fa60921a3583c3c8d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-64.ec2.internal" Jul 10 14:07:57.460983 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.460966 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 14:07:57.461707 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.461692 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-64.ec2.internal" event="NodeHasSufficientMemory" Jul 10 14:07:57.461772 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.461723 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 14:07:57.461772 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.461738 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-64.ec2.internal" event="NodeHasSufficientPID" Jul 10 14:07:57.461772 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.461767 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-64.ec2.internal" Jul 10 14:07:57.468451 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.468433 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-64.ec2.internal" Jul 10 14:07:57.468451 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:57.468450 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-64.ec2.internal\": node \"ip-10-0-135-64.ec2.internal\" not found" Jul 10 14:07:57.493825 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:57.493803 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-64.ec2.internal\" not found" Jul 10 14:07:57.529260 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.529241 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c765b849ad0a81fa60921a3583c3c8d3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-64.ec2.internal\" (UID: \"c765b849ad0a81fa60921a3583c3c8d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-64.ec2.internal" Jul 10 14:07:57.529320 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.529264 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c765b849ad0a81fa60921a3583c3c8d3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-64.ec2.internal\" (UID: \"c765b849ad0a81fa60921a3583c3c8d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-64.ec2.internal" Jul 10 14:07:57.529320 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.529281 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d42f5dcd4d345727f40495ab04e52e31-config\") pod \"kube-apiserver-proxy-ip-10-0-135-64.ec2.internal\" (UID: \"d42f5dcd4d345727f40495ab04e52e31\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-64.ec2.internal" Jul 10 14:07:57.529454 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.529317 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d42f5dcd4d345727f40495ab04e52e31-config\") pod \"kube-apiserver-proxy-ip-10-0-135-64.ec2.internal\" (UID: \"d42f5dcd4d345727f40495ab04e52e31\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-64.ec2.internal" Jul 10 14:07:57.529454 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.529365 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c765b849ad0a81fa60921a3583c3c8d3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-64.ec2.internal\" (UID: \"c765b849ad0a81fa60921a3583c3c8d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-64.ec2.internal" Jul 10 14:07:57.529454 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.529362 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c765b849ad0a81fa60921a3583c3c8d3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-64.ec2.internal\" (UID: \"c765b849ad0a81fa60921a3583c3c8d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-64.ec2.internal" Jul 10 14:07:57.594406 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:57.594374 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-64.ec2.internal\" not found" Jul 10 14:07:57.698893 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:57.698804 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-64.ec2.internal\" not found" Jul 10 14:07:57.719419 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.719389 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-64.ec2.internal" Jul 10 14:07:57.724584 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.724566 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-64.ec2.internal" Jul 10 14:07:57.801935 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:57.801895 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-64.ec2.internal\" not found" Jul 10 14:07:57.904255 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:57.904221 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-64.ec2.internal\" not found" Jul 10 14:07:57.953768 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.953714 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 10 14:07:57.954296 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.953850 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 14:07:57.969373 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.969348 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 14:07:57.998860 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:57.998838 2579 apiserver.go:52] "Watching apiserver" Jul 10 14:07:58.012314 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.012296 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 10 14:07:58.012626 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.012605 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9ht","openshift-cluster-node-tuning-operator/tuned-6dgd6","openshift-multus/multus-gz99k","openshift-multus/network-metrics-daemon-bkhqd","openshift-ovn-kubernetes/ovnkube-node-jwwrp","openshift-dns/node-resolver-gz2xn","openshift-image-registry/node-ca-t4t72","openshift-multus/multus-additional-cni-plugins-pkvqn","openshift-network-diagnostics/network-check-target-xzhpq","openshift-network-operator/iptables-alerter-99crd","kube-system/global-pull-secret-syncer-86t8x","kube-system/konnectivity-agent-whgbp"] Jul 10 14:07:58.015275 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.015261 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9ht" Jul 10 14:07:58.017531 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.017512 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.018001 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.017981 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 10 14:07:58.018105 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.018004 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 10 14:07:58.018105 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.018004 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 10 14:07:58.018105 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.018044 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cv5c6\"" Jul 10 14:07:58.020799 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.020235 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 10 14:07:58.020799 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.020267 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4rz7w\"" Jul 10 14:07:58.020799 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.020582 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 10 14:07:58.021181 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.021001 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.023865 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.023849 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:07:58.023930 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:58.023906 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkhqd" podUID="46040804-7e1e-41a2-a1e7-209bdc6b2945" Jul 10 14:07:58.024131 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.024118 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 10 14:07:58.024177 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.024136 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 10 14:07:58.024177 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.024156 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rgq5t\"" Jul 10 14:07:58.024262 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.024164 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 10 14:07:58.024402 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.024386 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 10 14:07:58.026159 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.026144 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 10 14:07:58.026235 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.026144 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-64.ec2.internal" Jul 10 14:07:58.026375 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.026360 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.028781 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.028763 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gz2xn" Jul 10 14:07:58.029195 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.029174 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-x6fvb\"" Jul 10 14:07:58.029305 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.029285 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 10 14:07:58.029517 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.029471 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 10 14:07:58.029639 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.029561 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 10 14:07:58.029639 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.029561 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 10 14:07:58.029639 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.029575 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 10 14:07:58.029639 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.029608 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 10 14:07:58.031208 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.031192 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t4t72" Jul 10 14:07:58.031578 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.031557 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-tmp\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.031681 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.031587 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-system-cni-dir\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.031681 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.031606 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-multus-cni-dir\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.031681 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.031621 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-cnibin\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.031681 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.031637 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-host-var-lib-kubelet\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.031681 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.031672 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-host-slash\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.031930 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.031702 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-var-lib-openvswitch\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.031930 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.031715 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 10 14:07:58.031930 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.031739 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6ce1e1c6-c734-4df5-9079-0295f7de80f6-env-overrides\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.031930 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.031780 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/16726297-db28-4a1d-ab9f-5fe69f0ff084-etc-selinux\") pod \"aws-ebs-csi-driver-node-xl9ht\" (UID: \"16726297-db28-4a1d-ab9f-5fe69f0ff084\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9ht" Jul 10 14:07:58.031930 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.031814 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-multus-socket-dir-parent\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.031930 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.031841 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr9nj\" (UniqueName: \"kubernetes.io/projected/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-kube-api-access-lr9nj\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.031930 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.031845 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 10 14:07:58.031930 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.031869 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4488g\" (UniqueName: \"kubernetes.io/projected/16726297-db28-4a1d-ab9f-5fe69f0ff084-kube-api-access-4488g\") pod \"aws-ebs-csi-driver-node-xl9ht\" (UID: \"16726297-db28-4a1d-ab9f-5fe69f0ff084\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9ht" Jul 10 14:07:58.031930 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.031903 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-etc-sysctl-d\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.031930 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.031928 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-etc-tuned\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.032416 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.031954 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6ce1e1c6-c734-4df5-9079-0295f7de80f6-ovnkube-script-lib\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.032416 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.031964 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9rwzb\"" Jul 10 14:07:58.032416 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032001 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5297778-2ed8-4173-a78f-55109e6e5503-tmp-dir\") pod \"node-resolver-gz2xn\" (UID: \"d5297778-2ed8-4173-a78f-55109e6e5503\") " pod="openshift-dns/node-resolver-gz2xn" Jul 10 14:07:58.032416 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032026 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-etc-kubernetes\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.032416 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032050 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmh7c\" (UniqueName: \"kubernetes.io/projected/46040804-7e1e-41a2-a1e7-209bdc6b2945-kube-api-access-pmh7c\") pod \"network-metrics-daemon-bkhqd\" (UID: \"46040804-7e1e-41a2-a1e7-209bdc6b2945\") " pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:07:58.032416 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032070 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/16726297-db28-4a1d-ab9f-5fe69f0ff084-registration-dir\") pod \"aws-ebs-csi-driver-node-xl9ht\" (UID: \"16726297-db28-4a1d-ab9f-5fe69f0ff084\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9ht" Jul 10 14:07:58.032416 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032087 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-etc-kubernetes\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.032416 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032101 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-sys\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.032416 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032122 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-var-lib-kubelet\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.032416 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032144 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-host-run-netns\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.032416 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032160 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-multus-conf-dir\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.032416 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032176 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-run-systemd\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.032416 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032210 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6ce1e1c6-c734-4df5-9079-0295f7de80f6-ovnkube-config\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.032416 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032238 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d5297778-2ed8-4173-a78f-55109e6e5503-hosts-file\") pod \"node-resolver-gz2xn\" (UID: \"d5297778-2ed8-4173-a78f-55109e6e5503\") " pod="openshift-dns/node-resolver-gz2xn" Jul 10 14:07:58.033018 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032287 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-run\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.033018 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032307 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-lib-modules\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.033018 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032324 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-etc-openvswitch\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.033018 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032350 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-etc-modprobe-d\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.033018 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032372 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-host\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.033018 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032394 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-run-ovn\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.033018 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032417 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/16726297-db28-4a1d-ab9f-5fe69f0ff084-socket-dir\") pod \"aws-ebs-csi-driver-node-xl9ht\" (UID: \"16726297-db28-4a1d-ab9f-5fe69f0ff084\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9ht" Jul 10 14:07:58.033018 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032435 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/16726297-db28-4a1d-ab9f-5fe69f0ff084-device-dir\") pod \"aws-ebs-csi-driver-node-xl9ht\" (UID: \"16726297-db28-4a1d-ab9f-5fe69f0ff084\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9ht" Jul 10 14:07:58.033018 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032453 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/16726297-db28-4a1d-ab9f-5fe69f0ff084-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xl9ht\" (UID: \"16726297-db28-4a1d-ab9f-5fe69f0ff084\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9ht" Jul 10 14:07:58.033018 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032469 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-etc-sysctl-conf\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.033018 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032484 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-etc-systemd\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.033018 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032499 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-cni-binary-copy\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.033018 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032513 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-host-var-lib-cni-bin\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.033018 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032531 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-log-socket\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.033527 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032548 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr6kv\" (UniqueName: \"kubernetes.io/projected/6ce1e1c6-c734-4df5-9079-0295f7de80f6-kube-api-access-mr6kv\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.033527 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032581 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/16726297-db28-4a1d-ab9f-5fe69f0ff084-sys-fs\") pod \"aws-ebs-csi-driver-node-xl9ht\" (UID: \"16726297-db28-4a1d-ab9f-5fe69f0ff084\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9ht" Jul 10 14:07:58.033527 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032629 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-host-var-lib-cni-multus\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.033527 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032658 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-host-run-multus-certs\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.033527 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032683 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-systemd-units\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.033527 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032706 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-host-run-netns\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.033527 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032730 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-run-openvswitch\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.033527 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032754 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-host-cni-bin\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.033527 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032783 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-host-run-k8s-cni-cncf-io\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.033527 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032810 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.033527 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032835 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ce1e1c6-c734-4df5-9079-0295f7de80f6-ovn-node-metrics-cert\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.033527 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032859 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vczmk\" (UniqueName: \"kubernetes.io/projected/d5297778-2ed8-4173-a78f-55109e6e5503-kube-api-access-vczmk\") pod \"node-resolver-gz2xn\" (UID: \"d5297778-2ed8-4173-a78f-55109e6e5503\") " pod="openshift-dns/node-resolver-gz2xn" Jul 10 14:07:58.033527 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032891 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-etc-sysconfig\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.033965 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032924 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6njnq\" (UniqueName: \"kubernetes.io/projected/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-kube-api-access-6njnq\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.033965 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.032959 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-hostroot\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.033965 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.033002 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-multus-daemon-config\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.033965 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.033028 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-host-kubelet\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.033965 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.033061 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-node-log\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.033965 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.033086 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-host-run-ovn-kubernetes\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.033965 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.033109 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-os-release\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.033965 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.033153 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46040804-7e1e-41a2-a1e7-209bdc6b2945-metrics-certs\") pod \"network-metrics-daemon-bkhqd\" (UID: \"46040804-7e1e-41a2-a1e7-209bdc6b2945\") " pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:07:58.033965 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.033213 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-host-cni-netd\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.033965 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.033641 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pkvqn" Jul 10 14:07:58.033965 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.033806 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 10 14:07:58.034498 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.034024 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 10 14:07:58.034498 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.034082 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 10 14:07:58.034498 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.034343 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-44z9s\"" Jul 10 14:07:58.036143 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.036127 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzhpq" Jul 10 14:07:58.036211 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:58.036193 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzhpq" podUID="4828193c-b7e0-4bdf-bf65-a610d88c1faf" Jul 10 14:07:58.036345 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.036322 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 10 14:07:58.036780 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.036765 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-48bkj\"" Jul 10 14:07:58.036864 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.036770 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 10 14:07:58.037487 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.037462 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 14:07:58.038548 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.038531 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-99crd" Jul 10 14:07:58.041057 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.041013 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:07:58.041152 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:58.041096 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86t8x" podUID="d30d948f-76fb-4888-a860-adf9622c2f3f" Jul 10 14:07:58.041373 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.041240 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 10 14:07:58.041373 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.041282 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 10 14:07:58.041479 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.041370 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 14:07:58.041599 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.041577 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vcdfm\"" Jul 10 14:07:58.041700 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.041638 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-64.ec2.internal" Jul 10 14:07:58.041766 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.041551 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 10 14:07:58.043455 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.043438 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-64.ec2.internal"] Jul 10 14:07:58.043514 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.043503 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-whgbp" Jul 10 14:07:58.046274 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.046257 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 10 14:07:58.046373 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.046283 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 10 14:07:58.046373 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.046324 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6w5gk\"" Jul 10 14:07:58.049404 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.049328 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 14:02:57 +0000 UTC" deadline="2028-04-09 11:02:45.8534439 +0000 UTC" Jul 10 14:07:58.049404 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.049401 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15332h54m47.804047652s" Jul 10 14:07:58.051367 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.051350 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 14:07:58.051448 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.051390 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-64.ec2.internal"] Jul 10 14:07:58.067467 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.067450 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jbpvh" Jul 10 14:07:58.076477 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.076458 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jbpvh" Jul 10 14:07:58.127377 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.127359 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 10 14:07:58.134157 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134136 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-etc-sysctl-conf\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.134264 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134164 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-etc-systemd\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.134264 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134182 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-cni-binary-copy\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.134264 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134204 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-host-var-lib-cni-bin\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.134264 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134222 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-log-socket\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.134264 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134247 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr6kv\" (UniqueName: \"kubernetes.io/projected/6ce1e1c6-c734-4df5-9079-0295f7de80f6-kube-api-access-mr6kv\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.134577 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134269 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/16726297-db28-4a1d-ab9f-5fe69f0ff084-sys-fs\") pod \"aws-ebs-csi-driver-node-xl9ht\" (UID: \"16726297-db28-4a1d-ab9f-5fe69f0ff084\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9ht" Jul 10 14:07:58.134577 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134271 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-etc-systemd\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.134577 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134293 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-host-var-lib-cni-multus\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.134577 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134307 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-host-var-lib-cni-bin\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.134577 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134317 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-host-run-multus-certs\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.134577 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134318 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-log-socket\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.134577 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134348 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d30d948f-76fb-4888-a860-adf9622c2f3f-original-pull-secret\") pod \"global-pull-secret-syncer-86t8x\" (UID: \"d30d948f-76fb-4888-a860-adf9622c2f3f\") " pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:07:58.134577 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134378 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-systemd-units\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.134577 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134384 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-host-var-lib-cni-multus\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.134577 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134391 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-etc-sysctl-conf\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.134577 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134400 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-host-run-multus-certs\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.134577 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134386 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/16726297-db28-4a1d-ab9f-5fe69f0ff084-sys-fs\") pod \"aws-ebs-csi-driver-node-xl9ht\" (UID: \"16726297-db28-4a1d-ab9f-5fe69f0ff084\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9ht" Jul 10 14:07:58.134577 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134404 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-host-run-netns\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.134577 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134446 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-systemd-units\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.134577 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134444 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-host-run-netns\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.135301 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134460 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-run-openvswitch\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.135301 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134495 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-host-cni-bin\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.135301 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134495 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-run-openvswitch\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.135301 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134524 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-host-cni-bin\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.135301 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134542 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-host-run-k8s-cni-cncf-io\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.135301 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134567 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.135301 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134588 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ce1e1c6-c734-4df5-9079-0295f7de80f6-ovn-node-metrics-cert\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.135301 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134607 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vczmk\" (UniqueName: \"kubernetes.io/projected/d5297778-2ed8-4173-a78f-55109e6e5503-kube-api-access-vczmk\") pod \"node-resolver-gz2xn\" (UID: \"d5297778-2ed8-4173-a78f-55109e6e5503\") " pod="openshift-dns/node-resolver-gz2xn" Jul 10 14:07:58.135301 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134607 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-host-run-k8s-cni-cncf-io\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.135301 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134631 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.135301 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134718 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-etc-sysconfig\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.135301 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134756 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6njnq\" (UniqueName: \"kubernetes.io/projected/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-kube-api-access-6njnq\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.135301 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134773 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-hostroot\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.135301 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134809 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-etc-sysconfig\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.135979 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134826 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-hostroot\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.135979 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134883 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-multus-daemon-config\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.135979 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134904 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-host-kubelet\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.135979 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134926 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-node-log\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.135979 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134935 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 10 14:07:58.135979 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134967 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-host-run-ovn-kubernetes\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.135979 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134996 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-host-kubelet\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.135979 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135002 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-os-release\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.135979 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.134964 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-cni-binary-copy\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.135979 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135043 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-host-run-ovn-kubernetes\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.135979 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135013 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-node-log\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.135979 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135075 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d30d948f-76fb-4888-a860-adf9622c2f3f-dbus\") pod \"global-pull-secret-syncer-86t8x\" (UID: \"d30d948f-76fb-4888-a860-adf9622c2f3f\") " pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:07:58.135979 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135104 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkvzd\" (UniqueName: \"kubernetes.io/projected/2eb94f66-b549-4dc9-8065-1a3801902629-kube-api-access-gkvzd\") pod \"multus-additional-cni-plugins-pkvqn\" (UID: \"2eb94f66-b549-4dc9-8065-1a3801902629\") " pod="openshift-multus/multus-additional-cni-plugins-pkvqn" Jul 10 14:07:58.135979 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135077 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-os-release\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.135979 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135136 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46040804-7e1e-41a2-a1e7-209bdc6b2945-metrics-certs\") pod \"network-metrics-daemon-bkhqd\" (UID: \"46040804-7e1e-41a2-a1e7-209bdc6b2945\") " pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:07:58.135979 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:58.135255 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:07:58.136836 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135255 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-host-cni-netd\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.136836 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135283 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2eb94f66-b549-4dc9-8065-1a3801902629-cni-binary-copy\") pod \"multus-additional-cni-plugins-pkvqn\" (UID: \"2eb94f66-b549-4dc9-8065-1a3801902629\") " pod="openshift-multus/multus-additional-cni-plugins-pkvqn" Jul 10 14:07:58.136836 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135311 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-tmp\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.136836 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135333 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-system-cni-dir\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.136836 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135335 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-host-cni-netd\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.136836 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135354 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-multus-cni-dir\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.136836 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:58.135391 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46040804-7e1e-41a2-a1e7-209bdc6b2945-metrics-certs podName:46040804-7e1e-41a2-a1e7-209bdc6b2945 nodeName:}" failed. No retries permitted until 2026-07-10 14:07:58.635369144 +0000 UTC m=+2.061593444 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46040804-7e1e-41a2-a1e7-209bdc6b2945-metrics-certs") pod "network-metrics-daemon-bkhqd" (UID: "46040804-7e1e-41a2-a1e7-209bdc6b2945") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:07:58.136836 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135415 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-cnibin\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.136836 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135427 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-multus-daemon-config\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.136836 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135437 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-host-var-lib-kubelet\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.136836 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135441 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-system-cni-dir\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.136836 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135463 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-host-slash\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.136836 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135485 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-var-lib-openvswitch\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.136836 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135508 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6ce1e1c6-c734-4df5-9079-0295f7de80f6-env-overrides\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.137624 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135483 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-host-var-lib-kubelet\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.137624 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135508 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-cnibin\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.137624 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135517 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-host-slash\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.137624 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135545 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/16726297-db28-4a1d-ab9f-5fe69f0ff084-etc-selinux\") pod \"aws-ebs-csi-driver-node-xl9ht\" (UID: \"16726297-db28-4a1d-ab9f-5fe69f0ff084\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9ht" Jul 10 14:07:58.137624 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135555 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-multus-cni-dir\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.137624 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135576 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-multus-socket-dir-parent\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.137624 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135582 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/16726297-db28-4a1d-ab9f-5fe69f0ff084-etc-selinux\") pod \"aws-ebs-csi-driver-node-xl9ht\" (UID: \"16726297-db28-4a1d-ab9f-5fe69f0ff084\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9ht" Jul 10 14:07:58.137624 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135606 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr9nj\" (UniqueName: \"kubernetes.io/projected/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-kube-api-access-lr9nj\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.137624 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135620 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-var-lib-openvswitch\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.137624 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135635 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0d3cdfbb-705a-459b-927e-349f851ced77-iptables-alerter-script\") pod \"iptables-alerter-99crd\" (UID: \"0d3cdfbb-705a-459b-927e-349f851ced77\") " pod="openshift-network-operator/iptables-alerter-99crd" Jul 10 14:07:58.137624 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135686 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4488g\" (UniqueName: \"kubernetes.io/projected/16726297-db28-4a1d-ab9f-5fe69f0ff084-kube-api-access-4488g\") pod \"aws-ebs-csi-driver-node-xl9ht\" (UID: \"16726297-db28-4a1d-ab9f-5fe69f0ff084\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9ht" Jul 10 14:07:58.137624 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135699 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-multus-socket-dir-parent\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.137624 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135711 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-etc-sysctl-d\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.137624 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135765 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-etc-tuned\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.138352 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135794 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/60fe63fb-184b-4a4a-838e-e5c3317392e9-konnectivity-ca\") pod \"konnectivity-agent-whgbp\" (UID: \"60fe63fb-184b-4a4a-838e-e5c3317392e9\") " pod="kube-system/konnectivity-agent-whgbp" Jul 10 14:07:58.138352 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135820 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-etc-sysctl-d\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.138352 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135839 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2eb94f66-b549-4dc9-8065-1a3801902629-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pkvqn\" (UID: \"2eb94f66-b549-4dc9-8065-1a3801902629\") " pod="openshift-multus/multus-additional-cni-plugins-pkvqn" Jul 10 14:07:58.138352 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135867 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6ce1e1c6-c734-4df5-9079-0295f7de80f6-ovnkube-script-lib\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.138352 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135892 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5297778-2ed8-4173-a78f-55109e6e5503-tmp-dir\") pod \"node-resolver-gz2xn\" (UID: \"d5297778-2ed8-4173-a78f-55109e6e5503\") " pod="openshift-dns/node-resolver-gz2xn" Jul 10 14:07:58.138352 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135916 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6ce1e1c6-c734-4df5-9079-0295f7de80f6-env-overrides\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.138352 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135917 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-etc-kubernetes\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.138352 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135950 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-etc-kubernetes\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.138352 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.135956 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2eb94f66-b549-4dc9-8065-1a3801902629-system-cni-dir\") pod \"multus-additional-cni-plugins-pkvqn\" (UID: \"2eb94f66-b549-4dc9-8065-1a3801902629\") " pod="openshift-multus/multus-additional-cni-plugins-pkvqn" Jul 10 14:07:58.138352 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.136031 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2eb94f66-b549-4dc9-8065-1a3801902629-cnibin\") pod \"multus-additional-cni-plugins-pkvqn\" (UID: \"2eb94f66-b549-4dc9-8065-1a3801902629\") " pod="openshift-multus/multus-additional-cni-plugins-pkvqn" Jul 10 14:07:58.138352 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.136107 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmh7c\" (UniqueName: \"kubernetes.io/projected/46040804-7e1e-41a2-a1e7-209bdc6b2945-kube-api-access-pmh7c\") pod \"network-metrics-daemon-bkhqd\" (UID: \"46040804-7e1e-41a2-a1e7-209bdc6b2945\") " pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:07:58.138352 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.136147 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/16726297-db28-4a1d-ab9f-5fe69f0ff084-registration-dir\") pod \"aws-ebs-csi-driver-node-xl9ht\" (UID: \"16726297-db28-4a1d-ab9f-5fe69f0ff084\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9ht" Jul 10 14:07:58.138352 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.136273 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-etc-kubernetes\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.138352 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.136290 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5297778-2ed8-4173-a78f-55109e6e5503-tmp-dir\") pod \"node-resolver-gz2xn\" (UID: \"d5297778-2ed8-4173-a78f-55109e6e5503\") " pod="openshift-dns/node-resolver-gz2xn" Jul 10 14:07:58.138907 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.136324 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-sys\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.138907 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.136367 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-var-lib-kubelet\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.138907 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.136381 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-etc-kubernetes\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.138907 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.136397 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/16726297-db28-4a1d-ab9f-5fe69f0ff084-registration-dir\") pod \"aws-ebs-csi-driver-node-xl9ht\" (UID: \"16726297-db28-4a1d-ab9f-5fe69f0ff084\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9ht" Jul 10 14:07:58.138907 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.136426 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-sys\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.138907 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.136440 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-host-run-netns\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.138907 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.136474 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-var-lib-kubelet\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.138907 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.136477 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-multus-conf-dir\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.138907 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.136501 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-host-run-netns\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.138907 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.136551 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-run-systemd\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.138907 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.136577 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6ce1e1c6-c734-4df5-9079-0295f7de80f6-ovnkube-script-lib\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.138907 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.136564 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-multus-conf-dir\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.138907 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.136614 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-run-systemd\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.138907 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.136615 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d30d948f-76fb-4888-a860-adf9622c2f3f-kubelet-config\") pod \"global-pull-secret-syncer-86t8x\" (UID: \"d30d948f-76fb-4888-a860-adf9622c2f3f\") " pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:07:58.138907 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.136667 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nhpm\" (UniqueName: \"kubernetes.io/projected/4828193c-b7e0-4bdf-bf65-a610d88c1faf-kube-api-access-9nhpm\") pod \"network-check-target-xzhpq\" (UID: \"4828193c-b7e0-4bdf-bf65-a610d88c1faf\") " pod="openshift-network-diagnostics/network-check-target-xzhpq" Jul 10 14:07:58.139408 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.136702 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8d41bc8-bad3-456a-8374-1c795e333862-host\") pod \"node-ca-t4t72\" (UID: \"f8d41bc8-bad3-456a-8374-1c795e333862\") " pod="openshift-image-registry/node-ca-t4t72" Jul 10 14:07:58.139408 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.136720 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f8d41bc8-bad3-456a-8374-1c795e333862-serviceca\") pod \"node-ca-t4t72\" (UID: \"f8d41bc8-bad3-456a-8374-1c795e333862\") " pod="openshift-image-registry/node-ca-t4t72" Jul 10 14:07:58.139408 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.136736 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9v7f\" (UniqueName: \"kubernetes.io/projected/f8d41bc8-bad3-456a-8374-1c795e333862-kube-api-access-w9v7f\") pod \"node-ca-t4t72\" (UID: \"f8d41bc8-bad3-456a-8374-1c795e333862\") " pod="openshift-image-registry/node-ca-t4t72" Jul 10 14:07:58.139408 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.136757 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d3cdfbb-705a-459b-927e-349f851ced77-host-slash\") pod \"iptables-alerter-99crd\" (UID: \"0d3cdfbb-705a-459b-927e-349f851ced77\") " pod="openshift-network-operator/iptables-alerter-99crd" Jul 10 14:07:58.139408 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.136813 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh6fl\" (UniqueName: \"kubernetes.io/projected/0d3cdfbb-705a-459b-927e-349f851ced77-kube-api-access-wh6fl\") pod \"iptables-alerter-99crd\" (UID: \"0d3cdfbb-705a-459b-927e-349f851ced77\") " pod="openshift-network-operator/iptables-alerter-99crd" Jul 10 14:07:58.139408 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.136846 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6ce1e1c6-c734-4df5-9079-0295f7de80f6-ovnkube-config\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.139408 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.136892 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d5297778-2ed8-4173-a78f-55109e6e5503-hosts-file\") pod \"node-resolver-gz2xn\" (UID: \"d5297778-2ed8-4173-a78f-55109e6e5503\") " pod="openshift-dns/node-resolver-gz2xn" Jul 10 14:07:58.139408 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.136919 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-run\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.139408 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.136945 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-lib-modules\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.139408 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.136997 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2eb94f66-b549-4dc9-8065-1a3801902629-os-release\") pod \"multus-additional-cni-plugins-pkvqn\" (UID: \"2eb94f66-b549-4dc9-8065-1a3801902629\") " pod="openshift-multus/multus-additional-cni-plugins-pkvqn" Jul 10 14:07:58.139408 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.137010 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d5297778-2ed8-4173-a78f-55109e6e5503-hosts-file\") pod \"node-resolver-gz2xn\" (UID: \"d5297778-2ed8-4173-a78f-55109e6e5503\") " pod="openshift-dns/node-resolver-gz2xn" Jul 10 14:07:58.139408 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.137029 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2eb94f66-b549-4dc9-8065-1a3801902629-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pkvqn\" (UID: \"2eb94f66-b549-4dc9-8065-1a3801902629\") " pod="openshift-multus/multus-additional-cni-plugins-pkvqn" Jul 10 14:07:58.139408 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.137070 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-etc-openvswitch\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.139408 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.137116 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-lib-modules\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.139797 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.137147 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-etc-openvswitch\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.139797 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.137157 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-etc-modprobe-d\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.139797 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.137192 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-host\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.139797 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.137230 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-run-ovn\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.139797 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.137253 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-etc-modprobe-d\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.139797 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.137256 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/16726297-db28-4a1d-ab9f-5fe69f0ff084-socket-dir\") pod \"aws-ebs-csi-driver-node-xl9ht\" (UID: \"16726297-db28-4a1d-ab9f-5fe69f0ff084\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9ht" Jul 10 14:07:58.139797 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.137278 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-host\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.139797 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.137318 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6ce1e1c6-c734-4df5-9079-0295f7de80f6-run-ovn\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.139797 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.137351 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/16726297-db28-4a1d-ab9f-5fe69f0ff084-socket-dir\") pod \"aws-ebs-csi-driver-node-xl9ht\" (UID: \"16726297-db28-4a1d-ab9f-5fe69f0ff084\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9ht" Jul 10 14:07:58.139797 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.137368 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/16726297-db28-4a1d-ab9f-5fe69f0ff084-device-dir\") pod \"aws-ebs-csi-driver-node-xl9ht\" (UID: \"16726297-db28-4a1d-ab9f-5fe69f0ff084\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9ht" Jul 10 14:07:58.139797 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.137399 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/60fe63fb-184b-4a4a-838e-e5c3317392e9-agent-certs\") pod \"konnectivity-agent-whgbp\" (UID: \"60fe63fb-184b-4a4a-838e-e5c3317392e9\") " pod="kube-system/konnectivity-agent-whgbp" Jul 10 14:07:58.139797 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.137405 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/16726297-db28-4a1d-ab9f-5fe69f0ff084-device-dir\") pod \"aws-ebs-csi-driver-node-xl9ht\" (UID: \"16726297-db28-4a1d-ab9f-5fe69f0ff084\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9ht" Jul 10 14:07:58.139797 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.137368 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6ce1e1c6-c734-4df5-9079-0295f7de80f6-ovnkube-config\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.139797 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.137427 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2eb94f66-b549-4dc9-8065-1a3801902629-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pkvqn\" (UID: \"2eb94f66-b549-4dc9-8065-1a3801902629\") " pod="openshift-multus/multus-additional-cni-plugins-pkvqn" Jul 10 14:07:58.140215 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.137455 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/16726297-db28-4a1d-ab9f-5fe69f0ff084-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xl9ht\" (UID: \"16726297-db28-4a1d-ab9f-5fe69f0ff084\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9ht" Jul 10 14:07:58.140215 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.137506 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/16726297-db28-4a1d-ab9f-5fe69f0ff084-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xl9ht\" (UID: \"16726297-db28-4a1d-ab9f-5fe69f0ff084\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9ht" Jul 10 14:07:58.140215 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.137551 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-run\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.140215 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.138787 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-etc-tuned\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.140215 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.138841 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-tmp\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.140215 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.138918 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ce1e1c6-c734-4df5-9079-0295f7de80f6-ovn-node-metrics-cert\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.144351 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.144325 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6njnq\" (UniqueName: \"kubernetes.io/projected/38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f-kube-api-access-6njnq\") pod \"tuned-6dgd6\" (UID: \"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.144464 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.144446 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vczmk\" (UniqueName: \"kubernetes.io/projected/d5297778-2ed8-4173-a78f-55109e6e5503-kube-api-access-vczmk\") pod \"node-resolver-gz2xn\" (UID: \"d5297778-2ed8-4173-a78f-55109e6e5503\") " pod="openshift-dns/node-resolver-gz2xn" Jul 10 14:07:58.148608 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.148582 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr9nj\" (UniqueName: \"kubernetes.io/projected/528dd816-1f5f-4b62-ac6b-64d7a33ea2f3-kube-api-access-lr9nj\") pod \"multus-gz99k\" (UID: \"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3\") " pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.151002 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.150968 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4488g\" (UniqueName: \"kubernetes.io/projected/16726297-db28-4a1d-ab9f-5fe69f0ff084-kube-api-access-4488g\") pod \"aws-ebs-csi-driver-node-xl9ht\" (UID: \"16726297-db28-4a1d-ab9f-5fe69f0ff084\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9ht" Jul 10 14:07:58.151312 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.151293 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr6kv\" (UniqueName: \"kubernetes.io/projected/6ce1e1c6-c734-4df5-9079-0295f7de80f6-kube-api-access-mr6kv\") pod \"ovnkube-node-jwwrp\" (UID: \"6ce1e1c6-c734-4df5-9079-0295f7de80f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.151399 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.151382 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmh7c\" (UniqueName: \"kubernetes.io/projected/46040804-7e1e-41a2-a1e7-209bdc6b2945-kube-api-access-pmh7c\") pod \"network-metrics-daemon-bkhqd\" (UID: \"46040804-7e1e-41a2-a1e7-209bdc6b2945\") " pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:07:58.238768 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.238690 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/60fe63fb-184b-4a4a-838e-e5c3317392e9-konnectivity-ca\") pod \"konnectivity-agent-whgbp\" (UID: \"60fe63fb-184b-4a4a-838e-e5c3317392e9\") " pod="kube-system/konnectivity-agent-whgbp" Jul 10 14:07:58.238768 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.238722 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2eb94f66-b549-4dc9-8065-1a3801902629-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pkvqn\" (UID: \"2eb94f66-b549-4dc9-8065-1a3801902629\") " pod="openshift-multus/multus-additional-cni-plugins-pkvqn" Jul 10 14:07:58.238768 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.238742 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2eb94f66-b549-4dc9-8065-1a3801902629-system-cni-dir\") pod \"multus-additional-cni-plugins-pkvqn\" (UID: \"2eb94f66-b549-4dc9-8065-1a3801902629\") " pod="openshift-multus/multus-additional-cni-plugins-pkvqn" Jul 10 14:07:58.238768 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.238758 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2eb94f66-b549-4dc9-8065-1a3801902629-cnibin\") pod \"multus-additional-cni-plugins-pkvqn\" (UID: \"2eb94f66-b549-4dc9-8065-1a3801902629\") " pod="openshift-multus/multus-additional-cni-plugins-pkvqn" Jul 10 14:07:58.239022 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.238823 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2eb94f66-b549-4dc9-8065-1a3801902629-cnibin\") pod \"multus-additional-cni-plugins-pkvqn\" (UID: \"2eb94f66-b549-4dc9-8065-1a3801902629\") " pod="openshift-multus/multus-additional-cni-plugins-pkvqn" Jul 10 14:07:58.239022 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.238841 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2eb94f66-b549-4dc9-8065-1a3801902629-system-cni-dir\") pod \"multus-additional-cni-plugins-pkvqn\" (UID: \"2eb94f66-b549-4dc9-8065-1a3801902629\") " pod="openshift-multus/multus-additional-cni-plugins-pkvqn" Jul 10 14:07:58.239022 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.238889 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d30d948f-76fb-4888-a860-adf9622c2f3f-kubelet-config\") pod \"global-pull-secret-syncer-86t8x\" (UID: \"d30d948f-76fb-4888-a860-adf9622c2f3f\") " pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:07:58.239022 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.238916 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nhpm\" (UniqueName: \"kubernetes.io/projected/4828193c-b7e0-4bdf-bf65-a610d88c1faf-kube-api-access-9nhpm\") pod \"network-check-target-xzhpq\" (UID: \"4828193c-b7e0-4bdf-bf65-a610d88c1faf\") " pod="openshift-network-diagnostics/network-check-target-xzhpq" Jul 10 14:07:58.239022 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.238938 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8d41bc8-bad3-456a-8374-1c795e333862-host\") pod \"node-ca-t4t72\" (UID: \"f8d41bc8-bad3-456a-8374-1c795e333862\") " pod="openshift-image-registry/node-ca-t4t72" Jul 10 14:07:58.239022 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.238987 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d30d948f-76fb-4888-a860-adf9622c2f3f-kubelet-config\") pod \"global-pull-secret-syncer-86t8x\" (UID: \"d30d948f-76fb-4888-a860-adf9622c2f3f\") " pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:07:58.239022 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.238977 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f8d41bc8-bad3-456a-8374-1c795e333862-serviceca\") pod \"node-ca-t4t72\" (UID: \"f8d41bc8-bad3-456a-8374-1c795e333862\") " pod="openshift-image-registry/node-ca-t4t72" Jul 10 14:07:58.239351 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.239030 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9v7f\" (UniqueName: \"kubernetes.io/projected/f8d41bc8-bad3-456a-8374-1c795e333862-kube-api-access-w9v7f\") pod \"node-ca-t4t72\" (UID: \"f8d41bc8-bad3-456a-8374-1c795e333862\") " pod="openshift-image-registry/node-ca-t4t72" Jul 10 14:07:58.239351 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.239035 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8d41bc8-bad3-456a-8374-1c795e333862-host\") pod \"node-ca-t4t72\" (UID: \"f8d41bc8-bad3-456a-8374-1c795e333862\") " pod="openshift-image-registry/node-ca-t4t72" Jul 10 14:07:58.239351 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.239054 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d3cdfbb-705a-459b-927e-349f851ced77-host-slash\") pod \"iptables-alerter-99crd\" (UID: \"0d3cdfbb-705a-459b-927e-349f851ced77\") " pod="openshift-network-operator/iptables-alerter-99crd" Jul 10 14:07:58.239351 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.239078 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh6fl\" (UniqueName: \"kubernetes.io/projected/0d3cdfbb-705a-459b-927e-349f851ced77-kube-api-access-wh6fl\") pod \"iptables-alerter-99crd\" (UID: \"0d3cdfbb-705a-459b-927e-349f851ced77\") " pod="openshift-network-operator/iptables-alerter-99crd" Jul 10 14:07:58.239351 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.239105 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2eb94f66-b549-4dc9-8065-1a3801902629-os-release\") pod \"multus-additional-cni-plugins-pkvqn\" (UID: \"2eb94f66-b549-4dc9-8065-1a3801902629\") " pod="openshift-multus/multus-additional-cni-plugins-pkvqn" Jul 10 14:07:58.239351 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.239131 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2eb94f66-b549-4dc9-8065-1a3801902629-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pkvqn\" (UID: \"2eb94f66-b549-4dc9-8065-1a3801902629\") " pod="openshift-multus/multus-additional-cni-plugins-pkvqn" Jul 10 14:07:58.239351 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.239153 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d3cdfbb-705a-459b-927e-349f851ced77-host-slash\") pod \"iptables-alerter-99crd\" (UID: \"0d3cdfbb-705a-459b-927e-349f851ced77\") " pod="openshift-network-operator/iptables-alerter-99crd" Jul 10 14:07:58.239351 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.239186 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/60fe63fb-184b-4a4a-838e-e5c3317392e9-agent-certs\") pod \"konnectivity-agent-whgbp\" (UID: \"60fe63fb-184b-4a4a-838e-e5c3317392e9\") " pod="kube-system/konnectivity-agent-whgbp" Jul 10 14:07:58.239351 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.239211 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2eb94f66-b549-4dc9-8065-1a3801902629-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pkvqn\" (UID: \"2eb94f66-b549-4dc9-8065-1a3801902629\") " pod="openshift-multus/multus-additional-cni-plugins-pkvqn" Jul 10 14:07:58.239351 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.239246 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d30d948f-76fb-4888-a860-adf9622c2f3f-original-pull-secret\") pod \"global-pull-secret-syncer-86t8x\" (UID: \"d30d948f-76fb-4888-a860-adf9622c2f3f\") " pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:07:58.239351 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.239248 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2eb94f66-b549-4dc9-8065-1a3801902629-os-release\") pod \"multus-additional-cni-plugins-pkvqn\" (UID: \"2eb94f66-b549-4dc9-8065-1a3801902629\") " pod="openshift-multus/multus-additional-cni-plugins-pkvqn" Jul 10 14:07:58.239351 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.239294 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d30d948f-76fb-4888-a860-adf9622c2f3f-dbus\") pod \"global-pull-secret-syncer-86t8x\" (UID: \"d30d948f-76fb-4888-a860-adf9622c2f3f\") " pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:07:58.239351 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.239317 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkvzd\" (UniqueName: \"kubernetes.io/projected/2eb94f66-b549-4dc9-8065-1a3801902629-kube-api-access-gkvzd\") pod \"multus-additional-cni-plugins-pkvqn\" (UID: \"2eb94f66-b549-4dc9-8065-1a3801902629\") " pod="openshift-multus/multus-additional-cni-plugins-pkvqn" Jul 10 14:07:58.239351 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.239357 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2eb94f66-b549-4dc9-8065-1a3801902629-cni-binary-copy\") pod \"multus-additional-cni-plugins-pkvqn\" (UID: \"2eb94f66-b549-4dc9-8065-1a3801902629\") " pod="openshift-multus/multus-additional-cni-plugins-pkvqn" Jul 10 14:07:58.239906 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.239361 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2eb94f66-b549-4dc9-8065-1a3801902629-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pkvqn\" (UID: \"2eb94f66-b549-4dc9-8065-1a3801902629\") " pod="openshift-multus/multus-additional-cni-plugins-pkvqn" Jul 10 14:07:58.239906 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.239387 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/60fe63fb-184b-4a4a-838e-e5c3317392e9-konnectivity-ca\") pod \"konnectivity-agent-whgbp\" (UID: \"60fe63fb-184b-4a4a-838e-e5c3317392e9\") " pod="kube-system/konnectivity-agent-whgbp" Jul 10 14:07:58.239906 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.239395 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0d3cdfbb-705a-459b-927e-349f851ced77-iptables-alerter-script\") pod \"iptables-alerter-99crd\" (UID: \"0d3cdfbb-705a-459b-927e-349f851ced77\") " pod="openshift-network-operator/iptables-alerter-99crd" Jul 10 14:07:58.239906 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.239495 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f8d41bc8-bad3-456a-8374-1c795e333862-serviceca\") pod \"node-ca-t4t72\" (UID: \"f8d41bc8-bad3-456a-8374-1c795e333862\") " pod="openshift-image-registry/node-ca-t4t72" Jul 10 14:07:58.239906 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.239503 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2eb94f66-b549-4dc9-8065-1a3801902629-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pkvqn\" (UID: \"2eb94f66-b549-4dc9-8065-1a3801902629\") " pod="openshift-multus/multus-additional-cni-plugins-pkvqn" Jul 10 14:07:58.239906 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:58.239518 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 14:07:58.239906 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.239506 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d30d948f-76fb-4888-a860-adf9622c2f3f-dbus\") pod \"global-pull-secret-syncer-86t8x\" (UID: \"d30d948f-76fb-4888-a860-adf9622c2f3f\") " pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:07:58.239906 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:58.239581 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d30d948f-76fb-4888-a860-adf9622c2f3f-original-pull-secret podName:d30d948f-76fb-4888-a860-adf9622c2f3f nodeName:}" failed. No retries permitted until 2026-07-10 14:07:58.73956375 +0000 UTC m=+2.165788066 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d30d948f-76fb-4888-a860-adf9622c2f3f-original-pull-secret") pod "global-pull-secret-syncer-86t8x" (UID: "d30d948f-76fb-4888-a860-adf9622c2f3f") : object "kube-system"/"original-pull-secret" not registered Jul 10 14:07:58.239906 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.239752 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2eb94f66-b549-4dc9-8065-1a3801902629-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pkvqn\" (UID: \"2eb94f66-b549-4dc9-8065-1a3801902629\") " pod="openshift-multus/multus-additional-cni-plugins-pkvqn" Jul 10 14:07:58.240192 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.239938 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2eb94f66-b549-4dc9-8065-1a3801902629-cni-binary-copy\") pod \"multus-additional-cni-plugins-pkvqn\" (UID: \"2eb94f66-b549-4dc9-8065-1a3801902629\") " pod="openshift-multus/multus-additional-cni-plugins-pkvqn" Jul 10 14:07:58.240665 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.240649 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0d3cdfbb-705a-459b-927e-349f851ced77-iptables-alerter-script\") pod \"iptables-alerter-99crd\" (UID: \"0d3cdfbb-705a-459b-927e-349f851ced77\") " pod="openshift-network-operator/iptables-alerter-99crd" Jul 10 14:07:58.241847 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.241824 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/60fe63fb-184b-4a4a-838e-e5c3317392e9-agent-certs\") pod \"konnectivity-agent-whgbp\" (UID: \"60fe63fb-184b-4a4a-838e-e5c3317392e9\") " pod="kube-system/konnectivity-agent-whgbp" Jul 10 14:07:58.250753 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:58.250731 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 14:07:58.250753 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:58.250753 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 14:07:58.250920 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:58.250763 2579 projected.go:196] Error preparing data for projected volume kube-api-access-9nhpm for pod openshift-network-diagnostics/network-check-target-xzhpq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:07:58.250920 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:58.250878 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4828193c-b7e0-4bdf-bf65-a610d88c1faf-kube-api-access-9nhpm podName:4828193c-b7e0-4bdf-bf65-a610d88c1faf nodeName:}" failed. No retries permitted until 2026-07-10 14:07:58.750857692 +0000 UTC m=+2.177081992 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9nhpm" (UniqueName: "kubernetes.io/projected/4828193c-b7e0-4bdf-bf65-a610d88c1faf-kube-api-access-9nhpm") pod "network-check-target-xzhpq" (UID: "4828193c-b7e0-4bdf-bf65-a610d88c1faf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:07:58.253333 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.253306 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9v7f\" (UniqueName: \"kubernetes.io/projected/f8d41bc8-bad3-456a-8374-1c795e333862-kube-api-access-w9v7f\") pod \"node-ca-t4t72\" (UID: \"f8d41bc8-bad3-456a-8374-1c795e333862\") " pod="openshift-image-registry/node-ca-t4t72" Jul 10 14:07:58.253406 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.253340 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkvzd\" (UniqueName: \"kubernetes.io/projected/2eb94f66-b549-4dc9-8065-1a3801902629-kube-api-access-gkvzd\") pod \"multus-additional-cni-plugins-pkvqn\" (UID: \"2eb94f66-b549-4dc9-8065-1a3801902629\") " pod="openshift-multus/multus-additional-cni-plugins-pkvqn" Jul 10 14:07:58.253733 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.253713 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh6fl\" (UniqueName: \"kubernetes.io/projected/0d3cdfbb-705a-459b-927e-349f851ced77-kube-api-access-wh6fl\") pod \"iptables-alerter-99crd\" (UID: \"0d3cdfbb-705a-459b-927e-349f851ced77\") " pod="openshift-network-operator/iptables-alerter-99crd" Jul 10 14:07:58.296262 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.296233 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 14:07:58.340690 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.340666 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9ht" Jul 10 14:07:58.352242 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.352224 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" Jul 10 14:07:58.366332 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.366307 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gz99k" Jul 10 14:07:58.375448 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.375433 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:07:58.391162 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.391146 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gz2xn" Jul 10 14:07:58.405044 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.405016 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t4t72" Jul 10 14:07:58.412932 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.412914 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pkvqn" Jul 10 14:07:58.419737 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.419719 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-99crd" Jul 10 14:07:58.435424 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.435402 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-whgbp" Jul 10 14:07:58.544942 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:58.544911 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc765b849ad0a81fa60921a3583c3c8d3.slice/crio-0dfea13d55c99617f1005b19bcae8705154108396405897b2680554686712eec WatchSource:0}: Error finding container 0dfea13d55c99617f1005b19bcae8705154108396405897b2680554686712eec: Status 404 returned error can't find the container with id 0dfea13d55c99617f1005b19bcae8705154108396405897b2680554686712eec Jul 10 14:07:58.549462 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.549445 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 14:07:58.551121 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:58.551098 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd42f5dcd4d345727f40495ab04e52e31.slice/crio-d5f394a2caebc054f35e4bd2472fe82282b8ee3a3d75fd90a7e8e7976ac6ba76 WatchSource:0}: Error finding container d5f394a2caebc054f35e4bd2472fe82282b8ee3a3d75fd90a7e8e7976ac6ba76: Status 404 returned error can't find the container with id d5f394a2caebc054f35e4bd2472fe82282b8ee3a3d75fd90a7e8e7976ac6ba76 Jul 10 14:07:58.576250 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.576230 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 14:07:58.643897 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.643869 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46040804-7e1e-41a2-a1e7-209bdc6b2945-metrics-certs\") pod \"network-metrics-daemon-bkhqd\" (UID: \"46040804-7e1e-41a2-a1e7-209bdc6b2945\") " pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:07:58.644056 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:58.644040 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:07:58.644114 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:58.644103 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46040804-7e1e-41a2-a1e7-209bdc6b2945-metrics-certs podName:46040804-7e1e-41a2-a1e7-209bdc6b2945 nodeName:}" failed. No retries permitted until 2026-07-10 14:07:59.644084395 +0000 UTC m=+3.070308706 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46040804-7e1e-41a2-a1e7-209bdc6b2945-metrics-certs") pod "network-metrics-daemon-bkhqd" (UID: "46040804-7e1e-41a2-a1e7-209bdc6b2945") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:07:58.739688 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:58.739658 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ce1e1c6_c734_4df5_9079_0295f7de80f6.slice/crio-5e53be0eb5e58e68518699ebed6c8a299c2613b4ee1bab4dc6d3bbfd3dfffef5 WatchSource:0}: Error finding container 5e53be0eb5e58e68518699ebed6c8a299c2613b4ee1bab4dc6d3bbfd3dfffef5: Status 404 returned error can't find the container with id 5e53be0eb5e58e68518699ebed6c8a299c2613b4ee1bab4dc6d3bbfd3dfffef5 Jul 10 14:07:58.745153 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.745135 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d30d948f-76fb-4888-a860-adf9622c2f3f-original-pull-secret\") pod \"global-pull-secret-syncer-86t8x\" (UID: \"d30d948f-76fb-4888-a860-adf9622c2f3f\") " pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:07:58.745247 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:58.745235 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 14:07:58.745292 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:58.745279 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d30d948f-76fb-4888-a860-adf9622c2f3f-original-pull-secret podName:d30d948f-76fb-4888-a860-adf9622c2f3f nodeName:}" failed. No retries permitted until 2026-07-10 14:07:59.745267658 +0000 UTC m=+3.171491956 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d30d948f-76fb-4888-a860-adf9622c2f3f-original-pull-secret") pod "global-pull-secret-syncer-86t8x" (UID: "d30d948f-76fb-4888-a860-adf9622c2f3f") : object "kube-system"/"original-pull-secret" not registered Jul 10 14:07:58.786216 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:58.786187 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5297778_2ed8_4173_a78f_55109e6e5503.slice/crio-79d04589a9ebf738b69f2e0c35eeff9ef58ac7d348b25688a28fd7112bb47e5b WatchSource:0}: Error finding container 79d04589a9ebf738b69f2e0c35eeff9ef58ac7d348b25688a28fd7112bb47e5b: Status 404 returned error can't find the container with id 79d04589a9ebf738b69f2e0c35eeff9ef58ac7d348b25688a28fd7112bb47e5b Jul 10 14:07:58.836294 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:58.836263 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod528dd816_1f5f_4b62_ac6b_64d7a33ea2f3.slice/crio-c874004b525bbbb325743d156cff075aaa439cb76ecc140d89364abe7dbe7978 WatchSource:0}: Error finding container c874004b525bbbb325743d156cff075aaa439cb76ecc140d89364abe7dbe7978: Status 404 returned error can't find the container with id c874004b525bbbb325743d156cff075aaa439cb76ecc140d89364abe7dbe7978 Jul 10 14:07:58.845920 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:58.845898 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nhpm\" (UniqueName: \"kubernetes.io/projected/4828193c-b7e0-4bdf-bf65-a610d88c1faf-kube-api-access-9nhpm\") pod \"network-check-target-xzhpq\" (UID: \"4828193c-b7e0-4bdf-bf65-a610d88c1faf\") " pod="openshift-network-diagnostics/network-check-target-xzhpq" Jul 10 14:07:58.846051 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:58.846038 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 14:07:58.846094 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:58.846067 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 14:07:58.846094 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:58.846078 2579 projected.go:196] Error preparing data for projected volume kube-api-access-9nhpm for pod openshift-network-diagnostics/network-check-target-xzhpq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:07:58.846161 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:58.846125 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4828193c-b7e0-4bdf-bf65-a610d88c1faf-kube-api-access-9nhpm podName:4828193c-b7e0-4bdf-bf65-a610d88c1faf nodeName:}" failed. No retries permitted until 2026-07-10 14:07:59.846110909 +0000 UTC m=+3.272335209 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9nhpm" (UniqueName: "kubernetes.io/projected/4828193c-b7e0-4bdf-bf65-a610d88c1faf-kube-api-access-9nhpm") pod "network-check-target-xzhpq" (UID: "4828193c-b7e0-4bdf-bf65-a610d88c1faf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:07:58.915478 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:58.915447 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38d9dc88_25ac_4e80_9dc8_a56a4a52ce2f.slice/crio-068441e8498bfbbc2177ec8b1158dbcc55c4878a079e88ce5925d1506c8093e3 WatchSource:0}: Error finding container 068441e8498bfbbc2177ec8b1158dbcc55c4878a079e88ce5925d1506c8093e3: Status 404 returned error can't find the container with id 068441e8498bfbbc2177ec8b1158dbcc55c4878a079e88ce5925d1506c8093e3 Jul 10 14:07:58.916875 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:58.916850 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d3cdfbb_705a_459b_927e_349f851ced77.slice/crio-33d288f160ee31f7702b1093ca5a5bd716a4561849605222c90741377455aaf3 WatchSource:0}: Error finding container 33d288f160ee31f7702b1093ca5a5bd716a4561849605222c90741377455aaf3: Status 404 returned error can't find the container with id 33d288f160ee31f7702b1093ca5a5bd716a4561849605222c90741377455aaf3 Jul 10 14:07:59.000592 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:59.000564 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eb94f66_b549_4dc9_8065_1a3801902629.slice/crio-95c4849e8a8299095bce649db7b6de15ab88be576813f5304442f78b34816b58 WatchSource:0}: Error finding container 95c4849e8a8299095bce649db7b6de15ab88be576813f5304442f78b34816b58: Status 404 returned error can't find the container with id 95c4849e8a8299095bce649db7b6de15ab88be576813f5304442f78b34816b58 Jul 10 14:07:59.079572 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:59.079506 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 14:02:58 +0000 UTC" deadline="2028-02-28 08:52:20.125114647 +0000 UTC" Jul 10 14:07:59.079572 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:59.079535 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14346h44m21.045582763s" Jul 10 14:07:59.099081 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:59.099034 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gz2xn" event={"ID":"d5297778-2ed8-4173-a78f-55109e6e5503","Type":"ContainerStarted","Data":"79d04589a9ebf738b69f2e0c35eeff9ef58ac7d348b25688a28fd7112bb47e5b"} Jul 10 14:07:59.100160 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:59.100139 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" event={"ID":"6ce1e1c6-c734-4df5-9079-0295f7de80f6","Type":"ContainerStarted","Data":"5e53be0eb5e58e68518699ebed6c8a299c2613b4ee1bab4dc6d3bbfd3dfffef5"} Jul 10 14:07:59.101201 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:59.101182 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-64.ec2.internal" event={"ID":"d42f5dcd4d345727f40495ab04e52e31","Type":"ContainerStarted","Data":"d5f394a2caebc054f35e4bd2472fe82282b8ee3a3d75fd90a7e8e7976ac6ba76"} Jul 10 14:07:59.102209 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:59.102178 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-64.ec2.internal" event={"ID":"c765b849ad0a81fa60921a3583c3c8d3","Type":"ContainerStarted","Data":"0dfea13d55c99617f1005b19bcae8705154108396405897b2680554686712eec"} Jul 10 14:07:59.103251 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:59.103231 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pkvqn" event={"ID":"2eb94f66-b549-4dc9-8065-1a3801902629","Type":"ContainerStarted","Data":"95c4849e8a8299095bce649db7b6de15ab88be576813f5304442f78b34816b58"} Jul 10 14:07:59.104247 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:59.104227 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-99crd" event={"ID":"0d3cdfbb-705a-459b-927e-349f851ced77","Type":"ContainerStarted","Data":"33d288f160ee31f7702b1093ca5a5bd716a4561849605222c90741377455aaf3"} Jul 10 14:07:59.105216 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:59.105194 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" event={"ID":"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f","Type":"ContainerStarted","Data":"068441e8498bfbbc2177ec8b1158dbcc55c4878a079e88ce5925d1506c8093e3"} Jul 10 14:07:59.106281 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:59.106263 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gz99k" event={"ID":"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3","Type":"ContainerStarted","Data":"c874004b525bbbb325743d156cff075aaa439cb76ecc140d89364abe7dbe7978"} Jul 10 14:07:59.411818 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:59.411773 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60fe63fb_184b_4a4a_838e_e5c3317392e9.slice/crio-7f77c0c3ca4e9800dce261ee8a53ff159deeb7436629465b29fb76174e91ed6d WatchSource:0}: Error finding container 7f77c0c3ca4e9800dce261ee8a53ff159deeb7436629465b29fb76174e91ed6d: Status 404 returned error can't find the container with id 7f77c0c3ca4e9800dce261ee8a53ff159deeb7436629465b29fb76174e91ed6d Jul 10 14:07:59.433902 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:59.433874 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 14:07:59.441863 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:59.441834 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16726297_db28_4a1d_ab9f_5fe69f0ff084.slice/crio-325b66a99b86bed536c3a183288552dd13c22ae95ef9569e662b5f7779878f66 WatchSource:0}: Error finding container 325b66a99b86bed536c3a183288552dd13c22ae95ef9569e662b5f7779878f66: Status 404 returned error can't find the container with id 325b66a99b86bed536c3a183288552dd13c22ae95ef9569e662b5f7779878f66 Jul 10 14:07:59.652430 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:59.652370 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46040804-7e1e-41a2-a1e7-209bdc6b2945-metrics-certs\") pod \"network-metrics-daemon-bkhqd\" (UID: \"46040804-7e1e-41a2-a1e7-209bdc6b2945\") " pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:07:59.652597 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:59.652578 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:07:59.652673 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:59.652639 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46040804-7e1e-41a2-a1e7-209bdc6b2945-metrics-certs podName:46040804-7e1e-41a2-a1e7-209bdc6b2945 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:01.652618674 +0000 UTC m=+5.078842989 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46040804-7e1e-41a2-a1e7-209bdc6b2945-metrics-certs") pod "network-metrics-daemon-bkhqd" (UID: "46040804-7e1e-41a2-a1e7-209bdc6b2945") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:07:59.752999 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:59.752918 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d30d948f-76fb-4888-a860-adf9622c2f3f-original-pull-secret\") pod \"global-pull-secret-syncer-86t8x\" (UID: \"d30d948f-76fb-4888-a860-adf9622c2f3f\") " pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:07:59.753183 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:59.753109 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 14:07:59.753183 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:59.753178 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d30d948f-76fb-4888-a860-adf9622c2f3f-original-pull-secret podName:d30d948f-76fb-4888-a860-adf9622c2f3f nodeName:}" failed. No retries permitted until 2026-07-10 14:08:01.753159297 +0000 UTC m=+5.179383600 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d30d948f-76fb-4888-a860-adf9622c2f3f-original-pull-secret") pod "global-pull-secret-syncer-86t8x" (UID: "d30d948f-76fb-4888-a860-adf9622c2f3f") : object "kube-system"/"original-pull-secret" not registered Jul 10 14:07:59.809748 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:07:59.809699 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8d41bc8_bad3_456a_8374_1c795e333862.slice/crio-6b9b6d76c0dcb6355adaa9f3131f3e4de5c8c4bcb119e7e779b9bd5392acaf7e WatchSource:0}: Error finding container 6b9b6d76c0dcb6355adaa9f3131f3e4de5c8c4bcb119e7e779b9bd5392acaf7e: Status 404 returned error can't find the container with id 6b9b6d76c0dcb6355adaa9f3131f3e4de5c8c4bcb119e7e779b9bd5392acaf7e Jul 10 14:07:59.853594 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:07:59.853556 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nhpm\" (UniqueName: \"kubernetes.io/projected/4828193c-b7e0-4bdf-bf65-a610d88c1faf-kube-api-access-9nhpm\") pod \"network-check-target-xzhpq\" (UID: \"4828193c-b7e0-4bdf-bf65-a610d88c1faf\") " pod="openshift-network-diagnostics/network-check-target-xzhpq" Jul 10 14:07:59.853779 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:59.853760 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 14:07:59.853925 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:59.853788 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 14:07:59.853925 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:59.853803 2579 projected.go:196] Error preparing data for projected volume kube-api-access-9nhpm for pod openshift-network-diagnostics/network-check-target-xzhpq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:07:59.853925 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:07:59.853864 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4828193c-b7e0-4bdf-bf65-a610d88c1faf-kube-api-access-9nhpm podName:4828193c-b7e0-4bdf-bf65-a610d88c1faf nodeName:}" failed. No retries permitted until 2026-07-10 14:08:01.853845364 +0000 UTC m=+5.280069679 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9nhpm" (UniqueName: "kubernetes.io/projected/4828193c-b7e0-4bdf-bf65-a610d88c1faf-kube-api-access-9nhpm") pod "network-check-target-xzhpq" (UID: "4828193c-b7e0-4bdf-bf65-a610d88c1faf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:08:00.080440 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:00.080316 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 14:02:58 +0000 UTC" deadline="2027-12-13 16:49:08.809421193 +0000 UTC" Jul 10 14:08:00.080440 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:00.080378 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12506h41m8.729046911s" Jul 10 14:08:00.095975 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:00.095936 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:08:00.096201 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:00.096115 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkhqd" podUID="46040804-7e1e-41a2-a1e7-209bdc6b2945" Jul 10 14:08:00.096561 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:00.096535 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzhpq" Jul 10 14:08:00.096718 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:00.096640 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzhpq" podUID="4828193c-b7e0-4bdf-bf65-a610d88c1faf" Jul 10 14:08:00.096718 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:00.096709 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:08:00.096841 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:00.096790 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86t8x" podUID="d30d948f-76fb-4888-a860-adf9622c2f3f" Jul 10 14:08:00.122504 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:00.122461 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t4t72" event={"ID":"f8d41bc8-bad3-456a-8374-1c795e333862","Type":"ContainerStarted","Data":"6b9b6d76c0dcb6355adaa9f3131f3e4de5c8c4bcb119e7e779b9bd5392acaf7e"} Jul 10 14:08:00.126361 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:00.126330 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9ht" event={"ID":"16726297-db28-4a1d-ab9f-5fe69f0ff084","Type":"ContainerStarted","Data":"325b66a99b86bed536c3a183288552dd13c22ae95ef9569e662b5f7779878f66"} Jul 10 14:08:00.129410 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:00.129379 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-whgbp" event={"ID":"60fe63fb-184b-4a4a-838e-e5c3317392e9","Type":"ContainerStarted","Data":"7f77c0c3ca4e9800dce261ee8a53ff159deeb7436629465b29fb76174e91ed6d"} Jul 10 14:08:01.673076 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:01.673037 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46040804-7e1e-41a2-a1e7-209bdc6b2945-metrics-certs\") pod \"network-metrics-daemon-bkhqd\" (UID: \"46040804-7e1e-41a2-a1e7-209bdc6b2945\") " pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:08:01.673585 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:01.673187 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:08:01.673585 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:01.673258 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46040804-7e1e-41a2-a1e7-209bdc6b2945-metrics-certs podName:46040804-7e1e-41a2-a1e7-209bdc6b2945 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:05.673237688 +0000 UTC m=+9.099461988 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46040804-7e1e-41a2-a1e7-209bdc6b2945-metrics-certs") pod "network-metrics-daemon-bkhqd" (UID: "46040804-7e1e-41a2-a1e7-209bdc6b2945") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:08:01.774018 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:01.773969 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d30d948f-76fb-4888-a860-adf9622c2f3f-original-pull-secret\") pod \"global-pull-secret-syncer-86t8x\" (UID: \"d30d948f-76fb-4888-a860-adf9622c2f3f\") " pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:08:01.774205 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:01.774186 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 14:08:01.774292 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:01.774256 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d30d948f-76fb-4888-a860-adf9622c2f3f-original-pull-secret podName:d30d948f-76fb-4888-a860-adf9622c2f3f nodeName:}" failed. No retries permitted until 2026-07-10 14:08:05.774237256 +0000 UTC m=+9.200461558 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d30d948f-76fb-4888-a860-adf9622c2f3f-original-pull-secret") pod "global-pull-secret-syncer-86t8x" (UID: "d30d948f-76fb-4888-a860-adf9622c2f3f") : object "kube-system"/"original-pull-secret" not registered Jul 10 14:08:01.874981 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:01.874928 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nhpm\" (UniqueName: \"kubernetes.io/projected/4828193c-b7e0-4bdf-bf65-a610d88c1faf-kube-api-access-9nhpm\") pod \"network-check-target-xzhpq\" (UID: \"4828193c-b7e0-4bdf-bf65-a610d88c1faf\") " pod="openshift-network-diagnostics/network-check-target-xzhpq" Jul 10 14:08:01.875201 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:01.875143 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 14:08:01.875201 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:01.875164 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 14:08:01.875201 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:01.875179 2579 projected.go:196] Error preparing data for projected volume kube-api-access-9nhpm for pod openshift-network-diagnostics/network-check-target-xzhpq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:08:01.875385 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:01.875243 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4828193c-b7e0-4bdf-bf65-a610d88c1faf-kube-api-access-9nhpm podName:4828193c-b7e0-4bdf-bf65-a610d88c1faf nodeName:}" failed. No retries permitted until 2026-07-10 14:08:05.87522303 +0000 UTC m=+9.301447387 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9nhpm" (UniqueName: "kubernetes.io/projected/4828193c-b7e0-4bdf-bf65-a610d88c1faf-kube-api-access-9nhpm") pod "network-check-target-xzhpq" (UID: "4828193c-b7e0-4bdf-bf65-a610d88c1faf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:08:02.095532 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:02.095496 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzhpq" Jul 10 14:08:02.095734 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:02.095621 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzhpq" podUID="4828193c-b7e0-4bdf-bf65-a610d88c1faf" Jul 10 14:08:02.095734 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:02.095693 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:08:02.095871 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:02.095770 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86t8x" podUID="d30d948f-76fb-4888-a860-adf9622c2f3f" Jul 10 14:08:02.095871 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:02.095823 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:08:02.095976 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:02.095908 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkhqd" podUID="46040804-7e1e-41a2-a1e7-209bdc6b2945" Jul 10 14:08:04.095336 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:04.095303 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzhpq" Jul 10 14:08:04.095336 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:04.095325 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:08:04.096011 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:04.095454 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzhpq" podUID="4828193c-b7e0-4bdf-bf65-a610d88c1faf" Jul 10 14:08:04.096011 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:04.095519 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86t8x" podUID="d30d948f-76fb-4888-a860-adf9622c2f3f" Jul 10 14:08:04.096011 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:04.095580 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:08:04.096011 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:04.095691 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkhqd" podUID="46040804-7e1e-41a2-a1e7-209bdc6b2945" Jul 10 14:08:05.712597 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:05.712496 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46040804-7e1e-41a2-a1e7-209bdc6b2945-metrics-certs\") pod \"network-metrics-daemon-bkhqd\" (UID: \"46040804-7e1e-41a2-a1e7-209bdc6b2945\") " pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:08:05.713094 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:05.712703 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:08:05.713094 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:05.712778 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46040804-7e1e-41a2-a1e7-209bdc6b2945-metrics-certs podName:46040804-7e1e-41a2-a1e7-209bdc6b2945 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:13.712756025 +0000 UTC m=+17.138980341 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46040804-7e1e-41a2-a1e7-209bdc6b2945-metrics-certs") pod "network-metrics-daemon-bkhqd" (UID: "46040804-7e1e-41a2-a1e7-209bdc6b2945") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:08:05.812973 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:05.812922 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d30d948f-76fb-4888-a860-adf9622c2f3f-original-pull-secret\") pod \"global-pull-secret-syncer-86t8x\" (UID: \"d30d948f-76fb-4888-a860-adf9622c2f3f\") " pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:08:05.813152 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:05.813097 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 14:08:05.813207 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:05.813176 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d30d948f-76fb-4888-a860-adf9622c2f3f-original-pull-secret podName:d30d948f-76fb-4888-a860-adf9622c2f3f nodeName:}" failed. No retries permitted until 2026-07-10 14:08:13.813157538 +0000 UTC m=+17.239381839 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d30d948f-76fb-4888-a860-adf9622c2f3f-original-pull-secret") pod "global-pull-secret-syncer-86t8x" (UID: "d30d948f-76fb-4888-a860-adf9622c2f3f") : object "kube-system"/"original-pull-secret" not registered Jul 10 14:08:05.913958 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:05.913922 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nhpm\" (UniqueName: \"kubernetes.io/projected/4828193c-b7e0-4bdf-bf65-a610d88c1faf-kube-api-access-9nhpm\") pod \"network-check-target-xzhpq\" (UID: \"4828193c-b7e0-4bdf-bf65-a610d88c1faf\") " pod="openshift-network-diagnostics/network-check-target-xzhpq" Jul 10 14:08:05.914150 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:05.914104 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 14:08:05.914150 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:05.914130 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 14:08:05.914150 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:05.914145 2579 projected.go:196] Error preparing data for projected volume kube-api-access-9nhpm for pod openshift-network-diagnostics/network-check-target-xzhpq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:08:05.914344 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:05.914216 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4828193c-b7e0-4bdf-bf65-a610d88c1faf-kube-api-access-9nhpm podName:4828193c-b7e0-4bdf-bf65-a610d88c1faf nodeName:}" failed. No retries permitted until 2026-07-10 14:08:13.914195795 +0000 UTC m=+17.340420104 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9nhpm" (UniqueName: "kubernetes.io/projected/4828193c-b7e0-4bdf-bf65-a610d88c1faf-kube-api-access-9nhpm") pod "network-check-target-xzhpq" (UID: "4828193c-b7e0-4bdf-bf65-a610d88c1faf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:08:06.095384 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:06.095287 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzhpq" Jul 10 14:08:06.095384 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:06.095313 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:08:06.095384 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:06.095313 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:08:06.095673 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:06.095424 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzhpq" podUID="4828193c-b7e0-4bdf-bf65-a610d88c1faf" Jul 10 14:08:06.095673 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:06.095523 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkhqd" podUID="46040804-7e1e-41a2-a1e7-209bdc6b2945" Jul 10 14:08:06.095673 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:06.095652 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86t8x" podUID="d30d948f-76fb-4888-a860-adf9622c2f3f" Jul 10 14:08:08.095763 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:08.095337 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:08:08.095763 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:08.095458 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86t8x" podUID="d30d948f-76fb-4888-a860-adf9622c2f3f" Jul 10 14:08:08.095763 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:08.095641 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzhpq" Jul 10 14:08:08.095763 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:08.095722 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzhpq" podUID="4828193c-b7e0-4bdf-bf65-a610d88c1faf" Jul 10 14:08:08.095763 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:08.095727 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:08:08.096383 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:08.095885 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkhqd" podUID="46040804-7e1e-41a2-a1e7-209bdc6b2945" Jul 10 14:08:10.095790 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:10.095752 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:08:10.095790 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:10.095767 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:08:10.095790 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:10.095767 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzhpq" Jul 10 14:08:10.096366 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:10.095892 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkhqd" podUID="46040804-7e1e-41a2-a1e7-209bdc6b2945" Jul 10 14:08:10.096366 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:10.096113 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzhpq" podUID="4828193c-b7e0-4bdf-bf65-a610d88c1faf" Jul 10 14:08:10.096366 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:10.096212 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86t8x" podUID="d30d948f-76fb-4888-a860-adf9622c2f3f" Jul 10 14:08:12.095199 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:12.095168 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:08:12.095655 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:12.095211 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzhpq" Jul 10 14:08:12.095655 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:12.095175 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:08:12.095655 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:12.095304 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkhqd" podUID="46040804-7e1e-41a2-a1e7-209bdc6b2945" Jul 10 14:08:12.095655 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:12.095435 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86t8x" podUID="d30d948f-76fb-4888-a860-adf9622c2f3f" Jul 10 14:08:12.095655 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:12.095519 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzhpq" podUID="4828193c-b7e0-4bdf-bf65-a610d88c1faf" Jul 10 14:08:13.776863 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:13.776823 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46040804-7e1e-41a2-a1e7-209bdc6b2945-metrics-certs\") pod \"network-metrics-daemon-bkhqd\" (UID: \"46040804-7e1e-41a2-a1e7-209bdc6b2945\") " pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:08:13.777311 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:13.776996 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:08:13.777311 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:13.777063 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46040804-7e1e-41a2-a1e7-209bdc6b2945-metrics-certs podName:46040804-7e1e-41a2-a1e7-209bdc6b2945 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:29.777041377 +0000 UTC m=+33.203265675 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46040804-7e1e-41a2-a1e7-209bdc6b2945-metrics-certs") pod "network-metrics-daemon-bkhqd" (UID: "46040804-7e1e-41a2-a1e7-209bdc6b2945") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:08:13.877751 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:13.877712 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d30d948f-76fb-4888-a860-adf9622c2f3f-original-pull-secret\") pod \"global-pull-secret-syncer-86t8x\" (UID: \"d30d948f-76fb-4888-a860-adf9622c2f3f\") " pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:08:13.877908 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:13.877832 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 14:08:13.877908 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:13.877882 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d30d948f-76fb-4888-a860-adf9622c2f3f-original-pull-secret podName:d30d948f-76fb-4888-a860-adf9622c2f3f nodeName:}" failed. No retries permitted until 2026-07-10 14:08:29.877868587 +0000 UTC m=+33.304092890 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d30d948f-76fb-4888-a860-adf9622c2f3f-original-pull-secret") pod "global-pull-secret-syncer-86t8x" (UID: "d30d948f-76fb-4888-a860-adf9622c2f3f") : object "kube-system"/"original-pull-secret" not registered Jul 10 14:08:13.978294 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:13.978260 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nhpm\" (UniqueName: \"kubernetes.io/projected/4828193c-b7e0-4bdf-bf65-a610d88c1faf-kube-api-access-9nhpm\") pod \"network-check-target-xzhpq\" (UID: \"4828193c-b7e0-4bdf-bf65-a610d88c1faf\") " pod="openshift-network-diagnostics/network-check-target-xzhpq" Jul 10 14:08:13.978438 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:13.978421 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 14:08:13.978502 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:13.978445 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 14:08:13.978502 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:13.978458 2579 projected.go:196] Error preparing data for projected volume kube-api-access-9nhpm for pod openshift-network-diagnostics/network-check-target-xzhpq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:08:13.978604 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:13.978517 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4828193c-b7e0-4bdf-bf65-a610d88c1faf-kube-api-access-9nhpm podName:4828193c-b7e0-4bdf-bf65-a610d88c1faf nodeName:}" failed. No retries permitted until 2026-07-10 14:08:29.978503445 +0000 UTC m=+33.404727745 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9nhpm" (UniqueName: "kubernetes.io/projected/4828193c-b7e0-4bdf-bf65-a610d88c1faf-kube-api-access-9nhpm") pod "network-check-target-xzhpq" (UID: "4828193c-b7e0-4bdf-bf65-a610d88c1faf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:08:14.095633 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:14.095548 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:08:14.095788 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:14.095558 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:08:14.095788 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:14.095686 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzhpq" Jul 10 14:08:14.095788 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:14.095678 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkhqd" podUID="46040804-7e1e-41a2-a1e7-209bdc6b2945" Jul 10 14:08:14.095788 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:14.095772 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86t8x" podUID="d30d948f-76fb-4888-a860-adf9622c2f3f" Jul 10 14:08:14.095979 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:14.095828 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzhpq" podUID="4828193c-b7e0-4bdf-bf65-a610d88c1faf" Jul 10 14:08:16.095482 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:16.095447 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:08:16.095895 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:16.095489 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:08:16.095895 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:16.095488 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzhpq" Jul 10 14:08:16.095895 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:16.095573 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86t8x" podUID="d30d948f-76fb-4888-a860-adf9622c2f3f" Jul 10 14:08:16.095895 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:16.095664 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkhqd" podUID="46040804-7e1e-41a2-a1e7-209bdc6b2945" Jul 10 14:08:16.095895 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:16.095746 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzhpq" podUID="4828193c-b7e0-4bdf-bf65-a610d88c1faf" Jul 10 14:08:18.095527 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:18.095426 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzhpq" Jul 10 14:08:18.095527 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:18.095482 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:08:18.096054 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:18.095564 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:08:18.096054 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:18.095571 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzhpq" podUID="4828193c-b7e0-4bdf-bf65-a610d88c1faf" Jul 10 14:08:18.096054 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:18.095659 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86t8x" podUID="d30d948f-76fb-4888-a860-adf9622c2f3f" Jul 10 14:08:18.096054 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:18.095772 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkhqd" podUID="46040804-7e1e-41a2-a1e7-209bdc6b2945" Jul 10 14:08:20.095913 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:20.095623 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzhpq" Jul 10 14:08:20.096639 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:20.095659 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:08:20.096639 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:20.095664 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:08:20.096639 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:20.096025 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzhpq" podUID="4828193c-b7e0-4bdf-bf65-a610d88c1faf" Jul 10 14:08:20.096639 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:20.096117 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkhqd" podUID="46040804-7e1e-41a2-a1e7-209bdc6b2945" Jul 10 14:08:20.096639 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:20.096171 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86t8x" podUID="d30d948f-76fb-4888-a860-adf9622c2f3f" Jul 10 14:08:20.172802 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:20.172775 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t4t72" event={"ID":"f8d41bc8-bad3-456a-8374-1c795e333862","Type":"ContainerStarted","Data":"50591ff738fe7fd0502c7c24a65014159f941231e84f4424e8ff3904dd153a2b"} Jul 10 14:08:20.174235 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:20.174211 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9ht" event={"ID":"16726297-db28-4a1d-ab9f-5fe69f0ff084","Type":"ContainerStarted","Data":"9769caa220ac1e0941e3a448f7577f3712eccf8075ed5732b72b9dd4dc9e0193"} Jul 10 14:08:20.175860 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:20.175835 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" event={"ID":"38d9dc88-25ac-4e80-9dc8-a56a4a52ce2f","Type":"ContainerStarted","Data":"037ee7b2378380974371d6aa3cb501773c18ae749df7106b029576324b80bf15"} Jul 10 14:08:20.178811 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:20.178794 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jwwrp_6ce1e1c6-c734-4df5-9079-0295f7de80f6/ovn-acl-logging/0.log" Jul 10 14:08:20.179174 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:20.179156 2579 generic.go:356] "Generic (PLEG): container finished" podID="6ce1e1c6-c734-4df5-9079-0295f7de80f6" containerID="c1441c7d83c7d71fac5821e0ecf2b6c157486fa42e0dacf1e3dbe52148efda8f" exitCode=1 Jul 10 14:08:20.179255 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:20.179223 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" event={"ID":"6ce1e1c6-c734-4df5-9079-0295f7de80f6","Type":"ContainerStarted","Data":"df20415d59ba5beac77c60dc35074e8e57afd2af650e4a9889a3ac0b45b53933"} Jul 10 14:08:20.179315 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:20.179281 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" event={"ID":"6ce1e1c6-c734-4df5-9079-0295f7de80f6","Type":"ContainerStarted","Data":"9d807f1a95fe4239314e2f943cfbadf0307ca3e952703689aeffa1a1359cdf48"} Jul 10 14:08:20.179364 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:20.179320 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" event={"ID":"6ce1e1c6-c734-4df5-9079-0295f7de80f6","Type":"ContainerStarted","Data":"4cdd2c6c036edc5f756f8eec09fd7549267ab49ff68d14ac31eec431f6c7bc9a"} Jul 10 14:08:20.179364 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:20.179361 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" event={"ID":"6ce1e1c6-c734-4df5-9079-0295f7de80f6","Type":"ContainerDied","Data":"c1441c7d83c7d71fac5821e0ecf2b6c157486fa42e0dacf1e3dbe52148efda8f"} Jul 10 14:08:20.179468 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:20.179392 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" event={"ID":"6ce1e1c6-c734-4df5-9079-0295f7de80f6","Type":"ContainerStarted","Data":"49d62330b74297a03b1e9edec4b98e649db7f954bd2aff5528746c41e3bd49f6"} Jul 10 14:08:20.180496 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:20.180475 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-whgbp" event={"ID":"60fe63fb-184b-4a4a-838e-e5c3317392e9","Type":"ContainerStarted","Data":"45226be8efac8f93be01910ac9b5d6e1dbdb676f0033926ba43d36bff4e2ff9c"} Jul 10 14:08:20.182074 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:20.182054 2579 generic.go:356] "Generic (PLEG): container finished" podID="2eb94f66-b549-4dc9-8065-1a3801902629" containerID="10c7b62ce29a5cdd9f9529a15dece7911eca43d1c3d7794cd5529eaaa6b7ee11" exitCode=0 Jul 10 14:08:20.182158 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:20.182080 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pkvqn" event={"ID":"2eb94f66-b549-4dc9-8065-1a3801902629","Type":"ContainerDied","Data":"10c7b62ce29a5cdd9f9529a15dece7911eca43d1c3d7794cd5529eaaa6b7ee11"} Jul 10 14:08:20.183804 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:20.183787 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gz99k" event={"ID":"528dd816-1f5f-4b62-ac6b-64d7a33ea2f3","Type":"ContainerStarted","Data":"08c2d7257cb615a77d1a2012b80da835c37e33555eee2a00b848c6d4dbc2f89b"} Jul 10 14:08:20.185295 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:20.185274 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gz2xn" event={"ID":"d5297778-2ed8-4173-a78f-55109e6e5503","Type":"ContainerStarted","Data":"9a993a9e6b2460dd6748fa4fc07a2df6f8d8d8408eef5dcaad65259bae2e3946"} Jul 10 14:08:20.189386 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:20.189363 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-64.ec2.internal" event={"ID":"d42f5dcd4d345727f40495ab04e52e31","Type":"ContainerStarted","Data":"ec395203027e8681644e02a9ee8757d6e7ae30142de9774130927a622e174912"} Jul 10 14:08:20.190816 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:20.190792 2579 generic.go:356] "Generic (PLEG): container finished" podID="c765b849ad0a81fa60921a3583c3c8d3" containerID="4d286a01376a4b1957111336df2a91b33fa396f6fb68cd6c9855c2ce9ba6a05c" exitCode=0 Jul 10 14:08:20.190911 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:20.190827 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-64.ec2.internal" event={"ID":"c765b849ad0a81fa60921a3583c3c8d3","Type":"ContainerDied","Data":"4d286a01376a4b1957111336df2a91b33fa396f6fb68cd6c9855c2ce9ba6a05c"} Jul 10 14:08:20.191140 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:20.191096 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-t4t72" podStartSLOduration=2.828455142 podStartE2EDuration="22.191083957s" totalImagesPullingTime="19.362628815s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:08:20.190542647 +0000 UTC m=+23.616766969" watchObservedRunningTime="2026-07-10 14:08:20.191083957 +0000 UTC m=+23.617308276" Jul 10 14:08:20.211335 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:20.211300 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6dgd6" podStartSLOduration=1.943200729 podStartE2EDuration="22.211288677s" totalImagesPullingTime="20.268087948s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:08:20.211107709 +0000 UTC m=+23.637332031" watchObservedRunningTime="2026-07-10 14:08:20.211288677 +0000 UTC m=+23.637512998" Jul 10 14:08:20.233124 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:20.232873 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gz99k" podStartSLOduration=1.851519417 podStartE2EDuration="22.232859507s" totalImagesPullingTime="20.38134009s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:08:20.232854673 +0000 UTC m=+23.659078994" watchObservedRunningTime="2026-07-10 14:08:20.232859507 +0000 UTC m=+23.659083827" Jul 10 14:08:20.259349 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:20.259312 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gz2xn" podStartSLOduration=1.8617139630000001 podStartE2EDuration="22.259299808s" totalImagesPullingTime="20.397585845s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:08:20.259014891 +0000 UTC m=+23.685239213" watchObservedRunningTime="2026-07-10 14:08:20.259299808 +0000 UTC m=+23.685524128" Jul 10 14:08:20.313590 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:20.313539 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-whgbp" podStartSLOduration=2.54207736 podStartE2EDuration="22.313522594s" totalImagesPullingTime="19.771445234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:08:20.312605575 +0000 UTC m=+23.738829894" watchObservedRunningTime="2026-07-10 14:08:20.313522594 +0000 UTC m=+23.739746915" Jul 10 14:08:20.330735 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:20.330687 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-64.ec2.internal" podStartSLOduration=22.330673652 podStartE2EDuration="22.330673652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:07:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:08:20.330650729 +0000 UTC m=+23.756875049" watchObservedRunningTime="2026-07-10 14:08:20.330673652 +0000 UTC m=+23.756897971" Jul 10 14:08:20.508415 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:20.508377 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-whgbp" Jul 10 14:08:20.742894 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:20.742864 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-whgbp" Jul 10 14:08:20.743553 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:20.743530 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-whgbp" Jul 10 14:08:21.193875 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:21.193841 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-99crd" event={"ID":"0d3cdfbb-705a-459b-927e-349f851ced77","Type":"ContainerStarted","Data":"b91ade89193121ff4dbd999acb5bb3aebb909a50894be0f85b43cfefe8ad7e44"} Jul 10 14:08:21.195513 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:21.195494 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-64.ec2.internal" event={"ID":"c765b849ad0a81fa60921a3583c3c8d3","Type":"ContainerStarted","Data":"1402c6eebef55a4529179a774a108f068ae0a37171bfce7656aca3421a518259"} Jul 10 14:08:21.198028 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:21.198004 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jwwrp_6ce1e1c6-c734-4df5-9079-0295f7de80f6/ovn-acl-logging/0.log" Jul 10 14:08:21.198318 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:21.198302 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" event={"ID":"6ce1e1c6-c734-4df5-9079-0295f7de80f6","Type":"ContainerStarted","Data":"a041c454ca6066e9493f13cef43cf254e422246d76219dbbe849725c7bfab233"} Jul 10 14:08:21.199422 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:21.199407 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-whgbp" Jul 10 14:08:21.215588 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:21.215550 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-99crd" podStartSLOduration=2.95310183 podStartE2EDuration="23.215538731s" totalImagesPullingTime="20.262436901s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:08:21.214896566 +0000 UTC m=+24.641120886" watchObservedRunningTime="2026-07-10 14:08:21.215538731 +0000 UTC m=+24.641763050" Jul 10 14:08:21.361809 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:21.361783 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 10 14:08:21.373457 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:21.373384 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T14:08:21.361805349Z","UUID":"449d2de3-a65e-4964-9bb5-e644c367ccb3","Handler":null,"Name":"","Endpoint":""} Jul 10 14:08:21.374546 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:21.374527 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 10 14:08:21.374649 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:21.374572 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 10 14:08:22.095653 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:22.095617 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:08:22.095927 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:22.095617 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzhpq" Jul 10 14:08:22.095927 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:22.095877 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzhpq" podUID="4828193c-b7e0-4bdf-bf65-a610d88c1faf" Jul 10 14:08:22.095927 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:22.095749 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86t8x" podUID="d30d948f-76fb-4888-a860-adf9622c2f3f" Jul 10 14:08:22.095927 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:22.095617 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:08:22.096163 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:22.096015 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkhqd" podUID="46040804-7e1e-41a2-a1e7-209bdc6b2945" Jul 10 14:08:22.201743 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:22.201708 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9ht" event={"ID":"16726297-db28-4a1d-ab9f-5fe69f0ff084","Type":"ContainerStarted","Data":"ec4f6ba715be0c2e40ddc798b310bed5fb0ece44f75533e8352c50db38570ea0"} Jul 10 14:08:23.205911 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:23.205877 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9ht" event={"ID":"16726297-db28-4a1d-ab9f-5fe69f0ff084","Type":"ContainerStarted","Data":"33434ca870f17502b3e38f8e75506f65f8483f6e37b0a04413cdf90f03ffd821"} Jul 10 14:08:23.208907 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:23.208887 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jwwrp_6ce1e1c6-c734-4df5-9079-0295f7de80f6/ovn-acl-logging/0.log" Jul 10 14:08:23.209305 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:23.209285 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" event={"ID":"6ce1e1c6-c734-4df5-9079-0295f7de80f6","Type":"ContainerStarted","Data":"7a23d7c8ade10ca5c94620f42d354d0668a417fb9fdca6c2ef2fcf96eafb58d4"} Jul 10 14:08:23.236422 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:23.236382 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-64.ec2.internal" podStartSLOduration=25.23636723 podStartE2EDuration="25.23636723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:07:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:08:21.274596079 +0000 UTC m=+24.700820400" watchObservedRunningTime="2026-07-10 14:08:23.23636723 +0000 UTC m=+26.662591544" Jul 10 14:08:24.095348 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:24.095314 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:08:24.095521 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:24.095314 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:08:24.095521 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:24.095400 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86t8x" podUID="d30d948f-76fb-4888-a860-adf9622c2f3f" Jul 10 14:08:24.095521 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:24.095425 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzhpq" Jul 10 14:08:24.095681 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:24.095527 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkhqd" podUID="46040804-7e1e-41a2-a1e7-209bdc6b2945" Jul 10 14:08:24.095681 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:24.095615 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzhpq" podUID="4828193c-b7e0-4bdf-bf65-a610d88c1faf" Jul 10 14:08:25.216936 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:25.216905 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jwwrp_6ce1e1c6-c734-4df5-9079-0295f7de80f6/ovn-acl-logging/0.log" Jul 10 14:08:25.217623 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:25.217319 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" event={"ID":"6ce1e1c6-c734-4df5-9079-0295f7de80f6","Type":"ContainerStarted","Data":"4764eacf725100b82a130e2fcc2ee323d70fa1a91baf07d190ba53b85c9ccfee"} Jul 10 14:08:25.217623 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:25.217597 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:08:25.217740 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:25.217655 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:08:25.217827 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:25.217802 2579 scope.go:117] "RemoveContainer" containerID="c1441c7d83c7d71fac5821e0ecf2b6c157486fa42e0dacf1e3dbe52148efda8f" Jul 10 14:08:25.234293 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:25.234261 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:08:25.266436 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:25.266389 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xl9ht" podStartSLOduration=4.866197872 podStartE2EDuration="27.266372045s" totalImagesPullingTime="22.400174173s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:07:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:08:23.237654325 +0000 UTC m=+26.663878644" watchObservedRunningTime="2026-07-10 14:08:25.266372045 +0000 UTC m=+28.692596383" Jul 10 14:08:26.098199 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:26.097578 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:08:26.098199 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:26.097720 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkhqd" podUID="46040804-7e1e-41a2-a1e7-209bdc6b2945" Jul 10 14:08:26.098199 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:26.097758 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzhpq" Jul 10 14:08:26.098199 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:26.097856 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzhpq" podUID="4828193c-b7e0-4bdf-bf65-a610d88c1faf" Jul 10 14:08:26.098199 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:26.097915 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:08:26.098199 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:26.097999 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86t8x" podUID="d30d948f-76fb-4888-a860-adf9622c2f3f" Jul 10 14:08:27.135847 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:27.135589 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xzhpq"] Jul 10 14:08:27.136669 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:27.136017 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzhpq" Jul 10 14:08:27.136669 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:27.136177 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzhpq" podUID="4828193c-b7e0-4bdf-bf65-a610d88c1faf" Jul 10 14:08:27.138574 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:27.138543 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-86t8x"] Jul 10 14:08:27.138688 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:27.138634 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:08:27.138730 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:27.138700 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86t8x" podUID="d30d948f-76fb-4888-a860-adf9622c2f3f" Jul 10 14:08:27.144917 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:27.144897 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bkhqd"] Jul 10 14:08:27.145039 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:27.144998 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:08:27.145095 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:27.145078 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkhqd" podUID="46040804-7e1e-41a2-a1e7-209bdc6b2945" Jul 10 14:08:27.223760 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:27.223722 2579 generic.go:356] "Generic (PLEG): container finished" podID="2eb94f66-b549-4dc9-8065-1a3801902629" containerID="ba13e1f07ca63711f9f39f5745b3fad8ce7a32d7b083ccc09863ebbfc21f7d93" exitCode=0 Jul 10 14:08:27.223908 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:27.223809 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pkvqn" event={"ID":"2eb94f66-b549-4dc9-8065-1a3801902629","Type":"ContainerDied","Data":"ba13e1f07ca63711f9f39f5745b3fad8ce7a32d7b083ccc09863ebbfc21f7d93"} Jul 10 14:08:27.227558 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:27.227542 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jwwrp_6ce1e1c6-c734-4df5-9079-0295f7de80f6/ovn-acl-logging/0.log" Jul 10 14:08:27.227878 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:27.227858 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" event={"ID":"6ce1e1c6-c734-4df5-9079-0295f7de80f6","Type":"ContainerStarted","Data":"3cc911a1b73caa63bc48661ee42bf3f16f8115e5ef627997e3e8e84664c8ba95"} Jul 10 14:08:27.228057 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:27.228044 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:08:27.242924 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:27.242907 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:08:27.309968 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:27.309909 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" podStartSLOduration=8.546195374 podStartE2EDuration="29.309895469s" totalImagesPullingTime="20.763700095s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:08:27.309343422 +0000 UTC m=+30.735567742" watchObservedRunningTime="2026-07-10 14:08:27.309895469 +0000 UTC m=+30.736119786" Jul 10 14:08:29.097924 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:29.097901 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzhpq" Jul 10 14:08:29.098295 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:29.097989 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:08:29.098295 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:29.098004 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzhpq" podUID="4828193c-b7e0-4bdf-bf65-a610d88c1faf" Jul 10 14:08:29.098295 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:29.098019 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:08:29.098295 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:29.098134 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkhqd" podUID="46040804-7e1e-41a2-a1e7-209bdc6b2945" Jul 10 14:08:29.098295 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:29.098188 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86t8x" podUID="d30d948f-76fb-4888-a860-adf9622c2f3f" Jul 10 14:08:29.233913 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:29.233882 2579 generic.go:356] "Generic (PLEG): container finished" podID="2eb94f66-b549-4dc9-8065-1a3801902629" containerID="468b65ecd014ff9df7509a73d42a1066da1e583e7c0f61b3564feb3819dd5534" exitCode=0 Jul 10 14:08:29.234063 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:29.233967 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pkvqn" event={"ID":"2eb94f66-b549-4dc9-8065-1a3801902629","Type":"ContainerDied","Data":"468b65ecd014ff9df7509a73d42a1066da1e583e7c0f61b3564feb3819dd5534"} Jul 10 14:08:29.244611 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:29.244580 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" podUID="6ce1e1c6-c734-4df5-9079-0295f7de80f6" containerName="ovnkube-controller" probeResult="failure" output="" Jul 10 14:08:29.794114 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:29.794084 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46040804-7e1e-41a2-a1e7-209bdc6b2945-metrics-certs\") pod \"network-metrics-daemon-bkhqd\" (UID: \"46040804-7e1e-41a2-a1e7-209bdc6b2945\") " pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:08:29.794289 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:29.794194 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:08:29.794289 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:29.794254 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46040804-7e1e-41a2-a1e7-209bdc6b2945-metrics-certs podName:46040804-7e1e-41a2-a1e7-209bdc6b2945 nodeName:}" failed. No retries permitted until 2026-07-10 14:09:01.794237239 +0000 UTC m=+65.220461549 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46040804-7e1e-41a2-a1e7-209bdc6b2945-metrics-certs") pod "network-metrics-daemon-bkhqd" (UID: "46040804-7e1e-41a2-a1e7-209bdc6b2945") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:08:29.895452 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:29.895418 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d30d948f-76fb-4888-a860-adf9622c2f3f-original-pull-secret\") pod \"global-pull-secret-syncer-86t8x\" (UID: \"d30d948f-76fb-4888-a860-adf9622c2f3f\") " pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:08:29.895605 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:29.895566 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 14:08:29.895650 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:29.895623 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d30d948f-76fb-4888-a860-adf9622c2f3f-original-pull-secret podName:d30d948f-76fb-4888-a860-adf9622c2f3f nodeName:}" failed. No retries permitted until 2026-07-10 14:09:01.895606134 +0000 UTC m=+65.321830439 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d30d948f-76fb-4888-a860-adf9622c2f3f-original-pull-secret") pod "global-pull-secret-syncer-86t8x" (UID: "d30d948f-76fb-4888-a860-adf9622c2f3f") : object "kube-system"/"original-pull-secret" not registered Jul 10 14:08:29.996369 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:29.996343 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nhpm\" (UniqueName: \"kubernetes.io/projected/4828193c-b7e0-4bdf-bf65-a610d88c1faf-kube-api-access-9nhpm\") pod \"network-check-target-xzhpq\" (UID: \"4828193c-b7e0-4bdf-bf65-a610d88c1faf\") " pod="openshift-network-diagnostics/network-check-target-xzhpq" Jul 10 14:08:29.996495 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:29.996479 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 14:08:29.996565 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:29.996501 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 14:08:29.996565 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:29.996510 2579 projected.go:196] Error preparing data for projected volume kube-api-access-9nhpm for pod openshift-network-diagnostics/network-check-target-xzhpq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:08:29.996565 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:29.996546 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4828193c-b7e0-4bdf-bf65-a610d88c1faf-kube-api-access-9nhpm podName:4828193c-b7e0-4bdf-bf65-a610d88c1faf nodeName:}" failed. No retries permitted until 2026-07-10 14:09:01.996533267 +0000 UTC m=+65.422757570 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9nhpm" (UniqueName: "kubernetes.io/projected/4828193c-b7e0-4bdf-bf65-a610d88c1faf-kube-api-access-9nhpm") pod "network-check-target-xzhpq" (UID: "4828193c-b7e0-4bdf-bf65-a610d88c1faf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:08:30.238065 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:30.238036 2579 generic.go:356] "Generic (PLEG): container finished" podID="2eb94f66-b549-4dc9-8065-1a3801902629" containerID="969e06b8804022baec397012bc1bbd166de39a38a425911cd2bd0cfab6c005ee" exitCode=0 Jul 10 14:08:30.238404 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:30.238094 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pkvqn" event={"ID":"2eb94f66-b549-4dc9-8065-1a3801902629","Type":"ContainerDied","Data":"969e06b8804022baec397012bc1bbd166de39a38a425911cd2bd0cfab6c005ee"} Jul 10 14:08:31.098890 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:31.098863 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:08:31.099058 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:31.098866 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzhpq" Jul 10 14:08:31.099058 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:31.098973 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86t8x" podUID="d30d948f-76fb-4888-a860-adf9622c2f3f" Jul 10 14:08:31.099058 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:31.098866 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:08:31.099058 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:31.099041 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzhpq" podUID="4828193c-b7e0-4bdf-bf65-a610d88c1faf" Jul 10 14:08:31.099214 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:31.099113 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkhqd" podUID="46040804-7e1e-41a2-a1e7-209bdc6b2945" Jul 10 14:08:33.095436 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.095138 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:08:33.095801 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.095138 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzhpq" Jul 10 14:08:33.095801 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.095174 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:08:33.095801 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:33.095510 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkhqd" podUID="46040804-7e1e-41a2-a1e7-209bdc6b2945" Jul 10 14:08:33.095801 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:33.095639 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-86t8x" podUID="d30d948f-76fb-4888-a860-adf9622c2f3f" Jul 10 14:08:33.095801 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:33.095717 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzhpq" podUID="4828193c-b7e0-4bdf-bf65-a610d88c1faf" Jul 10 14:08:33.332131 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.332108 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-64.ec2.internal" event="NodeReady" Jul 10 14:08:33.332280 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.332223 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 10 14:08:33.364333 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.364307 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-76jtw"] Jul 10 14:08:33.367847 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.367801 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-76jtw" Jul 10 14:08:33.371659 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.371443 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 10 14:08:33.371659 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.371547 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-bpc7b\"" Jul 10 14:08:33.372226 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.372196 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 10 14:08:33.372663 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.372620 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-vz755"] Jul 10 14:08:33.376679 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.376662 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6jvfg"] Jul 10 14:08:33.376792 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.376766 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-vz755" Jul 10 14:08:33.379781 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.379611 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 10 14:08:33.379781 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.379636 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 10 14:08:33.380076 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.379903 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 10 14:08:33.380076 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.380004 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 10 14:08:33.380076 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.380010 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-mc2h2\"" Jul 10 14:08:33.381419 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.381399 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qjfm8"] Jul 10 14:08:33.382161 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.381607 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6jvfg" Jul 10 14:08:33.384356 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.384339 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 10 14:08:33.384766 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.384747 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 10 14:08:33.384900 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.384877 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2"] Jul 10 14:08:33.385071 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.385055 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qjfm8" Jul 10 14:08:33.386426 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.386361 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-fbqwk\"" Jul 10 14:08:33.388309 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.388251 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 10 14:08:33.391092 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.389493 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 10 14:08:33.392712 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.392672 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-bzj84\"" Jul 10 14:08:33.392832 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.392713 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 10 14:08:33.394568 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.394534 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 10 14:08:33.395047 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.395024 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 10 14:08:33.396473 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.396442 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lq8n4"] Jul 10 14:08:33.396646 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.396629 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2" Jul 10 14:08:33.398432 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.398398 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 10 14:08:33.399874 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.399854 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 10 14:08:33.400182 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.400161 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 10 14:08:33.400271 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.400247 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 10 14:08:33.400649 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.400630 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 10 14:08:33.400735 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.400701 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 10 14:08:33.400935 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.400916 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 10 14:08:33.401055 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.401037 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 10 14:08:33.402853 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.402572 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxx5k"] Jul 10 14:08:33.403115 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.403100 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lq8n4" Jul 10 14:08:33.406204 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.406186 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-znjf2"] Jul 10 14:08:33.407795 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.407117 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 10 14:08:33.407795 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.406271 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxx5k" Jul 10 14:08:33.407795 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.407278 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zt6tz\"" Jul 10 14:08:33.407795 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.407452 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 10 14:08:33.407795 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.407474 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 10 14:08:33.407795 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.407772 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 10 14:08:33.410591 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.410575 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-cd7fdc78b-5qrnb"] Jul 10 14:08:33.411051 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.410762 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-znjf2" Jul 10 14:08:33.411679 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.411653 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 10 14:08:33.411831 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.411780 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 10 14:08:33.412452 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.412433 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 10 14:08:33.412650 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.412635 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 10 14:08:33.413247 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.413230 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-q5dnr\"" Jul 10 14:08:33.414206 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.414191 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 10 14:08:33.414408 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.414388 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-d8597c89c-dsq7z"] Jul 10 14:08:33.414894 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.414853 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:08:33.416048 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.416024 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 10 14:08:33.416048 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.416033 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 10 14:08:33.416663 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.416362 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-hwfj6\"" Jul 10 14:08:33.417106 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.417009 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 10 14:08:33.418494 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.417927 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-2ftqc"] Jul 10 14:08:33.418494 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.418319 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 10 14:08:33.418655 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.418619 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:08:33.419007 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.418985 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 10 14:08:33.421120 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.421080 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ww66r\"" Jul 10 14:08:33.421445 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.421427 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-74c7c45ff4-cg9w4"] Jul 10 14:08:33.421629 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.421617 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2ftqc" Jul 10 14:08:33.425581 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.425561 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-fgxcc"] Jul 10 14:08:33.426087 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.426066 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" Jul 10 14:08:33.427977 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.427935 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 10 14:08:33.430400 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.430375 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 14:08:33.430572 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.430551 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-659nt\"" Jul 10 14:08:33.430715 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.430698 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 14:08:33.433736 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.433717 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 10 14:08:33.433831 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.433751 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6675c66cbb-47smw"] Jul 10 14:08:33.433972 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.433936 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-fgxcc" Jul 10 14:08:33.435038 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.434828 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 10 14:08:33.435038 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.434905 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 10 14:08:33.435428 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.435412 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ldr4g\"" Jul 10 14:08:33.436066 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.436032 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 10 14:08:33.436187 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.436164 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 10 14:08:33.436258 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.436040 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 10 14:08:33.436518 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.436383 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 10 14:08:33.438106 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.438087 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 10 14:08:33.438372 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.438349 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7449d47c8b-hxx7v"] Jul 10 14:08:33.438473 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.438454 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6675c66cbb-47smw" Jul 10 14:08:33.438964 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.438926 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 10 14:08:33.439054 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.438943 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-6xcbp\"" Jul 10 14:08:33.439117 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.439101 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 10 14:08:33.441180 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.441155 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-7zbsj\"" Jul 10 14:08:33.441274 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.441250 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 10 14:08:33.441714 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.441699 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dzg7b"] Jul 10 14:08:33.442054 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.442038 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7449d47c8b-hxx7v" Jul 10 14:08:33.444701 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.444681 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 10 14:08:33.445149 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.445129 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-vz755"] Jul 10 14:08:33.445237 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.445168 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lq8n4"] Jul 10 14:08:33.445237 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.445190 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-76jtw"] Jul 10 14:08:33.445237 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.445207 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6675c66cbb-47smw"] Jul 10 14:08:33.445237 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.445221 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2"] Jul 10 14:08:33.445237 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.445236 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d8597c89c-dsq7z"] Jul 10 14:08:33.445491 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.445256 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qjfm8"] Jul 10 14:08:33.445491 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.445276 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6jvfg"] Jul 10 14:08:33.445491 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.445301 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wv479"] Jul 10 14:08:33.445734 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.445715 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dzg7b" Jul 10 14:08:33.448063 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.448047 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 10 14:08:33.448307 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.448287 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-znjf2"] Jul 10 14:08:33.448381 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.448327 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dzg7b"] Jul 10 14:08:33.448381 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.448353 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-fgxcc"] Jul 10 14:08:33.448381 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.448378 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7449d47c8b-hxx7v"] Jul 10 14:08:33.448519 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.448398 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-2ftqc"] Jul 10 14:08:33.448519 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.448411 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gwmhf\"" Jul 10 14:08:33.448519 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.448417 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wv479"] Jul 10 14:08:33.448519 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.448435 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxx5k"] Jul 10 14:08:33.448519 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.448453 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cd7fdc78b-5qrnb"] Jul 10 14:08:33.448519 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.448472 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-74c7c45ff4-cg9w4"] Jul 10 14:08:33.448846 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.448542 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wv479" Jul 10 14:08:33.448846 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.448603 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 10 14:08:33.451208 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.451193 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 10 14:08:33.451290 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.451244 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2tvlk\"" Jul 10 14:08:33.451290 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.451273 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 10 14:08:33.451534 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.451509 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 10 14:08:33.522700 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.522677 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wmsg\" (UniqueName: \"kubernetes.io/projected/262f42ab-f88a-4689-99ba-0c130a08dde1-kube-api-access-5wmsg\") pod \"cluster-monitoring-operator-5f7f494dd4-lq8n4\" (UID: \"262f42ab-f88a-4689-99ba-0c130a08dde1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lq8n4" Jul 10 14:08:33.522809 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.522727 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7f9d2e13-3a46-4539-b046-2c9ae7fe5f94-snapshots\") pod \"insights-operator-68d9dd94cf-vz755\" (UID: \"7f9d2e13-3a46-4539-b046-2c9ae7fe5f94\") " pod="openshift-insights/insights-operator-68d9dd94cf-vz755" Jul 10 14:08:33.522809 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.522775 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnj46\" (UniqueName: \"kubernetes.io/projected/702d9fee-e3a5-400c-b53a-e2ce3be19af3-kube-api-access-xnj46\") pod \"volume-data-source-validator-78495597f6-76jtw\" (UID: \"702d9fee-e3a5-400c-b53a-e2ce3be19af3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-76jtw" Jul 10 14:08:33.522809 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.522804 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f9d2e13-3a46-4539-b046-2c9ae7fe5f94-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-vz755\" (UID: \"7f9d2e13-3a46-4539-b046-2c9ae7fe5f94\") " pod="openshift-insights/insights-operator-68d9dd94cf-vz755" Jul 10 14:08:33.522936 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.522829 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qk27\" (UniqueName: \"kubernetes.io/projected/7f9d2e13-3a46-4539-b046-2c9ae7fe5f94-kube-api-access-9qk27\") pod \"insights-operator-68d9dd94cf-vz755\" (UID: \"7f9d2e13-3a46-4539-b046-2c9ae7fe5f94\") " pod="openshift-insights/insights-operator-68d9dd94cf-vz755" Jul 10 14:08:33.522936 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.522870 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-bound-sa-token\") pod \"image-registry-d8597c89c-dsq7z\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:08:33.522936 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.522910 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/369ec23b-46fc-4dbc-9e5a-f34d138da096-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-75ccb96b9c-jkwb2\" (UID: \"369ec23b-46fc-4dbc-9e5a-f34d138da096\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2" Jul 10 14:08:33.523088 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.522940 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb6r2\" (UniqueName: \"kubernetes.io/projected/99ef7290-2248-4e0c-9fda-100370c1ac2d-kube-api-access-pb6r2\") pod \"console-operator-7866497494-znjf2\" (UID: \"99ef7290-2248-4e0c-9fda-100370c1ac2d\") " pod="openshift-console-operator/console-operator-7866497494-znjf2" Jul 10 14:08:33.523088 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.522985 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-registry-tls\") pod \"image-registry-cd7fdc78b-5qrnb\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:08:33.523088 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.523014 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-registry-certificates\") pod \"image-registry-cd7fdc78b-5qrnb\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:08:33.523088 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.523042 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-bound-sa-token\") pod \"image-registry-cd7fdc78b-5qrnb\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:08:33.523088 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.523067 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/443ac7cb-245f-4e42-b991-61383cdd63be-tmp\") pod \"klusterlet-addon-workmgr-7449d47c8b-hxx7v\" (UID: \"443ac7cb-245f-4e42-b991-61383cdd63be\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7449d47c8b-hxx7v" Jul 10 14:08:33.523332 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.523094 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jj6z\" (UniqueName: \"kubernetes.io/projected/443ac7cb-245f-4e42-b991-61383cdd63be-kube-api-access-9jj6z\") pod \"klusterlet-addon-workmgr-7449d47c8b-hxx7v\" (UID: \"443ac7cb-245f-4e42-b991-61383cdd63be\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7449d47c8b-hxx7v" Jul 10 14:08:33.523332 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.523121 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0434507c-840c-4d87-bd9a-c3aab52951e6-ca-trust-extracted\") pod \"image-registry-d8597c89c-dsq7z\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:08:33.523332 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.523148 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/369ec23b-46fc-4dbc-9e5a-f34d138da096-hub\") pod \"cluster-proxy-proxy-agent-75ccb96b9c-jkwb2\" (UID: \"369ec23b-46fc-4dbc-9e5a-f34d138da096\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2" Jul 10 14:08:33.523332 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.523171 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f9d2e13-3a46-4539-b046-2c9ae7fe5f94-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-vz755\" (UID: \"7f9d2e13-3a46-4539-b046-2c9ae7fe5f94\") " pod="openshift-insights/insights-operator-68d9dd94cf-vz755" Jul 10 14:08:33.523332 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.523200 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/65c298b2-9990-431f-a1cd-1a06c1ec25df-serving-cert\") pod \"service-ca-operator-7695fc6c8c-qjfm8\" (UID: \"65c298b2-9990-431f-a1cd-1a06c1ec25df\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qjfm8" Jul 10 14:08:33.523332 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.523222 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/65c298b2-9990-431f-a1cd-1a06c1ec25df-config\") pod \"service-ca-operator-7695fc6c8c-qjfm8\" (UID: \"65c298b2-9990-431f-a1cd-1a06c1ec25df\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qjfm8" Jul 10 14:08:33.523332 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.523248 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54hkb\" (UniqueName: \"kubernetes.io/projected/65c298b2-9990-431f-a1cd-1a06c1ec25df-kube-api-access-54hkb\") pod \"service-ca-operator-7695fc6c8c-qjfm8\" (UID: \"65c298b2-9990-431f-a1cd-1a06c1ec25df\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qjfm8" Jul 10 14:08:33.523332 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.523272 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chcfz\" (UniqueName: \"kubernetes.io/projected/d58cbba7-3164-48fd-8697-1559ca85e14b-kube-api-access-chcfz\") pod \"kube-storage-version-migrator-operator-799cb7f958-xxx5k\" (UID: \"d58cbba7-3164-48fd-8697-1559ca85e14b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxx5k" Jul 10 14:08:33.523332 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.523297 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f9dm\" (UniqueName: \"kubernetes.io/projected/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-kube-api-access-8f9dm\") pod \"router-default-74c7c45ff4-cg9w4\" (UID: \"8ef37476-3f4b-430b-abfd-c43a4e2b73ea\") " pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" Jul 10 14:08:33.523332 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.523319 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cj8w\" (UniqueName: \"kubernetes.io/projected/369ec23b-46fc-4dbc-9e5a-f34d138da096-kube-api-access-4cj8w\") pod \"cluster-proxy-proxy-agent-75ccb96b9c-jkwb2\" (UID: \"369ec23b-46fc-4dbc-9e5a-f34d138da096\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2" Jul 10 14:08:33.523798 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.523345 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d58cbba7-3164-48fd-8697-1559ca85e14b-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-xxx5k\" (UID: \"d58cbba7-3164-48fd-8697-1559ca85e14b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxx5k" Jul 10 14:08:33.523798 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.523383 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/99ef7290-2248-4e0c-9fda-100370c1ac2d-config\") pod \"console-operator-7866497494-znjf2\" (UID: \"99ef7290-2248-4e0c-9fda-100370c1ac2d\") " pod="openshift-console-operator/console-operator-7866497494-znjf2" Jul 10 14:08:33.523798 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.523409 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-service-ca-bundle\") pod \"router-default-74c7c45ff4-cg9w4\" (UID: \"8ef37476-3f4b-430b-abfd-c43a4e2b73ea\") " pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" Jul 10 14:08:33.523798 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.523433 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0434507c-840c-4d87-bd9a-c3aab52951e6-image-registry-private-configuration\") pod \"image-registry-d8597c89c-dsq7z\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:08:33.523798 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.523455 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f9d2e13-3a46-4539-b046-2c9ae7fe5f94-tmp\") pod \"insights-operator-68d9dd94cf-vz755\" (UID: \"7f9d2e13-3a46-4539-b046-2c9ae7fe5f94\") " pod="openshift-insights/insights-operator-68d9dd94cf-vz755" Jul 10 14:08:33.523798 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.523473 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-default-certificate\") pod \"router-default-74c7c45ff4-cg9w4\" (UID: \"8ef37476-3f4b-430b-abfd-c43a4e2b73ea\") " pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" Jul 10 14:08:33.523798 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.523494 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-stats-auth\") pod \"router-default-74c7c45ff4-cg9w4\" (UID: \"8ef37476-3f4b-430b-abfd-c43a4e2b73ea\") " pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" Jul 10 14:08:33.524151 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.523813 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-trusted-ca\") pod \"image-registry-cd7fdc78b-5qrnb\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:08:33.524151 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.523885 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/369ec23b-46fc-4dbc-9e5a-f34d138da096-ca\") pod \"cluster-proxy-proxy-agent-75ccb96b9c-jkwb2\" (UID: \"369ec23b-46fc-4dbc-9e5a-f34d138da096\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2" Jul 10 14:08:33.524151 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.523925 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-registry-tls\") pod \"image-registry-d8597c89c-dsq7z\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:08:33.524151 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.524023 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/369ec23b-46fc-4dbc-9e5a-f34d138da096-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-75ccb96b9c-jkwb2\" (UID: \"369ec23b-46fc-4dbc-9e5a-f34d138da096\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2" Jul 10 14:08:33.524151 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.524072 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-ca-trust-extracted\") pod \"image-registry-cd7fdc78b-5qrnb\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:08:33.524151 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.524114 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0434507c-840c-4d87-bd9a-c3aab52951e6-registry-certificates\") pod \"image-registry-d8597c89c-dsq7z\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:08:33.524151 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.524146 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-installation-pull-secrets\") pod \"image-registry-cd7fdc78b-5qrnb\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:08:33.524498 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.524181 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/443ac7cb-245f-4e42-b991-61383cdd63be-klusterlet-config\") pod \"klusterlet-addon-workmgr-7449d47c8b-hxx7v\" (UID: \"443ac7cb-245f-4e42-b991-61383cdd63be\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7449d47c8b-hxx7v" Jul 10 14:08:33.524498 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.524241 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f9d2e13-3a46-4539-b046-2c9ae7fe5f94-serving-cert\") pod \"insights-operator-68d9dd94cf-vz755\" (UID: \"7f9d2e13-3a46-4539-b046-2c9ae7fe5f94\") " pod="openshift-insights/insights-operator-68d9dd94cf-vz755" Jul 10 14:08:33.524498 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.524339 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml97s\" (UniqueName: \"kubernetes.io/projected/599b3c3c-524d-49e8-9260-ef807f63fea6-kube-api-access-ml97s\") pod \"dns-default-dzg7b\" (UID: \"599b3c3c-524d-49e8-9260-ef807f63fea6\") " pod="openshift-dns/dns-default-dzg7b" Jul 10 14:08:33.524498 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.524381 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/262f42ab-f88a-4689-99ba-0c130a08dde1-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-lq8n4\" (UID: \"262f42ab-f88a-4689-99ba-0c130a08dde1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lq8n4" Jul 10 14:08:33.524498 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.524408 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0434507c-840c-4d87-bd9a-c3aab52951e6-installation-pull-secrets\") pod \"image-registry-d8597c89c-dsq7z\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:08:33.524498 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.524473 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xpn4\" (UniqueName: \"kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-kube-api-access-6xpn4\") pod \"image-registry-d8597c89c-dsq7z\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:08:33.524857 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.524508 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/599b3c3c-524d-49e8-9260-ef807f63fea6-config-volume\") pod \"dns-default-dzg7b\" (UID: \"599b3c3c-524d-49e8-9260-ef807f63fea6\") " pod="openshift-dns/dns-default-dzg7b" Jul 10 14:08:33.524857 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.524562 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9554w\" (UniqueName: \"kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-kube-api-access-9554w\") pod \"image-registry-cd7fdc78b-5qrnb\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:08:33.524857 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.524608 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-metrics-certs\") pod \"router-default-74c7c45ff4-cg9w4\" (UID: \"8ef37476-3f4b-430b-abfd-c43a4e2b73ea\") " pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" Jul 10 14:08:33.524857 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.524638 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lw5p\" (UniqueName: \"kubernetes.io/projected/3ebba52f-e57e-46fb-8335-77feeb2c62aa-kube-api-access-6lw5p\") pod \"managed-serviceaccount-addon-agent-6675c66cbb-47smw\" (UID: \"3ebba52f-e57e-46fb-8335-77feeb2c62aa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6675c66cbb-47smw" Jul 10 14:08:33.524857 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.524699 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/369ec23b-46fc-4dbc-9e5a-f34d138da096-additional-service-ca\") pod \"cluster-proxy-proxy-agent-75ccb96b9c-jkwb2\" (UID: \"369ec23b-46fc-4dbc-9e5a-f34d138da096\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2" Jul 10 14:08:33.524857 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.524769 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/99ef7290-2248-4e0c-9fda-100370c1ac2d-trusted-ca\") pod \"console-operator-7866497494-znjf2\" (UID: \"99ef7290-2248-4e0c-9fda-100370c1ac2d\") " pod="openshift-console-operator/console-operator-7866497494-znjf2" Jul 10 14:08:33.524857 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.524810 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3ebba52f-e57e-46fb-8335-77feeb2c62aa-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6675c66cbb-47smw\" (UID: \"3ebba52f-e57e-46fb-8335-77feeb2c62aa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6675c66cbb-47smw" Jul 10 14:08:33.525273 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.524963 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dca5b4bb-8439-4d1c-a76e-89d66227c825-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-6jvfg\" (UID: \"dca5b4bb-8439-4d1c-a76e-89d66227c825\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6jvfg" Jul 10 14:08:33.525273 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.525005 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/599b3c3c-524d-49e8-9260-ef807f63fea6-metrics-tls\") pod \"dns-default-dzg7b\" (UID: \"599b3c3c-524d-49e8-9260-ef807f63fea6\") " pod="openshift-dns/dns-default-dzg7b" Jul 10 14:08:33.525273 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.525043 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/599b3c3c-524d-49e8-9260-ef807f63fea6-tmp-dir\") pod \"dns-default-dzg7b\" (UID: \"599b3c3c-524d-49e8-9260-ef807f63fea6\") " pod="openshift-dns/dns-default-dzg7b" Jul 10 14:08:33.525273 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.525077 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0434507c-840c-4d87-bd9a-c3aab52951e6-trusted-ca\") pod \"image-registry-d8597c89c-dsq7z\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:08:33.525273 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.525135 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f49ccccf-cd07-4740-838d-11c0426f7273-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-fgxcc\" (UID: \"f49ccccf-cd07-4740-838d-11c0426f7273\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fgxcc" Jul 10 14:08:33.525273 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.525176 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/262f42ab-f88a-4689-99ba-0c130a08dde1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lq8n4\" (UID: \"262f42ab-f88a-4689-99ba-0c130a08dde1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lq8n4" Jul 10 14:08:33.525273 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.525207 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d58cbba7-3164-48fd-8697-1559ca85e14b-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-xxx5k\" (UID: \"d58cbba7-3164-48fd-8697-1559ca85e14b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxx5k" Jul 10 14:08:33.525273 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.525252 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g75q6\" (UniqueName: \"kubernetes.io/projected/99583015-7353-42d3-b7e0-cbf842aed856-kube-api-access-g75q6\") pod \"network-check-source-869dcfcdcd-2ftqc\" (UID: \"99583015-7353-42d3-b7e0-cbf842aed856\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2ftqc" Jul 10 14:08:33.525680 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.525300 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckz94\" (UniqueName: \"kubernetes.io/projected/dca5b4bb-8439-4d1c-a76e-89d66227c825-kube-api-access-ckz94\") pod \"cluster-samples-operator-65db858894-6jvfg\" (UID: \"dca5b4bb-8439-4d1c-a76e-89d66227c825\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6jvfg" Jul 10 14:08:33.525680 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.525348 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f49ccccf-cd07-4740-838d-11c0426f7273-nginx-conf\") pod \"networking-console-plugin-6cf856758c-fgxcc\" (UID: \"f49ccccf-cd07-4740-838d-11c0426f7273\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fgxcc" Jul 10 14:08:33.525680 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.525442 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/99ef7290-2248-4e0c-9fda-100370c1ac2d-serving-cert\") pod \"console-operator-7866497494-znjf2\" (UID: \"99ef7290-2248-4e0c-9fda-100370c1ac2d\") " pod="openshift-console-operator/console-operator-7866497494-znjf2" Jul 10 14:08:33.525680 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.525477 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-image-registry-private-configuration\") pod \"image-registry-cd7fdc78b-5qrnb\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:08:33.626136 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.626051 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/99ef7290-2248-4e0c-9fda-100370c1ac2d-serving-cert\") pod \"console-operator-7866497494-znjf2\" (UID: \"99ef7290-2248-4e0c-9fda-100370c1ac2d\") " pod="openshift-console-operator/console-operator-7866497494-znjf2" Jul 10 14:08:33.626136 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.626097 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-image-registry-private-configuration\") pod \"image-registry-cd7fdc78b-5qrnb\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:08:33.626136 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.626129 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wmsg\" (UniqueName: \"kubernetes.io/projected/262f42ab-f88a-4689-99ba-0c130a08dde1-kube-api-access-5wmsg\") pod \"cluster-monitoring-operator-5f7f494dd4-lq8n4\" (UID: \"262f42ab-f88a-4689-99ba-0c130a08dde1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lq8n4" Jul 10 14:08:33.626409 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.626320 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7f9d2e13-3a46-4539-b046-2c9ae7fe5f94-snapshots\") pod \"insights-operator-68d9dd94cf-vz755\" (UID: \"7f9d2e13-3a46-4539-b046-2c9ae7fe5f94\") " pod="openshift-insights/insights-operator-68d9dd94cf-vz755" Jul 10 14:08:33.626409 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.626369 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnj46\" (UniqueName: \"kubernetes.io/projected/702d9fee-e3a5-400c-b53a-e2ce3be19af3-kube-api-access-xnj46\") pod \"volume-data-source-validator-78495597f6-76jtw\" (UID: \"702d9fee-e3a5-400c-b53a-e2ce3be19af3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-76jtw" Jul 10 14:08:33.626409 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.626398 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f9d2e13-3a46-4539-b046-2c9ae7fe5f94-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-vz755\" (UID: \"7f9d2e13-3a46-4539-b046-2c9ae7fe5f94\") " pod="openshift-insights/insights-operator-68d9dd94cf-vz755" Jul 10 14:08:33.626560 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.626423 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qk27\" (UniqueName: \"kubernetes.io/projected/7f9d2e13-3a46-4539-b046-2c9ae7fe5f94-kube-api-access-9qk27\") pod \"insights-operator-68d9dd94cf-vz755\" (UID: \"7f9d2e13-3a46-4539-b046-2c9ae7fe5f94\") " pod="openshift-insights/insights-operator-68d9dd94cf-vz755" Jul 10 14:08:33.626560 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.626448 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-bound-sa-token\") pod \"image-registry-d8597c89c-dsq7z\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:08:33.626560 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.626478 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/369ec23b-46fc-4dbc-9e5a-f34d138da096-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-75ccb96b9c-jkwb2\" (UID: \"369ec23b-46fc-4dbc-9e5a-f34d138da096\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2" Jul 10 14:08:33.626560 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.626503 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb6r2\" (UniqueName: \"kubernetes.io/projected/99ef7290-2248-4e0c-9fda-100370c1ac2d-kube-api-access-pb6r2\") pod \"console-operator-7866497494-znjf2\" (UID: \"99ef7290-2248-4e0c-9fda-100370c1ac2d\") " pod="openshift-console-operator/console-operator-7866497494-znjf2" Jul 10 14:08:33.626560 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.626526 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-registry-tls\") pod \"image-registry-cd7fdc78b-5qrnb\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:08:33.626560 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.626559 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-registry-certificates\") pod \"image-registry-cd7fdc78b-5qrnb\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:08:33.626830 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.626583 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-bound-sa-token\") pod \"image-registry-cd7fdc78b-5qrnb\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:08:33.626830 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.626606 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/443ac7cb-245f-4e42-b991-61383cdd63be-tmp\") pod \"klusterlet-addon-workmgr-7449d47c8b-hxx7v\" (UID: \"443ac7cb-245f-4e42-b991-61383cdd63be\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7449d47c8b-hxx7v" Jul 10 14:08:33.626830 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.626636 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jj6z\" (UniqueName: \"kubernetes.io/projected/443ac7cb-245f-4e42-b991-61383cdd63be-kube-api-access-9jj6z\") pod \"klusterlet-addon-workmgr-7449d47c8b-hxx7v\" (UID: \"443ac7cb-245f-4e42-b991-61383cdd63be\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7449d47c8b-hxx7v" Jul 10 14:08:33.626830 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.626660 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0434507c-840c-4d87-bd9a-c3aab52951e6-ca-trust-extracted\") pod \"image-registry-d8597c89c-dsq7z\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:08:33.626830 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.626684 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/369ec23b-46fc-4dbc-9e5a-f34d138da096-hub\") pod \"cluster-proxy-proxy-agent-75ccb96b9c-jkwb2\" (UID: \"369ec23b-46fc-4dbc-9e5a-f34d138da096\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2" Jul 10 14:08:33.626830 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.626708 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f9d2e13-3a46-4539-b046-2c9ae7fe5f94-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-vz755\" (UID: \"7f9d2e13-3a46-4539-b046-2c9ae7fe5f94\") " pod="openshift-insights/insights-operator-68d9dd94cf-vz755" Jul 10 14:08:33.626830 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.626731 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/65c298b2-9990-431f-a1cd-1a06c1ec25df-serving-cert\") pod \"service-ca-operator-7695fc6c8c-qjfm8\" (UID: \"65c298b2-9990-431f-a1cd-1a06c1ec25df\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qjfm8" Jul 10 14:08:33.626830 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.626746 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/65c298b2-9990-431f-a1cd-1a06c1ec25df-config\") pod \"service-ca-operator-7695fc6c8c-qjfm8\" (UID: \"65c298b2-9990-431f-a1cd-1a06c1ec25df\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qjfm8" Jul 10 14:08:33.626830 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.626769 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54hkb\" (UniqueName: \"kubernetes.io/projected/65c298b2-9990-431f-a1cd-1a06c1ec25df-kube-api-access-54hkb\") pod \"service-ca-operator-7695fc6c8c-qjfm8\" (UID: \"65c298b2-9990-431f-a1cd-1a06c1ec25df\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qjfm8" Jul 10 14:08:33.626830 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.626787 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chcfz\" (UniqueName: \"kubernetes.io/projected/d58cbba7-3164-48fd-8697-1559ca85e14b-kube-api-access-chcfz\") pod \"kube-storage-version-migrator-operator-799cb7f958-xxx5k\" (UID: \"d58cbba7-3164-48fd-8697-1559ca85e14b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxx5k" Jul 10 14:08:33.626830 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.626807 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f9dm\" (UniqueName: \"kubernetes.io/projected/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-kube-api-access-8f9dm\") pod \"router-default-74c7c45ff4-cg9w4\" (UID: \"8ef37476-3f4b-430b-abfd-c43a4e2b73ea\") " pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" Jul 10 14:08:33.626830 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.626822 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cj8w\" (UniqueName: \"kubernetes.io/projected/369ec23b-46fc-4dbc-9e5a-f34d138da096-kube-api-access-4cj8w\") pod \"cluster-proxy-proxy-agent-75ccb96b9c-jkwb2\" (UID: \"369ec23b-46fc-4dbc-9e5a-f34d138da096\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2" Jul 10 14:08:33.627389 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.626845 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d58cbba7-3164-48fd-8697-1559ca85e14b-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-xxx5k\" (UID: \"d58cbba7-3164-48fd-8697-1559ca85e14b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxx5k" Jul 10 14:08:33.627389 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.626886 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/99ef7290-2248-4e0c-9fda-100370c1ac2d-config\") pod \"console-operator-7866497494-znjf2\" (UID: \"99ef7290-2248-4e0c-9fda-100370c1ac2d\") " pod="openshift-console-operator/console-operator-7866497494-znjf2" Jul 10 14:08:33.627389 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.626939 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-service-ca-bundle\") pod \"router-default-74c7c45ff4-cg9w4\" (UID: \"8ef37476-3f4b-430b-abfd-c43a4e2b73ea\") " pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" Jul 10 14:08:33.627389 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.626976 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7f9d2e13-3a46-4539-b046-2c9ae7fe5f94-snapshots\") pod \"insights-operator-68d9dd94cf-vz755\" (UID: \"7f9d2e13-3a46-4539-b046-2c9ae7fe5f94\") " pod="openshift-insights/insights-operator-68d9dd94cf-vz755" Jul 10 14:08:33.627389 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.626983 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0434507c-840c-4d87-bd9a-c3aab52951e6-image-registry-private-configuration\") pod \"image-registry-d8597c89c-dsq7z\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:08:33.627389 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.627031 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f9d2e13-3a46-4539-b046-2c9ae7fe5f94-tmp\") pod \"insights-operator-68d9dd94cf-vz755\" (UID: \"7f9d2e13-3a46-4539-b046-2c9ae7fe5f94\") " pod="openshift-insights/insights-operator-68d9dd94cf-vz755" Jul 10 14:08:33.627389 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.627057 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-default-certificate\") pod \"router-default-74c7c45ff4-cg9w4\" (UID: \"8ef37476-3f4b-430b-abfd-c43a4e2b73ea\") " pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" Jul 10 14:08:33.627389 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.627081 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-stats-auth\") pod \"router-default-74c7c45ff4-cg9w4\" (UID: \"8ef37476-3f4b-430b-abfd-c43a4e2b73ea\") " pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" Jul 10 14:08:33.627389 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.627109 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-trusted-ca\") pod \"image-registry-cd7fdc78b-5qrnb\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:08:33.627389 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.627137 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/369ec23b-46fc-4dbc-9e5a-f34d138da096-ca\") pod \"cluster-proxy-proxy-agent-75ccb96b9c-jkwb2\" (UID: \"369ec23b-46fc-4dbc-9e5a-f34d138da096\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2" Jul 10 14:08:33.627389 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.627163 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-registry-tls\") pod \"image-registry-d8597c89c-dsq7z\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:08:33.627389 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.627211 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/369ec23b-46fc-4dbc-9e5a-f34d138da096-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-75ccb96b9c-jkwb2\" (UID: \"369ec23b-46fc-4dbc-9e5a-f34d138da096\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2" Jul 10 14:08:33.627389 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.627238 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-ca-trust-extracted\") pod \"image-registry-cd7fdc78b-5qrnb\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:08:33.628052 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.627265 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0434507c-840c-4d87-bd9a-c3aab52951e6-registry-certificates\") pod \"image-registry-d8597c89c-dsq7z\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:08:33.628052 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.627285 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-installation-pull-secrets\") pod \"image-registry-cd7fdc78b-5qrnb\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:08:33.628052 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.627308 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/443ac7cb-245f-4e42-b991-61383cdd63be-klusterlet-config\") pod \"klusterlet-addon-workmgr-7449d47c8b-hxx7v\" (UID: \"443ac7cb-245f-4e42-b991-61383cdd63be\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7449d47c8b-hxx7v" Jul 10 14:08:33.628052 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.627324 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f9d2e13-3a46-4539-b046-2c9ae7fe5f94-serving-cert\") pod \"insights-operator-68d9dd94cf-vz755\" (UID: \"7f9d2e13-3a46-4539-b046-2c9ae7fe5f94\") " pod="openshift-insights/insights-operator-68d9dd94cf-vz755" Jul 10 14:08:33.628052 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.627369 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml97s\" (UniqueName: \"kubernetes.io/projected/599b3c3c-524d-49e8-9260-ef807f63fea6-kube-api-access-ml97s\") pod \"dns-default-dzg7b\" (UID: \"599b3c3c-524d-49e8-9260-ef807f63fea6\") " pod="openshift-dns/dns-default-dzg7b" Jul 10 14:08:33.628052 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.627392 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/262f42ab-f88a-4689-99ba-0c130a08dde1-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-lq8n4\" (UID: \"262f42ab-f88a-4689-99ba-0c130a08dde1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lq8n4" Jul 10 14:08:33.628052 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.627415 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0434507c-840c-4d87-bd9a-c3aab52951e6-installation-pull-secrets\") pod \"image-registry-d8597c89c-dsq7z\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:08:33.628052 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.627441 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mk9g\" (UniqueName: \"kubernetes.io/projected/c09a8bb4-23ae-4bec-8d56-63e2f705d3ef-kube-api-access-6mk9g\") pod \"ingress-canary-wv479\" (UID: \"c09a8bb4-23ae-4bec-8d56-63e2f705d3ef\") " pod="openshift-ingress-canary/ingress-canary-wv479" Jul 10 14:08:33.628052 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.627469 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xpn4\" (UniqueName: \"kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-kube-api-access-6xpn4\") pod \"image-registry-d8597c89c-dsq7z\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:08:33.628052 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.627504 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/599b3c3c-524d-49e8-9260-ef807f63fea6-config-volume\") pod \"dns-default-dzg7b\" (UID: \"599b3c3c-524d-49e8-9260-ef807f63fea6\") " pod="openshift-dns/dns-default-dzg7b" Jul 10 14:08:33.628052 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.627531 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9554w\" (UniqueName: \"kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-kube-api-access-9554w\") pod \"image-registry-cd7fdc78b-5qrnb\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:08:33.628052 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.627553 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-metrics-certs\") pod \"router-default-74c7c45ff4-cg9w4\" (UID: \"8ef37476-3f4b-430b-abfd-c43a4e2b73ea\") " pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" Jul 10 14:08:33.628052 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.627593 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lw5p\" (UniqueName: \"kubernetes.io/projected/3ebba52f-e57e-46fb-8335-77feeb2c62aa-kube-api-access-6lw5p\") pod \"managed-serviceaccount-addon-agent-6675c66cbb-47smw\" (UID: \"3ebba52f-e57e-46fb-8335-77feeb2c62aa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6675c66cbb-47smw" Jul 10 14:08:33.628640 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.627621 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/369ec23b-46fc-4dbc-9e5a-f34d138da096-additional-service-ca\") pod \"cluster-proxy-proxy-agent-75ccb96b9c-jkwb2\" (UID: \"369ec23b-46fc-4dbc-9e5a-f34d138da096\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2" Jul 10 14:08:33.628640 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.627641 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/99ef7290-2248-4e0c-9fda-100370c1ac2d-trusted-ca\") pod \"console-operator-7866497494-znjf2\" (UID: \"99ef7290-2248-4e0c-9fda-100370c1ac2d\") " pod="openshift-console-operator/console-operator-7866497494-znjf2" Jul 10 14:08:33.628640 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.627660 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3ebba52f-e57e-46fb-8335-77feeb2c62aa-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6675c66cbb-47smw\" (UID: \"3ebba52f-e57e-46fb-8335-77feeb2c62aa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6675c66cbb-47smw" Jul 10 14:08:33.628640 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.627665 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f9d2e13-3a46-4539-b046-2c9ae7fe5f94-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-vz755\" (UID: \"7f9d2e13-3a46-4539-b046-2c9ae7fe5f94\") " pod="openshift-insights/insights-operator-68d9dd94cf-vz755" Jul 10 14:08:33.628640 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.627691 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dca5b4bb-8439-4d1c-a76e-89d66227c825-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-6jvfg\" (UID: \"dca5b4bb-8439-4d1c-a76e-89d66227c825\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6jvfg" Jul 10 14:08:33.628640 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.627733 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f9d2e13-3a46-4539-b046-2c9ae7fe5f94-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-vz755\" (UID: \"7f9d2e13-3a46-4539-b046-2c9ae7fe5f94\") " pod="openshift-insights/insights-operator-68d9dd94cf-vz755" Jul 10 14:08:33.628640 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:33.627851 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 14:08:33.628640 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:33.627866 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cd7fdc78b-5qrnb: secret "image-registry-tls" not found Jul 10 14:08:33.628640 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:33.627924 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-registry-tls podName:03fc50eb-f63c-4c50-ae8f-501f774a1ed0 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:34.127908146 +0000 UTC m=+37.554132458 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-registry-tls") pod "image-registry-cd7fdc78b-5qrnb" (UID: "03fc50eb-f63c-4c50-ae8f-501f774a1ed0") : secret "image-registry-tls" not found Jul 10 14:08:33.628640 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.628471 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0434507c-840c-4d87-bd9a-c3aab52951e6-ca-trust-extracted\") pod \"image-registry-d8597c89c-dsq7z\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:08:33.629184 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.628682 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/99ef7290-2248-4e0c-9fda-100370c1ac2d-config\") pod \"console-operator-7866497494-znjf2\" (UID: \"99ef7290-2248-4e0c-9fda-100370c1ac2d\") " pod="openshift-console-operator/console-operator-7866497494-znjf2" Jul 10 14:08:33.629184 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.628744 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-registry-certificates\") pod \"image-registry-cd7fdc78b-5qrnb\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:08:33.629302 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.629280 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/443ac7cb-245f-4e42-b991-61383cdd63be-tmp\") pod \"klusterlet-addon-workmgr-7449d47c8b-hxx7v\" (UID: \"443ac7cb-245f-4e42-b991-61383cdd63be\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7449d47c8b-hxx7v" Jul 10 14:08:33.631632 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.629792 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d58cbba7-3164-48fd-8697-1559ca85e14b-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-xxx5k\" (UID: \"d58cbba7-3164-48fd-8697-1559ca85e14b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxx5k" Jul 10 14:08:33.631632 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.630106 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/65c298b2-9990-431f-a1cd-1a06c1ec25df-config\") pod \"service-ca-operator-7695fc6c8c-qjfm8\" (UID: \"65c298b2-9990-431f-a1cd-1a06c1ec25df\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qjfm8" Jul 10 14:08:33.631632 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.630311 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/599b3c3c-524d-49e8-9260-ef807f63fea6-config-volume\") pod \"dns-default-dzg7b\" (UID: \"599b3c3c-524d-49e8-9260-ef807f63fea6\") " pod="openshift-dns/dns-default-dzg7b" Jul 10 14:08:33.631632 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.630365 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-trusted-ca\") pod \"image-registry-cd7fdc78b-5qrnb\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:08:33.631632 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.631242 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/262f42ab-f88a-4689-99ba-0c130a08dde1-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-lq8n4\" (UID: \"262f42ab-f88a-4689-99ba-0c130a08dde1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lq8n4" Jul 10 14:08:33.631632 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:33.631258 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 14:08:33.634602 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.631564 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/99ef7290-2248-4e0c-9fda-100370c1ac2d-serving-cert\") pod \"console-operator-7866497494-znjf2\" (UID: \"99ef7290-2248-4e0c-9fda-100370c1ac2d\") " pod="openshift-console-operator/console-operator-7866497494-znjf2" Jul 10 14:08:33.634602 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:33.632166 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-service-ca-bundle podName:8ef37476-3f4b-430b-abfd-c43a4e2b73ea nodeName:}" failed. No retries permitted until 2026-07-10 14:08:34.132145091 +0000 UTC m=+37.558369607 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-service-ca-bundle") pod "router-default-74c7c45ff4-cg9w4" (UID: "8ef37476-3f4b-430b-abfd-c43a4e2b73ea") : configmap references non-existent config key: service-ca.crt Jul 10 14:08:33.634777 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.631677 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/369ec23b-46fc-4dbc-9e5a-f34d138da096-additional-service-ca\") pod \"cluster-proxy-proxy-agent-75ccb96b9c-jkwb2\" (UID: \"369ec23b-46fc-4dbc-9e5a-f34d138da096\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2" Jul 10 14:08:33.634777 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.631938 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/369ec23b-46fc-4dbc-9e5a-f34d138da096-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-75ccb96b9c-jkwb2\" (UID: \"369ec23b-46fc-4dbc-9e5a-f34d138da096\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2" Jul 10 14:08:33.634777 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.634625 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/599b3c3c-524d-49e8-9260-ef807f63fea6-metrics-tls\") pod \"dns-default-dzg7b\" (UID: \"599b3c3c-524d-49e8-9260-ef807f63fea6\") " pod="openshift-dns/dns-default-dzg7b" Jul 10 14:08:33.634777 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.632299 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-image-registry-private-configuration\") pod \"image-registry-cd7fdc78b-5qrnb\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:08:33.634777 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.632465 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/99ef7290-2248-4e0c-9fda-100370c1ac2d-trusted-ca\") pod \"console-operator-7866497494-znjf2\" (UID: \"99ef7290-2248-4e0c-9fda-100370c1ac2d\") " pod="openshift-console-operator/console-operator-7866497494-znjf2" Jul 10 14:08:33.634777 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.632987 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0434507c-840c-4d87-bd9a-c3aab52951e6-registry-certificates\") pod \"image-registry-d8597c89c-dsq7z\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:08:33.634777 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.634525 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/369ec23b-46fc-4dbc-9e5a-f34d138da096-hub\") pod \"cluster-proxy-proxy-agent-75ccb96b9c-jkwb2\" (UID: \"369ec23b-46fc-4dbc-9e5a-f34d138da096\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2" Jul 10 14:08:33.634777 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.634669 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/599b3c3c-524d-49e8-9260-ef807f63fea6-tmp-dir\") pod \"dns-default-dzg7b\" (UID: \"599b3c3c-524d-49e8-9260-ef807f63fea6\") " pod="openshift-dns/dns-default-dzg7b" Jul 10 14:08:33.634777 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.634701 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0434507c-840c-4d87-bd9a-c3aab52951e6-trusted-ca\") pod \"image-registry-d8597c89c-dsq7z\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:08:33.634777 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.634733 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c09a8bb4-23ae-4bec-8d56-63e2f705d3ef-cert\") pod \"ingress-canary-wv479\" (UID: \"c09a8bb4-23ae-4bec-8d56-63e2f705d3ef\") " pod="openshift-ingress-canary/ingress-canary-wv479" Jul 10 14:08:33.634777 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.634737 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/443ac7cb-245f-4e42-b991-61383cdd63be-klusterlet-config\") pod \"klusterlet-addon-workmgr-7449d47c8b-hxx7v\" (UID: \"443ac7cb-245f-4e42-b991-61383cdd63be\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7449d47c8b-hxx7v" Jul 10 14:08:33.634777 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.634763 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f49ccccf-cd07-4740-838d-11c0426f7273-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-fgxcc\" (UID: \"f49ccccf-cd07-4740-838d-11c0426f7273\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fgxcc" Jul 10 14:08:33.635357 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.634791 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/262f42ab-f88a-4689-99ba-0c130a08dde1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lq8n4\" (UID: \"262f42ab-f88a-4689-99ba-0c130a08dde1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lq8n4" Jul 10 14:08:33.635357 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.634820 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d58cbba7-3164-48fd-8697-1559ca85e14b-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-xxx5k\" (UID: \"d58cbba7-3164-48fd-8697-1559ca85e14b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxx5k" Jul 10 14:08:33.635357 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.634850 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g75q6\" (UniqueName: \"kubernetes.io/projected/99583015-7353-42d3-b7e0-cbf842aed856-kube-api-access-g75q6\") pod \"network-check-source-869dcfcdcd-2ftqc\" (UID: \"99583015-7353-42d3-b7e0-cbf842aed856\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2ftqc" Jul 10 14:08:33.635357 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.634882 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckz94\" (UniqueName: \"kubernetes.io/projected/dca5b4bb-8439-4d1c-a76e-89d66227c825-kube-api-access-ckz94\") pod \"cluster-samples-operator-65db858894-6jvfg\" (UID: \"dca5b4bb-8439-4d1c-a76e-89d66227c825\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6jvfg" Jul 10 14:08:33.635357 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.634890 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/599b3c3c-524d-49e8-9260-ef807f63fea6-tmp-dir\") pod \"dns-default-dzg7b\" (UID: \"599b3c3c-524d-49e8-9260-ef807f63fea6\") " pod="openshift-dns/dns-default-dzg7b" Jul 10 14:08:33.635357 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.631748 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f9d2e13-3a46-4539-b046-2c9ae7fe5f94-serving-cert\") pod \"insights-operator-68d9dd94cf-vz755\" (UID: \"7f9d2e13-3a46-4539-b046-2c9ae7fe5f94\") " pod="openshift-insights/insights-operator-68d9dd94cf-vz755" Jul 10 14:08:33.635357 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.634915 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f49ccccf-cd07-4740-838d-11c0426f7273-nginx-conf\") pod \"networking-console-plugin-6cf856758c-fgxcc\" (UID: \"f49ccccf-cd07-4740-838d-11c0426f7273\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fgxcc" Jul 10 14:08:33.635357 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:33.632629 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 14:08:33.635357 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:33.635024 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 14:08:33.635357 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.632333 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f9d2e13-3a46-4539-b046-2c9ae7fe5f94-tmp\") pod \"insights-operator-68d9dd94cf-vz755\" (UID: \"7f9d2e13-3a46-4539-b046-2c9ae7fe5f94\") " pod="openshift-insights/insights-operator-68d9dd94cf-vz755" Jul 10 14:08:33.635357 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:33.635055 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dca5b4bb-8439-4d1c-a76e-89d66227c825-samples-operator-tls podName:dca5b4bb-8439-4d1c-a76e-89d66227c825 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:34.135038758 +0000 UTC m=+37.561263069 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dca5b4bb-8439-4d1c-a76e-89d66227c825-samples-operator-tls") pod "cluster-samples-operator-65db858894-6jvfg" (UID: "dca5b4bb-8439-4d1c-a76e-89d66227c825") : secret "samples-operator-tls" not found Jul 10 14:08:33.635357 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:33.635073 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/599b3c3c-524d-49e8-9260-ef807f63fea6-metrics-tls podName:599b3c3c-524d-49e8-9260-ef807f63fea6 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:34.13506221 +0000 UTC m=+37.561286507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/599b3c3c-524d-49e8-9260-ef807f63fea6-metrics-tls") pod "dns-default-dzg7b" (UID: "599b3c3c-524d-49e8-9260-ef807f63fea6") : secret "dns-default-metrics-tls" not found Jul 10 14:08:33.635922 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:33.635088 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-metrics-certs podName:8ef37476-3f4b-430b-abfd-c43a4e2b73ea nodeName:}" failed. No retries permitted until 2026-07-10 14:08:34.135079615 +0000 UTC m=+37.561303952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-metrics-certs") pod "router-default-74c7c45ff4-cg9w4" (UID: "8ef37476-3f4b-430b-abfd-c43a4e2b73ea") : secret "router-metrics-certs-default" not found Jul 10 14:08:33.635922 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:33.635150 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 14:08:33.635922 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:33.635182 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/262f42ab-f88a-4689-99ba-0c130a08dde1-cluster-monitoring-operator-tls podName:262f42ab-f88a-4689-99ba-0c130a08dde1 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:34.13517154 +0000 UTC m=+37.561395839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/262f42ab-f88a-4689-99ba-0c130a08dde1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lq8n4" (UID: "262f42ab-f88a-4689-99ba-0c130a08dde1") : secret "cluster-monitoring-operator-tls" not found Jul 10 14:08:33.635922 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:33.635205 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 10 14:08:33.635922 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:33.635236 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f49ccccf-cd07-4740-838d-11c0426f7273-networking-console-plugin-cert podName:f49ccccf-cd07-4740-838d-11c0426f7273 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:34.13522709 +0000 UTC m=+37.561451393 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f49ccccf-cd07-4740-838d-11c0426f7273-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-fgxcc" (UID: "f49ccccf-cd07-4740-838d-11c0426f7273") : secret "networking-console-plugin-cert" not found Jul 10 14:08:33.635922 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:33.634225 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 14:08:33.635922 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:33.635319 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d8597c89c-dsq7z: secret "image-registry-tls" not found Jul 10 14:08:33.635922 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:33.635400 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-registry-tls podName:0434507c-840c-4d87-bd9a-c3aab52951e6 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:34.135382855 +0000 UTC m=+37.561607156 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-registry-tls") pod "image-registry-d8597c89c-dsq7z" (UID: "0434507c-840c-4d87-bd9a-c3aab52951e6") : secret "image-registry-tls" not found Jul 10 14:08:33.635922 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.635840 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f49ccccf-cd07-4740-838d-11c0426f7273-nginx-conf\") pod \"networking-console-plugin-6cf856758c-fgxcc\" (UID: \"f49ccccf-cd07-4740-838d-11c0426f7273\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fgxcc" Jul 10 14:08:33.635922 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.635842 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/369ec23b-46fc-4dbc-9e5a-f34d138da096-ca\") pod \"cluster-proxy-proxy-agent-75ccb96b9c-jkwb2\" (UID: \"369ec23b-46fc-4dbc-9e5a-f34d138da096\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2" Jul 10 14:08:33.636433 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.636164 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0434507c-840c-4d87-bd9a-c3aab52951e6-trusted-ca\") pod \"image-registry-d8597c89c-dsq7z\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:08:33.636555 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.636519 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-ca-trust-extracted\") pod \"image-registry-cd7fdc78b-5qrnb\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:08:33.636664 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.636643 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3ebba52f-e57e-46fb-8335-77feeb2c62aa-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6675c66cbb-47smw\" (UID: \"3ebba52f-e57e-46fb-8335-77feeb2c62aa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6675c66cbb-47smw" Jul 10 14:08:33.636791 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.636770 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0434507c-840c-4d87-bd9a-c3aab52951e6-image-registry-private-configuration\") pod \"image-registry-d8597c89c-dsq7z\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:08:33.637231 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.637180 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-installation-pull-secrets\") pod \"image-registry-cd7fdc78b-5qrnb\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:08:33.637325 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.637243 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0434507c-840c-4d87-bd9a-c3aab52951e6-installation-pull-secrets\") pod \"image-registry-d8597c89c-dsq7z\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:08:33.637566 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.637545 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/65c298b2-9990-431f-a1cd-1a06c1ec25df-serving-cert\") pod \"service-ca-operator-7695fc6c8c-qjfm8\" (UID: \"65c298b2-9990-431f-a1cd-1a06c1ec25df\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qjfm8" Jul 10 14:08:33.638216 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.638173 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/369ec23b-46fc-4dbc-9e5a-f34d138da096-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-75ccb96b9c-jkwb2\" (UID: \"369ec23b-46fc-4dbc-9e5a-f34d138da096\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2" Jul 10 14:08:33.638373 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.638346 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-default-certificate\") pod \"router-default-74c7c45ff4-cg9w4\" (UID: \"8ef37476-3f4b-430b-abfd-c43a4e2b73ea\") " pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" Jul 10 14:08:33.638619 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.638571 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d58cbba7-3164-48fd-8697-1559ca85e14b-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-xxx5k\" (UID: \"d58cbba7-3164-48fd-8697-1559ca85e14b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxx5k" Jul 10 14:08:33.639549 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.639530 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-stats-auth\") pod \"router-default-74c7c45ff4-cg9w4\" (UID: \"8ef37476-3f4b-430b-abfd-c43a4e2b73ea\") " pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" Jul 10 14:08:33.646390 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.646134 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54hkb\" (UniqueName: \"kubernetes.io/projected/65c298b2-9990-431f-a1cd-1a06c1ec25df-kube-api-access-54hkb\") pod \"service-ca-operator-7695fc6c8c-qjfm8\" (UID: \"65c298b2-9990-431f-a1cd-1a06c1ec25df\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qjfm8" Jul 10 14:08:33.648163 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.648138 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-bound-sa-token\") pod \"image-registry-cd7fdc78b-5qrnb\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:08:33.650044 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.650002 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-bound-sa-token\") pod \"image-registry-d8597c89c-dsq7z\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:08:33.650395 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.650368 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lw5p\" (UniqueName: \"kubernetes.io/projected/3ebba52f-e57e-46fb-8335-77feeb2c62aa-kube-api-access-6lw5p\") pod \"managed-serviceaccount-addon-agent-6675c66cbb-47smw\" (UID: \"3ebba52f-e57e-46fb-8335-77feeb2c62aa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6675c66cbb-47smw" Jul 10 14:08:33.650511 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.650488 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnj46\" (UniqueName: \"kubernetes.io/projected/702d9fee-e3a5-400c-b53a-e2ce3be19af3-kube-api-access-xnj46\") pod \"volume-data-source-validator-78495597f6-76jtw\" (UID: \"702d9fee-e3a5-400c-b53a-e2ce3be19af3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-76jtw" Jul 10 14:08:33.651094 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.650732 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wmsg\" (UniqueName: \"kubernetes.io/projected/262f42ab-f88a-4689-99ba-0c130a08dde1-kube-api-access-5wmsg\") pod \"cluster-monitoring-operator-5f7f494dd4-lq8n4\" (UID: \"262f42ab-f88a-4689-99ba-0c130a08dde1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lq8n4" Jul 10 14:08:33.651094 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.651033 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb6r2\" (UniqueName: \"kubernetes.io/projected/99ef7290-2248-4e0c-9fda-100370c1ac2d-kube-api-access-pb6r2\") pod \"console-operator-7866497494-znjf2\" (UID: \"99ef7290-2248-4e0c-9fda-100370c1ac2d\") " pod="openshift-console-operator/console-operator-7866497494-znjf2" Jul 10 14:08:33.651094 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.651036 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f9dm\" (UniqueName: \"kubernetes.io/projected/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-kube-api-access-8f9dm\") pod \"router-default-74c7c45ff4-cg9w4\" (UID: \"8ef37476-3f4b-430b-abfd-c43a4e2b73ea\") " pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" Jul 10 14:08:33.652587 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.652177 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chcfz\" (UniqueName: \"kubernetes.io/projected/d58cbba7-3164-48fd-8697-1559ca85e14b-kube-api-access-chcfz\") pod \"kube-storage-version-migrator-operator-799cb7f958-xxx5k\" (UID: \"d58cbba7-3164-48fd-8697-1559ca85e14b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxx5k" Jul 10 14:08:33.652587 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.652562 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml97s\" (UniqueName: \"kubernetes.io/projected/599b3c3c-524d-49e8-9260-ef807f63fea6-kube-api-access-ml97s\") pod \"dns-default-dzg7b\" (UID: \"599b3c3c-524d-49e8-9260-ef807f63fea6\") " pod="openshift-dns/dns-default-dzg7b" Jul 10 14:08:33.652756 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.652735 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qk27\" (UniqueName: \"kubernetes.io/projected/7f9d2e13-3a46-4539-b046-2c9ae7fe5f94-kube-api-access-9qk27\") pod \"insights-operator-68d9dd94cf-vz755\" (UID: \"7f9d2e13-3a46-4539-b046-2c9ae7fe5f94\") " pod="openshift-insights/insights-operator-68d9dd94cf-vz755" Jul 10 14:08:33.653078 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.653038 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cj8w\" (UniqueName: \"kubernetes.io/projected/369ec23b-46fc-4dbc-9e5a-f34d138da096-kube-api-access-4cj8w\") pod \"cluster-proxy-proxy-agent-75ccb96b9c-jkwb2\" (UID: \"369ec23b-46fc-4dbc-9e5a-f34d138da096\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2" Jul 10 14:08:33.653168 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.653131 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9554w\" (UniqueName: \"kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-kube-api-access-9554w\") pod \"image-registry-cd7fdc78b-5qrnb\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:08:33.654252 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.654228 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jj6z\" (UniqueName: \"kubernetes.io/projected/443ac7cb-245f-4e42-b991-61383cdd63be-kube-api-access-9jj6z\") pod \"klusterlet-addon-workmgr-7449d47c8b-hxx7v\" (UID: \"443ac7cb-245f-4e42-b991-61383cdd63be\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7449d47c8b-hxx7v" Jul 10 14:08:33.656849 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.656821 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xpn4\" (UniqueName: \"kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-kube-api-access-6xpn4\") pod \"image-registry-d8597c89c-dsq7z\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:08:33.678317 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.678290 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckz94\" (UniqueName: \"kubernetes.io/projected/dca5b4bb-8439-4d1c-a76e-89d66227c825-kube-api-access-ckz94\") pod \"cluster-samples-operator-65db858894-6jvfg\" (UID: \"dca5b4bb-8439-4d1c-a76e-89d66227c825\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6jvfg" Jul 10 14:08:33.684115 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.684094 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-76jtw" Jul 10 14:08:33.694300 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.694282 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-vz755" Jul 10 14:08:33.697074 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.697051 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g75q6\" (UniqueName: \"kubernetes.io/projected/99583015-7353-42d3-b7e0-cbf842aed856-kube-api-access-g75q6\") pod \"network-check-source-869dcfcdcd-2ftqc\" (UID: \"99583015-7353-42d3-b7e0-cbf842aed856\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2ftqc" Jul 10 14:08:33.714236 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.714209 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qjfm8" Jul 10 14:08:33.733697 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.733675 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2" Jul 10 14:08:33.736598 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.736547 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mk9g\" (UniqueName: \"kubernetes.io/projected/c09a8bb4-23ae-4bec-8d56-63e2f705d3ef-kube-api-access-6mk9g\") pod \"ingress-canary-wv479\" (UID: \"c09a8bb4-23ae-4bec-8d56-63e2f705d3ef\") " pod="openshift-ingress-canary/ingress-canary-wv479" Jul 10 14:08:33.736718 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.736683 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c09a8bb4-23ae-4bec-8d56-63e2f705d3ef-cert\") pod \"ingress-canary-wv479\" (UID: \"c09a8bb4-23ae-4bec-8d56-63e2f705d3ef\") " pod="openshift-ingress-canary/ingress-canary-wv479" Jul 10 14:08:33.739973 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.739925 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c09a8bb4-23ae-4bec-8d56-63e2f705d3ef-cert\") pod \"ingress-canary-wv479\" (UID: \"c09a8bb4-23ae-4bec-8d56-63e2f705d3ef\") " pod="openshift-ingress-canary/ingress-canary-wv479" Jul 10 14:08:33.749999 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.749882 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxx5k" Jul 10 14:08:33.757138 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.757048 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-znjf2" Jul 10 14:08:33.758807 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.758782 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mk9g\" (UniqueName: \"kubernetes.io/projected/c09a8bb4-23ae-4bec-8d56-63e2f705d3ef-kube-api-access-6mk9g\") pod \"ingress-canary-wv479\" (UID: \"c09a8bb4-23ae-4bec-8d56-63e2f705d3ef\") " pod="openshift-ingress-canary/ingress-canary-wv479" Jul 10 14:08:33.778901 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.778855 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2ftqc" Jul 10 14:08:33.802585 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.801156 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6675c66cbb-47smw" Jul 10 14:08:33.816352 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.816266 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7449d47c8b-hxx7v" Jul 10 14:08:33.830222 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.829817 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wv479" Jul 10 14:08:33.923033 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.920113 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-76jtw"] Jul 10 14:08:33.925348 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.925093 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-vz755"] Jul 10 14:08:33.925618 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:08:33.925574 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod702d9fee_e3a5_400c_b53a_e2ce3be19af3.slice/crio-db52dedb8815772d58f905117806cd896013356d950952f476e459e14bb41300 WatchSource:0}: Error finding container db52dedb8815772d58f905117806cd896013356d950952f476e459e14bb41300: Status 404 returned error can't find the container with id db52dedb8815772d58f905117806cd896013356d950952f476e459e14bb41300 Jul 10 14:08:33.997350 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:33.997183 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qjfm8"] Jul 10 14:08:34.018215 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:08:34.017451 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65c298b2_9990_431f_a1cd_1a06c1ec25df.slice/crio-6d9039b0588716059c84ff9a27e9c1324b19f54e8abb9e7a6928b9ec521b047d WatchSource:0}: Error finding container 6d9039b0588716059c84ff9a27e9c1324b19f54e8abb9e7a6928b9ec521b047d: Status 404 returned error can't find the container with id 6d9039b0588716059c84ff9a27e9c1324b19f54e8abb9e7a6928b9ec521b047d Jul 10 14:08:34.038148 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:34.037421 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2"] Jul 10 14:08:34.089082 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:34.089004 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wv479"] Jul 10 14:08:34.093915 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:08:34.092541 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc09a8bb4_23ae_4bec_8d56_63e2f705d3ef.slice/crio-10e758f98acddd2ab224aced67182f8cb662f999c56947b6f260e6c4f4d979d4 WatchSource:0}: Error finding container 10e758f98acddd2ab224aced67182f8cb662f999c56947b6f260e6c4f4d979d4: Status 404 returned error can't find the container with id 10e758f98acddd2ab224aced67182f8cb662f999c56947b6f260e6c4f4d979d4 Jul 10 14:08:34.093915 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:34.092744 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6675c66cbb-47smw"] Jul 10 14:08:34.095713 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:34.095101 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-znjf2"] Jul 10 14:08:34.096701 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:08:34.096671 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99ef7290_2248_4e0c_9fda_100370c1ac2d.slice/crio-117f045f6f982091e3ba35bb9dd7bac7fe7f0505ef13ab7da725f4cd172cd92c WatchSource:0}: Error finding container 117f045f6f982091e3ba35bb9dd7bac7fe7f0505ef13ab7da725f4cd172cd92c: Status 404 returned error can't find the container with id 117f045f6f982091e3ba35bb9dd7bac7fe7f0505ef13ab7da725f4cd172cd92c Jul 10 14:08:34.097255 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:34.097204 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxx5k"] Jul 10 14:08:34.097578 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:08:34.097543 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ebba52f_e57e_46fb_8335_77feeb2c62aa.slice/crio-bf9cc50f4243994c48b75a67eca6a30ee71dc5852dec380c65207f7a930327ba WatchSource:0}: Error finding container bf9cc50f4243994c48b75a67eca6a30ee71dc5852dec380c65207f7a930327ba: Status 404 returned error can't find the container with id bf9cc50f4243994c48b75a67eca6a30ee71dc5852dec380c65207f7a930327ba Jul 10 14:08:34.101362 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:08:34.099613 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd58cbba7_3164_48fd_8697_1559ca85e14b.slice/crio-b9709245b64b478eb3f704bd04351e3f925d1ad15277dde510960ae74670d66b WatchSource:0}: Error finding container b9709245b64b478eb3f704bd04351e3f925d1ad15277dde510960ae74670d66b: Status 404 returned error can't find the container with id b9709245b64b478eb3f704bd04351e3f925d1ad15277dde510960ae74670d66b Jul 10 14:08:34.101834 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:34.101812 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-2ftqc"] Jul 10 14:08:34.103658 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:08:34.103633 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99583015_7353_42d3_b7e0_cbf842aed856.slice/crio-12edb54c53b805004b41189bc8fd21ee1924435b5af8a5e5d9972193d9e11d51 WatchSource:0}: Error finding container 12edb54c53b805004b41189bc8fd21ee1924435b5af8a5e5d9972193d9e11d51: Status 404 returned error can't find the container with id 12edb54c53b805004b41189bc8fd21ee1924435b5af8a5e5d9972193d9e11d51 Jul 10 14:08:34.127619 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:34.127591 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7449d47c8b-hxx7v"] Jul 10 14:08:34.130262 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:08:34.130241 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod443ac7cb_245f_4e42_b991_61383cdd63be.slice/crio-335d66c66d51c8379fa257162a08f1faededdbc0b0af0748dc37224a2977c68e WatchSource:0}: Error finding container 335d66c66d51c8379fa257162a08f1faededdbc0b0af0748dc37224a2977c68e: Status 404 returned error can't find the container with id 335d66c66d51c8379fa257162a08f1faededdbc0b0af0748dc37224a2977c68e Jul 10 14:08:34.149813 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:34.149786 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dca5b4bb-8439-4d1c-a76e-89d66227c825-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-6jvfg\" (UID: \"dca5b4bb-8439-4d1c-a76e-89d66227c825\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6jvfg" Jul 10 14:08:34.149910 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:34.149828 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/599b3c3c-524d-49e8-9260-ef807f63fea6-metrics-tls\") pod \"dns-default-dzg7b\" (UID: \"599b3c3c-524d-49e8-9260-ef807f63fea6\") " pod="openshift-dns/dns-default-dzg7b" Jul 10 14:08:34.149910 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:34.149862 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f49ccccf-cd07-4740-838d-11c0426f7273-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-fgxcc\" (UID: \"f49ccccf-cd07-4740-838d-11c0426f7273\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fgxcc" Jul 10 14:08:34.149910 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:34.149889 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/262f42ab-f88a-4689-99ba-0c130a08dde1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lq8n4\" (UID: \"262f42ab-f88a-4689-99ba-0c130a08dde1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lq8n4" Jul 10 14:08:34.150067 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:34.149964 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 14:08:34.150067 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:34.149979 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-registry-tls\") pod \"image-registry-cd7fdc78b-5qrnb\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:08:34.150067 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:34.150013 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/599b3c3c-524d-49e8-9260-ef807f63fea6-metrics-tls podName:599b3c3c-524d-49e8-9260-ef807f63fea6 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:35.149999108 +0000 UTC m=+38.576223406 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/599b3c3c-524d-49e8-9260-ef807f63fea6-metrics-tls") pod "dns-default-dzg7b" (UID: "599b3c3c-524d-49e8-9260-ef807f63fea6") : secret "dns-default-metrics-tls" not found Jul 10 14:08:34.150067 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:34.150029 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 14:08:34.150067 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:34.150068 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 14:08:34.150255 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:34.150073 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-service-ca-bundle\") pod \"router-default-74c7c45ff4-cg9w4\" (UID: \"8ef37476-3f4b-430b-abfd-c43a4e2b73ea\") " pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" Jul 10 14:08:34.150255 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:34.150080 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cd7fdc78b-5qrnb: secret "image-registry-tls" not found Jul 10 14:08:34.150255 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:34.150106 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 14:08:34.150255 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:34.150081 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dca5b4bb-8439-4d1c-a76e-89d66227c825-samples-operator-tls podName:dca5b4bb-8439-4d1c-a76e-89d66227c825 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:35.150066228 +0000 UTC m=+38.576290549 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dca5b4bb-8439-4d1c-a76e-89d66227c825-samples-operator-tls") pod "cluster-samples-operator-65db858894-6jvfg" (UID: "dca5b4bb-8439-4d1c-a76e-89d66227c825") : secret "samples-operator-tls" not found Jul 10 14:08:34.150255 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:34.150131 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 10 14:08:34.150255 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:34.150148 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-registry-tls podName:03fc50eb-f63c-4c50-ae8f-501f774a1ed0 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:35.15013134 +0000 UTC m=+38.576355653 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-registry-tls") pod "image-registry-cd7fdc78b-5qrnb" (UID: "03fc50eb-f63c-4c50-ae8f-501f774a1ed0") : secret "image-registry-tls" not found Jul 10 14:08:34.150255 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:34.150167 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/262f42ab-f88a-4689-99ba-0c130a08dde1-cluster-monitoring-operator-tls podName:262f42ab-f88a-4689-99ba-0c130a08dde1 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:35.150157422 +0000 UTC m=+38.576381720 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/262f42ab-f88a-4689-99ba-0c130a08dde1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lq8n4" (UID: "262f42ab-f88a-4689-99ba-0c130a08dde1") : secret "cluster-monitoring-operator-tls" not found Jul 10 14:08:34.150255 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:34.150185 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f49ccccf-cd07-4740-838d-11c0426f7273-networking-console-plugin-cert podName:f49ccccf-cd07-4740-838d-11c0426f7273 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:35.150176222 +0000 UTC m=+38.576400521 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f49ccccf-cd07-4740-838d-11c0426f7273-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-fgxcc" (UID: "f49ccccf-cd07-4740-838d-11c0426f7273") : secret "networking-console-plugin-cert" not found Jul 10 14:08:34.150255 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:34.150210 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-service-ca-bundle podName:8ef37476-3f4b-430b-abfd-c43a4e2b73ea nodeName:}" failed. No retries permitted until 2026-07-10 14:08:35.150200534 +0000 UTC m=+38.576424832 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-service-ca-bundle") pod "router-default-74c7c45ff4-cg9w4" (UID: "8ef37476-3f4b-430b-abfd-c43a4e2b73ea") : configmap references non-existent config key: service-ca.crt Jul 10 14:08:34.150255 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:34.150245 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-registry-tls\") pod \"image-registry-d8597c89c-dsq7z\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:08:34.150601 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:34.150294 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-metrics-certs\") pod \"router-default-74c7c45ff4-cg9w4\" (UID: \"8ef37476-3f4b-430b-abfd-c43a4e2b73ea\") " pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" Jul 10 14:08:34.150601 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:34.150384 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 14:08:34.150601 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:34.150390 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 14:08:34.150601 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:34.150395 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d8597c89c-dsq7z: secret "image-registry-tls" not found Jul 10 14:08:34.150601 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:34.150432 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-metrics-certs podName:8ef37476-3f4b-430b-abfd-c43a4e2b73ea nodeName:}" failed. No retries permitted until 2026-07-10 14:08:35.150420929 +0000 UTC m=+38.576645237 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-metrics-certs") pod "router-default-74c7c45ff4-cg9w4" (UID: "8ef37476-3f4b-430b-abfd-c43a4e2b73ea") : secret "router-metrics-certs-default" not found Jul 10 14:08:34.150601 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:34.150444 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-registry-tls podName:0434507c-840c-4d87-bd9a-c3aab52951e6 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:35.150438644 +0000 UTC m=+38.576662946 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-registry-tls") pod "image-registry-d8597c89c-dsq7z" (UID: "0434507c-840c-4d87-bd9a-c3aab52951e6") : secret "image-registry-tls" not found Jul 10 14:08:34.248451 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:34.248411 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6675c66cbb-47smw" event={"ID":"3ebba52f-e57e-46fb-8335-77feeb2c62aa","Type":"ContainerStarted","Data":"bf9cc50f4243994c48b75a67eca6a30ee71dc5852dec380c65207f7a930327ba"} Jul 10 14:08:34.249464 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:34.249436 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qjfm8" event={"ID":"65c298b2-9990-431f-a1cd-1a06c1ec25df","Type":"ContainerStarted","Data":"6d9039b0588716059c84ff9a27e9c1324b19f54e8abb9e7a6928b9ec521b047d"} Jul 10 14:08:34.250397 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:34.250373 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-vz755" event={"ID":"7f9d2e13-3a46-4539-b046-2c9ae7fe5f94","Type":"ContainerStarted","Data":"af37d29ca99c7ad9c856b2957ed8b7a0de9caaef182d8a6f863aad3476b584ea"} Jul 10 14:08:34.251452 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:34.251428 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-76jtw" event={"ID":"702d9fee-e3a5-400c-b53a-e2ce3be19af3","Type":"ContainerStarted","Data":"db52dedb8815772d58f905117806cd896013356d950952f476e459e14bb41300"} Jul 10 14:08:34.252306 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:34.252287 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-znjf2" event={"ID":"99ef7290-2248-4e0c-9fda-100370c1ac2d","Type":"ContainerStarted","Data":"117f045f6f982091e3ba35bb9dd7bac7fe7f0505ef13ab7da725f4cd172cd92c"} Jul 10 14:08:34.253214 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:34.253194 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxx5k" event={"ID":"d58cbba7-3164-48fd-8697-1559ca85e14b","Type":"ContainerStarted","Data":"b9709245b64b478eb3f704bd04351e3f925d1ad15277dde510960ae74670d66b"} Jul 10 14:08:34.254202 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:34.254184 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2" event={"ID":"369ec23b-46fc-4dbc-9e5a-f34d138da096","Type":"ContainerStarted","Data":"ad8986a9fd917dda6f86da66c6fd15d18b75cb2854f29646c1373ef0fbf19d49"} Jul 10 14:08:34.255169 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:34.255152 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2ftqc" event={"ID":"99583015-7353-42d3-b7e0-cbf842aed856","Type":"ContainerStarted","Data":"12edb54c53b805004b41189bc8fd21ee1924435b5af8a5e5d9972193d9e11d51"} Jul 10 14:08:34.256118 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:34.256100 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wv479" event={"ID":"c09a8bb4-23ae-4bec-8d56-63e2f705d3ef","Type":"ContainerStarted","Data":"10e758f98acddd2ab224aced67182f8cb662f999c56947b6f260e6c4f4d979d4"} Jul 10 14:08:34.256975 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:34.256940 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7449d47c8b-hxx7v" event={"ID":"443ac7cb-245f-4e42-b991-61383cdd63be","Type":"ContainerStarted","Data":"335d66c66d51c8379fa257162a08f1faededdbc0b0af0748dc37224a2977c68e"} Jul 10 14:08:35.099846 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:35.099814 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzhpq" Jul 10 14:08:35.100337 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:35.099928 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:08:35.100337 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:35.099970 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:08:35.104238 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:35.104218 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 14:08:35.104352 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:35.104241 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7ddd8\"" Jul 10 14:08:35.104352 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:35.104241 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fptgw\"" Jul 10 14:08:35.104352 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:35.104225 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 14:08:35.159327 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:35.159293 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-registry-tls\") pod \"image-registry-d8597c89c-dsq7z\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:08:35.159502 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:35.159370 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-metrics-certs\") pod \"router-default-74c7c45ff4-cg9w4\" (UID: \"8ef37476-3f4b-430b-abfd-c43a4e2b73ea\") " pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" Jul 10 14:08:35.159502 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:35.159425 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dca5b4bb-8439-4d1c-a76e-89d66227c825-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-6jvfg\" (UID: \"dca5b4bb-8439-4d1c-a76e-89d66227c825\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6jvfg" Jul 10 14:08:35.159502 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:35.159446 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 14:08:35.159502 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:35.159467 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d8597c89c-dsq7z: secret "image-registry-tls" not found Jul 10 14:08:35.159502 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:35.159493 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 14:08:35.159721 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:35.159524 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-registry-tls podName:0434507c-840c-4d87-bd9a-c3aab52951e6 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:37.159504676 +0000 UTC m=+40.585728993 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-registry-tls") pod "image-registry-d8597c89c-dsq7z" (UID: "0434507c-840c-4d87-bd9a-c3aab52951e6") : secret "image-registry-tls" not found Jul 10 14:08:35.159721 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:35.159538 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 14:08:35.159721 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:35.159565 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 14:08:35.159721 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:35.159451 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/599b3c3c-524d-49e8-9260-ef807f63fea6-metrics-tls\") pod \"dns-default-dzg7b\" (UID: \"599b3c3c-524d-49e8-9260-ef807f63fea6\") " pod="openshift-dns/dns-default-dzg7b" Jul 10 14:08:35.159721 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:35.159541 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-metrics-certs podName:8ef37476-3f4b-430b-abfd-c43a4e2b73ea nodeName:}" failed. No retries permitted until 2026-07-10 14:08:37.159531994 +0000 UTC m=+40.585756299 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-metrics-certs") pod "router-default-74c7c45ff4-cg9w4" (UID: "8ef37476-3f4b-430b-abfd-c43a4e2b73ea") : secret "router-metrics-certs-default" not found Jul 10 14:08:35.159721 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:35.159592 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dca5b4bb-8439-4d1c-a76e-89d66227c825-samples-operator-tls podName:dca5b4bb-8439-4d1c-a76e-89d66227c825 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:37.159581557 +0000 UTC m=+40.585805854 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dca5b4bb-8439-4d1c-a76e-89d66227c825-samples-operator-tls") pod "cluster-samples-operator-65db858894-6jvfg" (UID: "dca5b4bb-8439-4d1c-a76e-89d66227c825") : secret "samples-operator-tls" not found Jul 10 14:08:35.159721 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:35.159608 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/599b3c3c-524d-49e8-9260-ef807f63fea6-metrics-tls podName:599b3c3c-524d-49e8-9260-ef807f63fea6 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:37.159599744 +0000 UTC m=+40.585824043 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/599b3c3c-524d-49e8-9260-ef807f63fea6-metrics-tls") pod "dns-default-dzg7b" (UID: "599b3c3c-524d-49e8-9260-ef807f63fea6") : secret "dns-default-metrics-tls" not found Jul 10 14:08:35.159721 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:35.159641 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f49ccccf-cd07-4740-838d-11c0426f7273-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-fgxcc\" (UID: \"f49ccccf-cd07-4740-838d-11c0426f7273\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fgxcc" Jul 10 14:08:35.159721 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:35.159666 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/262f42ab-f88a-4689-99ba-0c130a08dde1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lq8n4\" (UID: \"262f42ab-f88a-4689-99ba-0c130a08dde1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lq8n4" Jul 10 14:08:35.160191 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:35.159737 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-registry-tls\") pod \"image-registry-cd7fdc78b-5qrnb\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:08:35.160191 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:35.159766 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 10 14:08:35.160191 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:35.159798 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-service-ca-bundle\") pod \"router-default-74c7c45ff4-cg9w4\" (UID: \"8ef37476-3f4b-430b-abfd-c43a4e2b73ea\") " pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" Jul 10 14:08:35.160191 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:35.159834 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f49ccccf-cd07-4740-838d-11c0426f7273-networking-console-plugin-cert podName:f49ccccf-cd07-4740-838d-11c0426f7273 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:37.159826864 +0000 UTC m=+40.586051161 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f49ccccf-cd07-4740-838d-11c0426f7273-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-fgxcc" (UID: "f49ccccf-cd07-4740-838d-11c0426f7273") : secret "networking-console-plugin-cert" not found Jul 10 14:08:35.160191 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:35.159843 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 14:08:35.160191 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:35.159853 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cd7fdc78b-5qrnb: secret "image-registry-tls" not found Jul 10 14:08:35.160191 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:35.159920 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-registry-tls podName:03fc50eb-f63c-4c50-ae8f-501f774a1ed0 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:37.159874118 +0000 UTC m=+40.586098430 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-registry-tls") pod "image-registry-cd7fdc78b-5qrnb" (UID: "03fc50eb-f63c-4c50-ae8f-501f774a1ed0") : secret "image-registry-tls" not found Jul 10 14:08:35.160191 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:35.159920 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 14:08:35.160191 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:35.159939 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-service-ca-bundle podName:8ef37476-3f4b-430b-abfd-c43a4e2b73ea nodeName:}" failed. No retries permitted until 2026-07-10 14:08:37.159928359 +0000 UTC m=+40.586152664 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-service-ca-bundle") pod "router-default-74c7c45ff4-cg9w4" (UID: "8ef37476-3f4b-430b-abfd-c43a4e2b73ea") : configmap references non-existent config key: service-ca.crt Jul 10 14:08:35.160191 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:35.159979 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/262f42ab-f88a-4689-99ba-0c130a08dde1-cluster-monitoring-operator-tls podName:262f42ab-f88a-4689-99ba-0c130a08dde1 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:37.159968138 +0000 UTC m=+40.586192436 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/262f42ab-f88a-4689-99ba-0c130a08dde1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lq8n4" (UID: "262f42ab-f88a-4689-99ba-0c130a08dde1") : secret "cluster-monitoring-operator-tls" not found Jul 10 14:08:36.269359 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:36.269322 2579 generic.go:356] "Generic (PLEG): container finished" podID="2eb94f66-b549-4dc9-8065-1a3801902629" containerID="f9907c53aa5eb9ed77d7a846a611c09277bfd40931610e2134d0525285956494" exitCode=0 Jul 10 14:08:36.269769 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:36.269396 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pkvqn" event={"ID":"2eb94f66-b549-4dc9-8065-1a3801902629","Type":"ContainerDied","Data":"f9907c53aa5eb9ed77d7a846a611c09277bfd40931610e2134d0525285956494"} Jul 10 14:08:37.183180 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:37.181623 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-service-ca-bundle\") pod \"router-default-74c7c45ff4-cg9w4\" (UID: \"8ef37476-3f4b-430b-abfd-c43a4e2b73ea\") " pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" Jul 10 14:08:37.183180 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:37.181688 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-registry-tls\") pod \"image-registry-d8597c89c-dsq7z\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:08:37.183180 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:37.181749 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-metrics-certs\") pod \"router-default-74c7c45ff4-cg9w4\" (UID: \"8ef37476-3f4b-430b-abfd-c43a4e2b73ea\") " pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" Jul 10 14:08:37.183180 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:37.181790 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dca5b4bb-8439-4d1c-a76e-89d66227c825-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-6jvfg\" (UID: \"dca5b4bb-8439-4d1c-a76e-89d66227c825\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6jvfg" Jul 10 14:08:37.183180 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:37.181818 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/599b3c3c-524d-49e8-9260-ef807f63fea6-metrics-tls\") pod \"dns-default-dzg7b\" (UID: \"599b3c3c-524d-49e8-9260-ef807f63fea6\") " pod="openshift-dns/dns-default-dzg7b" Jul 10 14:08:37.183180 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:37.181850 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f49ccccf-cd07-4740-838d-11c0426f7273-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-fgxcc\" (UID: \"f49ccccf-cd07-4740-838d-11c0426f7273\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fgxcc" Jul 10 14:08:37.183180 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:37.181876 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/262f42ab-f88a-4689-99ba-0c130a08dde1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lq8n4\" (UID: \"262f42ab-f88a-4689-99ba-0c130a08dde1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lq8n4" Jul 10 14:08:37.183180 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:37.181945 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-registry-tls\") pod \"image-registry-cd7fdc78b-5qrnb\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:08:37.183180 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:37.182142 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 14:08:37.183180 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:37.182158 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cd7fdc78b-5qrnb: secret "image-registry-tls" not found Jul 10 14:08:37.183180 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:37.182215 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-registry-tls podName:03fc50eb-f63c-4c50-ae8f-501f774a1ed0 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:41.182196644 +0000 UTC m=+44.608420953 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-registry-tls") pod "image-registry-cd7fdc78b-5qrnb" (UID: "03fc50eb-f63c-4c50-ae8f-501f774a1ed0") : secret "image-registry-tls" not found Jul 10 14:08:37.183180 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:37.182303 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-service-ca-bundle podName:8ef37476-3f4b-430b-abfd-c43a4e2b73ea nodeName:}" failed. No retries permitted until 2026-07-10 14:08:41.182293209 +0000 UTC m=+44.608517510 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-service-ca-bundle") pod "router-default-74c7c45ff4-cg9w4" (UID: "8ef37476-3f4b-430b-abfd-c43a4e2b73ea") : configmap references non-existent config key: service-ca.crt Jul 10 14:08:37.183180 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:37.182364 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 14:08:37.183180 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:37.182373 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d8597c89c-dsq7z: secret "image-registry-tls" not found Jul 10 14:08:37.184009 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:37.182401 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-registry-tls podName:0434507c-840c-4d87-bd9a-c3aab52951e6 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:41.182391417 +0000 UTC m=+44.608615718 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-registry-tls") pod "image-registry-d8597c89c-dsq7z" (UID: "0434507c-840c-4d87-bd9a-c3aab52951e6") : secret "image-registry-tls" not found Jul 10 14:08:37.184009 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:37.182457 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 14:08:37.184009 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:37.182488 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-metrics-certs podName:8ef37476-3f4b-430b-abfd-c43a4e2b73ea nodeName:}" failed. No retries permitted until 2026-07-10 14:08:41.182476896 +0000 UTC m=+44.608701198 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-metrics-certs") pod "router-default-74c7c45ff4-cg9w4" (UID: "8ef37476-3f4b-430b-abfd-c43a4e2b73ea") : secret "router-metrics-certs-default" not found Jul 10 14:08:37.184009 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:37.182551 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 14:08:37.184009 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:37.182581 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dca5b4bb-8439-4d1c-a76e-89d66227c825-samples-operator-tls podName:dca5b4bb-8439-4d1c-a76e-89d66227c825 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:41.182571281 +0000 UTC m=+44.608795582 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dca5b4bb-8439-4d1c-a76e-89d66227c825-samples-operator-tls") pod "cluster-samples-operator-65db858894-6jvfg" (UID: "dca5b4bb-8439-4d1c-a76e-89d66227c825") : secret "samples-operator-tls" not found Jul 10 14:08:37.184009 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:37.182642 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 14:08:37.184009 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:37.182668 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/599b3c3c-524d-49e8-9260-ef807f63fea6-metrics-tls podName:599b3c3c-524d-49e8-9260-ef807f63fea6 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:41.182658694 +0000 UTC m=+44.608882996 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/599b3c3c-524d-49e8-9260-ef807f63fea6-metrics-tls") pod "dns-default-dzg7b" (UID: "599b3c3c-524d-49e8-9260-ef807f63fea6") : secret "dns-default-metrics-tls" not found Jul 10 14:08:37.184009 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:37.182720 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 10 14:08:37.184009 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:37.182749 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f49ccccf-cd07-4740-838d-11c0426f7273-networking-console-plugin-cert podName:f49ccccf-cd07-4740-838d-11c0426f7273 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:41.182738371 +0000 UTC m=+44.608962693 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f49ccccf-cd07-4740-838d-11c0426f7273-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-fgxcc" (UID: "f49ccccf-cd07-4740-838d-11c0426f7273") : secret "networking-console-plugin-cert" not found Jul 10 14:08:37.184009 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:37.182801 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 14:08:37.184009 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:37.182832 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/262f42ab-f88a-4689-99ba-0c130a08dde1-cluster-monitoring-operator-tls podName:262f42ab-f88a-4689-99ba-0c130a08dde1 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:41.182821137 +0000 UTC m=+44.609045438 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/262f42ab-f88a-4689-99ba-0c130a08dde1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lq8n4" (UID: "262f42ab-f88a-4689-99ba-0c130a08dde1") : secret "cluster-monitoring-operator-tls" not found Jul 10 14:08:37.291787 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:37.290863 2579 generic.go:356] "Generic (PLEG): container finished" podID="2eb94f66-b549-4dc9-8065-1a3801902629" containerID="a5e0d43580d8f06d940e75e1e81164fa2e0065b065e0fcfeb06711e47fcc8c36" exitCode=0 Jul 10 14:08:37.291787 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:37.290975 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pkvqn" event={"ID":"2eb94f66-b549-4dc9-8065-1a3801902629","Type":"ContainerDied","Data":"a5e0d43580d8f06d940e75e1e81164fa2e0065b065e0fcfeb06711e47fcc8c36"} Jul 10 14:08:38.239688 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:38.239433 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:38.311219 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:38.311160 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pkvqn" event={"ID":"2eb94f66-b549-4dc9-8065-1a3801902629","Type":"ContainerStarted","Data":"95709e91b2cd986397aaf65b5eb5377555d7851ac909d91ecee356f96797ec84"} Jul 10 14:08:38.346686 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:38.346631 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pkvqn" podStartSLOduration=6.007600051 podStartE2EDuration="40.346611703s" totalImagesPullingTime="34.339011652s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:07:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:08:38.343317346 +0000 UTC m=+41.769541667" watchObservedRunningTime="2026-07-10 14:08:38.346611703 +0000 UTC m=+41.772836025" Jul 10 14:08:38.381535 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:38.381486 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:38.500451 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:38.500347 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:38.645726 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:38.645677 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:38.749366 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:38.749212 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:39.036243 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:39.036167 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:39.114614 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:39.114523 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:39.299070 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:39.298880 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:39.375610 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:39.375558 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:39.709092 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:39.709041 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:39.779604 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:39.779559 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:41.225308 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:41.225271 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dca5b4bb-8439-4d1c-a76e-89d66227c825-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-6jvfg\" (UID: \"dca5b4bb-8439-4d1c-a76e-89d66227c825\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6jvfg" Jul 10 14:08:41.225308 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:41.225305 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/599b3c3c-524d-49e8-9260-ef807f63fea6-metrics-tls\") pod \"dns-default-dzg7b\" (UID: \"599b3c3c-524d-49e8-9260-ef807f63fea6\") " pod="openshift-dns/dns-default-dzg7b" Jul 10 14:08:41.225759 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:41.225327 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f49ccccf-cd07-4740-838d-11c0426f7273-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-fgxcc\" (UID: \"f49ccccf-cd07-4740-838d-11c0426f7273\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fgxcc" Jul 10 14:08:41.225759 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:41.225360 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/262f42ab-f88a-4689-99ba-0c130a08dde1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lq8n4\" (UID: \"262f42ab-f88a-4689-99ba-0c130a08dde1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lq8n4" Jul 10 14:08:41.225759 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:41.225399 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-registry-tls\") pod \"image-registry-cd7fdc78b-5qrnb\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:08:41.225759 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:41.225419 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 14:08:41.225759 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:41.225455 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-service-ca-bundle\") pod \"router-default-74c7c45ff4-cg9w4\" (UID: \"8ef37476-3f4b-430b-abfd-c43a4e2b73ea\") " pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" Jul 10 14:08:41.225759 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:41.225476 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dca5b4bb-8439-4d1c-a76e-89d66227c825-samples-operator-tls podName:dca5b4bb-8439-4d1c-a76e-89d66227c825 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:49.225461275 +0000 UTC m=+52.651685573 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dca5b4bb-8439-4d1c-a76e-89d66227c825-samples-operator-tls") pod "cluster-samples-operator-65db858894-6jvfg" (UID: "dca5b4bb-8439-4d1c-a76e-89d66227c825") : secret "samples-operator-tls" not found Jul 10 14:08:41.225759 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:41.225488 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 10 14:08:41.225759 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:41.225426 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 14:08:41.225759 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:41.225520 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-registry-tls\") pod \"image-registry-d8597c89c-dsq7z\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:08:41.225759 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:41.225534 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 14:08:41.225759 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:41.225569 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 14:08:41.225759 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:41.225580 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 14:08:41.225759 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:41.225585 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cd7fdc78b-5qrnb: secret "image-registry-tls" not found Jul 10 14:08:41.225759 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:41.225589 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d8597c89c-dsq7z: secret "image-registry-tls" not found Jul 10 14:08:41.225759 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:41.225539 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-service-ca-bundle podName:8ef37476-3f4b-430b-abfd-c43a4e2b73ea nodeName:}" failed. No retries permitted until 2026-07-10 14:08:49.225524434 +0000 UTC m=+52.651748733 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-service-ca-bundle") pod "router-default-74c7c45ff4-cg9w4" (UID: "8ef37476-3f4b-430b-abfd-c43a4e2b73ea") : configmap references non-existent config key: service-ca.crt Jul 10 14:08:41.226292 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:41.225631 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f49ccccf-cd07-4740-838d-11c0426f7273-networking-console-plugin-cert podName:f49ccccf-cd07-4740-838d-11c0426f7273 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:49.22561968 +0000 UTC m=+52.651843993 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f49ccccf-cd07-4740-838d-11c0426f7273-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-fgxcc" (UID: "f49ccccf-cd07-4740-838d-11c0426f7273") : secret "networking-console-plugin-cert" not found Jul 10 14:08:41.226292 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:41.225644 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/599b3c3c-524d-49e8-9260-ef807f63fea6-metrics-tls podName:599b3c3c-524d-49e8-9260-ef807f63fea6 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:49.225638141 +0000 UTC m=+52.651862438 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/599b3c3c-524d-49e8-9260-ef807f63fea6-metrics-tls") pod "dns-default-dzg7b" (UID: "599b3c3c-524d-49e8-9260-ef807f63fea6") : secret "dns-default-metrics-tls" not found Jul 10 14:08:41.226292 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:41.225656 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/262f42ab-f88a-4689-99ba-0c130a08dde1-cluster-monitoring-operator-tls podName:262f42ab-f88a-4689-99ba-0c130a08dde1 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:49.225651151 +0000 UTC m=+52.651875449 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/262f42ab-f88a-4689-99ba-0c130a08dde1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lq8n4" (UID: "262f42ab-f88a-4689-99ba-0c130a08dde1") : secret "cluster-monitoring-operator-tls" not found Jul 10 14:08:41.226292 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:41.225672 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-registry-tls podName:0434507c-840c-4d87-bd9a-c3aab52951e6 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:49.225666674 +0000 UTC m=+52.651890972 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-registry-tls") pod "image-registry-d8597c89c-dsq7z" (UID: "0434507c-840c-4d87-bd9a-c3aab52951e6") : secret "image-registry-tls" not found Jul 10 14:08:41.226292 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:41.225686 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-registry-tls podName:03fc50eb-f63c-4c50-ae8f-501f774a1ed0 nodeName:}" failed. No retries permitted until 2026-07-10 14:08:49.225681066 +0000 UTC m=+52.651905364 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-registry-tls") pod "image-registry-cd7fdc78b-5qrnb" (UID: "03fc50eb-f63c-4c50-ae8f-501f774a1ed0") : secret "image-registry-tls" not found Jul 10 14:08:41.226292 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:41.225727 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-metrics-certs\") pod \"router-default-74c7c45ff4-cg9w4\" (UID: \"8ef37476-3f4b-430b-abfd-c43a4e2b73ea\") " pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" Jul 10 14:08:41.226292 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:41.225787 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 14:08:41.226292 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:41.225812 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-metrics-certs podName:8ef37476-3f4b-430b-abfd-c43a4e2b73ea nodeName:}" failed. No retries permitted until 2026-07-10 14:08:49.225806625 +0000 UTC m=+52.652030922 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-metrics-certs") pod "router-default-74c7c45ff4-cg9w4" (UID: "8ef37476-3f4b-430b-abfd-c43a4e2b73ea") : secret "router-metrics-certs-default" not found Jul 10 14:08:49.301709 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:49.301678 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-service-ca-bundle\") pod \"router-default-74c7c45ff4-cg9w4\" (UID: \"8ef37476-3f4b-430b-abfd-c43a4e2b73ea\") " pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" Jul 10 14:08:49.302128 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:49.301721 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-registry-tls\") pod \"image-registry-d8597c89c-dsq7z\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:08:49.302128 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:49.301754 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-metrics-certs\") pod \"router-default-74c7c45ff4-cg9w4\" (UID: \"8ef37476-3f4b-430b-abfd-c43a4e2b73ea\") " pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" Jul 10 14:08:49.302128 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:49.301788 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dca5b4bb-8439-4d1c-a76e-89d66227c825-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-6jvfg\" (UID: \"dca5b4bb-8439-4d1c-a76e-89d66227c825\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6jvfg" Jul 10 14:08:49.302128 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:49.301806 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/599b3c3c-524d-49e8-9260-ef807f63fea6-metrics-tls\") pod \"dns-default-dzg7b\" (UID: \"599b3c3c-524d-49e8-9260-ef807f63fea6\") " pod="openshift-dns/dns-default-dzg7b" Jul 10 14:08:49.302128 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:49.301826 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f49ccccf-cd07-4740-838d-11c0426f7273-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-fgxcc\" (UID: \"f49ccccf-cd07-4740-838d-11c0426f7273\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fgxcc" Jul 10 14:08:49.302128 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:49.301841 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-service-ca-bundle podName:8ef37476-3f4b-430b-abfd-c43a4e2b73ea nodeName:}" failed. No retries permitted until 2026-07-10 14:09:05.301824026 +0000 UTC m=+68.728048323 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-service-ca-bundle") pod "router-default-74c7c45ff4-cg9w4" (UID: "8ef37476-3f4b-430b-abfd-c43a4e2b73ea") : configmap references non-existent config key: service-ca.crt Jul 10 14:08:49.302128 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:49.301886 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/262f42ab-f88a-4689-99ba-0c130a08dde1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lq8n4\" (UID: \"262f42ab-f88a-4689-99ba-0c130a08dde1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lq8n4" Jul 10 14:08:49.302128 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:49.301845 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 14:08:49.302128 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:49.301969 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 14:08:49.302128 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:49.301981 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-registry-tls\") pod \"image-registry-cd7fdc78b-5qrnb\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:08:49.302128 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:49.301989 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d8597c89c-dsq7z: secret "image-registry-tls" not found Jul 10 14:08:49.302128 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:49.302038 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 14:08:49.302128 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:49.301908 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 14:08:49.302128 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:49.301908 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 10 14:08:49.302128 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:49.302091 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 14:08:49.302128 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:49.301940 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 14:08:49.302128 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:49.302108 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cd7fdc78b-5qrnb: secret "image-registry-tls" not found Jul 10 14:08:49.302665 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:49.302041 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-metrics-certs podName:8ef37476-3f4b-430b-abfd-c43a4e2b73ea nodeName:}" failed. No retries permitted until 2026-07-10 14:09:05.302022557 +0000 UTC m=+68.728246866 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-metrics-certs") pod "router-default-74c7c45ff4-cg9w4" (UID: "8ef37476-3f4b-430b-abfd-c43a4e2b73ea") : secret "router-metrics-certs-default" not found Jul 10 14:08:49.302665 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:49.302140 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-registry-tls podName:0434507c-840c-4d87-bd9a-c3aab52951e6 nodeName:}" failed. No retries permitted until 2026-07-10 14:09:05.30212493 +0000 UTC m=+68.728349242 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-registry-tls") pod "image-registry-d8597c89c-dsq7z" (UID: "0434507c-840c-4d87-bd9a-c3aab52951e6") : secret "image-registry-tls" not found Jul 10 14:08:49.302665 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:49.302156 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dca5b4bb-8439-4d1c-a76e-89d66227c825-samples-operator-tls podName:dca5b4bb-8439-4d1c-a76e-89d66227c825 nodeName:}" failed. No retries permitted until 2026-07-10 14:09:05.302148585 +0000 UTC m=+68.728372882 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dca5b4bb-8439-4d1c-a76e-89d66227c825-samples-operator-tls") pod "cluster-samples-operator-65db858894-6jvfg" (UID: "dca5b4bb-8439-4d1c-a76e-89d66227c825") : secret "samples-operator-tls" not found Jul 10 14:08:49.302665 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:49.302167 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f49ccccf-cd07-4740-838d-11c0426f7273-networking-console-plugin-cert podName:f49ccccf-cd07-4740-838d-11c0426f7273 nodeName:}" failed. No retries permitted until 2026-07-10 14:09:05.302161383 +0000 UTC m=+68.728385681 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f49ccccf-cd07-4740-838d-11c0426f7273-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-fgxcc" (UID: "f49ccccf-cd07-4740-838d-11c0426f7273") : secret "networking-console-plugin-cert" not found Jul 10 14:08:49.302665 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:49.302175 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/262f42ab-f88a-4689-99ba-0c130a08dde1-cluster-monitoring-operator-tls podName:262f42ab-f88a-4689-99ba-0c130a08dde1 nodeName:}" failed. No retries permitted until 2026-07-10 14:09:05.302170442 +0000 UTC m=+68.728394739 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/262f42ab-f88a-4689-99ba-0c130a08dde1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lq8n4" (UID: "262f42ab-f88a-4689-99ba-0c130a08dde1") : secret "cluster-monitoring-operator-tls" not found Jul 10 14:08:49.302665 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:49.302184 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/599b3c3c-524d-49e8-9260-ef807f63fea6-metrics-tls podName:599b3c3c-524d-49e8-9260-ef807f63fea6 nodeName:}" failed. No retries permitted until 2026-07-10 14:09:05.30217963 +0000 UTC m=+68.728403928 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/599b3c3c-524d-49e8-9260-ef807f63fea6-metrics-tls") pod "dns-default-dzg7b" (UID: "599b3c3c-524d-49e8-9260-ef807f63fea6") : secret "dns-default-metrics-tls" not found Jul 10 14:08:49.302665 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:49.302192 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-registry-tls podName:03fc50eb-f63c-4c50-ae8f-501f774a1ed0 nodeName:}" failed. No retries permitted until 2026-07-10 14:09:05.302188343 +0000 UTC m=+68.728412641 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-registry-tls") pod "image-registry-cd7fdc78b-5qrnb" (UID: "03fc50eb-f63c-4c50-ae8f-501f774a1ed0") : secret "image-registry-tls" not found Jul 10 14:08:49.442608 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:49.442579 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:49.538253 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:49.538217 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:49.635844 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:49.635803 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:49.738006 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:49.737504 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:49.837446 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:49.837348 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:50.346596 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:50.346501 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-znjf2_99ef7290-2248-4e0c-9fda-100370c1ac2d/console-operator/0.log" Jul 10 14:08:50.346596 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:50.346546 2579 generic.go:356] "Generic (PLEG): container finished" podID="99ef7290-2248-4e0c-9fda-100370c1ac2d" containerID="d660752b55dd13742f155421783df4e10b542373202a10396332e46d92bd1412" exitCode=255 Jul 10 14:08:50.347149 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:50.346633 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-znjf2" event={"ID":"99ef7290-2248-4e0c-9fda-100370c1ac2d","Type":"ContainerDied","Data":"d660752b55dd13742f155421783df4e10b542373202a10396332e46d92bd1412"} Jul 10 14:08:50.347149 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:50.346890 2579 scope.go:117] "RemoveContainer" containerID="d660752b55dd13742f155421783df4e10b542373202a10396332e46d92bd1412" Jul 10 14:08:50.348624 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:50.348582 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxx5k" event={"ID":"d58cbba7-3164-48fd-8697-1559ca85e14b","Type":"ContainerStarted","Data":"418a6ed9fed81b289508f49c34b3675a0b2da86239ed881a5077288cde018462"} Jul 10 14:08:50.351265 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:50.351239 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2" event={"ID":"369ec23b-46fc-4dbc-9e5a-f34d138da096","Type":"ContainerStarted","Data":"70dc48929eb7325254f09ba3cd48037152b05f8787058c453f85fc6c45722f09"} Jul 10 14:08:50.351375 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:50.351306 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2" event={"ID":"369ec23b-46fc-4dbc-9e5a-f34d138da096","Type":"ContainerStarted","Data":"c6df93a6dee0e903bd6f07bea9228a7f6207f4e600cd2ea00765f4632d22cbbb"} Jul 10 14:08:50.351375 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:50.351330 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2" event={"ID":"369ec23b-46fc-4dbc-9e5a-f34d138da096","Type":"ContainerStarted","Data":"ec392129fd4254f1821b888638c5c0f166f87c0aa3189edc02464a7bbee68cb0"} Jul 10 14:08:50.353163 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:50.353132 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2ftqc" event={"ID":"99583015-7353-42d3-b7e0-cbf842aed856","Type":"ContainerStarted","Data":"dd78ff4a4e65b08da1d702a6ac49c0f718cd78f49fe748a903b2d8b71c1be51d"} Jul 10 14:08:50.354749 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:50.354713 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wv479" event={"ID":"c09a8bb4-23ae-4bec-8d56-63e2f705d3ef","Type":"ContainerStarted","Data":"65ec2b3af35366b6fbb8c1b26f618686fae9bf001d780c84330b272267650cb2"} Jul 10 14:08:50.356584 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:50.356555 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7449d47c8b-hxx7v" event={"ID":"443ac7cb-245f-4e42-b991-61383cdd63be","Type":"ContainerStarted","Data":"24ee8c93c67ddf85db8c964b134166141838d9916c8213ffe25a42f36234ca45"} Jul 10 14:08:50.357062 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:50.356896 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7449d47c8b-hxx7v" Jul 10 14:08:50.358485 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:50.358467 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7449d47c8b-hxx7v" Jul 10 14:08:50.359738 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:50.359496 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6675c66cbb-47smw" event={"ID":"3ebba52f-e57e-46fb-8335-77feeb2c62aa","Type":"ContainerStarted","Data":"94db41aaf4f74c9b9288d7dbb80460eabc483f8edab794c5e379a62ce2ce4e87"} Jul 10 14:08:50.361302 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:50.361283 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qjfm8" event={"ID":"65c298b2-9990-431f-a1cd-1a06c1ec25df","Type":"ContainerStarted","Data":"2e5d6cbfb87e60368032754d7ce8c3d7a1bbcb6237fa275f934929603f99faf0"} Jul 10 14:08:50.363107 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:50.363069 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-vz755" event={"ID":"7f9d2e13-3a46-4539-b046-2c9ae7fe5f94","Type":"ContainerStarted","Data":"a1186c8f8489beadf6045c4e208c5b12ebab674c52ff293e194e61d4a641d052"} Jul 10 14:08:50.364563 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:50.364493 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-76jtw" event={"ID":"702d9fee-e3a5-400c-b53a-e2ce3be19af3","Type":"ContainerStarted","Data":"055e3f3a51267c30ff18890728dfbafc94e5ef924fdaba22218285d7f2df38c8"} Jul 10 14:08:50.393238 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:50.393177 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7449d47c8b-hxx7v" podStartSLOduration=7.018482589 podStartE2EDuration="22.393159011s" totalImagesPullingTime="15.374676422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:08:50.391963891 +0000 UTC m=+53.818188203" watchObservedRunningTime="2026-07-10 14:08:50.393159011 +0000 UTC m=+53.819383332" Jul 10 14:08:50.418212 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:50.418148 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wv479" podStartSLOduration=2.075983123 podStartE2EDuration="17.418128614s" totalImagesPullingTime="15.342145491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:08:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:08:50.414778486 +0000 UTC m=+53.841002805" watchObservedRunningTime="2026-07-10 14:08:50.418128614 +0000 UTC m=+53.844352932" Jul 10 14:08:50.441750 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:50.441706 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6675c66cbb-47smw" podStartSLOduration=7.029741273 podStartE2EDuration="22.441691153s" totalImagesPullingTime="15.41194988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:08:50.440722546 +0000 UTC m=+53.866946867" watchObservedRunningTime="2026-07-10 14:08:50.441691153 +0000 UTC m=+53.867915450" Jul 10 14:08:50.463506 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:50.463456 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-vz755" podStartSLOduration=34.917669377 podStartE2EDuration="50.463435154s" totalImagesPullingTime="15.545765777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:08:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:08:50.46189098 +0000 UTC m=+53.888115301" watchObservedRunningTime="2026-07-10 14:08:50.463435154 +0000 UTC m=+53.889659475" Jul 10 14:08:50.509194 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:50.509142 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2" podStartSLOduration=7.046997886 podStartE2EDuration="22.509123036s" totalImagesPullingTime="15.46212515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:08:50.508408913 +0000 UTC m=+53.934633236" watchObservedRunningTime="2026-07-10 14:08:50.509123036 +0000 UTC m=+53.935347359" Jul 10 14:08:50.509935 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:50.509897 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-76jtw" podStartSLOduration=35.539908887 podStartE2EDuration="50.509886106s" totalImagesPullingTime="14.969977219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:08:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:08:50.489643969 +0000 UTC m=+53.915868291" watchObservedRunningTime="2026-07-10 14:08:50.509886106 +0000 UTC m=+53.936110427" Jul 10 14:08:50.527123 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:50.527071 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxx5k" podStartSLOduration=35.123540544 podStartE2EDuration="50.52705256s" totalImagesPullingTime="15.403512016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:08:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:08:50.526415573 +0000 UTC m=+53.952639894" watchObservedRunningTime="2026-07-10 14:08:50.52705256 +0000 UTC m=+53.953276886" Jul 10 14:08:50.554579 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:50.554521 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2ftqc" podStartSLOduration=33.153575985 podStartE2EDuration="48.554501282s" totalImagesPullingTime="15.400925297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:08:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:08:50.552893177 +0000 UTC m=+53.979117498" watchObservedRunningTime="2026-07-10 14:08:50.554501282 +0000 UTC m=+53.980725607" Jul 10 14:08:50.585091 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:50.585048 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qjfm8" podStartSLOduration=35.146786273 podStartE2EDuration="50.585031933s" totalImagesPullingTime="15.43824566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:08:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:08:50.583838143 +0000 UTC m=+54.010062466" watchObservedRunningTime="2026-07-10 14:08:50.585031933 +0000 UTC m=+54.011256293" Jul 10 14:08:50.605144 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:50.605113 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:50.706102 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:50.706047 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:51.370602 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:51.370568 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-znjf2_99ef7290-2248-4e0c-9fda-100370c1ac2d/console-operator/1.log" Jul 10 14:08:51.371083 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:51.371066 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-znjf2_99ef7290-2248-4e0c-9fda-100370c1ac2d/console-operator/0.log" Jul 10 14:08:51.371144 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:51.371101 2579 generic.go:356] "Generic (PLEG): container finished" podID="99ef7290-2248-4e0c-9fda-100370c1ac2d" containerID="6545b7054a491b601593bd649669487c2b0183b6a5a7c3c1be034306701af81a" exitCode=255 Jul 10 14:08:51.371205 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:51.371191 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-znjf2" event={"ID":"99ef7290-2248-4e0c-9fda-100370c1ac2d","Type":"ContainerDied","Data":"6545b7054a491b601593bd649669487c2b0183b6a5a7c3c1be034306701af81a"} Jul 10 14:08:51.371265 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:51.371256 2579 scope.go:117] "RemoveContainer" containerID="d660752b55dd13742f155421783df4e10b542373202a10396332e46d92bd1412" Jul 10 14:08:51.371960 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:51.371930 2579 scope.go:117] "RemoveContainer" containerID="6545b7054a491b601593bd649669487c2b0183b6a5a7c3c1be034306701af81a" Jul 10 14:08:51.372236 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:51.372108 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-znjf2_openshift-console-operator(99ef7290-2248-4e0c-9fda-100370c1ac2d)\"" pod="openshift-console-operator/console-operator-7866497494-znjf2" podUID="99ef7290-2248-4e0c-9fda-100370c1ac2d" Jul 10 14:08:51.897306 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:51.897275 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pflwv"] Jul 10 14:08:51.921236 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:51.921202 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:51.933633 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:51.933609 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pflwv"] Jul 10 14:08:51.933761 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:51.933721 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pflwv" Jul 10 14:08:51.936601 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:51.936584 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 10 14:08:51.936710 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:51.936676 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 10 14:08:51.938060 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:51.938039 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-54rbs\"" Jul 10 14:08:52.033278 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:52.033246 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl27q\" (UniqueName: \"kubernetes.io/projected/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-kube-api-access-rl27q\") pod \"insights-runtime-extractor-pflwv\" (UID: \"ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c\") " pod="openshift-insights/insights-runtime-extractor-pflwv" Jul 10 14:08:52.033428 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:52.033326 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pflwv\" (UID: \"ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c\") " pod="openshift-insights/insights-runtime-extractor-pflwv" Jul 10 14:08:52.033428 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:52.033351 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pflwv\" (UID: \"ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c\") " pod="openshift-insights/insights-runtime-extractor-pflwv" Jul 10 14:08:52.033548 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:52.033443 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-crio-socket\") pod \"insights-runtime-extractor-pflwv\" (UID: \"ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c\") " pod="openshift-insights/insights-runtime-extractor-pflwv" Jul 10 14:08:52.033548 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:52.033534 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-data-volume\") pod \"insights-runtime-extractor-pflwv\" (UID: \"ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c\") " pod="openshift-insights/insights-runtime-extractor-pflwv" Jul 10 14:08:52.134609 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:52.134576 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pflwv\" (UID: \"ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c\") " pod="openshift-insights/insights-runtime-extractor-pflwv" Jul 10 14:08:52.134755 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:52.134619 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pflwv\" (UID: \"ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c\") " pod="openshift-insights/insights-runtime-extractor-pflwv" Jul 10 14:08:52.134755 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:52.134679 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-crio-socket\") pod \"insights-runtime-extractor-pflwv\" (UID: \"ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c\") " pod="openshift-insights/insights-runtime-extractor-pflwv" Jul 10 14:08:52.134755 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:52.134701 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 14:08:52.134755 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:52.134713 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-data-volume\") pod \"insights-runtime-extractor-pflwv\" (UID: \"ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c\") " pod="openshift-insights/insights-runtime-extractor-pflwv" Jul 10 14:08:52.134898 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:52.134764 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-kube-rbac-proxy-cm podName:ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c nodeName:}" failed. No retries permitted until 2026-07-10 14:08:52.634747198 +0000 UTC m=+56.060971518 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pflwv" (UID: "ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c") : configmap "kube-rbac-proxy" not found Jul 10 14:08:52.134898 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:52.134784 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl27q\" (UniqueName: \"kubernetes.io/projected/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-kube-api-access-rl27q\") pod \"insights-runtime-extractor-pflwv\" (UID: \"ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c\") " pod="openshift-insights/insights-runtime-extractor-pflwv" Jul 10 14:08:52.134898 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:52.134791 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 14:08:52.134898 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:52.134797 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-crio-socket\") pod \"insights-runtime-extractor-pflwv\" (UID: \"ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c\") " pod="openshift-insights/insights-runtime-extractor-pflwv" Jul 10 14:08:52.134898 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:52.134853 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-insights-runtime-extractor-tls podName:ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c nodeName:}" failed. No retries permitted until 2026-07-10 14:08:52.6348368 +0000 UTC m=+56.061061103 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pflwv" (UID: "ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c") : secret "insights-runtime-extractor-tls" not found Jul 10 14:08:52.135123 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:52.135044 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-data-volume\") pod \"insights-runtime-extractor-pflwv\" (UID: \"ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c\") " pod="openshift-insights/insights-runtime-extractor-pflwv" Jul 10 14:08:52.145472 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:52.145447 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl27q\" (UniqueName: \"kubernetes.io/projected/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-kube-api-access-rl27q\") pod \"insights-runtime-extractor-pflwv\" (UID: \"ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c\") " pod="openshift-insights/insights-runtime-extractor-pflwv" Jul 10 14:08:52.242318 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:52.242226 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:52.368679 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:52.368649 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:52.375861 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:52.375843 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-znjf2_99ef7290-2248-4e0c-9fda-100370c1ac2d/console-operator/1.log" Jul 10 14:08:52.376310 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:52.376254 2579 scope.go:117] "RemoveContainer" containerID="6545b7054a491b601593bd649669487c2b0183b6a5a7c3c1be034306701af81a" Jul 10 14:08:52.376463 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:52.376442 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-znjf2_openshift-console-operator(99ef7290-2248-4e0c-9fda-100370c1ac2d)\"" pod="openshift-console-operator/console-operator-7866497494-znjf2" podUID="99ef7290-2248-4e0c-9fda-100370c1ac2d" Jul 10 14:08:52.432290 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:52.432265 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:52.638912 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:52.638883 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pflwv\" (UID: \"ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c\") " pod="openshift-insights/insights-runtime-extractor-pflwv" Jul 10 14:08:52.639066 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:52.638922 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pflwv\" (UID: \"ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c\") " pod="openshift-insights/insights-runtime-extractor-pflwv" Jul 10 14:08:52.639066 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:52.639019 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 14:08:52.639138 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:52.639080 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-kube-rbac-proxy-cm podName:ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c nodeName:}" failed. No retries permitted until 2026-07-10 14:08:53.63906645 +0000 UTC m=+57.065290750 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pflwv" (UID: "ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c") : configmap "kube-rbac-proxy" not found Jul 10 14:08:52.639138 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:52.639107 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 14:08:52.639217 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:52.639159 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-insights-runtime-extractor-tls podName:ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c nodeName:}" failed. No retries permitted until 2026-07-10 14:08:53.639143534 +0000 UTC m=+57.065367831 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pflwv" (UID: "ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c") : secret "insights-runtime-extractor-tls" not found Jul 10 14:08:52.677267 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:52.677244 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:52.771741 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:52.771706 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:52.886570 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:52.886534 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gz2xn_d5297778-2ed8-4173-a78f-55109e6e5503/dns-node-resolver/0.log" Jul 10 14:08:52.898769 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:52.898692 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-w4bp5"] Jul 10 14:08:52.901156 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:52.901135 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-w4bp5" Jul 10 14:08:52.903940 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:52.903922 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-cwn7x\"" Jul 10 14:08:52.904042 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:52.903986 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 10 14:08:52.905184 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:52.905167 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 10 14:08:52.911175 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:52.911156 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-w4bp5"] Jul 10 14:08:53.043644 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:53.043611 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmx47\" (UniqueName: \"kubernetes.io/projected/a91c7486-9ea5-4e2f-9e91-891925e51268-kube-api-access-jmx47\") pod \"migrator-7f59b54f6c-w4bp5\" (UID: \"a91c7486-9ea5-4e2f-9e91-891925e51268\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-w4bp5" Jul 10 14:08:53.117096 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:53.117065 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:53.144497 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:53.144472 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmx47\" (UniqueName: \"kubernetes.io/projected/a91c7486-9ea5-4e2f-9e91-891925e51268-kube-api-access-jmx47\") pod \"migrator-7f59b54f6c-w4bp5\" (UID: \"a91c7486-9ea5-4e2f-9e91-891925e51268\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-w4bp5" Jul 10 14:08:53.153321 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:53.153263 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmx47\" (UniqueName: \"kubernetes.io/projected/a91c7486-9ea5-4e2f-9e91-891925e51268-kube-api-access-jmx47\") pod \"migrator-7f59b54f6c-w4bp5\" (UID: \"a91c7486-9ea5-4e2f-9e91-891925e51268\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-w4bp5" Jul 10 14:08:53.191433 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:53.191403 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:53.210321 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:53.210300 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-w4bp5" Jul 10 14:08:53.332516 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:53.332495 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-w4bp5"] Jul 10 14:08:53.334758 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:08:53.334735 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda91c7486_9ea5_4e2f_9e91_891925e51268.slice/crio-004fb800227f4cef30634d646abd54e08a24db17fecc7f8d1e211431521c3c6a WatchSource:0}: Error finding container 004fb800227f4cef30634d646abd54e08a24db17fecc7f8d1e211431521c3c6a: Status 404 returned error can't find the container with id 004fb800227f4cef30634d646abd54e08a24db17fecc7f8d1e211431521c3c6a Jul 10 14:08:53.384343 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:53.384314 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-w4bp5" event={"ID":"a91c7486-9ea5-4e2f-9e91-891925e51268","Type":"ContainerStarted","Data":"004fb800227f4cef30634d646abd54e08a24db17fecc7f8d1e211431521c3c6a"} Jul 10 14:08:53.649349 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:53.649321 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pflwv\" (UID: \"ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c\") " pod="openshift-insights/insights-runtime-extractor-pflwv" Jul 10 14:08:53.649503 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:53.649361 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pflwv\" (UID: \"ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c\") " pod="openshift-insights/insights-runtime-extractor-pflwv" Jul 10 14:08:53.649503 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:53.649476 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 14:08:53.649579 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:53.649528 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-insights-runtime-extractor-tls podName:ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c nodeName:}" failed. No retries permitted until 2026-07-10 14:08:55.64951393 +0000 UTC m=+59.075738228 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pflwv" (UID: "ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c") : secret "insights-runtime-extractor-tls" not found Jul 10 14:08:53.649579 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:53.649548 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 14:08:53.649656 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:53.649603 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-kube-rbac-proxy-cm podName:ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c nodeName:}" failed. No retries permitted until 2026-07-10 14:08:55.649590197 +0000 UTC m=+59.075814495 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pflwv" (UID: "ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c") : configmap "kube-rbac-proxy" not found Jul 10 14:08:53.758154 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:53.758128 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-znjf2" Jul 10 14:08:53.758272 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:53.758181 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-znjf2" Jul 10 14:08:53.758484 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:53.758470 2579 scope.go:117] "RemoveContainer" containerID="6545b7054a491b601593bd649669487c2b0183b6a5a7c3c1be034306701af81a" Jul 10 14:08:53.758656 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:53.758633 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-znjf2_openshift-console-operator(99ef7290-2248-4e0c-9fda-100370c1ac2d)\"" pod="openshift-console-operator/console-operator-7866497494-znjf2" podUID="99ef7290-2248-4e0c-9fda-100370c1ac2d" Jul 10 14:08:54.077753 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:54.077682 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t4t72_f8d41bc8-bad3-456a-8374-1c795e333862/node-ca/0.log" Jul 10 14:08:54.244206 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:54.244172 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-r8d45"] Jul 10 14:08:54.246781 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:54.246762 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-r8d45" Jul 10 14:08:54.250326 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:54.250297 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 10 14:08:54.251693 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:54.251671 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 10 14:08:54.251784 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:54.251706 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 10 14:08:54.251784 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:54.251717 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-dlhj9\"" Jul 10 14:08:54.251784 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:54.251727 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 10 14:08:54.258468 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:54.258450 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-r8d45"] Jul 10 14:08:54.296124 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:54.296084 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:54.356591 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:54.356563 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/aa42b66d-2ac7-4bd5-814f-4f1e8ed7340f-signing-cabundle\") pod \"service-ca-79f68b9f4f-r8d45\" (UID: \"aa42b66d-2ac7-4bd5-814f-4f1e8ed7340f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-r8d45" Jul 10 14:08:54.356746 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:54.356623 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/aa42b66d-2ac7-4bd5-814f-4f1e8ed7340f-signing-key\") pod \"service-ca-79f68b9f4f-r8d45\" (UID: \"aa42b66d-2ac7-4bd5-814f-4f1e8ed7340f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-r8d45" Jul 10 14:08:54.356746 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:54.356736 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnnsm\" (UniqueName: \"kubernetes.io/projected/aa42b66d-2ac7-4bd5-814f-4f1e8ed7340f-kube-api-access-mnnsm\") pod \"service-ca-79f68b9f4f-r8d45\" (UID: \"aa42b66d-2ac7-4bd5-814f-4f1e8ed7340f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-r8d45" Jul 10 14:08:54.398138 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:54.398099 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:54.458261 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:54.458229 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/aa42b66d-2ac7-4bd5-814f-4f1e8ed7340f-signing-cabundle\") pod \"service-ca-79f68b9f4f-r8d45\" (UID: \"aa42b66d-2ac7-4bd5-814f-4f1e8ed7340f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-r8d45" Jul 10 14:08:54.458433 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:54.458302 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/aa42b66d-2ac7-4bd5-814f-4f1e8ed7340f-signing-key\") pod \"service-ca-79f68b9f4f-r8d45\" (UID: \"aa42b66d-2ac7-4bd5-814f-4f1e8ed7340f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-r8d45" Jul 10 14:08:54.458433 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:54.458379 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnnsm\" (UniqueName: \"kubernetes.io/projected/aa42b66d-2ac7-4bd5-814f-4f1e8ed7340f-kube-api-access-mnnsm\") pod \"service-ca-79f68b9f4f-r8d45\" (UID: \"aa42b66d-2ac7-4bd5-814f-4f1e8ed7340f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-r8d45" Jul 10 14:08:54.459220 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:54.459194 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/aa42b66d-2ac7-4bd5-814f-4f1e8ed7340f-signing-cabundle\") pod \"service-ca-79f68b9f4f-r8d45\" (UID: \"aa42b66d-2ac7-4bd5-814f-4f1e8ed7340f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-r8d45" Jul 10 14:08:54.460903 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:54.460883 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/aa42b66d-2ac7-4bd5-814f-4f1e8ed7340f-signing-key\") pod \"service-ca-79f68b9f4f-r8d45\" (UID: \"aa42b66d-2ac7-4bd5-814f-4f1e8ed7340f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-r8d45" Jul 10 14:08:54.468001 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:54.467977 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnnsm\" (UniqueName: \"kubernetes.io/projected/aa42b66d-2ac7-4bd5-814f-4f1e8ed7340f-kube-api-access-mnnsm\") pod \"service-ca-79f68b9f4f-r8d45\" (UID: \"aa42b66d-2ac7-4bd5-814f-4f1e8ed7340f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-r8d45" Jul 10 14:08:54.555585 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:54.555552 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-r8d45" Jul 10 14:08:54.678308 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:54.678123 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wv479_c09a8bb4-23ae-4bec-8d56-63e2f705d3ef/serve-healthcheck-canary/0.log" Jul 10 14:08:54.715705 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:54.715681 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-r8d45"] Jul 10 14:08:54.718509 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:08:54.718485 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa42b66d_2ac7_4bd5_814f_4f1e8ed7340f.slice/crio-4fc394a49060ce35b0acc608b0110cfbee4a4ef3211bc90f51efeb52e34bc9c9 WatchSource:0}: Error finding container 4fc394a49060ce35b0acc608b0110cfbee4a4ef3211bc90f51efeb52e34bc9c9: Status 404 returned error can't find the container with id 4fc394a49060ce35b0acc608b0110cfbee4a4ef3211bc90f51efeb52e34bc9c9 Jul 10 14:08:55.366271 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:55.366228 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:55.393374 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:55.393344 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-w4bp5" event={"ID":"a91c7486-9ea5-4e2f-9e91-891925e51268","Type":"ContainerStarted","Data":"0397537745fd3aec64e1e4b091533016858ffc400842945511163033bf3f5573"} Jul 10 14:08:55.393510 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:55.393397 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-w4bp5" event={"ID":"a91c7486-9ea5-4e2f-9e91-891925e51268","Type":"ContainerStarted","Data":"50ec3b66cac8f8f98d7be2252543ed083575ddc8f214be2606bc570b05437299"} Jul 10 14:08:55.394798 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:55.394773 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-r8d45" event={"ID":"aa42b66d-2ac7-4bd5-814f-4f1e8ed7340f","Type":"ContainerStarted","Data":"77e628759f0142070e2d6ace65fa61d96bf468deca58db2364988f83cd1a30e0"} Jul 10 14:08:55.394890 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:55.394821 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-r8d45" event={"ID":"aa42b66d-2ac7-4bd5-814f-4f1e8ed7340f","Type":"ContainerStarted","Data":"4fc394a49060ce35b0acc608b0110cfbee4a4ef3211bc90f51efeb52e34bc9c9"} Jul 10 14:08:55.412553 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:55.412515 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-w4bp5" podStartSLOduration=2.157485347 podStartE2EDuration="3.412500051s" totalImagesPullingTime="1.255014704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:08:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:08:55.411458912 +0000 UTC m=+58.837683232" watchObservedRunningTime="2026-07-10 14:08:55.412500051 +0000 UTC m=+58.838724398" Jul 10 14:08:55.432008 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:55.431974 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-r8d45" podStartSLOduration=1.431940722 podStartE2EDuration="1.431940722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:08:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:08:55.431275217 +0000 UTC m=+58.857499539" watchObservedRunningTime="2026-07-10 14:08:55.431940722 +0000 UTC m=+58.858165042" Jul 10 14:08:55.667245 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:55.667163 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pflwv\" (UID: \"ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c\") " pod="openshift-insights/insights-runtime-extractor-pflwv" Jul 10 14:08:55.667245 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:55.667202 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pflwv\" (UID: \"ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c\") " pod="openshift-insights/insights-runtime-extractor-pflwv" Jul 10 14:08:55.667461 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:55.667292 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 14:08:55.667461 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:55.667298 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 14:08:55.667461 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:55.667360 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-kube-rbac-proxy-cm podName:ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c nodeName:}" failed. No retries permitted until 2026-07-10 14:08:59.667340719 +0000 UTC m=+63.093565016 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pflwv" (UID: "ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c") : configmap "kube-rbac-proxy" not found Jul 10 14:08:55.667461 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:55.667390 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-insights-runtime-extractor-tls podName:ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c nodeName:}" failed. No retries permitted until 2026-07-10 14:08:59.667375976 +0000 UTC m=+63.093600274 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pflwv" (UID: "ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c") : secret "insights-runtime-extractor-tls" not found Jul 10 14:08:55.927388 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:55.927298 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:56.021520 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:56.021488 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:56.125711 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:56.125668 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:56.222091 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:56.222007 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:56.323175 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:56.323142 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:56.842598 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:56.842548 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:57.227181 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:57.227134 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:57.807818 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:57.807778 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:57.914928 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:57.914898 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:58.423132 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:58.423077 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:58.614725 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:58.614686 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:59.011502 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:59.011450 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:59.214860 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:59.214823 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:59.244339 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:59.244315 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jwwrp" Jul 10 14:08:59.565125 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:59.565086 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:08:59.706565 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:59.706523 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pflwv\" (UID: \"ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c\") " pod="openshift-insights/insights-runtime-extractor-pflwv" Jul 10 14:08:59.706742 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:59.706586 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pflwv\" (UID: \"ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c\") " pod="openshift-insights/insights-runtime-extractor-pflwv" Jul 10 14:08:59.706742 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:59.706672 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 14:08:59.706742 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:59.706737 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 14:08:59.706857 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:59.706751 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-kube-rbac-proxy-cm podName:ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c nodeName:}" failed. No retries permitted until 2026-07-10 14:09:07.706730408 +0000 UTC m=+71.132954718 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pflwv" (UID: "ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c") : configmap "kube-rbac-proxy" not found Jul 10 14:08:59.706857 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:08:59.706784 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-insights-runtime-extractor-tls podName:ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c nodeName:}" failed. No retries permitted until 2026-07-10 14:09:07.706771149 +0000 UTC m=+71.132995446 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pflwv" (UID: "ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c") : secret "insights-runtime-extractor-tls" not found Jul 10 14:08:59.860024 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:08:59.859988 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:09:00.917390 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:00.917356 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:09:01.013222 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:01.013187 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:09:01.212259 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:01.212179 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:09:01.611218 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:01.611186 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:09:01.811054 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:01.811023 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:09:01.828979 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:01.828939 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46040804-7e1e-41a2-a1e7-209bdc6b2945-metrics-certs\") pod \"network-metrics-daemon-bkhqd\" (UID: \"46040804-7e1e-41a2-a1e7-209bdc6b2945\") " pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:09:01.831721 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:01.831702 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 14:09:01.840020 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:09:01.839999 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 10 14:09:01.840104 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:09:01.840051 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46040804-7e1e-41a2-a1e7-209bdc6b2945-metrics-certs podName:46040804-7e1e-41a2-a1e7-209bdc6b2945 nodeName:}" failed. No retries permitted until 2026-07-10 14:10:05.840035149 +0000 UTC m=+129.266259450 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46040804-7e1e-41a2-a1e7-209bdc6b2945-metrics-certs") pod "network-metrics-daemon-bkhqd" (UID: "46040804-7e1e-41a2-a1e7-209bdc6b2945") : secret "metrics-daemon-secret" not found Jul 10 14:09:01.929908 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:01.929849 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d30d948f-76fb-4888-a860-adf9622c2f3f-original-pull-secret\") pod \"global-pull-secret-syncer-86t8x\" (UID: \"d30d948f-76fb-4888-a860-adf9622c2f3f\") " pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:09:01.932762 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:01.932746 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 14:09:01.942374 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:01.942353 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d30d948f-76fb-4888-a860-adf9622c2f3f-original-pull-secret\") pod \"global-pull-secret-syncer-86t8x\" (UID: \"d30d948f-76fb-4888-a860-adf9622c2f3f\") " pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:09:01.950299 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:01.950278 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" limit=1024 Jul 10 14:09:02.031413 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:02.031381 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nhpm\" (UniqueName: \"kubernetes.io/projected/4828193c-b7e0-4bdf-bf65-a610d88c1faf-kube-api-access-9nhpm\") pod \"network-check-target-xzhpq\" (UID: \"4828193c-b7e0-4bdf-bf65-a610d88c1faf\") " pod="openshift-network-diagnostics/network-check-target-xzhpq" Jul 10 14:09:02.033784 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:02.033754 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nhpm\" (UniqueName: \"kubernetes.io/projected/4828193c-b7e0-4bdf-bf65-a610d88c1faf-kube-api-access-9nhpm\") pod \"network-check-target-xzhpq\" (UID: \"4828193c-b7e0-4bdf-bf65-a610d88c1faf\") " pod="openshift-network-diagnostics/network-check-target-xzhpq" Jul 10 14:09:02.115342 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:02.115312 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7ddd8\"" Jul 10 14:09:02.119706 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:02.119691 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-86t8x" Jul 10 14:09:02.123510 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:02.123495 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzhpq" Jul 10 14:09:02.281101 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:02.281075 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xzhpq"] Jul 10 14:09:02.283581 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:09:02.283544 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4828193c_b7e0_4bdf_bf65_a610d88c1faf.slice/crio-54f40f17b1c7ad87bcfeed46c0505d86616176366b3ee241fda5c7c06ff97158 WatchSource:0}: Error finding container 54f40f17b1c7ad87bcfeed46c0505d86616176366b3ee241fda5c7c06ff97158: Status 404 returned error can't find the container with id 54f40f17b1c7ad87bcfeed46c0505d86616176366b3ee241fda5c7c06ff97158 Jul 10 14:09:02.297412 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:02.297388 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-86t8x"] Jul 10 14:09:02.300513 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:09:02.300482 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd30d948f_76fb_4888_a860_adf9622c2f3f.slice/crio-8ad54cf32562466702a1fc43c3138977c573b779931ae821211f2c9255752946 WatchSource:0}: Error finding container 8ad54cf32562466702a1fc43c3138977c573b779931ae821211f2c9255752946: Status 404 returned error can't find the container with id 8ad54cf32562466702a1fc43c3138977c573b779931ae821211f2c9255752946 Jul 10 14:09:02.427705 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:02.427677 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-86t8x" event={"ID":"d30d948f-76fb-4888-a860-adf9622c2f3f","Type":"ContainerStarted","Data":"8ad54cf32562466702a1fc43c3138977c573b779931ae821211f2c9255752946"} Jul 10 14:09:02.429076 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:02.429053 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xzhpq" event={"ID":"4828193c-b7e0-4bdf-bf65-a610d88c1faf","Type":"ContainerStarted","Data":"031f66e793a2e9039d034d2f0026104c8f2c899b07b3804440bf7dff2e166e22"} Jul 10 14:09:02.429176 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:02.429093 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xzhpq" event={"ID":"4828193c-b7e0-4bdf-bf65-a610d88c1faf","Type":"ContainerStarted","Data":"54f40f17b1c7ad87bcfeed46c0505d86616176366b3ee241fda5c7c06ff97158"} Jul 10 14:09:02.429236 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:02.429178 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xzhpq" Jul 10 14:09:02.445289 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:02.445248 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xzhpq" podStartSLOduration=64.445235358 podStartE2EDuration="1m4.445235358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:07:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:02.444158393 +0000 UTC m=+65.870382724" watchObservedRunningTime="2026-07-10 14:09:02.445235358 +0000 UTC m=+65.871459678" Jul 10 14:09:05.096085 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.096053 2579 scope.go:117] "RemoveContainer" containerID="6545b7054a491b601593bd649669487c2b0183b6a5a7c3c1be034306701af81a" Jul 10 14:09:05.362619 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.362581 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-service-ca-bundle\") pod \"router-default-74c7c45ff4-cg9w4\" (UID: \"8ef37476-3f4b-430b-abfd-c43a4e2b73ea\") " pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" Jul 10 14:09:05.362778 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.362637 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-registry-tls\") pod \"image-registry-d8597c89c-dsq7z\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:09:05.362778 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.362687 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-metrics-certs\") pod \"router-default-74c7c45ff4-cg9w4\" (UID: \"8ef37476-3f4b-430b-abfd-c43a4e2b73ea\") " pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" Jul 10 14:09:05.362778 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.362723 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dca5b4bb-8439-4d1c-a76e-89d66227c825-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-6jvfg\" (UID: \"dca5b4bb-8439-4d1c-a76e-89d66227c825\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6jvfg" Jul 10 14:09:05.362778 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.362751 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/599b3c3c-524d-49e8-9260-ef807f63fea6-metrics-tls\") pod \"dns-default-dzg7b\" (UID: \"599b3c3c-524d-49e8-9260-ef807f63fea6\") " pod="openshift-dns/dns-default-dzg7b" Jul 10 14:09:05.363027 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.362784 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f49ccccf-cd07-4740-838d-11c0426f7273-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-fgxcc\" (UID: \"f49ccccf-cd07-4740-838d-11c0426f7273\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fgxcc" Jul 10 14:09:05.363027 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.362809 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/262f42ab-f88a-4689-99ba-0c130a08dde1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lq8n4\" (UID: \"262f42ab-f88a-4689-99ba-0c130a08dde1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lq8n4" Jul 10 14:09:05.363027 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.362868 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-registry-tls\") pod \"image-registry-cd7fdc78b-5qrnb\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:09:05.363400 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.363364 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-service-ca-bundle\") pod \"router-default-74c7c45ff4-cg9w4\" (UID: \"8ef37476-3f4b-430b-abfd-c43a4e2b73ea\") " pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" Jul 10 14:09:05.365556 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.365530 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/599b3c3c-524d-49e8-9260-ef807f63fea6-metrics-tls\") pod \"dns-default-dzg7b\" (UID: \"599b3c3c-524d-49e8-9260-ef807f63fea6\") " pod="openshift-dns/dns-default-dzg7b" Jul 10 14:09:05.365726 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.365704 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ef37476-3f4b-430b-abfd-c43a4e2b73ea-metrics-certs\") pod \"router-default-74c7c45ff4-cg9w4\" (UID: \"8ef37476-3f4b-430b-abfd-c43a4e2b73ea\") " pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" Jul 10 14:09:05.366165 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.366144 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dca5b4bb-8439-4d1c-a76e-89d66227c825-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-6jvfg\" (UID: \"dca5b4bb-8439-4d1c-a76e-89d66227c825\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6jvfg" Jul 10 14:09:05.366243 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.366231 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-registry-tls\") pod \"image-registry-cd7fdc78b-5qrnb\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:09:05.366285 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.366253 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/262f42ab-f88a-4689-99ba-0c130a08dde1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lq8n4\" (UID: \"262f42ab-f88a-4689-99ba-0c130a08dde1\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lq8n4" Jul 10 14:09:05.366285 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.366262 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-registry-tls\") pod \"image-registry-d8597c89c-dsq7z\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:09:05.366351 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.366253 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f49ccccf-cd07-4740-838d-11c0426f7273-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-fgxcc\" (UID: \"f49ccccf-cd07-4740-838d-11c0426f7273\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-fgxcc" Jul 10 14:09:05.442381 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.442353 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-znjf2_99ef7290-2248-4e0c-9fda-100370c1ac2d/console-operator/1.log" Jul 10 14:09:05.442540 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.442446 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-znjf2" event={"ID":"99ef7290-2248-4e0c-9fda-100370c1ac2d","Type":"ContainerStarted","Data":"fce1c19503afd9828d84ad97fe19ca5e96c4be308ddf5df6e3f048ff726af4e1"} Jul 10 14:09:05.442753 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.442716 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-znjf2" Jul 10 14:09:05.461503 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.461462 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-znjf2" podStartSLOduration=50.101444298 podStartE2EDuration="1m5.461448385s" totalImagesPullingTime="15.360004087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:08:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:05.46096687 +0000 UTC m=+68.887191192" watchObservedRunningTime="2026-07-10 14:09:05.461448385 +0000 UTC m=+68.887672704" Jul 10 14:09:05.509150 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.509123 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-fbqwk\"" Jul 10 14:09:05.515537 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.515518 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6jvfg" Jul 10 14:09:05.545918 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.545892 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zt6tz\"" Jul 10 14:09:05.553515 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.553494 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lq8n4" Jul 10 14:09:05.566693 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.566669 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ww66r\"" Jul 10 14:09:05.571179 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.571155 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:09:05.575831 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.575664 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:09:05.590630 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.588842 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ldr4g\"" Jul 10 14:09:05.595060 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.594817 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-6xcbp\"" Jul 10 14:09:05.596725 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.596174 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" Jul 10 14:09:05.604887 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.604582 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-fgxcc" Jul 10 14:09:05.625535 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.625301 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gwmhf\"" Jul 10 14:09:05.636090 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.634898 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dzg7b" Jul 10 14:09:05.715694 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.715602 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6jvfg"] Jul 10 14:09:05.786870 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.786373 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lq8n4"] Jul 10 14:09:05.851544 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.851474 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d8597c89c-dsq7z"] Jul 10 14:09:05.860687 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.860661 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cd7fdc78b-5qrnb"] Jul 10 14:09:05.865622 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:09:05.865597 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03fc50eb_f63c_4c50_ae8f_501f774a1ed0.slice/crio-037b2ef0d392194653261dc0d3e482969260eea65e315bdc611c6351c25ee9ef WatchSource:0}: Error finding container 037b2ef0d392194653261dc0d3e482969260eea65e315bdc611c6351c25ee9ef: Status 404 returned error can't find the container with id 037b2ef0d392194653261dc0d3e482969260eea65e315bdc611c6351c25ee9ef Jul 10 14:09:05.876280 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.876145 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-74c7c45ff4-cg9w4"] Jul 10 14:09:05.885790 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:09:05.884646 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ef37476_3f4b_430b_abfd_c43a4e2b73ea.slice/crio-458c13b75996c64e38a77c46bb658cb9bd9c476b051ee23e51213226bf41751f WatchSource:0}: Error finding container 458c13b75996c64e38a77c46bb658cb9bd9c476b051ee23e51213226bf41751f: Status 404 returned error can't find the container with id 458c13b75996c64e38a77c46bb658cb9bd9c476b051ee23e51213226bf41751f Jul 10 14:09:05.900173 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.900146 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-fgxcc"] Jul 10 14:09:05.910647 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:09:05.910262 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf49ccccf_cd07_4740_838d_11c0426f7273.slice/crio-e97cc9566072fdd2282ba0e3e8592c1534d768e9cedfd5cce1227f09e311d242 WatchSource:0}: Error finding container e97cc9566072fdd2282ba0e3e8592c1534d768e9cedfd5cce1227f09e311d242: Status 404 returned error can't find the container with id e97cc9566072fdd2282ba0e3e8592c1534d768e9cedfd5cce1227f09e311d242 Jul 10 14:09:05.925728 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.925710 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dzg7b"] Jul 10 14:09:05.929506 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:09:05.929460 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod599b3c3c_524d_49e8_9260_ef807f63fea6.slice/crio-4f9c6728d1cb2d7da905ebc8e58726caa80a591de605ea5e7252ae3839b99230 WatchSource:0}: Error finding container 4f9c6728d1cb2d7da905ebc8e58726caa80a591de605ea5e7252ae3839b99230: Status 404 returned error can't find the container with id 4f9c6728d1cb2d7da905ebc8e58726caa80a591de605ea5e7252ae3839b99230 Jul 10 14:09:05.991619 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:05.991589 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-znjf2" Jul 10 14:09:06.451605 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:06.451481 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lq8n4" event={"ID":"262f42ab-f88a-4689-99ba-0c130a08dde1","Type":"ContainerStarted","Data":"3ceccfc106d87aec7947710dd9d7ec07e1e9c883953acb1e5a29883a320bba2f"} Jul 10 14:09:06.453603 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:06.453564 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6jvfg" event={"ID":"dca5b4bb-8439-4d1c-a76e-89d66227c825","Type":"ContainerStarted","Data":"5aacc4a0f0233647702ab9906d3a6487c9d7a7dcd0f88aa909ea866f6731d576"} Jul 10 14:09:06.455331 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:06.455262 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dzg7b" event={"ID":"599b3c3c-524d-49e8-9260-ef807f63fea6","Type":"ContainerStarted","Data":"4f9c6728d1cb2d7da905ebc8e58726caa80a591de605ea5e7252ae3839b99230"} Jul 10 14:09:06.456750 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:06.456683 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-fgxcc" event={"ID":"f49ccccf-cd07-4740-838d-11c0426f7273","Type":"ContainerStarted","Data":"e97cc9566072fdd2282ba0e3e8592c1534d768e9cedfd5cce1227f09e311d242"} Jul 10 14:09:06.458237 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:06.458216 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" event={"ID":"8ef37476-3f4b-430b-abfd-c43a4e2b73ea","Type":"ContainerStarted","Data":"4b2588237d07d198a158a3cb83994a9249cd7e53125049bb63e980a3b0ff3af0"} Jul 10 14:09:06.458323 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:06.458258 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" event={"ID":"8ef37476-3f4b-430b-abfd-c43a4e2b73ea","Type":"ContainerStarted","Data":"458c13b75996c64e38a77c46bb658cb9bd9c476b051ee23e51213226bf41751f"} Jul 10 14:09:06.460072 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:06.460037 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" event={"ID":"03fc50eb-f63c-4c50-ae8f-501f774a1ed0","Type":"ContainerStarted","Data":"d99f854779a3c36d7b369f8b255ecaca2356764cd0477393d5e2fd757fbb8407"} Jul 10 14:09:06.460180 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:06.460099 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" event={"ID":"03fc50eb-f63c-4c50-ae8f-501f774a1ed0","Type":"ContainerStarted","Data":"037b2ef0d392194653261dc0d3e482969260eea65e315bdc611c6351c25ee9ef"} Jul 10 14:09:06.460180 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:06.460128 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:09:06.461568 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:06.461540 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" event={"ID":"0434507c-840c-4d87-bd9a-c3aab52951e6","Type":"ContainerStarted","Data":"78b3eb83cfce9470bb1c1a165ec9698988fdcb61ee5039084f8be0305f493177"} Jul 10 14:09:06.461721 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:06.461708 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:09:06.461791 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:06.461738 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" event={"ID":"0434507c-840c-4d87-bd9a-c3aab52951e6","Type":"ContainerStarted","Data":"82ef388ac28c4642a488c3200e333a6b21bcf8390f4959dd4936135faf534801"} Jul 10 14:09:06.481478 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:06.481439 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" podStartSLOduration=65.481411094 podStartE2EDuration="1m5.481411094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:08:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:06.479938376 +0000 UTC m=+69.906162719" watchObservedRunningTime="2026-07-10 14:09:06.481411094 +0000 UTC m=+69.907635413" Jul 10 14:09:06.504277 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:06.504227 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" podStartSLOduration=66.50420847 podStartE2EDuration="1m6.50420847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:08:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:06.50286558 +0000 UTC m=+69.929089900" watchObservedRunningTime="2026-07-10 14:09:06.50420847 +0000 UTC m=+69.930432800" Jul 10 14:09:06.526246 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:06.526192 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" podStartSLOduration=68.52617346 podStartE2EDuration="1m8.52617346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:07:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:06.523932901 +0000 UTC m=+69.950157259" watchObservedRunningTime="2026-07-10 14:09:06.52617346 +0000 UTC m=+69.952397780" Jul 10 14:09:06.597545 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:06.597514 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" Jul 10 14:09:06.600513 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:06.600485 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" Jul 10 14:09:07.466501 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:07.466473 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" Jul 10 14:09:07.467799 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:07.467771 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-74c7c45ff4-cg9w4" Jul 10 14:09:07.792856 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:07.792761 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pflwv\" (UID: \"ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c\") " pod="openshift-insights/insights-runtime-extractor-pflwv" Jul 10 14:09:07.792856 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:07.792807 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pflwv\" (UID: \"ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c\") " pod="openshift-insights/insights-runtime-extractor-pflwv" Jul 10 14:09:07.793456 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:07.793424 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pflwv\" (UID: \"ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c\") " pod="openshift-insights/insights-runtime-extractor-pflwv" Jul 10 14:09:07.795626 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:07.795591 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pflwv\" (UID: \"ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c\") " pod="openshift-insights/insights-runtime-extractor-pflwv" Jul 10 14:09:07.846190 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:07.846159 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-54rbs\"" Jul 10 14:09:07.853573 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:07.853550 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pflwv" Jul 10 14:09:09.592467 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:09.592367 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pflwv"] Jul 10 14:09:09.595903 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:09:09.595836 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac9d9e26_b9bf_4a63_b7b2_7ecaae71588c.slice/crio-a210a7c46ac2d5c5478f08341d117d5d59faf556f2a8cc81f093161c7b535ed1 WatchSource:0}: Error finding container a210a7c46ac2d5c5478f08341d117d5d59faf556f2a8cc81f093161c7b535ed1: Status 404 returned error can't find the container with id a210a7c46ac2d5c5478f08341d117d5d59faf556f2a8cc81f093161c7b535ed1 Jul 10 14:09:10.482819 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:10.482785 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-86t8x" event={"ID":"d30d948f-76fb-4888-a860-adf9622c2f3f","Type":"ContainerStarted","Data":"71022cc394d3d55aa96ef9da034104e49a1b4cdc5580198246d83b63e804e6a0"} Jul 10 14:09:10.484544 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:10.484515 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6jvfg" event={"ID":"dca5b4bb-8439-4d1c-a76e-89d66227c825","Type":"ContainerStarted","Data":"b21a0a8d5d69b40393a8f589378315e76186dd6570607e6cc7ceed908b964317"} Jul 10 14:09:10.484666 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:10.484570 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6jvfg" event={"ID":"dca5b4bb-8439-4d1c-a76e-89d66227c825","Type":"ContainerStarted","Data":"28e0e9c4d654bf901130d8773f37c3f50ce60c8327d5a3f770d1b4609fd22524"} Jul 10 14:09:10.486144 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:10.486125 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dzg7b" event={"ID":"599b3c3c-524d-49e8-9260-ef807f63fea6","Type":"ContainerStarted","Data":"31f18eea4dc5d4950931178f1e7a3ff60dadf55c43e4b11ff4432cafc68e0dbb"} Jul 10 14:09:10.486218 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:10.486161 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dzg7b" event={"ID":"599b3c3c-524d-49e8-9260-ef807f63fea6","Type":"ContainerStarted","Data":"e9a309850dcbec72003e7a36cc8640beaaf7460ccc1aa2a6aeec22064af98cde"} Jul 10 14:09:10.486218 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:10.486188 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dzg7b" Jul 10 14:09:10.487634 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:10.487615 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-fgxcc" event={"ID":"f49ccccf-cd07-4740-838d-11c0426f7273","Type":"ContainerStarted","Data":"7e2696107e1e43681324cf71b02fdba30d511679e8615c0594469f7b9e262244"} Jul 10 14:09:10.488727 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:10.488708 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pflwv" event={"ID":"ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c","Type":"ContainerStarted","Data":"a210a7c46ac2d5c5478f08341d117d5d59faf556f2a8cc81f093161c7b535ed1"} Jul 10 14:09:10.499221 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:10.499177 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-86t8x" podStartSLOduration=65.373515562 podStartE2EDuration="1m12.499164388s" totalImagesPullingTime="7.125648826s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:10.499105731 +0000 UTC m=+73.925330051" watchObservedRunningTime="2026-07-10 14:09:10.499164388 +0000 UTC m=+73.925388702" Jul 10 14:09:10.518306 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:10.518261 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dzg7b" podStartSLOduration=34.020293542 podStartE2EDuration="37.518245881s" totalImagesPullingTime="3.497952339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:08:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:10.517405937 +0000 UTC m=+73.943630257" watchObservedRunningTime="2026-07-10 14:09:10.518245881 +0000 UTC m=+73.944470193" Jul 10 14:09:10.535144 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:10.535108 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-fgxcc" podStartSLOduration=36.017710846 podStartE2EDuration="39.535095062s" totalImagesPullingTime="3.517384216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:08:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:10.534528795 +0000 UTC m=+73.960753115" watchObservedRunningTime="2026-07-10 14:09:10.535095062 +0000 UTC m=+73.961319397" Jul 10 14:09:10.553516 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:10.553468 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6jvfg" podStartSLOduration=66.935723373 podStartE2EDuration="1m10.553451009s" totalImagesPullingTime="3.617727636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:08:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:10.553050298 +0000 UTC m=+73.979274619" watchObservedRunningTime="2026-07-10 14:09:10.553451009 +0000 UTC m=+73.979675308" Jul 10 14:09:12.499190 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:12.499051 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lq8n4" event={"ID":"262f42ab-f88a-4689-99ba-0c130a08dde1","Type":"ContainerStarted","Data":"0c90ca964fc5e27a99aafb33842e21adeeeade7619ee6d27f0ffe6f6d1a761de"} Jul 10 14:09:12.519093 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:12.519048 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lq8n4" podStartSLOduration=66.617218956 podStartE2EDuration="1m12.519031446s" totalImagesPullingTime="5.90181249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:08:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:12.517895807 +0000 UTC m=+75.944120127" watchObservedRunningTime="2026-07-10 14:09:12.519031446 +0000 UTC m=+75.945255762" Jul 10 14:09:16.289670 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.289642 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-cd7fdc78b-5qrnb"] Jul 10 14:09:16.291261 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.291235 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-db82z"] Jul 10 14:09:16.306869 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.306846 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d948477d9-mtkbl"] Jul 10 14:09:16.307044 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.307022 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-db82z" Jul 10 14:09:16.310699 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.310677 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 10 14:09:16.311010 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.310843 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-dzn6j\"" Jul 10 14:09:16.321238 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.321218 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-jxvq8"] Jul 10 14:09:16.321337 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.321324 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d948477d9-mtkbl" Jul 10 14:09:16.324467 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.324447 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 10 14:09:16.324710 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.324694 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 10 14:09:16.324798 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.324783 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 10 14:09:16.325707 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.325689 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 10 14:09:16.325807 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.325737 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 10 14:09:16.325807 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.325739 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 10 14:09:16.325916 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.325743 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 10 14:09:16.326124 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.326109 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-89tl4\"" Jul 10 14:09:16.342337 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.342315 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-jxvq8"] Jul 10 14:09:16.342446 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.342352 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-db82z"] Jul 10 14:09:16.342446 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.342378 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d948477d9-mtkbl"] Jul 10 14:09:16.342549 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.342467 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-jxvq8" Jul 10 14:09:16.345130 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.345115 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-6sjkt\"" Jul 10 14:09:16.374983 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.374942 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b75cea45-e4aa-42b3-98df-2dd67fd222cf-console-serving-cert\") pod \"console-7d948477d9-mtkbl\" (UID: \"b75cea45-e4aa-42b3-98df-2dd67fd222cf\") " pod="openshift-console/console-7d948477d9-mtkbl" Jul 10 14:09:16.375079 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.374988 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b75cea45-e4aa-42b3-98df-2dd67fd222cf-oauth-serving-cert\") pod \"console-7d948477d9-mtkbl\" (UID: \"b75cea45-e4aa-42b3-98df-2dd67fd222cf\") " pod="openshift-console/console-7d948477d9-mtkbl" Jul 10 14:09:16.375079 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.375014 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjcxz\" (UniqueName: \"kubernetes.io/projected/b75cea45-e4aa-42b3-98df-2dd67fd222cf-kube-api-access-hjcxz\") pod \"console-7d948477d9-mtkbl\" (UID: \"b75cea45-e4aa-42b3-98df-2dd67fd222cf\") " pod="openshift-console/console-7d948477d9-mtkbl" Jul 10 14:09:16.375079 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.375065 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e4b55c26-a8df-4225-9c2b-e08243a2b3b6-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-db82z\" (UID: \"e4b55c26-a8df-4225-9c2b-e08243a2b3b6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-db82z" Jul 10 14:09:16.375227 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.375209 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b75cea45-e4aa-42b3-98df-2dd67fd222cf-console-config\") pod \"console-7d948477d9-mtkbl\" (UID: \"b75cea45-e4aa-42b3-98df-2dd67fd222cf\") " pod="openshift-console/console-7d948477d9-mtkbl" Jul 10 14:09:16.375284 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.375246 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b75cea45-e4aa-42b3-98df-2dd67fd222cf-service-ca\") pod \"console-7d948477d9-mtkbl\" (UID: \"b75cea45-e4aa-42b3-98df-2dd67fd222cf\") " pod="openshift-console/console-7d948477d9-mtkbl" Jul 10 14:09:16.375335 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.375306 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b75cea45-e4aa-42b3-98df-2dd67fd222cf-console-oauth-config\") pod \"console-7d948477d9-mtkbl\" (UID: \"b75cea45-e4aa-42b3-98df-2dd67fd222cf\") " pod="openshift-console/console-7d948477d9-mtkbl" Jul 10 14:09:16.476293 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.476229 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b75cea45-e4aa-42b3-98df-2dd67fd222cf-console-config\") pod \"console-7d948477d9-mtkbl\" (UID: \"b75cea45-e4aa-42b3-98df-2dd67fd222cf\") " pod="openshift-console/console-7d948477d9-mtkbl" Jul 10 14:09:16.476293 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.476260 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b75cea45-e4aa-42b3-98df-2dd67fd222cf-service-ca\") pod \"console-7d948477d9-mtkbl\" (UID: \"b75cea45-e4aa-42b3-98df-2dd67fd222cf\") " pod="openshift-console/console-7d948477d9-mtkbl" Jul 10 14:09:16.476293 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.476289 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zg9s\" (UniqueName: \"kubernetes.io/projected/202c32b7-79a9-4d76-b943-c8624099e36f-kube-api-access-7zg9s\") pod \"downloads-68c9cbb497-jxvq8\" (UID: \"202c32b7-79a9-4d76-b943-c8624099e36f\") " pod="openshift-console/downloads-68c9cbb497-jxvq8" Jul 10 14:09:16.476504 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.476405 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b75cea45-e4aa-42b3-98df-2dd67fd222cf-console-oauth-config\") pod \"console-7d948477d9-mtkbl\" (UID: \"b75cea45-e4aa-42b3-98df-2dd67fd222cf\") " pod="openshift-console/console-7d948477d9-mtkbl" Jul 10 14:09:16.476504 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.476439 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b75cea45-e4aa-42b3-98df-2dd67fd222cf-console-serving-cert\") pod \"console-7d948477d9-mtkbl\" (UID: \"b75cea45-e4aa-42b3-98df-2dd67fd222cf\") " pod="openshift-console/console-7d948477d9-mtkbl" Jul 10 14:09:16.476504 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.476455 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b75cea45-e4aa-42b3-98df-2dd67fd222cf-oauth-serving-cert\") pod \"console-7d948477d9-mtkbl\" (UID: \"b75cea45-e4aa-42b3-98df-2dd67fd222cf\") " pod="openshift-console/console-7d948477d9-mtkbl" Jul 10 14:09:16.476646 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.476562 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjcxz\" (UniqueName: \"kubernetes.io/projected/b75cea45-e4aa-42b3-98df-2dd67fd222cf-kube-api-access-hjcxz\") pod \"console-7d948477d9-mtkbl\" (UID: \"b75cea45-e4aa-42b3-98df-2dd67fd222cf\") " pod="openshift-console/console-7d948477d9-mtkbl" Jul 10 14:09:16.476646 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.476615 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e4b55c26-a8df-4225-9c2b-e08243a2b3b6-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-db82z\" (UID: \"e4b55c26-a8df-4225-9c2b-e08243a2b3b6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-db82z" Jul 10 14:09:16.477114 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.477092 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b75cea45-e4aa-42b3-98df-2dd67fd222cf-oauth-serving-cert\") pod \"console-7d948477d9-mtkbl\" (UID: \"b75cea45-e4aa-42b3-98df-2dd67fd222cf\") " pod="openshift-console/console-7d948477d9-mtkbl" Jul 10 14:09:16.477114 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.477104 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b75cea45-e4aa-42b3-98df-2dd67fd222cf-service-ca\") pod \"console-7d948477d9-mtkbl\" (UID: \"b75cea45-e4aa-42b3-98df-2dd67fd222cf\") " pod="openshift-console/console-7d948477d9-mtkbl" Jul 10 14:09:16.477114 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.477094 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b75cea45-e4aa-42b3-98df-2dd67fd222cf-console-config\") pod \"console-7d948477d9-mtkbl\" (UID: \"b75cea45-e4aa-42b3-98df-2dd67fd222cf\") " pod="openshift-console/console-7d948477d9-mtkbl" Jul 10 14:09:16.478890 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.478866 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b75cea45-e4aa-42b3-98df-2dd67fd222cf-console-serving-cert\") pod \"console-7d948477d9-mtkbl\" (UID: \"b75cea45-e4aa-42b3-98df-2dd67fd222cf\") " pod="openshift-console/console-7d948477d9-mtkbl" Jul 10 14:09:16.479045 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.479026 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e4b55c26-a8df-4225-9c2b-e08243a2b3b6-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-db82z\" (UID: \"e4b55c26-a8df-4225-9c2b-e08243a2b3b6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-db82z" Jul 10 14:09:16.479106 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.479087 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b75cea45-e4aa-42b3-98df-2dd67fd222cf-console-oauth-config\") pod \"console-7d948477d9-mtkbl\" (UID: \"b75cea45-e4aa-42b3-98df-2dd67fd222cf\") " pod="openshift-console/console-7d948477d9-mtkbl" Jul 10 14:09:16.486551 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.486527 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjcxz\" (UniqueName: \"kubernetes.io/projected/b75cea45-e4aa-42b3-98df-2dd67fd222cf-kube-api-access-hjcxz\") pod \"console-7d948477d9-mtkbl\" (UID: \"b75cea45-e4aa-42b3-98df-2dd67fd222cf\") " pod="openshift-console/console-7d948477d9-mtkbl" Jul 10 14:09:16.516609 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.516583 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pflwv" event={"ID":"ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c","Type":"ContainerStarted","Data":"c92554defee87e107cc17d73035609019593398a13fd63cad7e459cf99044673"} Jul 10 14:09:16.577814 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.577789 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zg9s\" (UniqueName: \"kubernetes.io/projected/202c32b7-79a9-4d76-b943-c8624099e36f-kube-api-access-7zg9s\") pod \"downloads-68c9cbb497-jxvq8\" (UID: \"202c32b7-79a9-4d76-b943-c8624099e36f\") " pod="openshift-console/downloads-68c9cbb497-jxvq8" Jul 10 14:09:16.586976 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.586944 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zg9s\" (UniqueName: \"kubernetes.io/projected/202c32b7-79a9-4d76-b943-c8624099e36f-kube-api-access-7zg9s\") pod \"downloads-68c9cbb497-jxvq8\" (UID: \"202c32b7-79a9-4d76-b943-c8624099e36f\") " pod="openshift-console/downloads-68c9cbb497-jxvq8" Jul 10 14:09:16.618745 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.618726 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-db82z" Jul 10 14:09:16.632605 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.632580 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d948477d9-mtkbl" Jul 10 14:09:16.650678 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.650652 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-jxvq8" Jul 10 14:09:16.798241 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.798214 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-db82z"] Jul 10 14:09:16.800568 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:09:16.800537 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4b55c26_a8df_4225_9c2b_e08243a2b3b6.slice/crio-ab3bf9f3b9fda9d21df8302a121a3ed0b78d34dd4adbd433671fd987436947ab WatchSource:0}: Error finding container ab3bf9f3b9fda9d21df8302a121a3ed0b78d34dd4adbd433671fd987436947ab: Status 404 returned error can't find the container with id ab3bf9f3b9fda9d21df8302a121a3ed0b78d34dd4adbd433671fd987436947ab Jul 10 14:09:16.841264 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.841239 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d948477d9-mtkbl"] Jul 10 14:09:16.843179 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:09:16.843150 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb75cea45_e4aa_42b3_98df_2dd67fd222cf.slice/crio-7d441ea831f44542b4e5e2b5529e13bb1e830e9939a9bb74be9b53676225a43e WatchSource:0}: Error finding container 7d441ea831f44542b4e5e2b5529e13bb1e830e9939a9bb74be9b53676225a43e: Status 404 returned error can't find the container with id 7d441ea831f44542b4e5e2b5529e13bb1e830e9939a9bb74be9b53676225a43e Jul 10 14:09:16.860590 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:16.860569 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-jxvq8"] Jul 10 14:09:16.862164 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:09:16.862141 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod202c32b7_79a9_4d76_b943_c8624099e36f.slice/crio-ad3623fdfc8fd3093f6893a246e41b76c420d4f19e4ffb377f04fdcefd13b197 WatchSource:0}: Error finding container ad3623fdfc8fd3093f6893a246e41b76c420d4f19e4ffb377f04fdcefd13b197: Status 404 returned error can't find the container with id ad3623fdfc8fd3093f6893a246e41b76c420d4f19e4ffb377f04fdcefd13b197 Jul 10 14:09:17.522345 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:17.522313 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-jxvq8" event={"ID":"202c32b7-79a9-4d76-b943-c8624099e36f","Type":"ContainerStarted","Data":"ad3623fdfc8fd3093f6893a246e41b76c420d4f19e4ffb377f04fdcefd13b197"} Jul 10 14:09:17.523899 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:17.523865 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d948477d9-mtkbl" event={"ID":"b75cea45-e4aa-42b3-98df-2dd67fd222cf","Type":"ContainerStarted","Data":"7d441ea831f44542b4e5e2b5529e13bb1e830e9939a9bb74be9b53676225a43e"} Jul 10 14:09:17.525137 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:17.525112 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-db82z" event={"ID":"e4b55c26-a8df-4225-9c2b-e08243a2b3b6","Type":"ContainerStarted","Data":"ab3bf9f3b9fda9d21df8302a121a3ed0b78d34dd4adbd433671fd987436947ab"} Jul 10 14:09:19.535744 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:19.535603 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-db82z" event={"ID":"e4b55c26-a8df-4225-9c2b-e08243a2b3b6","Type":"ContainerStarted","Data":"fa41520ec1a2ab5ee347cf456a8ce5b924c26d18ec598593d31e42e72bf4aef8"} Jul 10 14:09:19.536160 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:19.535761 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-db82z" Jul 10 14:09:19.537473 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:19.537448 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pflwv" event={"ID":"ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c","Type":"ContainerStarted","Data":"34f36a55c613c7d7efedd8523ba62caf182ed3e7cb39f9b7087f62940f97dbb0"} Jul 10 14:09:19.540315 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:19.540298 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-db82z" Jul 10 14:09:19.556534 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:19.556479 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-db82z" podStartSLOduration=1.584063151 podStartE2EDuration="3.556461523s" totalImagesPullingTime="1.972398372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:19.555730694 +0000 UTC m=+82.981955013" watchObservedRunningTime="2026-07-10 14:09:19.556461523 +0000 UTC m=+82.982685844" Jul 10 14:09:20.458898 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:20.458868 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-v6fzx"] Jul 10 14:09:20.490891 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:20.490858 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-v6fzx"] Jul 10 14:09:20.491092 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:20.490999 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-v6fzx" Jul 10 14:09:20.495092 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:20.495065 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dzg7b" Jul 10 14:09:20.495840 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:20.495812 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-r4db4\"" Jul 10 14:09:20.495968 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:20.495890 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 10 14:09:20.497203 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:20.497176 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 10 14:09:20.497325 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:20.497190 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 10 14:09:20.618179 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:20.617890 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whk6n\" (UniqueName: \"kubernetes.io/projected/9c9ef0e2-0c71-49fb-8d35-203b7748caf2-kube-api-access-whk6n\") pod \"prometheus-operator-64785b6675-v6fzx\" (UID: \"9c9ef0e2-0c71-49fb-8d35-203b7748caf2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-v6fzx" Jul 10 14:09:20.618179 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:20.618070 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c9ef0e2-0c71-49fb-8d35-203b7748caf2-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-v6fzx\" (UID: \"9c9ef0e2-0c71-49fb-8d35-203b7748caf2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-v6fzx" Jul 10 14:09:20.618179 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:20.618111 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c9ef0e2-0c71-49fb-8d35-203b7748caf2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-v6fzx\" (UID: \"9c9ef0e2-0c71-49fb-8d35-203b7748caf2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-v6fzx" Jul 10 14:09:20.618179 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:20.618175 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c9ef0e2-0c71-49fb-8d35-203b7748caf2-metrics-client-ca\") pod \"prometheus-operator-64785b6675-v6fzx\" (UID: \"9c9ef0e2-0c71-49fb-8d35-203b7748caf2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-v6fzx" Jul 10 14:09:20.719478 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:20.719382 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c9ef0e2-0c71-49fb-8d35-203b7748caf2-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-v6fzx\" (UID: \"9c9ef0e2-0c71-49fb-8d35-203b7748caf2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-v6fzx" Jul 10 14:09:20.719478 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:20.719438 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c9ef0e2-0c71-49fb-8d35-203b7748caf2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-v6fzx\" (UID: \"9c9ef0e2-0c71-49fb-8d35-203b7748caf2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-v6fzx" Jul 10 14:09:20.719742 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:20.719485 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c9ef0e2-0c71-49fb-8d35-203b7748caf2-metrics-client-ca\") pod \"prometheus-operator-64785b6675-v6fzx\" (UID: \"9c9ef0e2-0c71-49fb-8d35-203b7748caf2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-v6fzx" Jul 10 14:09:20.719742 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:20.719567 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whk6n\" (UniqueName: \"kubernetes.io/projected/9c9ef0e2-0c71-49fb-8d35-203b7748caf2-kube-api-access-whk6n\") pod \"prometheus-operator-64785b6675-v6fzx\" (UID: \"9c9ef0e2-0c71-49fb-8d35-203b7748caf2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-v6fzx" Jul 10 14:09:20.720635 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:20.720586 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c9ef0e2-0c71-49fb-8d35-203b7748caf2-metrics-client-ca\") pod \"prometheus-operator-64785b6675-v6fzx\" (UID: \"9c9ef0e2-0c71-49fb-8d35-203b7748caf2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-v6fzx" Jul 10 14:09:20.722519 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:20.722493 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c9ef0e2-0c71-49fb-8d35-203b7748caf2-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-v6fzx\" (UID: \"9c9ef0e2-0c71-49fb-8d35-203b7748caf2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-v6fzx" Jul 10 14:09:20.722920 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:20.722900 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c9ef0e2-0c71-49fb-8d35-203b7748caf2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-v6fzx\" (UID: \"9c9ef0e2-0c71-49fb-8d35-203b7748caf2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-v6fzx" Jul 10 14:09:20.732467 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:20.732413 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whk6n\" (UniqueName: \"kubernetes.io/projected/9c9ef0e2-0c71-49fb-8d35-203b7748caf2-kube-api-access-whk6n\") pod \"prometheus-operator-64785b6675-v6fzx\" (UID: \"9c9ef0e2-0c71-49fb-8d35-203b7748caf2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-v6fzx" Jul 10 14:09:20.804574 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:20.804534 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-v6fzx" Jul 10 14:09:21.252992 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:21.252965 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-v6fzx"] Jul 10 14:09:21.255050 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:09:21.255025 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c9ef0e2_0c71_49fb_8d35_203b7748caf2.slice/crio-5d77d152c88ce8038ad68950d59efb706e89b62a572f96033a35bec205b8ea53 WatchSource:0}: Error finding container 5d77d152c88ce8038ad68950d59efb706e89b62a572f96033a35bec205b8ea53: Status 404 returned error can't find the container with id 5d77d152c88ce8038ad68950d59efb706e89b62a572f96033a35bec205b8ea53 Jul 10 14:09:21.549138 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:21.549109 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-v6fzx" event={"ID":"9c9ef0e2-0c71-49fb-8d35-203b7748caf2","Type":"ContainerStarted","Data":"5d77d152c88ce8038ad68950d59efb706e89b62a572f96033a35bec205b8ea53"} Jul 10 14:09:22.557112 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:22.557070 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d948477d9-mtkbl" event={"ID":"b75cea45-e4aa-42b3-98df-2dd67fd222cf","Type":"ContainerStarted","Data":"49664ed701808628c1e0a33f338c641cc54fe094df80627076afdb5724075e5a"} Jul 10 14:09:22.580621 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:22.580572 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d948477d9-mtkbl" podStartSLOduration=1.936140263 podStartE2EDuration="6.580550895s" totalImagesPullingTime="4.644410632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:22.578877459 +0000 UTC m=+86.005101779" watchObservedRunningTime="2026-07-10 14:09:22.580550895 +0000 UTC m=+86.006775218" Jul 10 14:09:25.575203 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:25.575163 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pflwv" event={"ID":"ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c","Type":"ContainerStarted","Data":"707be5839708204f1bffc29153db5100d7f163a67df776df64e9234c93aff750"} Jul 10 14:09:25.577129 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:25.577100 2579 patch_prober.go:28] interesting pod/image-registry-d8597c89c-dsq7z container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 10 14:09:25.577255 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:25.577148 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" podUID="0434507c-840c-4d87-bd9a-c3aab52951e6" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 14:09:25.577856 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:25.577830 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-v6fzx" event={"ID":"9c9ef0e2-0c71-49fb-8d35-203b7748caf2","Type":"ContainerStarted","Data":"6a30554c0237ba66eb850001565a0b021c65adb8d48c5692ff31a6b40e4c1360"} Jul 10 14:09:25.577985 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:25.577883 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-v6fzx" event={"ID":"9c9ef0e2-0c71-49fb-8d35-203b7748caf2","Type":"ContainerStarted","Data":"9ac62cd65f1b3c3453b99977e57154449f5dccf936110e9aeff61c92e51edd42"} Jul 10 14:09:25.596714 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:25.596667 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pflwv" podStartSLOduration=19.833242603 podStartE2EDuration="34.596654143s" totalImagesPullingTime="14.76341154s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:08:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:25.594764388 +0000 UTC m=+89.020988708" watchObservedRunningTime="2026-07-10 14:09:25.596654143 +0000 UTC m=+89.022878462" Jul 10 14:09:25.612635 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:25.612598 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-v6fzx" podStartSLOduration=2.276166914 podStartE2EDuration="5.612586317s" totalImagesPullingTime="3.336419403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:09:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:25.611523769 +0000 UTC m=+89.037748090" watchObservedRunningTime="2026-07-10 14:09:25.612586317 +0000 UTC m=+89.038810637" Jul 10 14:09:26.296024 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:26.295987 2579 patch_prober.go:28] interesting pod/image-registry-cd7fdc78b-5qrnb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 10 14:09:26.296207 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:26.296048 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" podUID="03fc50eb-f63c-4c50-ae8f-501f774a1ed0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 14:09:26.632690 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:26.632660 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d948477d9-mtkbl" Jul 10 14:09:26.633158 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:26.632741 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d948477d9-mtkbl" Jul 10 14:09:26.638044 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:26.638023 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d948477d9-mtkbl" Jul 10 14:09:27.472902 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:27.472873 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:09:27.590487 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:27.590452 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d948477d9-mtkbl" Jul 10 14:09:27.824055 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:27.823853 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6kh94"] Jul 10 14:09:27.829569 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:27.829543 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6kh94" Jul 10 14:09:27.832605 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:27.832580 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 10 14:09:27.832912 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:27.832893 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tn4nf\"" Jul 10 14:09:27.834159 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:27.833138 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 10 14:09:27.834159 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:27.833175 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 10 14:09:27.989997 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:27.989943 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf-node-exporter-tls\") pod \"node-exporter-6kh94\" (UID: \"8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf\") " pod="openshift-monitoring/node-exporter-6kh94" Jul 10 14:09:27.990174 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:27.990015 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf-metrics-client-ca\") pod \"node-exporter-6kh94\" (UID: \"8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf\") " pod="openshift-monitoring/node-exporter-6kh94" Jul 10 14:09:27.990174 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:27.990106 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf-node-exporter-wtmp\") pod \"node-exporter-6kh94\" (UID: \"8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf\") " pod="openshift-monitoring/node-exporter-6kh94" Jul 10 14:09:27.990174 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:27.990142 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6kh94\" (UID: \"8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf\") " pod="openshift-monitoring/node-exporter-6kh94" Jul 10 14:09:27.990174 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:27.990163 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf-node-exporter-textfile\") pod \"node-exporter-6kh94\" (UID: \"8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf\") " pod="openshift-monitoring/node-exporter-6kh94" Jul 10 14:09:27.990376 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:27.990273 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf-root\") pod \"node-exporter-6kh94\" (UID: \"8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf\") " pod="openshift-monitoring/node-exporter-6kh94" Jul 10 14:09:27.990376 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:27.990292 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj6zr\" (UniqueName: \"kubernetes.io/projected/8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf-kube-api-access-mj6zr\") pod \"node-exporter-6kh94\" (UID: \"8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf\") " pod="openshift-monitoring/node-exporter-6kh94" Jul 10 14:09:27.990376 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:27.990329 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf-sys\") pod \"node-exporter-6kh94\" (UID: \"8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf\") " pod="openshift-monitoring/node-exporter-6kh94" Jul 10 14:09:27.990567 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:27.990391 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-6kh94\" (UID: \"8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf\") " pod="openshift-monitoring/node-exporter-6kh94" Jul 10 14:09:28.091563 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:28.091476 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6kh94\" (UID: \"8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf\") " pod="openshift-monitoring/node-exporter-6kh94" Jul 10 14:09:28.091563 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:28.091529 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf-node-exporter-textfile\") pod \"node-exporter-6kh94\" (UID: \"8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf\") " pod="openshift-monitoring/node-exporter-6kh94" Jul 10 14:09:28.091784 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:28.091600 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf-root\") pod \"node-exporter-6kh94\" (UID: \"8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf\") " pod="openshift-monitoring/node-exporter-6kh94" Jul 10 14:09:28.091784 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:28.091624 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj6zr\" (UniqueName: \"kubernetes.io/projected/8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf-kube-api-access-mj6zr\") pod \"node-exporter-6kh94\" (UID: \"8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf\") " pod="openshift-monitoring/node-exporter-6kh94" Jul 10 14:09:28.092027 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:28.092003 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf-root\") pod \"node-exporter-6kh94\" (UID: \"8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf\") " pod="openshift-monitoring/node-exporter-6kh94" Jul 10 14:09:28.092126 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:28.092059 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf-sys\") pod \"node-exporter-6kh94\" (UID: \"8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf\") " pod="openshift-monitoring/node-exporter-6kh94" Jul 10 14:09:28.092126 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:28.092102 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-6kh94\" (UID: \"8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf\") " pod="openshift-monitoring/node-exporter-6kh94" Jul 10 14:09:28.092219 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:28.092126 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf-node-exporter-tls\") pod \"node-exporter-6kh94\" (UID: \"8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf\") " pod="openshift-monitoring/node-exporter-6kh94" Jul 10 14:09:28.092219 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:28.092145 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf-metrics-client-ca\") pod \"node-exporter-6kh94\" (UID: \"8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf\") " pod="openshift-monitoring/node-exporter-6kh94" Jul 10 14:09:28.092219 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:28.092155 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf-sys\") pod \"node-exporter-6kh94\" (UID: \"8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf\") " pod="openshift-monitoring/node-exporter-6kh94" Jul 10 14:09:28.092219 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:28.092181 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf-node-exporter-wtmp\") pod \"node-exporter-6kh94\" (UID: \"8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf\") " pod="openshift-monitoring/node-exporter-6kh94" Jul 10 14:09:28.092409 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:28.092248 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf-node-exporter-textfile\") pod \"node-exporter-6kh94\" (UID: \"8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf\") " pod="openshift-monitoring/node-exporter-6kh94" Jul 10 14:09:28.092409 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:28.092307 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf-node-exporter-wtmp\") pod \"node-exporter-6kh94\" (UID: \"8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf\") " pod="openshift-monitoring/node-exporter-6kh94" Jul 10 14:09:28.092766 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:28.092728 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-6kh94\" (UID: \"8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf\") " pod="openshift-monitoring/node-exporter-6kh94" Jul 10 14:09:28.092859 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:28.092746 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf-metrics-client-ca\") pod \"node-exporter-6kh94\" (UID: \"8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf\") " pod="openshift-monitoring/node-exporter-6kh94" Jul 10 14:09:28.094710 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:28.094687 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf-node-exporter-tls\") pod \"node-exporter-6kh94\" (UID: \"8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf\") " pod="openshift-monitoring/node-exporter-6kh94" Jul 10 14:09:28.095661 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:28.095618 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6kh94\" (UID: \"8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf\") " pod="openshift-monitoring/node-exporter-6kh94" Jul 10 14:09:28.102536 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:28.102507 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj6zr\" (UniqueName: \"kubernetes.io/projected/8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf-kube-api-access-mj6zr\") pod \"node-exporter-6kh94\" (UID: \"8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf\") " pod="openshift-monitoring/node-exporter-6kh94" Jul 10 14:09:28.146646 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:28.146609 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6kh94" Jul 10 14:09:28.164466 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:09:28.164375 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fbbad3b_2ae9_4e1d_8e33_91c5d58b55cf.slice/crio-ad39694ecde87c6baa8cb6cad0a7a25a503fe37b925ea5307f7f8e541f07e582 WatchSource:0}: Error finding container ad39694ecde87c6baa8cb6cad0a7a25a503fe37b925ea5307f7f8e541f07e582: Status 404 returned error can't find the container with id ad39694ecde87c6baa8cb6cad0a7a25a503fe37b925ea5307f7f8e541f07e582 Jul 10 14:09:28.592469 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:28.592434 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6kh94" event={"ID":"8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf","Type":"ContainerStarted","Data":"ad39694ecde87c6baa8cb6cad0a7a25a503fe37b925ea5307f7f8e541f07e582"} Jul 10 14:09:29.600769 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:29.600729 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6kh94" event={"ID":"8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf","Type":"ContainerStarted","Data":"45f952a58f71429815955261429c636c480051b31fbb075ac35d351dceaab46b"} Jul 10 14:09:30.606763 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:30.606730 2579 generic.go:356] "Generic (PLEG): container finished" podID="8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf" containerID="45f952a58f71429815955261429c636c480051b31fbb075ac35d351dceaab46b" exitCode=0 Jul 10 14:09:30.607218 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:30.606811 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6kh94" event={"ID":"8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf","Type":"ContainerDied","Data":"45f952a58f71429815955261429c636c480051b31fbb075ac35d351dceaab46b"} Jul 10 14:09:31.614459 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:31.614424 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6kh94" event={"ID":"8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf","Type":"ContainerStarted","Data":"a4c1170a5e6f705a0a0aca23bdfa11549285a38f30adc7debd3f9d31f813a9f3"} Jul 10 14:09:31.614902 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:31.614484 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6kh94" event={"ID":"8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf","Type":"ContainerStarted","Data":"c778631d02da3c61cbfceb21c343640d8d3c6e87b8673ffff810079f0285ad0f"} Jul 10 14:09:31.634496 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:31.634447 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6kh94" podStartSLOduration=3.21101593 podStartE2EDuration="4.634407378s" totalImagesPullingTime="1.341095059s" totalInitContainerRuntime="82.296389ms" isStatefulPod=true podCreationTimestamp="2026-07-10 14:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:31.634292871 +0000 UTC m=+95.060517191" watchObservedRunningTime="2026-07-10 14:09:31.634407378 +0000 UTC m=+95.060631698" Jul 10 14:09:33.436197 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:33.436162 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xzhpq" Jul 10 14:09:36.296056 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:36.296021 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:09:40.662355 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:40.662309 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-jxvq8" event={"ID":"202c32b7-79a9-4d76-b943-c8624099e36f","Type":"ContainerStarted","Data":"4085bc1cc76543a55ec3b6782d6311faeec18e49ac44e2a1f71654e08d01d5bf"} Jul 10 14:09:40.662901 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:40.662514 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-jxvq8" Jul 10 14:09:40.675959 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:40.675932 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-jxvq8" Jul 10 14:09:40.684284 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:40.684206 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-jxvq8" podStartSLOduration=1.684020831 podStartE2EDuration="24.684188747s" totalImagesPullingTime="23.000167916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:09:40.682709525 +0000 UTC m=+104.108933858" watchObservedRunningTime="2026-07-10 14:09:40.684188747 +0000 UTC m=+104.110413082" Jul 10 14:09:41.313559 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.313486 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" podUID="03fc50eb-f63c-4c50-ae8f-501f774a1ed0" containerName="registry" containerID="cri-o://d99f854779a3c36d7b369f8b255ecaca2356764cd0477393d5e2fd757fbb8407" gracePeriod=30 Jul 10 14:09:41.657582 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.657552 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:09:41.668324 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.668293 2579 generic.go:356] "Generic (PLEG): container finished" podID="03fc50eb-f63c-4c50-ae8f-501f774a1ed0" containerID="d99f854779a3c36d7b369f8b255ecaca2356764cd0477393d5e2fd757fbb8407" exitCode=0 Jul 10 14:09:41.668733 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.668357 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" Jul 10 14:09:41.668733 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.668380 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" event={"ID":"03fc50eb-f63c-4c50-ae8f-501f774a1ed0","Type":"ContainerDied","Data":"d99f854779a3c36d7b369f8b255ecaca2356764cd0477393d5e2fd757fbb8407"} Jul 10 14:09:41.668733 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.668477 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cd7fdc78b-5qrnb" event={"ID":"03fc50eb-f63c-4c50-ae8f-501f774a1ed0","Type":"ContainerDied","Data":"037b2ef0d392194653261dc0d3e482969260eea65e315bdc611c6351c25ee9ef"} Jul 10 14:09:41.668733 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.668508 2579 scope.go:117] "RemoveContainer" containerID="d99f854779a3c36d7b369f8b255ecaca2356764cd0477393d5e2fd757fbb8407" Jul 10 14:09:41.678418 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.678343 2579 scope.go:117] "RemoveContainer" containerID="d99f854779a3c36d7b369f8b255ecaca2356764cd0477393d5e2fd757fbb8407" Jul 10 14:09:41.678708 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:09:41.678674 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d99f854779a3c36d7b369f8b255ecaca2356764cd0477393d5e2fd757fbb8407\": container with ID starting with d99f854779a3c36d7b369f8b255ecaca2356764cd0477393d5e2fd757fbb8407 not found: ID does not exist" containerID="d99f854779a3c36d7b369f8b255ecaca2356764cd0477393d5e2fd757fbb8407" Jul 10 14:09:41.678822 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.678710 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d99f854779a3c36d7b369f8b255ecaca2356764cd0477393d5e2fd757fbb8407"} err="failed to get container status \"d99f854779a3c36d7b369f8b255ecaca2356764cd0477393d5e2fd757fbb8407\": rpc error: code = NotFound desc = could not find container \"d99f854779a3c36d7b369f8b255ecaca2356764cd0477393d5e2fd757fbb8407\": container with ID starting with d99f854779a3c36d7b369f8b255ecaca2356764cd0477393d5e2fd757fbb8407 not found: ID does not exist" Jul 10 14:09:41.825907 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.825868 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-registry-tls\") pod \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " Jul 10 14:09:41.826113 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.825925 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-installation-pull-secrets\") pod \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " Jul 10 14:09:41.826113 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.825977 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9554w\" (UniqueName: \"kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-kube-api-access-9554w\") pod \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " Jul 10 14:09:41.826113 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.826010 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-ca-trust-extracted\") pod \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " Jul 10 14:09:41.826113 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.826046 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-registry-certificates\") pod \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " Jul 10 14:09:41.826113 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.826094 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-bound-sa-token\") pod \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " Jul 10 14:09:41.826387 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.826154 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-image-registry-private-configuration\") pod \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " Jul 10 14:09:41.826387 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.826189 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-trusted-ca\") pod \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\" (UID: \"03fc50eb-f63c-4c50-ae8f-501f774a1ed0\") " Jul 10 14:09:41.826664 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.826625 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "03fc50eb-f63c-4c50-ae8f-501f774a1ed0" (UID: "03fc50eb-f63c-4c50-ae8f-501f774a1ed0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:09:41.826822 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.826781 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "03fc50eb-f63c-4c50-ae8f-501f774a1ed0" (UID: "03fc50eb-f63c-4c50-ae8f-501f774a1ed0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:09:41.829870 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.829062 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-kube-api-access-9554w" (OuterVolumeSpecName: "kube-api-access-9554w") pod "03fc50eb-f63c-4c50-ae8f-501f774a1ed0" (UID: "03fc50eb-f63c-4c50-ae8f-501f774a1ed0"). InnerVolumeSpecName "kube-api-access-9554w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:09:41.829870 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.829783 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "03fc50eb-f63c-4c50-ae8f-501f774a1ed0" (UID: "03fc50eb-f63c-4c50-ae8f-501f774a1ed0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:09:41.829870 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.829797 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "03fc50eb-f63c-4c50-ae8f-501f774a1ed0" (UID: "03fc50eb-f63c-4c50-ae8f-501f774a1ed0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:09:41.830973 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.830922 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "03fc50eb-f63c-4c50-ae8f-501f774a1ed0" (UID: "03fc50eb-f63c-4c50-ae8f-501f774a1ed0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:09:41.831293 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.831261 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "03fc50eb-f63c-4c50-ae8f-501f774a1ed0" (UID: "03fc50eb-f63c-4c50-ae8f-501f774a1ed0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:09:41.838375 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.838350 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "03fc50eb-f63c-4c50-ae8f-501f774a1ed0" (UID: "03fc50eb-f63c-4c50-ae8f-501f774a1ed0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:09:41.927772 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.927689 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-registry-tls\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:09:41.927772 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.927724 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-installation-pull-secrets\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:09:41.927772 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.927739 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9554w\" (UniqueName: \"kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-kube-api-access-9554w\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:09:41.927772 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.927751 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-ca-trust-extracted\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:09:41.927772 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.927763 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-registry-certificates\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:09:41.928140 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.927778 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-bound-sa-token\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:09:41.928140 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.927790 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-image-registry-private-configuration\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:09:41.928140 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.927804 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/03fc50eb-f63c-4c50-ae8f-501f774a1ed0-trusted-ca\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:09:41.993742 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.993706 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-cd7fdc78b-5qrnb"] Jul 10 14:09:41.999777 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:41.999748 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-cd7fdc78b-5qrnb"] Jul 10 14:09:43.102722 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:43.102685 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03fc50eb-f63c-4c50-ae8f-501f774a1ed0" path="/var/lib/kubelet/pods/03fc50eb-f63c-4c50-ae8f-501f774a1ed0/volumes" Jul 10 14:09:44.903399 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:44.903364 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d8597c89c-dsq7z"] Jul 10 14:09:55.082817 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:09:55.082785 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d948477d9-mtkbl"] Jul 10 14:10:00.760288 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:00.760254 2579 generic.go:356] "Generic (PLEG): container finished" podID="65c298b2-9990-431f-a1cd-1a06c1ec25df" containerID="2e5d6cbfb87e60368032754d7ce8c3d7a1bbcb6237fa275f934929603f99faf0" exitCode=0 Jul 10 14:10:00.760721 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:00.760331 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qjfm8" event={"ID":"65c298b2-9990-431f-a1cd-1a06c1ec25df","Type":"ContainerDied","Data":"2e5d6cbfb87e60368032754d7ce8c3d7a1bbcb6237fa275f934929603f99faf0"} Jul 10 14:10:00.760721 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:00.760664 2579 scope.go:117] "RemoveContainer" containerID="2e5d6cbfb87e60368032754d7ce8c3d7a1bbcb6237fa275f934929603f99faf0" Jul 10 14:10:01.766673 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:01.766630 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qjfm8" event={"ID":"65c298b2-9990-431f-a1cd-1a06c1ec25df","Type":"ContainerStarted","Data":"cb9eea03a9424d154e773e11816ea9c96eda040e1a7a69cc759f3760fe7a3dc1"} Jul 10 14:10:05.842096 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:05.842064 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46040804-7e1e-41a2-a1e7-209bdc6b2945-metrics-certs\") pod \"network-metrics-daemon-bkhqd\" (UID: \"46040804-7e1e-41a2-a1e7-209bdc6b2945\") " pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:10:05.844337 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:05.844314 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46040804-7e1e-41a2-a1e7-209bdc6b2945-metrics-certs\") pod \"network-metrics-daemon-bkhqd\" (UID: \"46040804-7e1e-41a2-a1e7-209bdc6b2945\") " pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:10:06.028019 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:06.027995 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fptgw\"" Jul 10 14:10:06.035445 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:06.035429 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkhqd" Jul 10 14:10:06.178884 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:06.178858 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bkhqd"] Jul 10 14:10:06.181514 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:10:06.181486 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46040804_7e1e_41a2_a1e7_209bdc6b2945.slice/crio-5aee4b1e74236981fc782d170ec4151f8ede892a78c870e0f30d74d6e97721a8 WatchSource:0}: Error finding container 5aee4b1e74236981fc782d170ec4151f8ede892a78c870e0f30d74d6e97721a8: Status 404 returned error can't find the container with id 5aee4b1e74236981fc782d170ec4151f8ede892a78c870e0f30d74d6e97721a8 Jul 10 14:10:06.787997 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:06.787963 2579 generic.go:356] "Generic (PLEG): container finished" podID="d58cbba7-3164-48fd-8697-1559ca85e14b" containerID="418a6ed9fed81b289508f49c34b3675a0b2da86239ed881a5077288cde018462" exitCode=0 Jul 10 14:10:06.788186 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:06.788028 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxx5k" event={"ID":"d58cbba7-3164-48fd-8697-1559ca85e14b","Type":"ContainerDied","Data":"418a6ed9fed81b289508f49c34b3675a0b2da86239ed881a5077288cde018462"} Jul 10 14:10:06.788379 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:06.788362 2579 scope.go:117] "RemoveContainer" containerID="418a6ed9fed81b289508f49c34b3675a0b2da86239ed881a5077288cde018462" Jul 10 14:10:06.789094 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:06.789063 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bkhqd" event={"ID":"46040804-7e1e-41a2-a1e7-209bdc6b2945","Type":"ContainerStarted","Data":"5aee4b1e74236981fc782d170ec4151f8ede892a78c870e0f30d74d6e97721a8"} Jul 10 14:10:07.794887 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:07.794851 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-xxx5k" event={"ID":"d58cbba7-3164-48fd-8697-1559ca85e14b","Type":"ContainerStarted","Data":"131ccebbdeb27c7cee676f102c647daeadb8e4f23ab9398a59a601383fb9d644"} Jul 10 14:10:08.800623 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:08.800589 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bkhqd" event={"ID":"46040804-7e1e-41a2-a1e7-209bdc6b2945","Type":"ContainerStarted","Data":"d80efb9c5ee5e58f8c51abf947b98f654b50f06cc7f316ae3abe3924a0cc89a7"} Jul 10 14:10:08.801026 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:08.800673 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bkhqd" event={"ID":"46040804-7e1e-41a2-a1e7-209bdc6b2945","Type":"ContainerStarted","Data":"b03c00cf36012873c2c291b7d16f3feda3d1c4c2960446b315eb46b6508d8a03"} Jul 10 14:10:08.817882 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:08.817835 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bkhqd" podStartSLOduration=128.959953564 podStartE2EDuration="2m10.817820837s" totalImagesPullingTime="1.857867273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:10:08.816144799 +0000 UTC m=+132.242369118" watchObservedRunningTime="2026-07-10 14:10:08.817820837 +0000 UTC m=+132.244045157" Jul 10 14:10:09.930775 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:09.930736 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" podUID="0434507c-840c-4d87-bd9a-c3aab52951e6" containerName="registry" containerID="cri-o://78b3eb83cfce9470bb1c1a165ec9698988fdcb61ee5039084f8be0305f493177" gracePeriod=30 Jul 10 14:10:10.217158 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.217131 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:10:10.382461 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.382431 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-bound-sa-token\") pod \"0434507c-840c-4d87-bd9a-c3aab52951e6\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " Jul 10 14:10:10.382461 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.382463 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0434507c-840c-4d87-bd9a-c3aab52951e6-image-registry-private-configuration\") pod \"0434507c-840c-4d87-bd9a-c3aab52951e6\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " Jul 10 14:10:10.382650 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.382482 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-registry-tls\") pod \"0434507c-840c-4d87-bd9a-c3aab52951e6\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " Jul 10 14:10:10.382650 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.382501 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0434507c-840c-4d87-bd9a-c3aab52951e6-trusted-ca\") pod \"0434507c-840c-4d87-bd9a-c3aab52951e6\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " Jul 10 14:10:10.382650 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.382534 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0434507c-840c-4d87-bd9a-c3aab52951e6-installation-pull-secrets\") pod \"0434507c-840c-4d87-bd9a-c3aab52951e6\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " Jul 10 14:10:10.382650 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.382593 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0434507c-840c-4d87-bd9a-c3aab52951e6-registry-certificates\") pod \"0434507c-840c-4d87-bd9a-c3aab52951e6\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " Jul 10 14:10:10.382650 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.382648 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0434507c-840c-4d87-bd9a-c3aab52951e6-ca-trust-extracted\") pod \"0434507c-840c-4d87-bd9a-c3aab52951e6\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " Jul 10 14:10:10.382889 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.382681 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xpn4\" (UniqueName: \"kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-kube-api-access-6xpn4\") pod \"0434507c-840c-4d87-bd9a-c3aab52951e6\" (UID: \"0434507c-840c-4d87-bd9a-c3aab52951e6\") " Jul 10 14:10:10.383109 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.383007 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0434507c-840c-4d87-bd9a-c3aab52951e6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0434507c-840c-4d87-bd9a-c3aab52951e6" (UID: "0434507c-840c-4d87-bd9a-c3aab52951e6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:10:10.383385 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.383357 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0434507c-840c-4d87-bd9a-c3aab52951e6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0434507c-840c-4d87-bd9a-c3aab52951e6" (UID: "0434507c-840c-4d87-bd9a-c3aab52951e6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:10:10.384984 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.384902 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0434507c-840c-4d87-bd9a-c3aab52951e6" (UID: "0434507c-840c-4d87-bd9a-c3aab52951e6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:10:10.385266 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.385233 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0434507c-840c-4d87-bd9a-c3aab52951e6" (UID: "0434507c-840c-4d87-bd9a-c3aab52951e6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:10:10.385266 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.385242 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0434507c-840c-4d87-bd9a-c3aab52951e6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0434507c-840c-4d87-bd9a-c3aab52951e6" (UID: "0434507c-840c-4d87-bd9a-c3aab52951e6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:10:10.385466 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.385440 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0434507c-840c-4d87-bd9a-c3aab52951e6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0434507c-840c-4d87-bd9a-c3aab52951e6" (UID: "0434507c-840c-4d87-bd9a-c3aab52951e6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:10:10.385506 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.385475 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-kube-api-access-6xpn4" (OuterVolumeSpecName: "kube-api-access-6xpn4") pod "0434507c-840c-4d87-bd9a-c3aab52951e6" (UID: "0434507c-840c-4d87-bd9a-c3aab52951e6"). InnerVolumeSpecName "kube-api-access-6xpn4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:10:10.390926 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.390901 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0434507c-840c-4d87-bd9a-c3aab52951e6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0434507c-840c-4d87-bd9a-c3aab52951e6" (UID: "0434507c-840c-4d87-bd9a-c3aab52951e6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:10:10.483669 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.483603 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0434507c-840c-4d87-bd9a-c3aab52951e6-ca-trust-extracted\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:10:10.483669 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.483627 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xpn4\" (UniqueName: \"kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-kube-api-access-6xpn4\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:10:10.483669 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.483637 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-bound-sa-token\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:10:10.483669 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.483647 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0434507c-840c-4d87-bd9a-c3aab52951e6-image-registry-private-configuration\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:10:10.483669 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.483656 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0434507c-840c-4d87-bd9a-c3aab52951e6-registry-tls\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:10:10.483669 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.483664 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0434507c-840c-4d87-bd9a-c3aab52951e6-trusted-ca\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:10:10.483669 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.483671 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0434507c-840c-4d87-bd9a-c3aab52951e6-installation-pull-secrets\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:10:10.483980 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.483681 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0434507c-840c-4d87-bd9a-c3aab52951e6-registry-certificates\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:10:10.810199 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.810122 2579 generic.go:356] "Generic (PLEG): container finished" podID="0434507c-840c-4d87-bd9a-c3aab52951e6" containerID="78b3eb83cfce9470bb1c1a165ec9698988fdcb61ee5039084f8be0305f493177" exitCode=0 Jul 10 14:10:10.810199 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.810168 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" Jul 10 14:10:10.810395 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.810168 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" event={"ID":"0434507c-840c-4d87-bd9a-c3aab52951e6","Type":"ContainerDied","Data":"78b3eb83cfce9470bb1c1a165ec9698988fdcb61ee5039084f8be0305f493177"} Jul 10 14:10:10.810395 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.810292 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d8597c89c-dsq7z" event={"ID":"0434507c-840c-4d87-bd9a-c3aab52951e6","Type":"ContainerDied","Data":"82ef388ac28c4642a488c3200e333a6b21bcf8390f4959dd4936135faf534801"} Jul 10 14:10:10.810395 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.810325 2579 scope.go:117] "RemoveContainer" containerID="78b3eb83cfce9470bb1c1a165ec9698988fdcb61ee5039084f8be0305f493177" Jul 10 14:10:10.819181 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.819159 2579 scope.go:117] "RemoveContainer" containerID="78b3eb83cfce9470bb1c1a165ec9698988fdcb61ee5039084f8be0305f493177" Jul 10 14:10:10.819441 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:10:10.819424 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78b3eb83cfce9470bb1c1a165ec9698988fdcb61ee5039084f8be0305f493177\": container with ID starting with 78b3eb83cfce9470bb1c1a165ec9698988fdcb61ee5039084f8be0305f493177 not found: ID does not exist" containerID="78b3eb83cfce9470bb1c1a165ec9698988fdcb61ee5039084f8be0305f493177" Jul 10 14:10:10.819485 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.819450 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78b3eb83cfce9470bb1c1a165ec9698988fdcb61ee5039084f8be0305f493177"} err="failed to get container status \"78b3eb83cfce9470bb1c1a165ec9698988fdcb61ee5039084f8be0305f493177\": rpc error: code = NotFound desc = could not find container \"78b3eb83cfce9470bb1c1a165ec9698988fdcb61ee5039084f8be0305f493177\": container with ID starting with 78b3eb83cfce9470bb1c1a165ec9698988fdcb61ee5039084f8be0305f493177 not found: ID does not exist" Jul 10 14:10:10.832992 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.832968 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d8597c89c-dsq7z"] Jul 10 14:10:10.836597 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:10.836575 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-d8597c89c-dsq7z"] Jul 10 14:10:11.100729 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:11.100698 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0434507c-840c-4d87-bd9a-c3aab52951e6" path="/var/lib/kubelet/pods/0434507c-840c-4d87-bd9a-c3aab52951e6/volumes" Jul 10 14:10:13.734858 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:13.734788 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2" podUID="369ec23b-46fc-4dbc-9e5a-f34d138da096" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 10 14:10:20.106058 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:20.106017 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7d948477d9-mtkbl" podUID="b75cea45-e4aa-42b3-98df-2dd67fd222cf" containerName="console" containerID="cri-o://49664ed701808628c1e0a33f338c641cc54fe094df80627076afdb5724075e5a" gracePeriod=15 Jul 10 14:10:20.391352 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:20.391329 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d948477d9-mtkbl" Jul 10 14:10:20.565712 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:20.565675 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b75cea45-e4aa-42b3-98df-2dd67fd222cf-console-config\") pod \"b75cea45-e4aa-42b3-98df-2dd67fd222cf\" (UID: \"b75cea45-e4aa-42b3-98df-2dd67fd222cf\") " Jul 10 14:10:20.565887 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:20.565724 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b75cea45-e4aa-42b3-98df-2dd67fd222cf-service-ca\") pod \"b75cea45-e4aa-42b3-98df-2dd67fd222cf\" (UID: \"b75cea45-e4aa-42b3-98df-2dd67fd222cf\") " Jul 10 14:10:20.565887 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:20.565751 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b75cea45-e4aa-42b3-98df-2dd67fd222cf-console-serving-cert\") pod \"b75cea45-e4aa-42b3-98df-2dd67fd222cf\" (UID: \"b75cea45-e4aa-42b3-98df-2dd67fd222cf\") " Jul 10 14:10:20.565887 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:20.565785 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b75cea45-e4aa-42b3-98df-2dd67fd222cf-oauth-serving-cert\") pod \"b75cea45-e4aa-42b3-98df-2dd67fd222cf\" (UID: \"b75cea45-e4aa-42b3-98df-2dd67fd222cf\") " Jul 10 14:10:20.565887 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:20.565814 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b75cea45-e4aa-42b3-98df-2dd67fd222cf-console-oauth-config\") pod \"b75cea45-e4aa-42b3-98df-2dd67fd222cf\" (UID: \"b75cea45-e4aa-42b3-98df-2dd67fd222cf\") " Jul 10 14:10:20.565887 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:20.565869 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjcxz\" (UniqueName: \"kubernetes.io/projected/b75cea45-e4aa-42b3-98df-2dd67fd222cf-kube-api-access-hjcxz\") pod \"b75cea45-e4aa-42b3-98df-2dd67fd222cf\" (UID: \"b75cea45-e4aa-42b3-98df-2dd67fd222cf\") " Jul 10 14:10:20.566177 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:20.566146 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b75cea45-e4aa-42b3-98df-2dd67fd222cf-console-config" (OuterVolumeSpecName: "console-config") pod "b75cea45-e4aa-42b3-98df-2dd67fd222cf" (UID: "b75cea45-e4aa-42b3-98df-2dd67fd222cf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:10:20.566177 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:20.566157 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b75cea45-e4aa-42b3-98df-2dd67fd222cf-service-ca" (OuterVolumeSpecName: "service-ca") pod "b75cea45-e4aa-42b3-98df-2dd67fd222cf" (UID: "b75cea45-e4aa-42b3-98df-2dd67fd222cf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:10:20.566177 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:20.566164 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b75cea45-e4aa-42b3-98df-2dd67fd222cf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b75cea45-e4aa-42b3-98df-2dd67fd222cf" (UID: "b75cea45-e4aa-42b3-98df-2dd67fd222cf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:10:20.568184 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:20.568146 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b75cea45-e4aa-42b3-98df-2dd67fd222cf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b75cea45-e4aa-42b3-98df-2dd67fd222cf" (UID: "b75cea45-e4aa-42b3-98df-2dd67fd222cf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:10:20.568302 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:20.568235 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b75cea45-e4aa-42b3-98df-2dd67fd222cf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b75cea45-e4aa-42b3-98df-2dd67fd222cf" (UID: "b75cea45-e4aa-42b3-98df-2dd67fd222cf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:10:20.568302 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:20.568237 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b75cea45-e4aa-42b3-98df-2dd67fd222cf-kube-api-access-hjcxz" (OuterVolumeSpecName: "kube-api-access-hjcxz") pod "b75cea45-e4aa-42b3-98df-2dd67fd222cf" (UID: "b75cea45-e4aa-42b3-98df-2dd67fd222cf"). InnerVolumeSpecName "kube-api-access-hjcxz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:10:20.666993 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:20.666901 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b75cea45-e4aa-42b3-98df-2dd67fd222cf-console-config\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:10:20.666993 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:20.666926 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b75cea45-e4aa-42b3-98df-2dd67fd222cf-service-ca\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:10:20.666993 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:20.666938 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b75cea45-e4aa-42b3-98df-2dd67fd222cf-console-serving-cert\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:10:20.666993 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:20.666974 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b75cea45-e4aa-42b3-98df-2dd67fd222cf-oauth-serving-cert\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:10:20.666993 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:20.666988 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b75cea45-e4aa-42b3-98df-2dd67fd222cf-console-oauth-config\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:10:20.667227 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:20.667002 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjcxz\" (UniqueName: \"kubernetes.io/projected/b75cea45-e4aa-42b3-98df-2dd67fd222cf-kube-api-access-hjcxz\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:10:20.857705 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:20.857673 2579 generic.go:356] "Generic (PLEG): container finished" podID="b75cea45-e4aa-42b3-98df-2dd67fd222cf" containerID="49664ed701808628c1e0a33f338c641cc54fe094df80627076afdb5724075e5a" exitCode=0 Jul 10 14:10:20.857820 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:20.857717 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d948477d9-mtkbl" Jul 10 14:10:20.857820 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:20.857759 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d948477d9-mtkbl" event={"ID":"b75cea45-e4aa-42b3-98df-2dd67fd222cf","Type":"ContainerDied","Data":"49664ed701808628c1e0a33f338c641cc54fe094df80627076afdb5724075e5a"} Jul 10 14:10:20.857820 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:20.857808 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d948477d9-mtkbl" event={"ID":"b75cea45-e4aa-42b3-98df-2dd67fd222cf","Type":"ContainerDied","Data":"7d441ea831f44542b4e5e2b5529e13bb1e830e9939a9bb74be9b53676225a43e"} Jul 10 14:10:20.857937 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:20.857838 2579 scope.go:117] "RemoveContainer" containerID="49664ed701808628c1e0a33f338c641cc54fe094df80627076afdb5724075e5a" Jul 10 14:10:20.859410 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:20.859381 2579 generic.go:356] "Generic (PLEG): container finished" podID="7f9d2e13-3a46-4539-b046-2c9ae7fe5f94" containerID="a1186c8f8489beadf6045c4e208c5b12ebab674c52ff293e194e61d4a641d052" exitCode=0 Jul 10 14:10:20.859510 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:20.859452 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-vz755" event={"ID":"7f9d2e13-3a46-4539-b046-2c9ae7fe5f94","Type":"ContainerDied","Data":"a1186c8f8489beadf6045c4e208c5b12ebab674c52ff293e194e61d4a641d052"} Jul 10 14:10:20.859884 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:20.859864 2579 scope.go:117] "RemoveContainer" containerID="a1186c8f8489beadf6045c4e208c5b12ebab674c52ff293e194e61d4a641d052" Jul 10 14:10:20.866688 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:20.866622 2579 scope.go:117] "RemoveContainer" containerID="49664ed701808628c1e0a33f338c641cc54fe094df80627076afdb5724075e5a" Jul 10 14:10:20.866935 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:10:20.866904 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49664ed701808628c1e0a33f338c641cc54fe094df80627076afdb5724075e5a\": container with ID starting with 49664ed701808628c1e0a33f338c641cc54fe094df80627076afdb5724075e5a not found: ID does not exist" containerID="49664ed701808628c1e0a33f338c641cc54fe094df80627076afdb5724075e5a" Jul 10 14:10:20.867055 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:20.866935 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49664ed701808628c1e0a33f338c641cc54fe094df80627076afdb5724075e5a"} err="failed to get container status \"49664ed701808628c1e0a33f338c641cc54fe094df80627076afdb5724075e5a\": rpc error: code = NotFound desc = could not find container \"49664ed701808628c1e0a33f338c641cc54fe094df80627076afdb5724075e5a\": container with ID starting with 49664ed701808628c1e0a33f338c641cc54fe094df80627076afdb5724075e5a not found: ID does not exist" Jul 10 14:10:20.896606 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:20.896584 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d948477d9-mtkbl"] Jul 10 14:10:20.900839 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:20.900817 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d948477d9-mtkbl"] Jul 10 14:10:21.101648 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:21.101610 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b75cea45-e4aa-42b3-98df-2dd67fd222cf" path="/var/lib/kubelet/pods/b75cea45-e4aa-42b3-98df-2dd67fd222cf/volumes" Jul 10 14:10:21.867043 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:21.867009 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-vz755" event={"ID":"7f9d2e13-3a46-4539-b046-2c9ae7fe5f94","Type":"ContainerStarted","Data":"36c59cca97198f4a0a146789b0433759c9d3c5c4a56461f62d742bf37f53197a"} Jul 10 14:10:23.735425 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:23.735386 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2" podUID="369ec23b-46fc-4dbc-9e5a-f34d138da096" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 10 14:10:33.748312 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:33.748261 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2" podUID="369ec23b-46fc-4dbc-9e5a-f34d138da096" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 10 14:10:33.748799 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:33.748366 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2" Jul 10 14:10:33.749056 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:33.749035 2579 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"70dc48929eb7325254f09ba3cd48037152b05f8787058c453f85fc6c45722f09"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 10 14:10:33.749146 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:33.749079 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2" podUID="369ec23b-46fc-4dbc-9e5a-f34d138da096" containerName="service-proxy" containerID="cri-o://70dc48929eb7325254f09ba3cd48037152b05f8787058c453f85fc6c45722f09" gracePeriod=30 Jul 10 14:10:33.922024 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:33.921995 2579 generic.go:356] "Generic (PLEG): container finished" podID="369ec23b-46fc-4dbc-9e5a-f34d138da096" containerID="70dc48929eb7325254f09ba3cd48037152b05f8787058c453f85fc6c45722f09" exitCode=2 Jul 10 14:10:33.922135 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:33.922055 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2" event={"ID":"369ec23b-46fc-4dbc-9e5a-f34d138da096","Type":"ContainerDied","Data":"70dc48929eb7325254f09ba3cd48037152b05f8787058c453f85fc6c45722f09"} Jul 10 14:10:34.930688 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:10:34.930643 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75ccb96b9c-jkwb2" event={"ID":"369ec23b-46fc-4dbc-9e5a-f34d138da096","Type":"ContainerStarted","Data":"355a2b88d6e1cc5fa1c3fc7547eb70954e2db1709d84881e7b4e0c64e71116ca"} Jul 10 14:12:32.342278 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.342201 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d47b746d6-6bxtx"] Jul 10 14:12:32.342759 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.342569 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03fc50eb-f63c-4c50-ae8f-501f774a1ed0" containerName="registry" Jul 10 14:12:32.342759 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.342583 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="03fc50eb-f63c-4c50-ae8f-501f774a1ed0" containerName="registry" Jul 10 14:12:32.342759 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.342598 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b75cea45-e4aa-42b3-98df-2dd67fd222cf" containerName="console" Jul 10 14:12:32.342759 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.342604 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b75cea45-e4aa-42b3-98df-2dd67fd222cf" containerName="console" Jul 10 14:12:32.342759 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.342611 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0434507c-840c-4d87-bd9a-c3aab52951e6" containerName="registry" Jul 10 14:12:32.342759 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.342618 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0434507c-840c-4d87-bd9a-c3aab52951e6" containerName="registry" Jul 10 14:12:32.342759 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.342680 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b75cea45-e4aa-42b3-98df-2dd67fd222cf" containerName="console" Jul 10 14:12:32.342759 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.342690 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0434507c-840c-4d87-bd9a-c3aab52951e6" containerName="registry" Jul 10 14:12:32.342759 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.342695 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="03fc50eb-f63c-4c50-ae8f-501f774a1ed0" containerName="registry" Jul 10 14:12:32.345786 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.345761 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-6bxtx" Jul 10 14:12:32.352344 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.352316 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 10 14:12:32.352344 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.352336 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 10 14:12:32.352524 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.352394 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cw2fh\"" Jul 10 14:12:32.352916 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.352649 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 10 14:12:32.352916 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.352708 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 10 14:12:32.364130 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.364108 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d47b746d6-6bxtx"] Jul 10 14:12:32.473815 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.473777 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cbaae726-7e51-4d6b-91e5-063ae0a4a966-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d47b746d6-6bxtx\" (UID: \"cbaae726-7e51-4d6b-91e5-063ae0a4a966\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-6bxtx" Jul 10 14:12:32.473815 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.473812 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cbaae726-7e51-4d6b-91e5-063ae0a4a966-manifests\") pod \"opendatahub-operator-controller-manager-5d47b746d6-6bxtx\" (UID: \"cbaae726-7e51-4d6b-91e5-063ae0a4a966\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-6bxtx" Jul 10 14:12:32.474047 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.473835 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cbaae726-7e51-4d6b-91e5-063ae0a4a966-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d47b746d6-6bxtx\" (UID: \"cbaae726-7e51-4d6b-91e5-063ae0a4a966\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-6bxtx" Jul 10 14:12:32.474047 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.473911 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbaae726-7e51-4d6b-91e5-063ae0a4a966-tmp\") pod \"opendatahub-operator-controller-manager-5d47b746d6-6bxtx\" (UID: \"cbaae726-7e51-4d6b-91e5-063ae0a4a966\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-6bxtx" Jul 10 14:12:32.474047 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.474006 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr7w8\" (UniqueName: \"kubernetes.io/projected/cbaae726-7e51-4d6b-91e5-063ae0a4a966-kube-api-access-tr7w8\") pod \"opendatahub-operator-controller-manager-5d47b746d6-6bxtx\" (UID: \"cbaae726-7e51-4d6b-91e5-063ae0a4a966\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-6bxtx" Jul 10 14:12:32.574976 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.574914 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr7w8\" (UniqueName: \"kubernetes.io/projected/cbaae726-7e51-4d6b-91e5-063ae0a4a966-kube-api-access-tr7w8\") pod \"opendatahub-operator-controller-manager-5d47b746d6-6bxtx\" (UID: \"cbaae726-7e51-4d6b-91e5-063ae0a4a966\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-6bxtx" Jul 10 14:12:32.575163 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.575010 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cbaae726-7e51-4d6b-91e5-063ae0a4a966-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d47b746d6-6bxtx\" (UID: \"cbaae726-7e51-4d6b-91e5-063ae0a4a966\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-6bxtx" Jul 10 14:12:32.575163 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.575041 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cbaae726-7e51-4d6b-91e5-063ae0a4a966-manifests\") pod \"opendatahub-operator-controller-manager-5d47b746d6-6bxtx\" (UID: \"cbaae726-7e51-4d6b-91e5-063ae0a4a966\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-6bxtx" Jul 10 14:12:32.575163 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.575082 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cbaae726-7e51-4d6b-91e5-063ae0a4a966-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d47b746d6-6bxtx\" (UID: \"cbaae726-7e51-4d6b-91e5-063ae0a4a966\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-6bxtx" Jul 10 14:12:32.575163 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.575132 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbaae726-7e51-4d6b-91e5-063ae0a4a966-tmp\") pod \"opendatahub-operator-controller-manager-5d47b746d6-6bxtx\" (UID: \"cbaae726-7e51-4d6b-91e5-063ae0a4a966\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-6bxtx" Jul 10 14:12:32.575510 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.575484 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cbaae726-7e51-4d6b-91e5-063ae0a4a966-manifests\") pod \"opendatahub-operator-controller-manager-5d47b746d6-6bxtx\" (UID: \"cbaae726-7e51-4d6b-91e5-063ae0a4a966\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-6bxtx" Jul 10 14:12:32.577351 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.577326 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbaae726-7e51-4d6b-91e5-063ae0a4a966-tmp\") pod \"opendatahub-operator-controller-manager-5d47b746d6-6bxtx\" (UID: \"cbaae726-7e51-4d6b-91e5-063ae0a4a966\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-6bxtx" Jul 10 14:12:32.577568 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.577548 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cbaae726-7e51-4d6b-91e5-063ae0a4a966-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d47b746d6-6bxtx\" (UID: \"cbaae726-7e51-4d6b-91e5-063ae0a4a966\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-6bxtx" Jul 10 14:12:32.577630 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.577585 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cbaae726-7e51-4d6b-91e5-063ae0a4a966-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d47b746d6-6bxtx\" (UID: \"cbaae726-7e51-4d6b-91e5-063ae0a4a966\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-6bxtx" Jul 10 14:12:32.584114 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.584087 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr7w8\" (UniqueName: \"kubernetes.io/projected/cbaae726-7e51-4d6b-91e5-063ae0a4a966-kube-api-access-tr7w8\") pod \"opendatahub-operator-controller-manager-5d47b746d6-6bxtx\" (UID: \"cbaae726-7e51-4d6b-91e5-063ae0a4a966\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-6bxtx" Jul 10 14:12:32.656452 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.656418 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-6bxtx" Jul 10 14:12:32.808658 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:32.808611 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d47b746d6-6bxtx"] Jul 10 14:12:32.812419 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:12:32.812392 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbaae726_7e51_4d6b_91e5_063ae0a4a966.slice/crio-c944b6f13c702d279a0876ccd82eace46e61d49fc29f90fee79de979e26b61f0 WatchSource:0}: Error finding container c944b6f13c702d279a0876ccd82eace46e61d49fc29f90fee79de979e26b61f0: Status 404 returned error can't find the container with id c944b6f13c702d279a0876ccd82eace46e61d49fc29f90fee79de979e26b61f0 Jul 10 14:12:33.388343 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:33.388302 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-6bxtx" event={"ID":"cbaae726-7e51-4d6b-91e5-063ae0a4a966","Type":"ContainerStarted","Data":"c944b6f13c702d279a0876ccd82eace46e61d49fc29f90fee79de979e26b61f0"} Jul 10 14:12:36.405824 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:36.405782 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-6bxtx" event={"ID":"cbaae726-7e51-4d6b-91e5-063ae0a4a966","Type":"ContainerStarted","Data":"07a831ad92253a0f3624bbad3ec7e64a61b43ed8d56b68f18c67cba10466272d"} Jul 10 14:12:37.411870 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:37.411794 2579 generic.go:356] "Generic (PLEG): container finished" podID="cbaae726-7e51-4d6b-91e5-063ae0a4a966" containerID="07a831ad92253a0f3624bbad3ec7e64a61b43ed8d56b68f18c67cba10466272d" exitCode=0 Jul 10 14:12:37.412310 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:37.411865 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-6bxtx" event={"ID":"cbaae726-7e51-4d6b-91e5-063ae0a4a966","Type":"ContainerDied","Data":"07a831ad92253a0f3624bbad3ec7e64a61b43ed8d56b68f18c67cba10466272d"} Jul 10 14:12:38.418169 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:38.418133 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-6bxtx" event={"ID":"cbaae726-7e51-4d6b-91e5-063ae0a4a966","Type":"ContainerStarted","Data":"dfa8690672196b7bc275c06aaa74365bf78dfc1a7738b9ee91aecf55b2db0014"} Jul 10 14:12:38.418591 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:38.418231 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-6bxtx" Jul 10 14:12:38.443788 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:38.443696 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-6bxtx" podStartSLOduration=1.840970146 podStartE2EDuration="6.443681574s" totalImagesPullingTime="3.56062848s" totalInitContainerRuntime="1.042082948s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:12:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:12:38.443115447 +0000 UTC m=+281.869339768" watchObservedRunningTime="2026-07-10 14:12:38.443681574 +0000 UTC m=+281.869905894" Jul 10 14:12:49.424715 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:49.424683 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d47b746d6-6bxtx" Jul 10 14:12:52.647939 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:52.647892 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5d5554d48-4zn98"] Jul 10 14:12:52.651646 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:52.651622 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5d5554d48-4zn98" Jul 10 14:12:52.655602 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:52.655572 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 10 14:12:52.656510 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:52.656484 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 10 14:12:52.656635 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:52.656521 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 10 14:12:52.656968 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:52.656931 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-z7jnj\"" Jul 10 14:12:52.657092 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:52.656935 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 10 14:12:52.657092 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:52.657030 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 10 14:12:52.662933 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:52.662910 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5d5554d48-4zn98"] Jul 10 14:12:52.838238 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:52.838166 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bfde1597-c60a-4d6e-8e40-26ade28fcf1b-manager-config\") pod \"lws-controller-manager-5d5554d48-4zn98\" (UID: \"bfde1597-c60a-4d6e-8e40-26ade28fcf1b\") " pod="openshift-lws-operator/lws-controller-manager-5d5554d48-4zn98" Jul 10 14:12:52.838420 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:52.838252 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7bb2\" (UniqueName: \"kubernetes.io/projected/bfde1597-c60a-4d6e-8e40-26ade28fcf1b-kube-api-access-d7bb2\") pod \"lws-controller-manager-5d5554d48-4zn98\" (UID: \"bfde1597-c60a-4d6e-8e40-26ade28fcf1b\") " pod="openshift-lws-operator/lws-controller-manager-5d5554d48-4zn98" Jul 10 14:12:52.838420 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:52.838284 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bfde1597-c60a-4d6e-8e40-26ade28fcf1b-metrics-cert\") pod \"lws-controller-manager-5d5554d48-4zn98\" (UID: \"bfde1597-c60a-4d6e-8e40-26ade28fcf1b\") " pod="openshift-lws-operator/lws-controller-manager-5d5554d48-4zn98" Jul 10 14:12:52.838420 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:52.838401 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bfde1597-c60a-4d6e-8e40-26ade28fcf1b-cert\") pod \"lws-controller-manager-5d5554d48-4zn98\" (UID: \"bfde1597-c60a-4d6e-8e40-26ade28fcf1b\") " pod="openshift-lws-operator/lws-controller-manager-5d5554d48-4zn98" Jul 10 14:12:52.939164 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:52.939079 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bfde1597-c60a-4d6e-8e40-26ade28fcf1b-manager-config\") pod \"lws-controller-manager-5d5554d48-4zn98\" (UID: \"bfde1597-c60a-4d6e-8e40-26ade28fcf1b\") " pod="openshift-lws-operator/lws-controller-manager-5d5554d48-4zn98" Jul 10 14:12:52.939164 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:52.939114 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7bb2\" (UniqueName: \"kubernetes.io/projected/bfde1597-c60a-4d6e-8e40-26ade28fcf1b-kube-api-access-d7bb2\") pod \"lws-controller-manager-5d5554d48-4zn98\" (UID: \"bfde1597-c60a-4d6e-8e40-26ade28fcf1b\") " pod="openshift-lws-operator/lws-controller-manager-5d5554d48-4zn98" Jul 10 14:12:52.939164 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:52.939137 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bfde1597-c60a-4d6e-8e40-26ade28fcf1b-metrics-cert\") pod \"lws-controller-manager-5d5554d48-4zn98\" (UID: \"bfde1597-c60a-4d6e-8e40-26ade28fcf1b\") " pod="openshift-lws-operator/lws-controller-manager-5d5554d48-4zn98" Jul 10 14:12:52.939447 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:52.939171 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bfde1597-c60a-4d6e-8e40-26ade28fcf1b-cert\") pod \"lws-controller-manager-5d5554d48-4zn98\" (UID: \"bfde1597-c60a-4d6e-8e40-26ade28fcf1b\") " pod="openshift-lws-operator/lws-controller-manager-5d5554d48-4zn98" Jul 10 14:12:52.939971 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:52.939923 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bfde1597-c60a-4d6e-8e40-26ade28fcf1b-manager-config\") pod \"lws-controller-manager-5d5554d48-4zn98\" (UID: \"bfde1597-c60a-4d6e-8e40-26ade28fcf1b\") " pod="openshift-lws-operator/lws-controller-manager-5d5554d48-4zn98" Jul 10 14:12:52.941941 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:52.941916 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bfde1597-c60a-4d6e-8e40-26ade28fcf1b-metrics-cert\") pod \"lws-controller-manager-5d5554d48-4zn98\" (UID: \"bfde1597-c60a-4d6e-8e40-26ade28fcf1b\") " pod="openshift-lws-operator/lws-controller-manager-5d5554d48-4zn98" Jul 10 14:12:52.942064 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:52.941943 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bfde1597-c60a-4d6e-8e40-26ade28fcf1b-cert\") pod \"lws-controller-manager-5d5554d48-4zn98\" (UID: \"bfde1597-c60a-4d6e-8e40-26ade28fcf1b\") " pod="openshift-lws-operator/lws-controller-manager-5d5554d48-4zn98" Jul 10 14:12:52.951753 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:52.951725 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7bb2\" (UniqueName: \"kubernetes.io/projected/bfde1597-c60a-4d6e-8e40-26ade28fcf1b-kube-api-access-d7bb2\") pod \"lws-controller-manager-5d5554d48-4zn98\" (UID: \"bfde1597-c60a-4d6e-8e40-26ade28fcf1b\") " pod="openshift-lws-operator/lws-controller-manager-5d5554d48-4zn98" Jul 10 14:12:52.963636 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:52.963615 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5d5554d48-4zn98" Jul 10 14:12:53.119248 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:53.119220 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5d5554d48-4zn98"] Jul 10 14:12:53.121030 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:12:53.121007 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfde1597_c60a_4d6e_8e40_26ade28fcf1b.slice/crio-0612e600c3b8e6ed9aa6debdf38adf5b327891edcc22f9a3be14fa0f1b6f45ef WatchSource:0}: Error finding container 0612e600c3b8e6ed9aa6debdf38adf5b327891edcc22f9a3be14fa0f1b6f45ef: Status 404 returned error can't find the container with id 0612e600c3b8e6ed9aa6debdf38adf5b327891edcc22f9a3be14fa0f1b6f45ef Jul 10 14:12:53.485288 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:53.485250 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5d5554d48-4zn98" event={"ID":"bfde1597-c60a-4d6e-8e40-26ade28fcf1b","Type":"ContainerStarted","Data":"0612e600c3b8e6ed9aa6debdf38adf5b327891edcc22f9a3be14fa0f1b6f45ef"} Jul 10 14:12:57.097197 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:57.097160 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-znjf2_99ef7290-2248-4e0c-9fda-100370c1ac2d/console-operator/1.log" Jul 10 14:12:57.097655 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:57.097357 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-znjf2_99ef7290-2248-4e0c-9fda-100370c1ac2d/console-operator/1.log" Jul 10 14:12:57.108839 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:57.108816 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jwwrp_6ce1e1c6-c734-4df5-9079-0295f7de80f6/ovn-acl-logging/0.log" Jul 10 14:12:57.109060 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:57.109043 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jwwrp_6ce1e1c6-c734-4df5-9079-0295f7de80f6/ovn-acl-logging/0.log" Jul 10 14:12:57.111797 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:57.111782 2579 kubelet.go:1648] "Image garbage collection succeeded" Jul 10 14:12:57.504629 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:57.504545 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5d5554d48-4zn98" event={"ID":"bfde1597-c60a-4d6e-8e40-26ade28fcf1b","Type":"ContainerStarted","Data":"fa71f04b69c57eb2a22fd3a7a8b9f935d0c1552f58e6a9dc48d33fee8ab26ffa"} Jul 10 14:12:57.504792 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:57.504675 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5d5554d48-4zn98" Jul 10 14:12:57.521698 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:12:57.521651 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5d5554d48-4zn98" podStartSLOduration=1.498429791 podStartE2EDuration="5.521636978s" totalImagesPullingTime="4.023207187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:12:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:12:57.521145852 +0000 UTC m=+300.947370175" watchObservedRunningTime="2026-07-10 14:12:57.521636978 +0000 UTC m=+300.947861300" Jul 10 14:13:00.974124 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:00.974093 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9"] Jul 10 14:13:00.977592 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:00.977571 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" Jul 10 14:13:00.980790 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:00.980770 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 10 14:13:00.981192 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:00.981156 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-c6dqv\"" Jul 10 14:13:00.996436 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:00.996415 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9"] Jul 10 14:13:01.011064 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:01.011024 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7030bbeb-5332-407d-99ac-8b2c06d9afd5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gqkd9\" (UID: \"7030bbeb-5332-407d-99ac-8b2c06d9afd5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" Jul 10 14:13:01.011364 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:01.011084 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7030bbeb-5332-407d-99ac-8b2c06d9afd5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gqkd9\" (UID: \"7030bbeb-5332-407d-99ac-8b2c06d9afd5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" Jul 10 14:13:01.011364 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:01.011194 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7030bbeb-5332-407d-99ac-8b2c06d9afd5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gqkd9\" (UID: \"7030bbeb-5332-407d-99ac-8b2c06d9afd5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" Jul 10 14:13:01.011364 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:01.011241 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbqtz\" (UniqueName: \"kubernetes.io/projected/7030bbeb-5332-407d-99ac-8b2c06d9afd5-kube-api-access-qbqtz\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gqkd9\" (UID: \"7030bbeb-5332-407d-99ac-8b2c06d9afd5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" Jul 10 14:13:01.011364 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:01.011279 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7030bbeb-5332-407d-99ac-8b2c06d9afd5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gqkd9\" (UID: \"7030bbeb-5332-407d-99ac-8b2c06d9afd5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" Jul 10 14:13:01.011364 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:01.011348 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7030bbeb-5332-407d-99ac-8b2c06d9afd5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gqkd9\" (UID: \"7030bbeb-5332-407d-99ac-8b2c06d9afd5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" Jul 10 14:13:01.011656 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:01.011399 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7030bbeb-5332-407d-99ac-8b2c06d9afd5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gqkd9\" (UID: \"7030bbeb-5332-407d-99ac-8b2c06d9afd5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" Jul 10 14:13:01.011656 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:01.011428 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7030bbeb-5332-407d-99ac-8b2c06d9afd5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gqkd9\" (UID: \"7030bbeb-5332-407d-99ac-8b2c06d9afd5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" Jul 10 14:13:01.011656 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:01.011448 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7030bbeb-5332-407d-99ac-8b2c06d9afd5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gqkd9\" (UID: \"7030bbeb-5332-407d-99ac-8b2c06d9afd5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" Jul 10 14:13:01.112619 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:01.112586 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7030bbeb-5332-407d-99ac-8b2c06d9afd5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gqkd9\" (UID: \"7030bbeb-5332-407d-99ac-8b2c06d9afd5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" Jul 10 14:13:01.112619 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:01.112621 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7030bbeb-5332-407d-99ac-8b2c06d9afd5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gqkd9\" (UID: \"7030bbeb-5332-407d-99ac-8b2c06d9afd5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" Jul 10 14:13:01.112841 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:01.112647 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbqtz\" (UniqueName: \"kubernetes.io/projected/7030bbeb-5332-407d-99ac-8b2c06d9afd5-kube-api-access-qbqtz\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gqkd9\" (UID: \"7030bbeb-5332-407d-99ac-8b2c06d9afd5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" Jul 10 14:13:01.112841 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:01.112675 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7030bbeb-5332-407d-99ac-8b2c06d9afd5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gqkd9\" (UID: \"7030bbeb-5332-407d-99ac-8b2c06d9afd5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" Jul 10 14:13:01.112841 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:01.112692 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7030bbeb-5332-407d-99ac-8b2c06d9afd5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gqkd9\" (UID: \"7030bbeb-5332-407d-99ac-8b2c06d9afd5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" Jul 10 14:13:01.112841 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:01.112712 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7030bbeb-5332-407d-99ac-8b2c06d9afd5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gqkd9\" (UID: \"7030bbeb-5332-407d-99ac-8b2c06d9afd5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" Jul 10 14:13:01.112841 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:01.112765 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7030bbeb-5332-407d-99ac-8b2c06d9afd5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gqkd9\" (UID: \"7030bbeb-5332-407d-99ac-8b2c06d9afd5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" Jul 10 14:13:01.112841 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:01.112790 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7030bbeb-5332-407d-99ac-8b2c06d9afd5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gqkd9\" (UID: \"7030bbeb-5332-407d-99ac-8b2c06d9afd5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" Jul 10 14:13:01.112841 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:01.112835 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7030bbeb-5332-407d-99ac-8b2c06d9afd5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gqkd9\" (UID: \"7030bbeb-5332-407d-99ac-8b2c06d9afd5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" Jul 10 14:13:01.113221 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:01.113154 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7030bbeb-5332-407d-99ac-8b2c06d9afd5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gqkd9\" (UID: \"7030bbeb-5332-407d-99ac-8b2c06d9afd5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" Jul 10 14:13:01.113221 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:01.113200 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7030bbeb-5332-407d-99ac-8b2c06d9afd5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gqkd9\" (UID: \"7030bbeb-5332-407d-99ac-8b2c06d9afd5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" Jul 10 14:13:01.113303 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:01.113253 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7030bbeb-5332-407d-99ac-8b2c06d9afd5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gqkd9\" (UID: \"7030bbeb-5332-407d-99ac-8b2c06d9afd5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" Jul 10 14:13:01.113367 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:01.113340 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7030bbeb-5332-407d-99ac-8b2c06d9afd5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gqkd9\" (UID: \"7030bbeb-5332-407d-99ac-8b2c06d9afd5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" Jul 10 14:13:01.113565 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:01.113547 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7030bbeb-5332-407d-99ac-8b2c06d9afd5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gqkd9\" (UID: \"7030bbeb-5332-407d-99ac-8b2c06d9afd5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" Jul 10 14:13:01.115044 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:01.115019 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7030bbeb-5332-407d-99ac-8b2c06d9afd5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gqkd9\" (UID: \"7030bbeb-5332-407d-99ac-8b2c06d9afd5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" Jul 10 14:13:01.115205 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:01.115188 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7030bbeb-5332-407d-99ac-8b2c06d9afd5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gqkd9\" (UID: \"7030bbeb-5332-407d-99ac-8b2c06d9afd5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" Jul 10 14:13:01.123209 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:01.123180 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbqtz\" (UniqueName: \"kubernetes.io/projected/7030bbeb-5332-407d-99ac-8b2c06d9afd5-kube-api-access-qbqtz\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gqkd9\" (UID: \"7030bbeb-5332-407d-99ac-8b2c06d9afd5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" Jul 10 14:13:01.123479 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:01.123457 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7030bbeb-5332-407d-99ac-8b2c06d9afd5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gqkd9\" (UID: \"7030bbeb-5332-407d-99ac-8b2c06d9afd5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" Jul 10 14:13:01.292849 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:01.292772 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" Jul 10 14:13:01.451794 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:01.451769 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9"] Jul 10 14:13:01.453996 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:13:01.453967 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7030bbeb_5332_407d_99ac_8b2c06d9afd5.slice/crio-deb47eaf8228bde260059c43ae68166b948acfa83d05b03facc2cfc50ba7cc72 WatchSource:0}: Error finding container deb47eaf8228bde260059c43ae68166b948acfa83d05b03facc2cfc50ba7cc72: Status 404 returned error can't find the container with id deb47eaf8228bde260059c43ae68166b948acfa83d05b03facc2cfc50ba7cc72 Jul 10 14:13:01.456250 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:01.456233 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 14:13:01.522472 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:01.522433 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" event={"ID":"7030bbeb-5332-407d-99ac-8b2c06d9afd5","Type":"ContainerStarted","Data":"deb47eaf8228bde260059c43ae68166b948acfa83d05b03facc2cfc50ba7cc72"} Jul 10 14:13:04.389117 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:04.389073 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:13:04.389370 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:04.389155 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:13:04.389370 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:04.389184 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:13:04.541100 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:04.541052 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" event={"ID":"7030bbeb-5332-407d-99ac-8b2c06d9afd5","Type":"ContainerStarted","Data":"8711dea7cd05c7d46ab4caa999e2282a2f6fa27e4331af54554fff3107eca19e"} Jul 10 14:13:04.572004 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:04.571933 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" podStartSLOduration=1.639470074 podStartE2EDuration="4.571914375s" totalImagesPullingTime="2.932444301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:13:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:13:04.570840021 +0000 UTC m=+307.997064341" watchObservedRunningTime="2026-07-10 14:13:04.571914375 +0000 UTC m=+307.998138732" Jul 10 14:13:05.292967 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:05.292922 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" Jul 10 14:13:05.297723 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:05.297698 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" Jul 10 14:13:05.545341 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:05.545262 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" Jul 10 14:13:05.546218 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:05.546199 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gqkd9" Jul 10 14:13:08.510201 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:13:08.510175 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5d5554d48-4zn98" Jul 10 14:14:32.246958 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:32.246867 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8nghr"] Jul 10 14:14:32.250243 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:32.250223 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8nghr" Jul 10 14:14:32.253539 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:32.253523 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 10 14:14:32.253634 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:32.253567 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 10 14:14:32.254791 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:32.254773 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-rxh92\"" Jul 10 14:14:32.261183 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:32.261162 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8nghr"] Jul 10 14:14:32.397726 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:32.397696 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r5fs\" (UniqueName: \"kubernetes.io/projected/f69fe418-2e6e-4652-8d73-39973db79af4-kube-api-access-2r5fs\") pod \"limitador-operator-controller-manager-859d7b78bd-8nghr\" (UID: \"f69fe418-2e6e-4652-8d73-39973db79af4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8nghr" Jul 10 14:14:32.498500 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:32.498426 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r5fs\" (UniqueName: \"kubernetes.io/projected/f69fe418-2e6e-4652-8d73-39973db79af4-kube-api-access-2r5fs\") pod \"limitador-operator-controller-manager-859d7b78bd-8nghr\" (UID: \"f69fe418-2e6e-4652-8d73-39973db79af4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8nghr" Jul 10 14:14:32.509663 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:32.509644 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r5fs\" (UniqueName: \"kubernetes.io/projected/f69fe418-2e6e-4652-8d73-39973db79af4-kube-api-access-2r5fs\") pod \"limitador-operator-controller-manager-859d7b78bd-8nghr\" (UID: \"f69fe418-2e6e-4652-8d73-39973db79af4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8nghr" Jul 10 14:14:32.560266 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:32.560241 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8nghr" Jul 10 14:14:32.690719 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:32.690695 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8nghr"] Jul 10 14:14:32.692788 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:14:32.692762 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf69fe418_2e6e_4652_8d73_39973db79af4.slice/crio-ed36147057e7071b0aadc8dc97ebed3cbc2cc230ec34fc3cc173123f7a09f3e2 WatchSource:0}: Error finding container ed36147057e7071b0aadc8dc97ebed3cbc2cc230ec34fc3cc173123f7a09f3e2: Status 404 returned error can't find the container with id ed36147057e7071b0aadc8dc97ebed3cbc2cc230ec34fc3cc173123f7a09f3e2 Jul 10 14:14:32.924525 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:32.924493 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8nghr" event={"ID":"f69fe418-2e6e-4652-8d73-39973db79af4","Type":"ContainerStarted","Data":"ed36147057e7071b0aadc8dc97ebed3cbc2cc230ec34fc3cc173123f7a09f3e2"} Jul 10 14:14:35.941780 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:35.941747 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8nghr" event={"ID":"f69fe418-2e6e-4652-8d73-39973db79af4","Type":"ContainerStarted","Data":"6f3f805d737e822a9d60c5d907125ea4af246ee8713343471f1c7930bc42054e"} Jul 10 14:14:35.942205 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:35.941861 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8nghr" Jul 10 14:14:35.963809 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:35.963769 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8nghr" podStartSLOduration=1.674991335 podStartE2EDuration="3.963757922s" totalImagesPullingTime="2.288766587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:14:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:14:35.962200134 +0000 UTC m=+399.388424454" watchObservedRunningTime="2026-07-10 14:14:35.963757922 +0000 UTC m=+399.389982242" Jul 10 14:14:46.949430 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:46.949399 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8nghr" Jul 10 14:14:58.358765 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:58.358724 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8nghr"] Jul 10 14:14:58.359267 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:58.358985 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8nghr" podUID="f69fe418-2e6e-4652-8d73-39973db79af4" containerName="manager" containerID="cri-o://6f3f805d737e822a9d60c5d907125ea4af246ee8713343471f1c7930bc42054e" gracePeriod=2 Jul 10 14:14:58.381329 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:58.381238 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8nghr"] Jul 10 14:14:58.393128 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:14:58.393092 2579 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f69fe418-2e6e-4652-8d73-39973db79af4\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-8nghr\": pods \"limitador-operator-controller-manager-859d7b78bd-8nghr\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8nghr" Jul 10 14:14:58.401232 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:58.401207 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxh6s"] Jul 10 14:14:58.401577 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:58.401563 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f69fe418-2e6e-4652-8d73-39973db79af4" containerName="manager" Jul 10 14:14:58.401577 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:58.401577 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f69fe418-2e6e-4652-8d73-39973db79af4" containerName="manager" Jul 10 14:14:58.401709 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:58.401645 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f69fe418-2e6e-4652-8d73-39973db79af4" containerName="manager" Jul 10 14:14:58.404621 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:58.404602 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxh6s" Jul 10 14:14:58.407589 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:14:58.407564 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8nghr\" is forbidden: User \"system:node:ip-10-0-135-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-64.ec2.internal' and this object" podUID="f69fe418-2e6e-4652-8d73-39973db79af4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8nghr" Jul 10 14:14:58.420460 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:58.420433 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxh6s"] Jul 10 14:14:58.510790 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:58.510756 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l82ch\" (UniqueName: \"kubernetes.io/projected/12e1b218-be9a-4271-a142-be336da650d9-kube-api-access-l82ch\") pod \"limitador-operator-controller-manager-859d7b78bd-dxh6s\" (UID: \"12e1b218-be9a-4271-a142-be336da650d9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxh6s" Jul 10 14:14:58.594099 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:58.594076 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8nghr" Jul 10 14:14:58.596778 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:14:58.596753 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8nghr\" is forbidden: User \"system:node:ip-10-0-135-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-64.ec2.internal' and this object" podUID="f69fe418-2e6e-4652-8d73-39973db79af4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8nghr" Jul 10 14:14:58.611707 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:58.611658 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2r5fs\" (UniqueName: \"kubernetes.io/projected/f69fe418-2e6e-4652-8d73-39973db79af4-kube-api-access-2r5fs\") pod \"f69fe418-2e6e-4652-8d73-39973db79af4\" (UID: \"f69fe418-2e6e-4652-8d73-39973db79af4\") " Jul 10 14:14:58.611787 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:58.611774 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l82ch\" (UniqueName: \"kubernetes.io/projected/12e1b218-be9a-4271-a142-be336da650d9-kube-api-access-l82ch\") pod \"limitador-operator-controller-manager-859d7b78bd-dxh6s\" (UID: \"12e1b218-be9a-4271-a142-be336da650d9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxh6s" Jul 10 14:14:58.613684 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:58.613655 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f69fe418-2e6e-4652-8d73-39973db79af4-kube-api-access-2r5fs" (OuterVolumeSpecName: "kube-api-access-2r5fs") pod "f69fe418-2e6e-4652-8d73-39973db79af4" (UID: "f69fe418-2e6e-4652-8d73-39973db79af4"). InnerVolumeSpecName "kube-api-access-2r5fs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:14:58.622668 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:58.622646 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l82ch\" (UniqueName: \"kubernetes.io/projected/12e1b218-be9a-4271-a142-be336da650d9-kube-api-access-l82ch\") pod \"limitador-operator-controller-manager-859d7b78bd-dxh6s\" (UID: \"12e1b218-be9a-4271-a142-be336da650d9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxh6s" Jul 10 14:14:58.713279 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:58.713244 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2r5fs\" (UniqueName: \"kubernetes.io/projected/f69fe418-2e6e-4652-8d73-39973db79af4-kube-api-access-2r5fs\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:14:58.742177 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:58.742148 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxh6s" Jul 10 14:14:58.881700 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:58.881677 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxh6s"] Jul 10 14:14:58.883738 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:14:58.883713 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12e1b218_be9a_4271_a142_be336da650d9.slice/crio-4efa60db7744c765d20aea3873402d7c21ea6e851651e257b86984b7d6cb0493 WatchSource:0}: Error finding container 4efa60db7744c765d20aea3873402d7c21ea6e851651e257b86984b7d6cb0493: Status 404 returned error can't find the container with id 4efa60db7744c765d20aea3873402d7c21ea6e851651e257b86984b7d6cb0493 Jul 10 14:14:59.048985 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:59.048937 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxh6s" event={"ID":"12e1b218-be9a-4271-a142-be336da650d9","Type":"ContainerStarted","Data":"4b4c3c0a3a1908eb98c0313e8404da8d1463e5c8331a317dfe17485666969800"} Jul 10 14:14:59.049170 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:59.049000 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxh6s" event={"ID":"12e1b218-be9a-4271-a142-be336da650d9","Type":"ContainerStarted","Data":"4efa60db7744c765d20aea3873402d7c21ea6e851651e257b86984b7d6cb0493"} Jul 10 14:14:59.049170 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:59.049087 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxh6s" Jul 10 14:14:59.050221 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:59.050203 2579 generic.go:356] "Generic (PLEG): container finished" podID="f69fe418-2e6e-4652-8d73-39973db79af4" containerID="6f3f805d737e822a9d60c5d907125ea4af246ee8713343471f1c7930bc42054e" exitCode=0 Jul 10 14:14:59.050308 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:59.050241 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8nghr" Jul 10 14:14:59.050308 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:59.050263 2579 scope.go:117] "RemoveContainer" containerID="6f3f805d737e822a9d60c5d907125ea4af246ee8713343471f1c7930bc42054e" Jul 10 14:14:59.051903 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:14:59.051883 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8nghr\" is forbidden: User \"system:node:ip-10-0-135-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-64.ec2.internal' and this object" podUID="f69fe418-2e6e-4652-8d73-39973db79af4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8nghr" Jul 10 14:14:59.059005 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:59.058990 2579 scope.go:117] "RemoveContainer" containerID="6f3f805d737e822a9d60c5d907125ea4af246ee8713343471f1c7930bc42054e" Jul 10 14:14:59.059251 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:14:59.059234 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f3f805d737e822a9d60c5d907125ea4af246ee8713343471f1c7930bc42054e\": container with ID starting with 6f3f805d737e822a9d60c5d907125ea4af246ee8713343471f1c7930bc42054e not found: ID does not exist" containerID="6f3f805d737e822a9d60c5d907125ea4af246ee8713343471f1c7930bc42054e" Jul 10 14:14:59.059299 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:59.059260 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f3f805d737e822a9d60c5d907125ea4af246ee8713343471f1c7930bc42054e"} err="failed to get container status \"6f3f805d737e822a9d60c5d907125ea4af246ee8713343471f1c7930bc42054e\": rpc error: code = NotFound desc = could not find container \"6f3f805d737e822a9d60c5d907125ea4af246ee8713343471f1c7930bc42054e\": container with ID starting with 6f3f805d737e822a9d60c5d907125ea4af246ee8713343471f1c7930bc42054e not found: ID does not exist" Jul 10 14:14:59.073359 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:59.073313 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxh6s" podStartSLOduration=1.0733016 podStartE2EDuration="1.0733016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:14:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:14:59.071854063 +0000 UTC m=+422.498078384" watchObservedRunningTime="2026-07-10 14:14:59.0733016 +0000 UTC m=+422.499525919" Jul 10 14:14:59.074362 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:14:59.074340 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8nghr\" is forbidden: User \"system:node:ip-10-0-135-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-64.ec2.internal' and this object" podUID="f69fe418-2e6e-4652-8d73-39973db79af4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8nghr" Jul 10 14:14:59.102171 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:14:59.102150 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f69fe418-2e6e-4652-8d73-39973db79af4" path="/var/lib/kubelet/pods/f69fe418-2e6e-4652-8d73-39973db79af4/volumes" Jul 10 14:15:10.057748 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:10.057717 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dxh6s" Jul 10 14:15:40.055676 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.055639 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm"] Jul 10 14:15:40.059672 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.059653 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:15:40.063128 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.063110 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-hgllh\"" Jul 10 14:15:40.069784 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.069762 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm"] Jul 10 14:15:40.156701 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.156671 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b70e341-1ab3-4e0b-a724-ecb87b6ec91f-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9fxmm\" (UID: \"7b70e341-1ab3-4e0b-a724-ecb87b6ec91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:15:40.156872 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.156713 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b70e341-1ab3-4e0b-a724-ecb87b6ec91f-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-9fxmm\" (UID: \"7b70e341-1ab3-4e0b-a724-ecb87b6ec91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:15:40.156872 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.156745 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b70e341-1ab3-4e0b-a724-ecb87b6ec91f-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9fxmm\" (UID: \"7b70e341-1ab3-4e0b-a724-ecb87b6ec91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:15:40.156872 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.156765 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b70e341-1ab3-4e0b-a724-ecb87b6ec91f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-9fxmm\" (UID: \"7b70e341-1ab3-4e0b-a724-ecb87b6ec91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:15:40.156872 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.156782 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b70e341-1ab3-4e0b-a724-ecb87b6ec91f-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-9fxmm\" (UID: \"7b70e341-1ab3-4e0b-a724-ecb87b6ec91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:15:40.156872 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.156800 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b70e341-1ab3-4e0b-a724-ecb87b6ec91f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-9fxmm\" (UID: \"7b70e341-1ab3-4e0b-a724-ecb87b6ec91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:15:40.157086 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.156877 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b70e341-1ab3-4e0b-a724-ecb87b6ec91f-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-9fxmm\" (UID: \"7b70e341-1ab3-4e0b-a724-ecb87b6ec91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:15:40.157086 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.156899 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b70e341-1ab3-4e0b-a724-ecb87b6ec91f-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-9fxmm\" (UID: \"7b70e341-1ab3-4e0b-a724-ecb87b6ec91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:15:40.157086 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.156923 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksbj5\" (UniqueName: \"kubernetes.io/projected/7b70e341-1ab3-4e0b-a724-ecb87b6ec91f-kube-api-access-ksbj5\") pod \"maas-default-gateway-openshift-default-56654dcf7-9fxmm\" (UID: \"7b70e341-1ab3-4e0b-a724-ecb87b6ec91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:15:40.258311 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.258282 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b70e341-1ab3-4e0b-a724-ecb87b6ec91f-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9fxmm\" (UID: \"7b70e341-1ab3-4e0b-a724-ecb87b6ec91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:15:40.258507 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.258321 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b70e341-1ab3-4e0b-a724-ecb87b6ec91f-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-9fxmm\" (UID: \"7b70e341-1ab3-4e0b-a724-ecb87b6ec91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:15:40.258507 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.258339 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b70e341-1ab3-4e0b-a724-ecb87b6ec91f-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9fxmm\" (UID: \"7b70e341-1ab3-4e0b-a724-ecb87b6ec91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:15:40.258507 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.258361 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b70e341-1ab3-4e0b-a724-ecb87b6ec91f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-9fxmm\" (UID: \"7b70e341-1ab3-4e0b-a724-ecb87b6ec91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:15:40.258507 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.258387 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b70e341-1ab3-4e0b-a724-ecb87b6ec91f-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-9fxmm\" (UID: \"7b70e341-1ab3-4e0b-a724-ecb87b6ec91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:15:40.258507 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.258414 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b70e341-1ab3-4e0b-a724-ecb87b6ec91f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-9fxmm\" (UID: \"7b70e341-1ab3-4e0b-a724-ecb87b6ec91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:15:40.258507 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.258458 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b70e341-1ab3-4e0b-a724-ecb87b6ec91f-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-9fxmm\" (UID: \"7b70e341-1ab3-4e0b-a724-ecb87b6ec91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:15:40.258507 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.258485 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b70e341-1ab3-4e0b-a724-ecb87b6ec91f-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-9fxmm\" (UID: \"7b70e341-1ab3-4e0b-a724-ecb87b6ec91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:15:40.258872 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.258516 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksbj5\" (UniqueName: \"kubernetes.io/projected/7b70e341-1ab3-4e0b-a724-ecb87b6ec91f-kube-api-access-ksbj5\") pod \"maas-default-gateway-openshift-default-56654dcf7-9fxmm\" (UID: \"7b70e341-1ab3-4e0b-a724-ecb87b6ec91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:15:40.258872 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.258746 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b70e341-1ab3-4e0b-a724-ecb87b6ec91f-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9fxmm\" (UID: \"7b70e341-1ab3-4e0b-a724-ecb87b6ec91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:15:40.258872 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.258838 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b70e341-1ab3-4e0b-a724-ecb87b6ec91f-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-9fxmm\" (UID: \"7b70e341-1ab3-4e0b-a724-ecb87b6ec91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:15:40.259041 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.258941 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b70e341-1ab3-4e0b-a724-ecb87b6ec91f-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9fxmm\" (UID: \"7b70e341-1ab3-4e0b-a724-ecb87b6ec91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:15:40.259095 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.259033 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b70e341-1ab3-4e0b-a724-ecb87b6ec91f-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-9fxmm\" (UID: \"7b70e341-1ab3-4e0b-a724-ecb87b6ec91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:15:40.259268 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.259245 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b70e341-1ab3-4e0b-a724-ecb87b6ec91f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-9fxmm\" (UID: \"7b70e341-1ab3-4e0b-a724-ecb87b6ec91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:15:40.260779 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.260756 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b70e341-1ab3-4e0b-a724-ecb87b6ec91f-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-9fxmm\" (UID: \"7b70e341-1ab3-4e0b-a724-ecb87b6ec91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:15:40.260927 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.260903 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b70e341-1ab3-4e0b-a724-ecb87b6ec91f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-9fxmm\" (UID: \"7b70e341-1ab3-4e0b-a724-ecb87b6ec91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:15:40.268423 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.268402 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b70e341-1ab3-4e0b-a724-ecb87b6ec91f-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-9fxmm\" (UID: \"7b70e341-1ab3-4e0b-a724-ecb87b6ec91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:15:40.268552 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.268520 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksbj5\" (UniqueName: \"kubernetes.io/projected/7b70e341-1ab3-4e0b-a724-ecb87b6ec91f-kube-api-access-ksbj5\") pod \"maas-default-gateway-openshift-default-56654dcf7-9fxmm\" (UID: \"7b70e341-1ab3-4e0b-a724-ecb87b6ec91f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:15:40.371121 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.371089 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:15:40.505183 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.505159 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm"] Jul 10 14:15:40.507721 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:15:40.507696 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b70e341_1ab3_4e0b_a724_ecb87b6ec91f.slice/crio-02dabecab97ca0b63630ee1fc1f0ecabec019ac11e4b6a0c3704a950e6c27bec WatchSource:0}: Error finding container 02dabecab97ca0b63630ee1fc1f0ecabec019ac11e4b6a0c3704a950e6c27bec: Status 404 returned error can't find the container with id 02dabecab97ca0b63630ee1fc1f0ecabec019ac11e4b6a0c3704a950e6c27bec Jul 10 14:15:40.510038 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.510005 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:15:40.510131 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.510068 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:15:40.510131 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:40.510096 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:15:41.237923 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:41.237889 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" event={"ID":"7b70e341-1ab3-4e0b-a724-ecb87b6ec91f","Type":"ContainerStarted","Data":"5a599ee3b4a1266fa22c8ece6bf9d906fbad2e3503ad5bb2e68bc593235fd121"} Jul 10 14:15:41.238315 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:41.237938 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" event={"ID":"7b70e341-1ab3-4e0b-a724-ecb87b6ec91f","Type":"ContainerStarted","Data":"02dabecab97ca0b63630ee1fc1f0ecabec019ac11e4b6a0c3704a950e6c27bec"} Jul 10 14:15:41.262855 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:41.262810 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" podStartSLOduration=1.262794707 podStartE2EDuration="1.262794707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:15:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:15:41.260693519 +0000 UTC m=+464.686917834" watchObservedRunningTime="2026-07-10 14:15:41.262794707 +0000 UTC m=+464.689019026" Jul 10 14:15:41.372103 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:41.372074 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:15:41.377925 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:41.377899 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:15:42.242285 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:42.242251 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:15:42.243207 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:15:42.243186 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:16:14.435986 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:16:14.435937 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-cqd6z"] Jul 10 14:16:14.441067 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:16:14.441041 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cqd6z" Jul 10 14:16:14.445969 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:16:14.445924 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 10 14:16:14.446080 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:16:14.446050 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 10 14:16:14.447457 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:16:14.447413 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-6ktbk\"" Jul 10 14:16:14.447457 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:16:14.447427 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 10 14:16:14.450752 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:16:14.450729 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-cqd6z"] Jul 10 14:16:14.543682 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:16:14.543645 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpzs7\" (UniqueName: \"kubernetes.io/projected/dad11190-2bf2-401d-bc19-498260448de8-kube-api-access-qpzs7\") pod \"postgres-69fb4594cf-cqd6z\" (UID: \"dad11190-2bf2-401d-bc19-498260448de8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cqd6z" Jul 10 14:16:14.543860 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:16:14.543768 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dad11190-2bf2-401d-bc19-498260448de8-data\") pod \"postgres-69fb4594cf-cqd6z\" (UID: \"dad11190-2bf2-401d-bc19-498260448de8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cqd6z" Jul 10 14:16:14.644807 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:16:14.644775 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dad11190-2bf2-401d-bc19-498260448de8-data\") pod \"postgres-69fb4594cf-cqd6z\" (UID: \"dad11190-2bf2-401d-bc19-498260448de8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cqd6z" Jul 10 14:16:14.644807 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:16:14.644812 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpzs7\" (UniqueName: \"kubernetes.io/projected/dad11190-2bf2-401d-bc19-498260448de8-kube-api-access-qpzs7\") pod \"postgres-69fb4594cf-cqd6z\" (UID: \"dad11190-2bf2-401d-bc19-498260448de8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cqd6z" Jul 10 14:16:14.645170 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:16:14.645152 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dad11190-2bf2-401d-bc19-498260448de8-data\") pod \"postgres-69fb4594cf-cqd6z\" (UID: \"dad11190-2bf2-401d-bc19-498260448de8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cqd6z" Jul 10 14:16:14.657709 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:16:14.657682 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpzs7\" (UniqueName: \"kubernetes.io/projected/dad11190-2bf2-401d-bc19-498260448de8-kube-api-access-qpzs7\") pod \"postgres-69fb4594cf-cqd6z\" (UID: \"dad11190-2bf2-401d-bc19-498260448de8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cqd6z" Jul 10 14:16:14.752460 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:16:14.752380 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cqd6z" Jul 10 14:16:14.883022 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:16:14.883000 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-cqd6z"] Jul 10 14:16:14.885041 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:16:14.885011 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad11190_2bf2_401d_bc19_498260448de8.slice/crio-06645571975ec57a52b08412beaf29ec46c97ad1a5ac718cd399493f928263d6 WatchSource:0}: Error finding container 06645571975ec57a52b08412beaf29ec46c97ad1a5ac718cd399493f928263d6: Status 404 returned error can't find the container with id 06645571975ec57a52b08412beaf29ec46c97ad1a5ac718cd399493f928263d6 Jul 10 14:16:15.387357 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:16:15.387324 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cqd6z" event={"ID":"dad11190-2bf2-401d-bc19-498260448de8","Type":"ContainerStarted","Data":"06645571975ec57a52b08412beaf29ec46c97ad1a5ac718cd399493f928263d6"} Jul 10 14:16:20.416989 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:16:20.416945 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cqd6z" event={"ID":"dad11190-2bf2-401d-bc19-498260448de8","Type":"ContainerStarted","Data":"86e3a84b32fda207a37a62e094401197d1b6cf00db7347b1b021e7418b83a754"} Jul 10 14:16:20.417437 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:16:20.417019 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cqd6z" Jul 10 14:16:20.436683 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:16:20.436628 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cqd6z" podStartSLOduration=1.724190087 podStartE2EDuration="6.43661179s" totalImagesPullingTime="4.712421703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:16:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:16:20.434979754 +0000 UTC m=+503.861204073" watchObservedRunningTime="2026-07-10 14:16:20.43661179 +0000 UTC m=+503.862836110" Jul 10 14:16:26.451296 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:16:26.451267 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cqd6z" Jul 10 14:17:18.680912 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:18.680875 2579 generic.go:356] "Generic (PLEG): container finished" podID="7b70e341-1ab3-4e0b-a724-ecb87b6ec91f" containerID="5a599ee3b4a1266fa22c8ece6bf9d906fbad2e3503ad5bb2e68bc593235fd121" exitCode=0 Jul 10 14:17:18.681320 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:18.680958 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" event={"ID":"7b70e341-1ab3-4e0b-a724-ecb87b6ec91f","Type":"ContainerDied","Data":"5a599ee3b4a1266fa22c8ece6bf9d906fbad2e3503ad5bb2e68bc593235fd121"} Jul 10 14:17:18.681320 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:18.681310 2579 scope.go:117] "RemoveContainer" containerID="5a599ee3b4a1266fa22c8ece6bf9d906fbad2e3503ad5bb2e68bc593235fd121" Jul 10 14:17:18.682271 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:18.682245 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:17:18.682337 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:18.682304 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:17:18.682372 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:18.682336 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:17:19.687489 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:19.687448 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" event={"ID":"7b70e341-1ab3-4e0b-a724-ecb87b6ec91f","Type":"ContainerStarted","Data":"34d17a3d05ab92a6005efb09a46c5e9656064c4aea48cc3d8ac42f55b834c366"} Jul 10 14:17:20.372150 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:20.372113 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:17:20.372330 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:20.372298 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9fxmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Jul 10 14:17:20.372395 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:20.372374 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" podUID="7b70e341-1ab3-4e0b-a724-ecb87b6ec91f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Jul 10 14:17:21.372041 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:21.372004 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9fxmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Jul 10 14:17:21.372436 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:21.372065 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" podUID="7b70e341-1ab3-4e0b-a724-ecb87b6ec91f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Jul 10 14:17:22.372053 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:22.372014 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9fxmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Jul 10 14:17:22.372437 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:22.372072 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" podUID="7b70e341-1ab3-4e0b-a724-ecb87b6ec91f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Jul 10 14:17:23.372499 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:23.372466 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9fxmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Jul 10 14:17:23.372890 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:23.372520 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" podUID="7b70e341-1ab3-4e0b-a724-ecb87b6ec91f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Jul 10 14:17:24.375176 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:24.375144 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:17:24.375600 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:24.375403 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:17:24.376145 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:24.376131 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9fxmm" Jul 10 14:17:29.060907 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:29.060859 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr"] Jul 10 14:17:29.064385 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:29.064365 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr" Jul 10 14:17:29.068498 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:29.068477 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8rsbh\"" Jul 10 14:17:29.068611 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:29.068505 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 10 14:17:29.068611 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:29.068497 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 10 14:17:29.068737 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:29.068477 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 10 14:17:29.069301 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:29.069281 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12140959-558c-4aa1-847e-bf3bd0cf731d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr\" (UID: \"12140959-558c-4aa1-847e-bf3bd0cf731d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr" Jul 10 14:17:29.069408 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:29.069328 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12140959-558c-4aa1-847e-bf3bd0cf731d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr\" (UID: \"12140959-558c-4aa1-847e-bf3bd0cf731d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr" Jul 10 14:17:29.069408 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:29.069353 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/12140959-558c-4aa1-847e-bf3bd0cf731d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr\" (UID: \"12140959-558c-4aa1-847e-bf3bd0cf731d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr" Jul 10 14:17:29.069408 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:29.069394 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/12140959-558c-4aa1-847e-bf3bd0cf731d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr\" (UID: \"12140959-558c-4aa1-847e-bf3bd0cf731d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr" Jul 10 14:17:29.069573 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:29.069549 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvq8s\" (UniqueName: \"kubernetes.io/projected/12140959-558c-4aa1-847e-bf3bd0cf731d-kube-api-access-fvq8s\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr\" (UID: \"12140959-558c-4aa1-847e-bf3bd0cf731d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr" Jul 10 14:17:29.069617 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:29.069601 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12140959-558c-4aa1-847e-bf3bd0cf731d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr\" (UID: \"12140959-558c-4aa1-847e-bf3bd0cf731d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr" Jul 10 14:17:29.077182 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:29.077155 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr"] Jul 10 14:17:29.170710 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:29.170679 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvq8s\" (UniqueName: \"kubernetes.io/projected/12140959-558c-4aa1-847e-bf3bd0cf731d-kube-api-access-fvq8s\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr\" (UID: \"12140959-558c-4aa1-847e-bf3bd0cf731d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr" Jul 10 14:17:29.170710 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:29.170717 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12140959-558c-4aa1-847e-bf3bd0cf731d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr\" (UID: \"12140959-558c-4aa1-847e-bf3bd0cf731d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr" Jul 10 14:17:29.170989 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:29.170747 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12140959-558c-4aa1-847e-bf3bd0cf731d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr\" (UID: \"12140959-558c-4aa1-847e-bf3bd0cf731d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr" Jul 10 14:17:29.170989 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:29.170922 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12140959-558c-4aa1-847e-bf3bd0cf731d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr\" (UID: \"12140959-558c-4aa1-847e-bf3bd0cf731d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr" Jul 10 14:17:29.170989 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:29.170983 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/12140959-558c-4aa1-847e-bf3bd0cf731d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr\" (UID: \"12140959-558c-4aa1-847e-bf3bd0cf731d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr" Jul 10 14:17:29.171155 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:29.171023 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/12140959-558c-4aa1-847e-bf3bd0cf731d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr\" (UID: \"12140959-558c-4aa1-847e-bf3bd0cf731d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr" Jul 10 14:17:29.171155 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:29.171115 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12140959-558c-4aa1-847e-bf3bd0cf731d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr\" (UID: \"12140959-558c-4aa1-847e-bf3bd0cf731d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr" Jul 10 14:17:29.171276 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:29.171254 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12140959-558c-4aa1-847e-bf3bd0cf731d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr\" (UID: \"12140959-558c-4aa1-847e-bf3bd0cf731d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr" Jul 10 14:17:29.171374 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:29.171354 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/12140959-558c-4aa1-847e-bf3bd0cf731d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr\" (UID: \"12140959-558c-4aa1-847e-bf3bd0cf731d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr" Jul 10 14:17:29.173103 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:29.173078 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/12140959-558c-4aa1-847e-bf3bd0cf731d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr\" (UID: \"12140959-558c-4aa1-847e-bf3bd0cf731d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr" Jul 10 14:17:29.173276 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:29.173256 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12140959-558c-4aa1-847e-bf3bd0cf731d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr\" (UID: \"12140959-558c-4aa1-847e-bf3bd0cf731d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr" Jul 10 14:17:29.179515 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:29.179486 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvq8s\" (UniqueName: \"kubernetes.io/projected/12140959-558c-4aa1-847e-bf3bd0cf731d-kube-api-access-fvq8s\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr\" (UID: \"12140959-558c-4aa1-847e-bf3bd0cf731d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr" Jul 10 14:17:29.377173 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:29.377141 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr" Jul 10 14:17:29.511594 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:29.511569 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr"] Jul 10 14:17:29.514588 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:17:29.514545 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12140959_558c_4aa1_847e_bf3bd0cf731d.slice/crio-7997106f7441f377d88a9eed444de592b28e161c66a9ff492473277fa348aca9 WatchSource:0}: Error finding container 7997106f7441f377d88a9eed444de592b28e161c66a9ff492473277fa348aca9: Status 404 returned error can't find the container with id 7997106f7441f377d88a9eed444de592b28e161c66a9ff492473277fa348aca9 Jul 10 14:17:29.737021 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:29.736913 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr" event={"ID":"12140959-558c-4aa1-847e-bf3bd0cf731d","Type":"ContainerStarted","Data":"7997106f7441f377d88a9eed444de592b28e161c66a9ff492473277fa348aca9"} Jul 10 14:17:31.747524 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:31.747491 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr" event={"ID":"12140959-558c-4aa1-847e-bf3bd0cf731d","Type":"ContainerStarted","Data":"9394c0a555a72100d87c043dba935aea68974988198aeca338c498eebb691937"} Jul 10 14:17:31.770404 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:31.766844 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr" podStartSLOduration=1.59661633 podStartE2EDuration="2.766822742s" totalImagesPullingTime="1.170206412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:17:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:17:31.763384157 +0000 UTC m=+575.189608491" watchObservedRunningTime="2026-07-10 14:17:31.766822742 +0000 UTC m=+575.193047062" Jul 10 14:17:39.377964 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:39.377917 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr" Jul 10 14:17:39.378385 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:39.377994 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr" Jul 10 14:17:39.390232 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:39.390211 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr" Jul 10 14:17:39.795301 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:39.795223 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr" Jul 10 14:17:56.563765 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:56.563729 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw"] Jul 10 14:17:56.567159 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:56.567142 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw" Jul 10 14:17:56.570034 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:56.570012 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 10 14:17:56.583182 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:56.583157 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw"] Jul 10 14:17:56.707403 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:56.707370 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5aa2c284-9217-4db2-bc83-337275e0cea6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw\" (UID: \"5aa2c284-9217-4db2-bc83-337275e0cea6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw" Jul 10 14:17:56.707403 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:56.707410 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5aa2c284-9217-4db2-bc83-337275e0cea6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw\" (UID: \"5aa2c284-9217-4db2-bc83-337275e0cea6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw" Jul 10 14:17:56.707621 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:56.707454 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqjc7\" (UniqueName: \"kubernetes.io/projected/5aa2c284-9217-4db2-bc83-337275e0cea6-kube-api-access-tqjc7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw\" (UID: \"5aa2c284-9217-4db2-bc83-337275e0cea6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw" Jul 10 14:17:56.707621 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:56.707489 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5aa2c284-9217-4db2-bc83-337275e0cea6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw\" (UID: \"5aa2c284-9217-4db2-bc83-337275e0cea6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw" Jul 10 14:17:56.707621 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:56.707510 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5aa2c284-9217-4db2-bc83-337275e0cea6-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw\" (UID: \"5aa2c284-9217-4db2-bc83-337275e0cea6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw" Jul 10 14:17:56.707621 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:56.707550 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5aa2c284-9217-4db2-bc83-337275e0cea6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw\" (UID: \"5aa2c284-9217-4db2-bc83-337275e0cea6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw" Jul 10 14:17:56.808340 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:56.808305 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5aa2c284-9217-4db2-bc83-337275e0cea6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw\" (UID: \"5aa2c284-9217-4db2-bc83-337275e0cea6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw" Jul 10 14:17:56.808527 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:56.808345 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5aa2c284-9217-4db2-bc83-337275e0cea6-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw\" (UID: \"5aa2c284-9217-4db2-bc83-337275e0cea6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw" Jul 10 14:17:56.808527 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:56.808374 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5aa2c284-9217-4db2-bc83-337275e0cea6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw\" (UID: \"5aa2c284-9217-4db2-bc83-337275e0cea6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw" Jul 10 14:17:56.808527 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:56.808437 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5aa2c284-9217-4db2-bc83-337275e0cea6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw\" (UID: \"5aa2c284-9217-4db2-bc83-337275e0cea6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw" Jul 10 14:17:56.808527 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:56.808468 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5aa2c284-9217-4db2-bc83-337275e0cea6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw\" (UID: \"5aa2c284-9217-4db2-bc83-337275e0cea6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw" Jul 10 14:17:56.808527 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:56.808510 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqjc7\" (UniqueName: \"kubernetes.io/projected/5aa2c284-9217-4db2-bc83-337275e0cea6-kube-api-access-tqjc7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw\" (UID: \"5aa2c284-9217-4db2-bc83-337275e0cea6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw" Jul 10 14:17:56.808770 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:56.808724 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5aa2c284-9217-4db2-bc83-337275e0cea6-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw\" (UID: \"5aa2c284-9217-4db2-bc83-337275e0cea6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw" Jul 10 14:17:56.808827 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:56.808763 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5aa2c284-9217-4db2-bc83-337275e0cea6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw\" (UID: \"5aa2c284-9217-4db2-bc83-337275e0cea6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw" Jul 10 14:17:56.808884 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:56.808872 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5aa2c284-9217-4db2-bc83-337275e0cea6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw\" (UID: \"5aa2c284-9217-4db2-bc83-337275e0cea6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw" Jul 10 14:17:56.810710 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:56.810688 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5aa2c284-9217-4db2-bc83-337275e0cea6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw\" (UID: \"5aa2c284-9217-4db2-bc83-337275e0cea6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw" Jul 10 14:17:56.811015 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:56.810995 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5aa2c284-9217-4db2-bc83-337275e0cea6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw\" (UID: \"5aa2c284-9217-4db2-bc83-337275e0cea6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw" Jul 10 14:17:56.816691 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:56.816625 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqjc7\" (UniqueName: \"kubernetes.io/projected/5aa2c284-9217-4db2-bc83-337275e0cea6-kube-api-access-tqjc7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw\" (UID: \"5aa2c284-9217-4db2-bc83-337275e0cea6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw" Jul 10 14:17:56.877622 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:56.877599 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw" Jul 10 14:17:57.010551 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:57.010520 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw"] Jul 10 14:17:57.012609 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:17:57.012586 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aa2c284_9217_4db2_bc83_337275e0cea6.slice/crio-4f732a6cde8571a5d01587fef1522a7badbb6935b84ffefbb9dc9be30a147d12 WatchSource:0}: Error finding container 4f732a6cde8571a5d01587fef1522a7badbb6935b84ffefbb9dc9be30a147d12: Status 404 returned error can't find the container with id 4f732a6cde8571a5d01587fef1522a7badbb6935b84ffefbb9dc9be30a147d12 Jul 10 14:17:57.127404 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:57.127371 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-znjf2_99ef7290-2248-4e0c-9fda-100370c1ac2d/console-operator/1.log" Jul 10 14:17:57.128080 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:57.128060 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-znjf2_99ef7290-2248-4e0c-9fda-100370c1ac2d/console-operator/1.log" Jul 10 14:17:57.135620 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:57.135601 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jwwrp_6ce1e1c6-c734-4df5-9079-0295f7de80f6/ovn-acl-logging/0.log" Jul 10 14:17:57.136511 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:57.136492 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jwwrp_6ce1e1c6-c734-4df5-9079-0295f7de80f6/ovn-acl-logging/0.log" Jul 10 14:17:57.871500 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:57.871468 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw" event={"ID":"5aa2c284-9217-4db2-bc83-337275e0cea6","Type":"ContainerStarted","Data":"62e2c3a795d1021f9d4a490b98229258ebbf4e9790fad736df6a3c2ca15dab80"} Jul 10 14:17:57.871862 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:57.871526 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw" event={"ID":"5aa2c284-9217-4db2-bc83-337275e0cea6","Type":"ContainerStarted","Data":"4f732a6cde8571a5d01587fef1522a7badbb6935b84ffefbb9dc9be30a147d12"} Jul 10 14:17:57.895454 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:17:57.895405 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw" podStartSLOduration=1.7051758380000002 podStartE2EDuration="1.895388901s" totalImagesPullingTime="190.213063ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:17:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:17:57.894291883 +0000 UTC m=+601.320516204" watchObservedRunningTime="2026-07-10 14:17:57.895388901 +0000 UTC m=+601.321613222" Jul 10 14:18:06.878937 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:18:06.878767 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw" Jul 10 14:18:06.878937 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:18:06.878840 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw" Jul 10 14:18:06.894644 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:18:06.894617 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw" Jul 10 14:18:06.925250 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:18:06.925220 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw" Jul 10 14:22:57.153931 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:22:57.153846 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-znjf2_99ef7290-2248-4e0c-9fda-100370c1ac2d/console-operator/1.log" Jul 10 14:22:57.156161 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:22:57.156139 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-znjf2_99ef7290-2248-4e0c-9fda-100370c1ac2d/console-operator/1.log" Jul 10 14:22:57.162627 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:22:57.162607 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jwwrp_6ce1e1c6-c734-4df5-9079-0295f7de80f6/ovn-acl-logging/0.log" Jul 10 14:22:57.165094 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:22:57.165073 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jwwrp_6ce1e1c6-c734-4df5-9079-0295f7de80f6/ovn-acl-logging/0.log" Jul 10 14:27:57.183733 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:27:57.183700 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-znjf2_99ef7290-2248-4e0c-9fda-100370c1ac2d/console-operator/1.log" Jul 10 14:27:57.187224 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:27:57.187201 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-znjf2_99ef7290-2248-4e0c-9fda-100370c1ac2d/console-operator/1.log" Jul 10 14:27:57.192820 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:27:57.192797 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jwwrp_6ce1e1c6-c734-4df5-9079-0295f7de80f6/ovn-acl-logging/0.log" Jul 10 14:27:57.196140 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:27:57.196121 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jwwrp_6ce1e1c6-c734-4df5-9079-0295f7de80f6/ovn-acl-logging/0.log" Jul 10 14:32:42.911828 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:42.911798 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw"] Jul 10 14:32:42.915093 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:42.915074 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:42.929852 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:42.929834 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-dc35352e-openshift-default-dockercfg-qqd7g\"" Jul 10 14:32:42.979275 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:42.979242 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw"] Jul 10 14:32:43.084227 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.084196 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b273361-2eb3-4803-9983-65b5b6a62897-istio-envoy\") pod \"e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:43.084227 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.084226 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b273361-2eb3-4803-9983-65b5b6a62897-istio-data\") pod \"e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:43.084420 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.084247 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b273361-2eb3-4803-9983-65b5b6a62897-workload-socket\") pod \"e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:43.084420 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.084294 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b273361-2eb3-4803-9983-65b5b6a62897-istiod-ca-cert\") pod \"e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:43.084420 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.084332 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b273361-2eb3-4803-9983-65b5b6a62897-istio-token\") pod \"e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:43.084420 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.084352 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b273361-2eb3-4803-9983-65b5b6a62897-workload-certs\") pod \"e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:43.084544 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.084447 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b273361-2eb3-4803-9983-65b5b6a62897-istio-podinfo\") pod \"e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:43.084544 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.084466 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b273361-2eb3-4803-9983-65b5b6a62897-credential-socket\") pod \"e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:43.084544 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.084488 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nskn7\" (UniqueName: \"kubernetes.io/projected/9b273361-2eb3-4803-9983-65b5b6a62897-kube-api-access-nskn7\") pod \"e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:43.185770 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.185692 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b273361-2eb3-4803-9983-65b5b6a62897-istio-podinfo\") pod \"e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:43.185770 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.185723 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b273361-2eb3-4803-9983-65b5b6a62897-credential-socket\") pod \"e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:43.185770 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.185745 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nskn7\" (UniqueName: \"kubernetes.io/projected/9b273361-2eb3-4803-9983-65b5b6a62897-kube-api-access-nskn7\") pod \"e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:43.186072 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.185819 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b273361-2eb3-4803-9983-65b5b6a62897-istio-envoy\") pod \"e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:43.186072 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.185841 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b273361-2eb3-4803-9983-65b5b6a62897-istio-data\") pod \"e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:43.186072 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.185872 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b273361-2eb3-4803-9983-65b5b6a62897-workload-socket\") pod \"e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:43.186072 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.185899 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b273361-2eb3-4803-9983-65b5b6a62897-istiod-ca-cert\") pod \"e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:43.186072 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.185929 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b273361-2eb3-4803-9983-65b5b6a62897-istio-token\") pod \"e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:43.186072 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.185980 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b273361-2eb3-4803-9983-65b5b6a62897-workload-certs\") pod \"e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:43.186379 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.186209 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b273361-2eb3-4803-9983-65b5b6a62897-credential-socket\") pod \"e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:43.186379 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.186243 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b273361-2eb3-4803-9983-65b5b6a62897-workload-socket\") pod \"e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:43.186379 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.186296 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b273361-2eb3-4803-9983-65b5b6a62897-istio-data\") pod \"e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:43.186572 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.186546 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b273361-2eb3-4803-9983-65b5b6a62897-workload-certs\") pod \"e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:43.186931 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.186906 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b273361-2eb3-4803-9983-65b5b6a62897-istiod-ca-cert\") pod \"e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:43.188233 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.188212 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b273361-2eb3-4803-9983-65b5b6a62897-istio-envoy\") pod \"e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:43.188362 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.188341 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b273361-2eb3-4803-9983-65b5b6a62897-istio-podinfo\") pod \"e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:43.205306 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.205283 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b273361-2eb3-4803-9983-65b5b6a62897-istio-token\") pod \"e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:43.205777 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.205758 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nskn7\" (UniqueName: \"kubernetes.io/projected/9b273361-2eb3-4803-9983-65b5b6a62897-kube-api-access-nskn7\") pod \"e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:43.225675 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.225642 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:43.367074 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.367044 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw"] Jul 10 14:32:43.368548 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:32:43.368521 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b273361_2eb3_4803_9983_65b5b6a62897.slice/crio-5e6f88248bb7fcda365670785147294638a3932070596f2090b53e2bb8d1a88a WatchSource:0}: Error finding container 5e6f88248bb7fcda365670785147294638a3932070596f2090b53e2bb8d1a88a: Status 404 returned error can't find the container with id 5e6f88248bb7fcda365670785147294638a3932070596f2090b53e2bb8d1a88a Jul 10 14:32:43.370668 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.370637 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:32:43.370774 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.370715 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:32:43.370774 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.370758 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:32:43.970859 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.970822 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" event={"ID":"9b273361-2eb3-4803-9983-65b5b6a62897","Type":"ContainerStarted","Data":"9a46cab5eb87d94c341827beec7cf76154e0094739bc283026378a29bbc7d2ed"} Jul 10 14:32:43.971370 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:43.970880 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" event={"ID":"9b273361-2eb3-4803-9983-65b5b6a62897","Type":"ContainerStarted","Data":"5e6f88248bb7fcda365670785147294638a3932070596f2090b53e2bb8d1a88a"} Jul 10 14:32:44.006550 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:44.006500 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" podStartSLOduration=2.006484785 podStartE2EDuration="2.006484785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:32:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:32:44.004096425 +0000 UTC m=+1487.430320745" watchObservedRunningTime="2026-07-10 14:32:44.006484785 +0000 UTC m=+1487.432709104" Jul 10 14:32:44.226793 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:44.226707 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:44.231855 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:44.231827 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:44.977201 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:44.977172 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:44.978241 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:44.978215 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:49.320200 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:49.320170 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw"] Jul 10 14:32:49.320711 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:49.320368 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" podUID="9b273361-2eb3-4803-9983-65b5b6a62897" containerName="istio-proxy" containerID="cri-o://9a46cab5eb87d94c341827beec7cf76154e0094739bc283026378a29bbc7d2ed" gracePeriod=30 Jul 10 14:32:55.274831 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.274763 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:55.302931 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.302905 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b273361-2eb3-4803-9983-65b5b6a62897-workload-certs\") pod \"9b273361-2eb3-4803-9983-65b5b6a62897\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " Jul 10 14:32:55.303094 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.302939 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b273361-2eb3-4803-9983-65b5b6a62897-istio-podinfo\") pod \"9b273361-2eb3-4803-9983-65b5b6a62897\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " Jul 10 14:32:55.303094 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.303016 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nskn7\" (UniqueName: \"kubernetes.io/projected/9b273361-2eb3-4803-9983-65b5b6a62897-kube-api-access-nskn7\") pod \"9b273361-2eb3-4803-9983-65b5b6a62897\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " Jul 10 14:32:55.303094 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.303044 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b273361-2eb3-4803-9983-65b5b6a62897-workload-socket\") pod \"9b273361-2eb3-4803-9983-65b5b6a62897\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " Jul 10 14:32:55.303094 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.303068 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b273361-2eb3-4803-9983-65b5b6a62897-credential-socket\") pod \"9b273361-2eb3-4803-9983-65b5b6a62897\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " Jul 10 14:32:55.303304 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.303103 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b273361-2eb3-4803-9983-65b5b6a62897-istio-data\") pod \"9b273361-2eb3-4803-9983-65b5b6a62897\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " Jul 10 14:32:55.303304 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.303154 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b273361-2eb3-4803-9983-65b5b6a62897-istio-token\") pod \"9b273361-2eb3-4803-9983-65b5b6a62897\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " Jul 10 14:32:55.303304 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.303194 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b273361-2eb3-4803-9983-65b5b6a62897-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9b273361-2eb3-4803-9983-65b5b6a62897" (UID: "9b273361-2eb3-4803-9983-65b5b6a62897"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:32:55.303304 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.303204 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b273361-2eb3-4803-9983-65b5b6a62897-istiod-ca-cert\") pod \"9b273361-2eb3-4803-9983-65b5b6a62897\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " Jul 10 14:32:55.303304 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.303286 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b273361-2eb3-4803-9983-65b5b6a62897-istio-envoy\") pod \"9b273361-2eb3-4803-9983-65b5b6a62897\" (UID: \"9b273361-2eb3-4803-9983-65b5b6a62897\") " Jul 10 14:32:55.303535 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.303325 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b273361-2eb3-4803-9983-65b5b6a62897-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9b273361-2eb3-4803-9983-65b5b6a62897" (UID: "9b273361-2eb3-4803-9983-65b5b6a62897"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:32:55.303535 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.303394 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b273361-2eb3-4803-9983-65b5b6a62897-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9b273361-2eb3-4803-9983-65b5b6a62897" (UID: "9b273361-2eb3-4803-9983-65b5b6a62897"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:32:55.303535 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.303501 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b273361-2eb3-4803-9983-65b5b6a62897-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9b273361-2eb3-4803-9983-65b5b6a62897" (UID: "9b273361-2eb3-4803-9983-65b5b6a62897"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:32:55.303670 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.303621 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b273361-2eb3-4803-9983-65b5b6a62897-workload-certs\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:32:55.303670 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.303639 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b273361-2eb3-4803-9983-65b5b6a62897-workload-socket\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:32:55.303670 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.303652 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b273361-2eb3-4803-9983-65b5b6a62897-credential-socket\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:32:55.303670 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.303666 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b273361-2eb3-4803-9983-65b5b6a62897-istiod-ca-cert\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:32:55.304064 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.304040 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b273361-2eb3-4803-9983-65b5b6a62897-istio-data" (OuterVolumeSpecName: "istio-data") pod "9b273361-2eb3-4803-9983-65b5b6a62897" (UID: "9b273361-2eb3-4803-9983-65b5b6a62897"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:32:55.305271 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.305250 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9b273361-2eb3-4803-9983-65b5b6a62897-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9b273361-2eb3-4803-9983-65b5b6a62897" (UID: "9b273361-2eb3-4803-9983-65b5b6a62897"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 14:32:55.305360 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.305333 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b273361-2eb3-4803-9983-65b5b6a62897-istio-token" (OuterVolumeSpecName: "istio-token") pod "9b273361-2eb3-4803-9983-65b5b6a62897" (UID: "9b273361-2eb3-4803-9983-65b5b6a62897"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:32:55.305571 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.305551 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b273361-2eb3-4803-9983-65b5b6a62897-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9b273361-2eb3-4803-9983-65b5b6a62897" (UID: "9b273361-2eb3-4803-9983-65b5b6a62897"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:32:55.305571 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.305560 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b273361-2eb3-4803-9983-65b5b6a62897-kube-api-access-nskn7" (OuterVolumeSpecName: "kube-api-access-nskn7") pod "9b273361-2eb3-4803-9983-65b5b6a62897" (UID: "9b273361-2eb3-4803-9983-65b5b6a62897"). InnerVolumeSpecName "kube-api-access-nskn7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:32:55.404726 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.404687 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b273361-2eb3-4803-9983-65b5b6a62897-istio-podinfo\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:32:55.404726 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.404720 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nskn7\" (UniqueName: \"kubernetes.io/projected/9b273361-2eb3-4803-9983-65b5b6a62897-kube-api-access-nskn7\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:32:55.404726 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.404730 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b273361-2eb3-4803-9983-65b5b6a62897-istio-data\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:32:55.404726 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.404739 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b273361-2eb3-4803-9983-65b5b6a62897-istio-token\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:32:55.405012 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.404747 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b273361-2eb3-4803-9983-65b5b6a62897-istio-envoy\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:32:55.972444 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.972410 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl"] Jul 10 14:32:55.972795 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.972782 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b273361-2eb3-4803-9983-65b5b6a62897" containerName="istio-proxy" Jul 10 14:32:55.972836 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.972796 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b273361-2eb3-4803-9983-65b5b6a62897" containerName="istio-proxy" Jul 10 14:32:55.972870 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.972862 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b273361-2eb3-4803-9983-65b5b6a62897" containerName="istio-proxy" Jul 10 14:32:55.976239 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.976220 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:32:55.979673 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.979653 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f7ca71ee-openshift-default-dockercfg-wh9dg\"" Jul 10 14:32:55.991317 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:55.991297 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl"] Jul 10 14:32:56.010956 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.010933 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-istio-token\") pod \"e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:32:56.011087 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.010974 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-credential-socket\") pod \"e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:32:56.011087 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.011026 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-istiod-ca-cert\") pod \"e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:32:56.011087 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.011055 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgsqq\" (UniqueName: \"kubernetes.io/projected/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-kube-api-access-zgsqq\") pod \"e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:32:56.011221 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.011132 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-workload-certs\") pod \"e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:32:56.011221 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.011164 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-istio-envoy\") pod \"e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:32:56.011221 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.011195 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-istio-podinfo\") pod \"e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:32:56.011221 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.011216 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-istio-data\") pod \"e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:32:56.011345 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.011233 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-workload-socket\") pod \"e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:32:56.032198 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.032173 2579 generic.go:356] "Generic (PLEG): container finished" podID="9b273361-2eb3-4803-9983-65b5b6a62897" containerID="9a46cab5eb87d94c341827beec7cf76154e0094739bc283026378a29bbc7d2ed" exitCode=0 Jul 10 14:32:56.032306 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.032215 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" Jul 10 14:32:56.032306 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.032262 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" event={"ID":"9b273361-2eb3-4803-9983-65b5b6a62897","Type":"ContainerDied","Data":"9a46cab5eb87d94c341827beec7cf76154e0094739bc283026378a29bbc7d2ed"} Jul 10 14:32:56.032390 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.032310 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw" event={"ID":"9b273361-2eb3-4803-9983-65b5b6a62897","Type":"ContainerDied","Data":"5e6f88248bb7fcda365670785147294638a3932070596f2090b53e2bb8d1a88a"} Jul 10 14:32:56.032390 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.032332 2579 scope.go:117] "RemoveContainer" containerID="9a46cab5eb87d94c341827beec7cf76154e0094739bc283026378a29bbc7d2ed" Jul 10 14:32:56.042163 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.042148 2579 scope.go:117] "RemoveContainer" containerID="9a46cab5eb87d94c341827beec7cf76154e0094739bc283026378a29bbc7d2ed" Jul 10 14:32:56.042369 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:32:56.042352 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a46cab5eb87d94c341827beec7cf76154e0094739bc283026378a29bbc7d2ed\": container with ID starting with 9a46cab5eb87d94c341827beec7cf76154e0094739bc283026378a29bbc7d2ed not found: ID does not exist" containerID="9a46cab5eb87d94c341827beec7cf76154e0094739bc283026378a29bbc7d2ed" Jul 10 14:32:56.042416 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.042376 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a46cab5eb87d94c341827beec7cf76154e0094739bc283026378a29bbc7d2ed"} err="failed to get container status \"9a46cab5eb87d94c341827beec7cf76154e0094739bc283026378a29bbc7d2ed\": rpc error: code = NotFound desc = could not find container \"9a46cab5eb87d94c341827beec7cf76154e0094739bc283026378a29bbc7d2ed\": container with ID starting with 9a46cab5eb87d94c341827beec7cf76154e0094739bc283026378a29bbc7d2ed not found: ID does not exist" Jul 10 14:32:56.058033 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.058010 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw"] Jul 10 14:32:56.062518 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.062499 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-dc35352e-openshift-default-768dbb7bf5-v8zvw"] Jul 10 14:32:56.112463 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.112432 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-istiod-ca-cert\") pod \"e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:32:56.112617 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.112478 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgsqq\" (UniqueName: \"kubernetes.io/projected/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-kube-api-access-zgsqq\") pod \"e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:32:56.112617 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.112521 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-workload-certs\") pod \"e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:32:56.112617 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.112549 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-istio-envoy\") pod \"e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:32:56.112804 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.112666 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-istio-podinfo\") pod \"e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:32:56.112804 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.112700 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-istio-data\") pod \"e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:32:56.112804 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.112719 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-workload-socket\") pod \"e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:32:56.112804 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.112769 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-istio-token\") pod \"e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:32:56.112804 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.112795 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-credential-socket\") pod \"e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:32:56.113337 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.112931 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-workload-certs\") pod \"e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:32:56.113337 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.113078 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-istio-data\") pod \"e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:32:56.113337 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.113163 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-credential-socket\") pod \"e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:32:56.113337 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.113235 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-istiod-ca-cert\") pod \"e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:32:56.113337 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.113273 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-workload-socket\") pod \"e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:32:56.114891 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.114864 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-istio-envoy\") pod \"e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:32:56.115107 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.115093 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-istio-podinfo\") pod \"e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:32:56.121915 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.121892 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-istio-token\") pod \"e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:32:56.122056 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.121921 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgsqq\" (UniqueName: \"kubernetes.io/projected/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-kube-api-access-zgsqq\") pod \"e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:32:56.290700 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.290630 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:32:56.426225 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.426151 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl"] Jul 10 14:32:56.430881 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.430852 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:32:56.430999 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.430919 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:32:56.430999 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:56.430964 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:32:57.039968 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:57.039922 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" event={"ID":"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb","Type":"ContainerStarted","Data":"6d0127150aab25bd287ec5f22f17852d7927852c75fffa2c16904087895e893b"} Jul 10 14:32:57.040164 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:57.039997 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" event={"ID":"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb","Type":"ContainerStarted","Data":"2f750f4cfa869b93c7e11bfd081d481669db7ec14862a5709f77067cab360a1d"} Jul 10 14:32:57.065752 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:57.065706 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" podStartSLOduration=2.065689029 podStartE2EDuration="2.065689029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:32:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:32:57.063933386 +0000 UTC m=+1500.490157705" watchObservedRunningTime="2026-07-10 14:32:57.065689029 +0000 UTC m=+1500.491913349" Jul 10 14:32:57.102168 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:57.102140 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b273361-2eb3-4803-9983-65b5b6a62897" path="/var/lib/kubelet/pods/9b273361-2eb3-4803-9983-65b5b6a62897/volumes" Jul 10 14:32:57.221280 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:57.221257 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-znjf2_99ef7290-2248-4e0c-9fda-100370c1ac2d/console-operator/1.log" Jul 10 14:32:57.223424 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:57.223404 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-znjf2_99ef7290-2248-4e0c-9fda-100370c1ac2d/console-operator/1.log" Jul 10 14:32:57.231148 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:57.231124 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jwwrp_6ce1e1c6-c734-4df5-9079-0295f7de80f6/ovn-acl-logging/0.log" Jul 10 14:32:57.233332 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:57.233316 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jwwrp_6ce1e1c6-c734-4df5-9079-0295f7de80f6/ovn-acl-logging/0.log" Jul 10 14:32:57.291691 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:57.291609 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:32:57.296883 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:57.296856 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:32:58.045002 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:58.044942 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:32:58.046002 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:32:58.045983 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:33:08.534603 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:08.534570 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl"] Jul 10 14:33:08.535127 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:08.534772 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" podUID="1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb" containerName="istio-proxy" containerID="cri-o://6d0127150aab25bd287ec5f22f17852d7927852c75fffa2c16904087895e893b" gracePeriod=30 Jul 10 14:33:13.047782 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:13.047744 2579 patch_prober.go:28] interesting pod/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 10 14:33:13.048236 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:13.047806 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" podUID="1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 14:33:13.781878 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:13.781854 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:33:13.865735 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:13.865709 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-istio-token\") pod \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " Jul 10 14:33:13.865864 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:13.865759 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-istio-podinfo\") pod \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " Jul 10 14:33:13.865864 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:13.865797 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-istio-envoy\") pod \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " Jul 10 14:33:13.865976 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:13.865917 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-istio-data\") pod \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " Jul 10 14:33:13.866037 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:13.865984 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-workload-certs\") pod \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " Jul 10 14:33:13.866092 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:13.866033 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-credential-socket\") pod \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " Jul 10 14:33:13.866092 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:13.866063 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-istiod-ca-cert\") pod \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " Jul 10 14:33:13.866190 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:13.866090 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-workload-socket\") pod \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " Jul 10 14:33:13.866190 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:13.866147 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgsqq\" (UniqueName: \"kubernetes.io/projected/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-kube-api-access-zgsqq\") pod \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\" (UID: \"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb\") " Jul 10 14:33:13.866293 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:13.866196 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb" (UID: "1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:33:13.866366 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:13.866335 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb" (UID: "1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:33:13.866553 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:13.866476 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-istio-data" (OuterVolumeSpecName: "istio-data") pod "1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb" (UID: "1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:33:13.866553 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:13.866346 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb" (UID: "1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:33:13.866553 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:13.866488 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-workload-certs\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:33:13.866553 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:13.866508 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb" (UID: "1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:33:13.866553 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:13.866533 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-credential-socket\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:33:13.868275 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:13.868251 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-kube-api-access-zgsqq" (OuterVolumeSpecName: "kube-api-access-zgsqq") pod "1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb" (UID: "1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb"). InnerVolumeSpecName "kube-api-access-zgsqq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:33:13.868396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:13.868275 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-istio-token" (OuterVolumeSpecName: "istio-token") pod "1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb" (UID: "1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:33:13.868396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:13.868339 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb" (UID: "1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 14:33:13.868396 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:13.868366 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb" (UID: "1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:33:13.967885 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:13.967850 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-istio-token\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:33:13.967885 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:13.967883 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-istio-podinfo\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:33:13.967885 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:13.967891 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-istio-envoy\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:33:13.967885 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:13.967899 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-istio-data\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:33:13.968159 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:13.967907 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-istiod-ca-cert\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:33:13.968159 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:13.967915 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-workload-socket\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:33:13.968159 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:13.967922 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgsqq\" (UniqueName: \"kubernetes.io/projected/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb-kube-api-access-zgsqq\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:33:14.117310 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:14.117277 2579 generic.go:356] "Generic (PLEG): container finished" podID="1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb" containerID="6d0127150aab25bd287ec5f22f17852d7927852c75fffa2c16904087895e893b" exitCode=0 Jul 10 14:33:14.117705 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:14.117337 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" Jul 10 14:33:14.117705 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:14.117353 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" event={"ID":"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb","Type":"ContainerDied","Data":"6d0127150aab25bd287ec5f22f17852d7927852c75fffa2c16904087895e893b"} Jul 10 14:33:14.117705 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:14.117396 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl" event={"ID":"1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb","Type":"ContainerDied","Data":"2f750f4cfa869b93c7e11bfd081d481669db7ec14862a5709f77067cab360a1d"} Jul 10 14:33:14.117705 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:14.117417 2579 scope.go:117] "RemoveContainer" containerID="6d0127150aab25bd287ec5f22f17852d7927852c75fffa2c16904087895e893b" Jul 10 14:33:14.126710 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:14.126694 2579 scope.go:117] "RemoveContainer" containerID="6d0127150aab25bd287ec5f22f17852d7927852c75fffa2c16904087895e893b" Jul 10 14:33:14.126998 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:33:14.126976 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d0127150aab25bd287ec5f22f17852d7927852c75fffa2c16904087895e893b\": container with ID starting with 6d0127150aab25bd287ec5f22f17852d7927852c75fffa2c16904087895e893b not found: ID does not exist" containerID="6d0127150aab25bd287ec5f22f17852d7927852c75fffa2c16904087895e893b" Jul 10 14:33:14.127076 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:14.127011 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d0127150aab25bd287ec5f22f17852d7927852c75fffa2c16904087895e893b"} err="failed to get container status \"6d0127150aab25bd287ec5f22f17852d7927852c75fffa2c16904087895e893b\": rpc error: code = NotFound desc = could not find container \"6d0127150aab25bd287ec5f22f17852d7927852c75fffa2c16904087895e893b\": container with ID starting with 6d0127150aab25bd287ec5f22f17852d7927852c75fffa2c16904087895e893b not found: ID does not exist" Jul 10 14:33:14.151161 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:14.151135 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl"] Jul 10 14:33:14.159390 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:14.159364 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f7ca71ee-openshift-default-644fd9578f-kbtkl"] Jul 10 14:33:15.000273 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.000246 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf"] Jul 10 14:33:15.000600 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.000588 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb" containerName="istio-proxy" Jul 10 14:33:15.000655 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.000601 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb" containerName="istio-proxy" Jul 10 14:33:15.000690 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.000676 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb" containerName="istio-proxy" Jul 10 14:33:15.005288 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.005266 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:15.008168 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.008152 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-c6adcb10-openshift-default-dockercfg-7fvnm\"" Jul 10 14:33:15.020655 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.020632 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf"] Jul 10 14:33:15.077513 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.077489 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65e337de-e42b-4325-8463-ded99919f168-istiod-ca-cert\") pod \"e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:15.077621 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.077520 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65e337de-e42b-4325-8463-ded99919f168-workload-socket\") pod \"e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:15.077621 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.077547 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65e337de-e42b-4325-8463-ded99919f168-istio-token\") pod \"e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:15.077697 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.077617 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65e337de-e42b-4325-8463-ded99919f168-credential-socket\") pod \"e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:15.077697 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.077643 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjlhs\" (UniqueName: \"kubernetes.io/projected/65e337de-e42b-4325-8463-ded99919f168-kube-api-access-tjlhs\") pod \"e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:15.077761 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.077744 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65e337de-e42b-4325-8463-ded99919f168-istio-envoy\") pod \"e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:15.077791 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.077771 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65e337de-e42b-4325-8463-ded99919f168-istio-podinfo\") pod \"e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:15.077840 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.077799 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65e337de-e42b-4325-8463-ded99919f168-istio-data\") pod \"e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:15.077840 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.077837 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65e337de-e42b-4325-8463-ded99919f168-workload-certs\") pod \"e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:15.101190 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.101168 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb" path="/var/lib/kubelet/pods/1d8a2624-0ea3-4f1f-b443-3df26d8ef5eb/volumes" Jul 10 14:33:15.179180 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.179151 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65e337de-e42b-4325-8463-ded99919f168-istio-token\") pod \"e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:15.179629 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.179198 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65e337de-e42b-4325-8463-ded99919f168-credential-socket\") pod \"e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:15.179629 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.179219 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjlhs\" (UniqueName: \"kubernetes.io/projected/65e337de-e42b-4325-8463-ded99919f168-kube-api-access-tjlhs\") pod \"e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:15.179629 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.179275 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65e337de-e42b-4325-8463-ded99919f168-istio-envoy\") pod \"e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:15.179629 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.179310 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65e337de-e42b-4325-8463-ded99919f168-istio-podinfo\") pod \"e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:15.179629 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.179327 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65e337de-e42b-4325-8463-ded99919f168-istio-data\") pod \"e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:15.179629 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.179380 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65e337de-e42b-4325-8463-ded99919f168-workload-certs\") pod \"e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:15.179629 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.179439 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65e337de-e42b-4325-8463-ded99919f168-istiod-ca-cert\") pod \"e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:15.179629 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.179470 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65e337de-e42b-4325-8463-ded99919f168-workload-socket\") pod \"e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:15.180008 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.179642 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65e337de-e42b-4325-8463-ded99919f168-credential-socket\") pod \"e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:15.180008 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.179798 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65e337de-e42b-4325-8463-ded99919f168-istio-data\") pod \"e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:15.180008 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.179825 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65e337de-e42b-4325-8463-ded99919f168-workload-certs\") pod \"e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:15.180008 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.179893 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65e337de-e42b-4325-8463-ded99919f168-workload-socket\") pod \"e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:15.180242 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.180220 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65e337de-e42b-4325-8463-ded99919f168-istiod-ca-cert\") pod \"e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:15.181731 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.181714 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65e337de-e42b-4325-8463-ded99919f168-istio-podinfo\") pod \"e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:15.181818 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.181790 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65e337de-e42b-4325-8463-ded99919f168-istio-envoy\") pod \"e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:15.188827 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.188801 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65e337de-e42b-4325-8463-ded99919f168-istio-token\") pod \"e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:15.189270 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.189252 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjlhs\" (UniqueName: \"kubernetes.io/projected/65e337de-e42b-4325-8463-ded99919f168-kube-api-access-tjlhs\") pod \"e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:15.316440 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.316371 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:15.453847 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.453820 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf"] Jul 10 14:33:15.455033 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:33:15.455006 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65e337de_e42b_4325_8463_ded99919f168.slice/crio-46cd8e8ac0c302231f65e278e464b7f579d0a6cd1fa1e84b80f4944e849471a2 WatchSource:0}: Error finding container 46cd8e8ac0c302231f65e278e464b7f579d0a6cd1fa1e84b80f4944e849471a2: Status 404 returned error can't find the container with id 46cd8e8ac0c302231f65e278e464b7f579d0a6cd1fa1e84b80f4944e849471a2 Jul 10 14:33:15.457308 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.457278 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:33:15.457402 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.457353 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:33:15.457463 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:15.457401 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:33:16.132941 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:16.132907 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" event={"ID":"65e337de-e42b-4325-8463-ded99919f168","Type":"ContainerStarted","Data":"92c70c5bd2cd9f604dccf601324e03c5084e2c969bf9c6d0add5666ea7d551db"} Jul 10 14:33:16.133110 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:16.132976 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" event={"ID":"65e337de-e42b-4325-8463-ded99919f168","Type":"ContainerStarted","Data":"46cd8e8ac0c302231f65e278e464b7f579d0a6cd1fa1e84b80f4944e849471a2"} Jul 10 14:33:16.188603 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:16.188552 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" podStartSLOduration=2.188536579 podStartE2EDuration="2.188536579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:33:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:33:16.187545376 +0000 UTC m=+1519.613769697" watchObservedRunningTime="2026-07-10 14:33:16.188536579 +0000 UTC m=+1519.614760899" Jul 10 14:33:16.316843 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:16.316765 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:16.321221 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:16.321196 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:17.137910 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:17.137875 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:17.138804 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:17.138785 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:20.790420 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:20.790383 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf"] Jul 10 14:33:20.790845 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:20.790585 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" podUID="65e337de-e42b-4325-8463-ded99919f168" containerName="istio-proxy" containerID="cri-o://92c70c5bd2cd9f604dccf601324e03c5084e2c969bf9c6d0add5666ea7d551db" gracePeriod=30 Jul 10 14:33:26.049011 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.048987 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:26.180705 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.180676 2579 generic.go:356] "Generic (PLEG): container finished" podID="65e337de-e42b-4325-8463-ded99919f168" containerID="92c70c5bd2cd9f604dccf601324e03c5084e2c969bf9c6d0add5666ea7d551db" exitCode=0 Jul 10 14:33:26.180864 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.180720 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" Jul 10 14:33:26.180864 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.180765 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" event={"ID":"65e337de-e42b-4325-8463-ded99919f168","Type":"ContainerDied","Data":"92c70c5bd2cd9f604dccf601324e03c5084e2c969bf9c6d0add5666ea7d551db"} Jul 10 14:33:26.180864 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.180815 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf" event={"ID":"65e337de-e42b-4325-8463-ded99919f168","Type":"ContainerDied","Data":"46cd8e8ac0c302231f65e278e464b7f579d0a6cd1fa1e84b80f4944e849471a2"} Jul 10 14:33:26.180864 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.180842 2579 scope.go:117] "RemoveContainer" containerID="92c70c5bd2cd9f604dccf601324e03c5084e2c969bf9c6d0add5666ea7d551db" Jul 10 14:33:26.186622 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.186593 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65e337de-e42b-4325-8463-ded99919f168-istiod-ca-cert\") pod \"65e337de-e42b-4325-8463-ded99919f168\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " Jul 10 14:33:26.186724 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.186625 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65e337de-e42b-4325-8463-ded99919f168-istio-podinfo\") pod \"65e337de-e42b-4325-8463-ded99919f168\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " Jul 10 14:33:26.186724 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.186658 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65e337de-e42b-4325-8463-ded99919f168-istio-envoy\") pod \"65e337de-e42b-4325-8463-ded99919f168\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " Jul 10 14:33:26.186724 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.186714 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjlhs\" (UniqueName: \"kubernetes.io/projected/65e337de-e42b-4325-8463-ded99919f168-kube-api-access-tjlhs\") pod \"65e337de-e42b-4325-8463-ded99919f168\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " Jul 10 14:33:26.186849 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.186740 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65e337de-e42b-4325-8463-ded99919f168-istio-data\") pod \"65e337de-e42b-4325-8463-ded99919f168\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " Jul 10 14:33:26.186849 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.186762 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65e337de-e42b-4325-8463-ded99919f168-istio-token\") pod \"65e337de-e42b-4325-8463-ded99919f168\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " Jul 10 14:33:26.186849 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.186778 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65e337de-e42b-4325-8463-ded99919f168-workload-certs\") pod \"65e337de-e42b-4325-8463-ded99919f168\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " Jul 10 14:33:26.186849 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.186818 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65e337de-e42b-4325-8463-ded99919f168-workload-socket\") pod \"65e337de-e42b-4325-8463-ded99919f168\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " Jul 10 14:33:26.186849 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.186849 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65e337de-e42b-4325-8463-ded99919f168-credential-socket\") pod \"65e337de-e42b-4325-8463-ded99919f168\" (UID: \"65e337de-e42b-4325-8463-ded99919f168\") " Jul 10 14:33:26.187107 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.187051 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65e337de-e42b-4325-8463-ded99919f168-istio-data" (OuterVolumeSpecName: "istio-data") pod "65e337de-e42b-4325-8463-ded99919f168" (UID: "65e337de-e42b-4325-8463-ded99919f168"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:33:26.187107 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.187094 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65e337de-e42b-4325-8463-ded99919f168-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "65e337de-e42b-4325-8463-ded99919f168" (UID: "65e337de-e42b-4325-8463-ded99919f168"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:33:26.187236 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.187212 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65e337de-e42b-4325-8463-ded99919f168-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "65e337de-e42b-4325-8463-ded99919f168" (UID: "65e337de-e42b-4325-8463-ded99919f168"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:33:26.187297 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.187246 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65e337de-e42b-4325-8463-ded99919f168-istiod-ca-cert\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:33:26.187297 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.187265 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65e337de-e42b-4325-8463-ded99919f168-istio-data\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:33:26.187297 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.187250 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65e337de-e42b-4325-8463-ded99919f168-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "65e337de-e42b-4325-8463-ded99919f168" (UID: "65e337de-e42b-4325-8463-ded99919f168"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:33:26.187492 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.187324 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65e337de-e42b-4325-8463-ded99919f168-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "65e337de-e42b-4325-8463-ded99919f168" (UID: "65e337de-e42b-4325-8463-ded99919f168"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:33:26.189436 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.189401 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65e337de-e42b-4325-8463-ded99919f168-istio-token" (OuterVolumeSpecName: "istio-token") pod "65e337de-e42b-4325-8463-ded99919f168" (UID: "65e337de-e42b-4325-8463-ded99919f168"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:33:26.192095 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.191469 2579 scope.go:117] "RemoveContainer" containerID="92c70c5bd2cd9f604dccf601324e03c5084e2c969bf9c6d0add5666ea7d551db" Jul 10 14:33:26.192095 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:33:26.191756 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92c70c5bd2cd9f604dccf601324e03c5084e2c969bf9c6d0add5666ea7d551db\": container with ID starting with 92c70c5bd2cd9f604dccf601324e03c5084e2c969bf9c6d0add5666ea7d551db not found: ID does not exist" containerID="92c70c5bd2cd9f604dccf601324e03c5084e2c969bf9c6d0add5666ea7d551db" Jul 10 14:33:26.192095 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.191783 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92c70c5bd2cd9f604dccf601324e03c5084e2c969bf9c6d0add5666ea7d551db"} err="failed to get container status \"92c70c5bd2cd9f604dccf601324e03c5084e2c969bf9c6d0add5666ea7d551db\": rpc error: code = NotFound desc = could not find container \"92c70c5bd2cd9f604dccf601324e03c5084e2c969bf9c6d0add5666ea7d551db\": container with ID starting with 92c70c5bd2cd9f604dccf601324e03c5084e2c969bf9c6d0add5666ea7d551db not found: ID does not exist" Jul 10 14:33:26.192095 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.192039 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65e337de-e42b-4325-8463-ded99919f168-kube-api-access-tjlhs" (OuterVolumeSpecName: "kube-api-access-tjlhs") pod "65e337de-e42b-4325-8463-ded99919f168" (UID: "65e337de-e42b-4325-8463-ded99919f168"). InnerVolumeSpecName "kube-api-access-tjlhs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:33:26.192312 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.192257 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/65e337de-e42b-4325-8463-ded99919f168-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "65e337de-e42b-4325-8463-ded99919f168" (UID: "65e337de-e42b-4325-8463-ded99919f168"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 14:33:26.192312 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.192268 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65e337de-e42b-4325-8463-ded99919f168-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "65e337de-e42b-4325-8463-ded99919f168" (UID: "65e337de-e42b-4325-8463-ded99919f168"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:33:26.288171 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.288142 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65e337de-e42b-4325-8463-ded99919f168-workload-socket\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:33:26.288171 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.288166 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65e337de-e42b-4325-8463-ded99919f168-credential-socket\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:33:26.288171 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.288176 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65e337de-e42b-4325-8463-ded99919f168-istio-podinfo\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:33:26.288362 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.288185 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65e337de-e42b-4325-8463-ded99919f168-istio-envoy\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:33:26.288362 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.288193 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjlhs\" (UniqueName: \"kubernetes.io/projected/65e337de-e42b-4325-8463-ded99919f168-kube-api-access-tjlhs\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:33:26.288362 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.288215 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65e337de-e42b-4325-8463-ded99919f168-istio-token\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:33:26.288362 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.288236 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65e337de-e42b-4325-8463-ded99919f168-workload-certs\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:33:26.506893 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.506861 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf"] Jul 10 14:33:26.509640 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:26.509619 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-c6adcb10-openshift-default-68b7745b7-xsmkf"] Jul 10 14:33:27.102455 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:33:27.102415 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65e337de-e42b-4325-8463-ded99919f168" path="/var/lib/kubelet/pods/65e337de-e42b-4325-8463-ded99919f168/volumes" Jul 10 14:35:06.436235 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.436161 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz"] Jul 10 14:35:06.436723 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.436706 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65e337de-e42b-4325-8463-ded99919f168" containerName="istio-proxy" Jul 10 14:35:06.436769 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.436726 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="65e337de-e42b-4325-8463-ded99919f168" containerName="istio-proxy" Jul 10 14:35:06.436843 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.436832 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="65e337de-e42b-4325-8463-ded99919f168" containerName="istio-proxy" Jul 10 14:35:06.441552 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.441529 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:06.444542 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.444522 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-8a12160b-openshift-default-dockercfg-vrg4k\"" Jul 10 14:35:06.468864 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.468838 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz"] Jul 10 14:35:06.542835 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.542801 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-istio-podinfo\") pod \"e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:06.542835 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.542837 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwxc9\" (UniqueName: \"kubernetes.io/projected/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-kube-api-access-lwxc9\") pod \"e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:06.543058 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.542921 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-istio-data\") pod \"e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:06.543058 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.542999 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-istiod-ca-cert\") pod \"e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:06.543134 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.543059 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-workload-certs\") pod \"e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:06.543134 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.543080 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-istio-envoy\") pod \"e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:06.543198 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.543160 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-credential-socket\") pod \"e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:06.543198 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.543187 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-istio-token\") pod \"e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:06.543264 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.543207 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-workload-socket\") pod \"e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:06.644531 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.644486 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-istio-podinfo\") pod \"e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:06.644531 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.644533 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwxc9\" (UniqueName: \"kubernetes.io/projected/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-kube-api-access-lwxc9\") pod \"e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:06.644789 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.644558 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-istio-data\") pod \"e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:06.644789 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.644581 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-istiod-ca-cert\") pod \"e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:06.644789 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.644631 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-workload-certs\") pod \"e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:06.644789 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.644656 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-istio-envoy\") pod \"e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:06.644789 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.644698 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-credential-socket\") pod \"e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:06.644789 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.644715 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-istio-token\") pod \"e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:06.644789 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.644732 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-workload-socket\") pod \"e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:06.645189 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.645059 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-workload-certs\") pod \"e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:06.645189 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.645155 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-credential-socket\") pod \"e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:06.645302 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.645204 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-workload-socket\") pod \"e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:06.645302 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.645284 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-istio-data\") pod \"e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:06.645477 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.645455 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-istiod-ca-cert\") pod \"e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:06.647002 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.646984 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-istio-envoy\") pod \"e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:06.647002 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.646992 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-istio-podinfo\") pod \"e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:06.656632 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.656601 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwxc9\" (UniqueName: \"kubernetes.io/projected/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-kube-api-access-lwxc9\") pod \"e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:06.659543 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.659520 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-istio-token\") pod \"e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:06.751860 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.751766 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:06.892282 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.892261 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz"] Jul 10 14:35:06.893811 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:35:06.893789 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb14c9cb_560e_4a16_83d6_5a2fccb24c0e.slice/crio-7acb697b19ad61644251a011bd6ea01e972108aea2983fffad7cd4ca72367010 WatchSource:0}: Error finding container 7acb697b19ad61644251a011bd6ea01e972108aea2983fffad7cd4ca72367010: Status 404 returned error can't find the container with id 7acb697b19ad61644251a011bd6ea01e972108aea2983fffad7cd4ca72367010 Jul 10 14:35:06.895890 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.895864 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:35:06.895971 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.895921 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:35:06.896014 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:06.895968 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:35:07.659026 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:07.658992 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" event={"ID":"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e","Type":"ContainerStarted","Data":"b5635537235ca158631ce92c08138f789f6614f7b4ce22259bb27b16b182bb2b"} Jul 10 14:35:07.659486 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:07.659047 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" event={"ID":"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e","Type":"ContainerStarted","Data":"7acb697b19ad61644251a011bd6ea01e972108aea2983fffad7cd4ca72367010"} Jul 10 14:35:07.690072 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:07.690019 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" podStartSLOduration=1.690001595 podStartE2EDuration="1.690001595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:35:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:35:07.687310352 +0000 UTC m=+1631.113534706" watchObservedRunningTime="2026-07-10 14:35:07.690001595 +0000 UTC m=+1631.116225914" Jul 10 14:35:07.752909 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:07.752875 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:07.757683 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:07.757656 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:08.663685 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:08.663649 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:08.664489 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:08.664469 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:24.033754 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:24.033263 2579 patch_prober.go:28] interesting pod/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": read tcp 10.132.0.2:33038->10.132.0.42:15021: read: connection reset by peer" start-of-body= Jul 10 14:35:24.033754 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:24.033328 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" podUID="fb14c9cb-560e-4a16-83d6-5a2fccb24c0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": read tcp 10.132.0.2:33038->10.132.0.42:15021: read: connection reset by peer" Jul 10 14:35:24.740672 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:24.740643 2579 generic.go:356] "Generic (PLEG): container finished" podID="fb14c9cb-560e-4a16-83d6-5a2fccb24c0e" containerID="b5635537235ca158631ce92c08138f789f6614f7b4ce22259bb27b16b182bb2b" exitCode=0 Jul 10 14:35:24.740849 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:24.740691 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" event={"ID":"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e","Type":"ContainerDied","Data":"b5635537235ca158631ce92c08138f789f6614f7b4ce22259bb27b16b182bb2b"} Jul 10 14:35:24.741055 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:24.741040 2579 scope.go:117] "RemoveContainer" containerID="b5635537235ca158631ce92c08138f789f6614f7b4ce22259bb27b16b182bb2b" Jul 10 14:35:24.742032 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:24.742004 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:35:24.742095 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:24.742069 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:35:24.742131 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:24.742099 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:35:25.751097 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:25.751063 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" event={"ID":"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e","Type":"ContainerStarted","Data":"3c0632d723a6f4f65e67996f2ce52d835e97f2dd48d9f866b71f4bf6123dbd88"} Jul 10 14:35:25.752548 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:25.752526 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:25.752720 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:25.752700 2579 patch_prober.go:28] interesting pod/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 10 14:35:25.752763 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:25.752746 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" podUID="fb14c9cb-560e-4a16-83d6-5a2fccb24c0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 10 14:35:26.752422 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:26.752385 2579 patch_prober.go:28] interesting pod/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 10 14:35:26.752842 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:26.752451 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" podUID="fb14c9cb-560e-4a16-83d6-5a2fccb24c0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 10 14:35:27.752522 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:27.752483 2579 patch_prober.go:28] interesting pod/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 10 14:35:27.753037 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:27.752561 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" podUID="fb14c9cb-560e-4a16-83d6-5a2fccb24c0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 10 14:35:28.753048 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:28.753015 2579 patch_prober.go:28] interesting pod/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 10 14:35:28.753455 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:28.753086 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" podUID="fb14c9cb-560e-4a16-83d6-5a2fccb24c0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 10 14:35:28.935977 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:28.932980 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz"] Jul 10 14:35:28.935977 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:28.933232 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" podUID="fb14c9cb-560e-4a16-83d6-5a2fccb24c0e" containerName="istio-proxy" containerID="cri-o://3c0632d723a6f4f65e67996f2ce52d835e97f2dd48d9f866b71f4bf6123dbd88" gracePeriod=30 Jul 10 14:35:34.794536 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:34.794503 2579 generic.go:356] "Generic (PLEG): container finished" podID="fb14c9cb-560e-4a16-83d6-5a2fccb24c0e" containerID="3c0632d723a6f4f65e67996f2ce52d835e97f2dd48d9f866b71f4bf6123dbd88" exitCode=0 Jul 10 14:35:34.794999 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:34.794596 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" event={"ID":"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e","Type":"ContainerDied","Data":"3c0632d723a6f4f65e67996f2ce52d835e97f2dd48d9f866b71f4bf6123dbd88"} Jul 10 14:35:34.794999 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:34.794667 2579 scope.go:117] "RemoveContainer" containerID="b5635537235ca158631ce92c08138f789f6614f7b4ce22259bb27b16b182bb2b" Jul 10 14:35:34.897019 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:34.896994 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:35.013260 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:35.013176 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-istiod-ca-cert\") pod \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " Jul 10 14:35:35.013260 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:35.013206 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-istio-token\") pod \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " Jul 10 14:35:35.013260 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:35.013254 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-istio-envoy\") pod \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " Jul 10 14:35:35.013532 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:35.013275 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-workload-certs\") pod \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " Jul 10 14:35:35.013532 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:35.013314 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-credential-socket\") pod \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " Jul 10 14:35:35.013532 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:35.013332 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwxc9\" (UniqueName: \"kubernetes.io/projected/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-kube-api-access-lwxc9\") pod \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " Jul 10 14:35:35.013532 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:35.013397 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-istio-podinfo\") pod \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " Jul 10 14:35:35.013532 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:35.013423 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-istio-data\") pod \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " Jul 10 14:35:35.013532 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:35.013445 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-workload-socket\") pod \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\" (UID: \"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e\") " Jul 10 14:35:35.013837 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:35.013639 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fb14c9cb-560e-4a16-83d6-5a2fccb24c0e" (UID: "fb14c9cb-560e-4a16-83d6-5a2fccb24c0e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:35:35.013837 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:35.013649 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fb14c9cb-560e-4a16-83d6-5a2fccb24c0e" (UID: "fb14c9cb-560e-4a16-83d6-5a2fccb24c0e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:35:35.013837 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:35.013632 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fb14c9cb-560e-4a16-83d6-5a2fccb24c0e" (UID: "fb14c9cb-560e-4a16-83d6-5a2fccb24c0e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:35:35.013837 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:35.013751 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-workload-certs\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:35:35.013837 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:35.013768 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-credential-socket\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:35:35.013837 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:35.013780 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-istiod-ca-cert\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:35:35.014595 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:35.013900 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fb14c9cb-560e-4a16-83d6-5a2fccb24c0e" (UID: "fb14c9cb-560e-4a16-83d6-5a2fccb24c0e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:35:35.014595 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:35.014460 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-istio-data" (OuterVolumeSpecName: "istio-data") pod "fb14c9cb-560e-4a16-83d6-5a2fccb24c0e" (UID: "fb14c9cb-560e-4a16-83d6-5a2fccb24c0e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:35:35.015767 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:35.015746 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-istio-token" (OuterVolumeSpecName: "istio-token") pod "fb14c9cb-560e-4a16-83d6-5a2fccb24c0e" (UID: "fb14c9cb-560e-4a16-83d6-5a2fccb24c0e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:35:35.015846 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:35.015766 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fb14c9cb-560e-4a16-83d6-5a2fccb24c0e" (UID: "fb14c9cb-560e-4a16-83d6-5a2fccb24c0e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:35:35.016028 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:35.016003 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-kube-api-access-lwxc9" (OuterVolumeSpecName: "kube-api-access-lwxc9") pod "fb14c9cb-560e-4a16-83d6-5a2fccb24c0e" (UID: "fb14c9cb-560e-4a16-83d6-5a2fccb24c0e"). InnerVolumeSpecName "kube-api-access-lwxc9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:35:35.016102 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:35.016010 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fb14c9cb-560e-4a16-83d6-5a2fccb24c0e" (UID: "fb14c9cb-560e-4a16-83d6-5a2fccb24c0e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 14:35:35.114874 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:35.114854 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwxc9\" (UniqueName: \"kubernetes.io/projected/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-kube-api-access-lwxc9\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:35:35.114945 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:35.114875 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-istio-podinfo\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:35:35.114945 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:35.114886 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-istio-data\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:35:35.114945 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:35.114894 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-workload-socket\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:35:35.114945 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:35.114901 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-istio-token\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:35:35.114945 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:35.114912 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e-istio-envoy\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:35:35.800150 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:35.800112 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" event={"ID":"fb14c9cb-560e-4a16-83d6-5a2fccb24c0e","Type":"ContainerDied","Data":"7acb697b19ad61644251a011bd6ea01e972108aea2983fffad7cd4ca72367010"} Jul 10 14:35:35.800589 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:35.800173 2579 scope.go:117] "RemoveContainer" containerID="3c0632d723a6f4f65e67996f2ce52d835e97f2dd48d9f866b71f4bf6123dbd88" Jul 10 14:35:35.800589 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:35.800132 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz" Jul 10 14:35:35.826031 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:35.826004 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz"] Jul 10 14:35:35.832493 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:35.832473 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-8a12160b-openshift-default-554f995b6c-qz6bz"] Jul 10 14:35:37.100962 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:37.100926 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb14c9cb-560e-4a16-83d6-5a2fccb24c0e" path="/var/lib/kubelet/pods/fb14c9cb-560e-4a16-83d6-5a2fccb24c0e/volumes" Jul 10 14:35:50.283108 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.283071 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9"] Jul 10 14:35:50.283585 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.283570 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb14c9cb-560e-4a16-83d6-5a2fccb24c0e" containerName="istio-proxy" Jul 10 14:35:50.283629 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.283589 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb14c9cb-560e-4a16-83d6-5a2fccb24c0e" containerName="istio-proxy" Jul 10 14:35:50.283709 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.283698 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb14c9cb-560e-4a16-83d6-5a2fccb24c0e" containerName="istio-proxy" Jul 10 14:35:50.283748 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.283710 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb14c9cb-560e-4a16-83d6-5a2fccb24c0e" containerName="istio-proxy" Jul 10 14:35:50.288554 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.288533 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:35:50.292357 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:35:50.292328 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9\" is forbidden: User \"system:node:ip-10-0-135-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-135-64.ec2.internal' and this object" podUID="19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0" pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:35:50.292480 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:35:50.292352 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"e2e-mt-59512b8b-openshift-default-dockercfg-cnvxl\" is forbidden: User \"system:node:ip-10-0-135-64.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-135-64.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"e2e-mt-59512b8b-openshift-default-dockercfg-cnvxl\"" type="*v1.Secret" Jul 10 14:35:50.346763 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.346733 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9"] Jul 10 14:35:50.443908 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.443879 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-credential-socket\") pod \"e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:35:50.444100 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.443933 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-istio-data\") pod \"e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:35:50.444100 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.444010 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x7mf\" (UniqueName: \"kubernetes.io/projected/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-kube-api-access-2x7mf\") pod \"e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:35:50.444100 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.444062 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-workload-certs\") pod \"e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:35:50.444100 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.444093 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-istio-envoy\") pod \"e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:35:50.444326 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.444111 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-istio-token\") pod \"e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:35:50.444326 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.444203 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-workload-socket\") pod \"e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:35:50.444326 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.444246 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-istio-podinfo\") pod \"e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:35:50.444326 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.444275 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-istiod-ca-cert\") pod \"e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:35:50.545450 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.545367 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-workload-certs\") pod \"e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:35:50.545450 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.545420 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-istio-envoy\") pod \"e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:35:50.545450 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.545446 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-istio-token\") pod \"e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:35:50.545739 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.545502 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-workload-socket\") pod \"e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:35:50.545739 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.545534 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-istio-podinfo\") pod \"e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:35:50.545739 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.545557 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-istiod-ca-cert\") pod \"e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:35:50.545739 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.545593 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-credential-socket\") pod \"e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:35:50.545739 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.545664 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-istio-data\") pod \"e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:35:50.545739 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.545691 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x7mf\" (UniqueName: \"kubernetes.io/projected/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-kube-api-access-2x7mf\") pod \"e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:35:50.546130 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.545764 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-workload-certs\") pod \"e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:35:50.546130 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.545886 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-workload-socket\") pod \"e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:35:50.546239 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.546031 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-credential-socket\") pod \"e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:35:50.546552 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.546062 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-istio-data\") pod \"e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:35:50.546788 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.546762 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-istiod-ca-cert\") pod \"e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:35:50.548708 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.548680 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-istio-podinfo\") pod \"e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:35:50.554634 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.554610 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-istio-envoy\") pod \"e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:35:50.557812 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.557793 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x7mf\" (UniqueName: \"kubernetes.io/projected/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-kube-api-access-2x7mf\") pod \"e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:35:50.560430 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:50.560411 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-istio-token\") pod \"e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:35:51.288783 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:51.288749 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-59512b8b-openshift-default-dockercfg-cnvxl\"" Jul 10 14:35:51.290846 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:51.290830 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:35:51.441973 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:51.441931 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9"] Jul 10 14:35:51.445029 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:35:51.445004 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19e4d3cb_1e8d_47b2_bbc5_c34c5558fef0.slice/crio-ec49c52444abd069b14895eb248f411a08e82a2a795faed9a8ec72252b7e77ec WatchSource:0}: Error finding container ec49c52444abd069b14895eb248f411a08e82a2a795faed9a8ec72252b7e77ec: Status 404 returned error can't find the container with id ec49c52444abd069b14895eb248f411a08e82a2a795faed9a8ec72252b7e77ec Jul 10 14:35:51.447198 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:51.447165 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:35:51.447298 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:51.447230 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:35:51.447298 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:51.447260 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:35:51.872390 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:51.872353 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" event={"ID":"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0","Type":"ContainerStarted","Data":"dbb2c83245d1297129354f3b6c130e23f04bcb9d80e4e0989e88a968fd27b8b3"} Jul 10 14:35:51.872579 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:51.872418 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" event={"ID":"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0","Type":"ContainerStarted","Data":"ec49c52444abd069b14895eb248f411a08e82a2a795faed9a8ec72252b7e77ec"} Jul 10 14:35:52.291565 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:52.291479 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:35:52.296363 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:52.296340 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:35:52.345687 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:52.345644 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" podStartSLOduration=2.345629424 podStartE2EDuration="2.345629424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:35:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:35:51.917396172 +0000 UTC m=+1675.343620491" watchObservedRunningTime="2026-07-10 14:35:52.345629424 +0000 UTC m=+1675.771853743" Jul 10 14:35:52.878921 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:52.878895 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:35:52.879905 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:35:52.879886 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:36:08.481910 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:36:08.480725 2579 patch_prober.go:28] interesting pod/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": read tcp 10.132.0.2:47398->10.132.0.43:15021: read: connection reset by peer" start-of-body= Jul 10 14:36:08.481910 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:36:08.480806 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" podUID="19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": read tcp 10.132.0.2:47398->10.132.0.43:15021: read: connection reset by peer" Jul 10 14:36:08.962141 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:36:08.962105 2579 generic.go:356] "Generic (PLEG): container finished" podID="19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0" containerID="dbb2c83245d1297129354f3b6c130e23f04bcb9d80e4e0989e88a968fd27b8b3" exitCode=0 Jul 10 14:36:08.962335 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:36:08.962178 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" event={"ID":"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0","Type":"ContainerDied","Data":"dbb2c83245d1297129354f3b6c130e23f04bcb9d80e4e0989e88a968fd27b8b3"} Jul 10 14:36:08.962628 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:36:08.962610 2579 scope.go:117] "RemoveContainer" containerID="dbb2c83245d1297129354f3b6c130e23f04bcb9d80e4e0989e88a968fd27b8b3" Jul 10 14:36:08.963621 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:36:08.963598 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:36:08.963678 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:36:08.963659 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:36:08.963716 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:36:08.963690 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:36:09.969642 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:36:09.969609 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" event={"ID":"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0","Type":"ContainerStarted","Data":"bc9fa3ad70350a0d609ba6b04d0741077a82ec30963cd773c8be455860bc272b"} Jul 10 14:36:10.291474 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:36:10.291389 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:36:10.291626 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:36:10.291605 2579 patch_prober.go:28] interesting pod/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 10 14:36:10.291674 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:36:10.291651 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" podUID="19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 10 14:36:11.291656 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:36:11.291624 2579 patch_prober.go:28] interesting pod/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 10 14:36:11.292090 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:36:11.291678 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" podUID="19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 10 14:36:12.291759 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:36:12.291726 2579 patch_prober.go:28] interesting pod/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 10 14:36:12.292188 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:36:12.291780 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" podUID="19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 10 14:36:13.292327 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:36:13.292289 2579 patch_prober.go:28] interesting pod/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 10 14:36:13.292719 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:36:13.292348 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" podUID="19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 10 14:36:14.294372 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:36:14.294342 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:36:14.294761 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:36:14.294600 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:36:14.295211 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:36:14.295192 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:37:26.005897 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:26.005867 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9"] Jul 10 14:37:26.006405 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:26.006106 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" podUID="19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0" containerName="istio-proxy" containerID="cri-o://bc9fa3ad70350a0d609ba6b04d0741077a82ec30963cd773c8be455860bc272b" gracePeriod=30 Jul 10 14:37:29.297181 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:29.297147 2579 patch_prober.go:28] interesting pod/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 10 14:37:29.297548 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:29.297207 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" podUID="19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 14:37:31.258920 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.258896 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:37:31.360128 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.360092 2579 generic.go:356] "Generic (PLEG): container finished" podID="19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0" containerID="bc9fa3ad70350a0d609ba6b04d0741077a82ec30963cd773c8be455860bc272b" exitCode=0 Jul 10 14:37:31.360299 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.360137 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" Jul 10 14:37:31.360299 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.360173 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" event={"ID":"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0","Type":"ContainerDied","Data":"bc9fa3ad70350a0d609ba6b04d0741077a82ec30963cd773c8be455860bc272b"} Jul 10 14:37:31.360299 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.360226 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9" event={"ID":"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0","Type":"ContainerDied","Data":"ec49c52444abd069b14895eb248f411a08e82a2a795faed9a8ec72252b7e77ec"} Jul 10 14:37:31.360299 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.360248 2579 scope.go:117] "RemoveContainer" containerID="bc9fa3ad70350a0d609ba6b04d0741077a82ec30963cd773c8be455860bc272b" Jul 10 14:37:31.368610 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.368598 2579 scope.go:117] "RemoveContainer" containerID="dbb2c83245d1297129354f3b6c130e23f04bcb9d80e4e0989e88a968fd27b8b3" Jul 10 14:37:31.378204 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.378187 2579 scope.go:117] "RemoveContainer" containerID="bc9fa3ad70350a0d609ba6b04d0741077a82ec30963cd773c8be455860bc272b" Jul 10 14:37:31.378471 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:37:31.378453 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc9fa3ad70350a0d609ba6b04d0741077a82ec30963cd773c8be455860bc272b\": container with ID starting with bc9fa3ad70350a0d609ba6b04d0741077a82ec30963cd773c8be455860bc272b not found: ID does not exist" containerID="bc9fa3ad70350a0d609ba6b04d0741077a82ec30963cd773c8be455860bc272b" Jul 10 14:37:31.378519 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.378479 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc9fa3ad70350a0d609ba6b04d0741077a82ec30963cd773c8be455860bc272b"} err="failed to get container status \"bc9fa3ad70350a0d609ba6b04d0741077a82ec30963cd773c8be455860bc272b\": rpc error: code = NotFound desc = could not find container \"bc9fa3ad70350a0d609ba6b04d0741077a82ec30963cd773c8be455860bc272b\": container with ID starting with bc9fa3ad70350a0d609ba6b04d0741077a82ec30963cd773c8be455860bc272b not found: ID does not exist" Jul 10 14:37:31.378519 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.378495 2579 scope.go:117] "RemoveContainer" containerID="dbb2c83245d1297129354f3b6c130e23f04bcb9d80e4e0989e88a968fd27b8b3" Jul 10 14:37:31.378737 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:37:31.378720 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbb2c83245d1297129354f3b6c130e23f04bcb9d80e4e0989e88a968fd27b8b3\": container with ID starting with dbb2c83245d1297129354f3b6c130e23f04bcb9d80e4e0989e88a968fd27b8b3 not found: ID does not exist" containerID="dbb2c83245d1297129354f3b6c130e23f04bcb9d80e4e0989e88a968fd27b8b3" Jul 10 14:37:31.378790 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.378746 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbb2c83245d1297129354f3b6c130e23f04bcb9d80e4e0989e88a968fd27b8b3"} err="failed to get container status \"dbb2c83245d1297129354f3b6c130e23f04bcb9d80e4e0989e88a968fd27b8b3\": rpc error: code = NotFound desc = could not find container \"dbb2c83245d1297129354f3b6c130e23f04bcb9d80e4e0989e88a968fd27b8b3\": container with ID starting with dbb2c83245d1297129354f3b6c130e23f04bcb9d80e4e0989e88a968fd27b8b3 not found: ID does not exist" Jul 10 14:37:31.421005 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.420977 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-istiod-ca-cert\") pod \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " Jul 10 14:37:31.421121 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.421051 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2x7mf\" (UniqueName: \"kubernetes.io/projected/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-kube-api-access-2x7mf\") pod \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " Jul 10 14:37:31.421121 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.421068 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-istio-podinfo\") pod \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " Jul 10 14:37:31.421121 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.421101 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-workload-socket\") pod \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " Jul 10 14:37:31.421280 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.421135 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-istio-token\") pod \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " Jul 10 14:37:31.421280 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.421178 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-istio-envoy\") pod \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " Jul 10 14:37:31.421280 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.421214 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-workload-certs\") pod \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " Jul 10 14:37:31.421280 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.421259 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-istio-data\") pod \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " Jul 10 14:37:31.421484 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.421304 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-credential-socket\") pod \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\" (UID: \"19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0\") " Jul 10 14:37:31.421484 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.421375 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0" (UID: "19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:37:31.421484 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.421416 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0" (UID: "19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:37:31.421646 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.421544 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0" (UID: "19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:37:31.421646 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.421607 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0" (UID: "19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:37:31.421750 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.421688 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-workload-certs\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:37:31.421750 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.421709 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-credential-socket\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:37:31.421750 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.421724 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-istiod-ca-cert\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:37:31.421750 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.421738 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-workload-socket\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:37:31.422206 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.422178 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-istio-data" (OuterVolumeSpecName: "istio-data") pod "19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0" (UID: "19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:37:31.423481 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.423457 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0" (UID: "19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:37:31.423595 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.423472 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-istio-token" (OuterVolumeSpecName: "istio-token") pod "19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0" (UID: "19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:37:31.423665 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.423644 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0" (UID: "19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 14:37:31.423828 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.423810 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-kube-api-access-2x7mf" (OuterVolumeSpecName: "kube-api-access-2x7mf") pod "19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0" (UID: "19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0"). InnerVolumeSpecName "kube-api-access-2x7mf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:37:31.522608 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.522561 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2x7mf\" (UniqueName: \"kubernetes.io/projected/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-kube-api-access-2x7mf\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:37:31.522608 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.522605 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-istio-podinfo\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:37:31.522608 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.522614 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-istio-token\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:37:31.522608 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.522622 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-istio-envoy\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:37:31.522860 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.522630 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0-istio-data\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:37:31.683262 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.683228 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9"] Jul 10 14:37:31.687918 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:31.687891 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-59512b8b-openshift-default-7f9d7c447-gfkr9"] Jul 10 14:37:33.100679 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:33.100644 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0" path="/var/lib/kubelet/pods/19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0/volumes" Jul 10 14:37:57.252509 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:57.252483 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-znjf2_99ef7290-2248-4e0c-9fda-100370c1ac2d/console-operator/1.log" Jul 10 14:37:57.254202 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:57.254180 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-znjf2_99ef7290-2248-4e0c-9fda-100370c1ac2d/console-operator/1.log" Jul 10 14:37:57.260820 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:57.260803 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jwwrp_6ce1e1c6-c734-4df5-9079-0295f7de80f6/ovn-acl-logging/0.log" Jul 10 14:37:57.262653 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:37:57.262634 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jwwrp_6ce1e1c6-c734-4df5-9079-0295f7de80f6/ovn-acl-logging/0.log" Jul 10 14:38:22.427068 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.427028 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m"] Jul 10 14:38:22.427561 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.427543 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0" containerName="istio-proxy" Jul 10 14:38:22.427638 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.427563 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0" containerName="istio-proxy" Jul 10 14:38:22.427638 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.427584 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0" containerName="istio-proxy" Jul 10 14:38:22.427638 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.427593 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0" containerName="istio-proxy" Jul 10 14:38:22.427638 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.427609 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb14c9cb-560e-4a16-83d6-5a2fccb24c0e" containerName="istio-proxy" Jul 10 14:38:22.427638 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.427620 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb14c9cb-560e-4a16-83d6-5a2fccb24c0e" containerName="istio-proxy" Jul 10 14:38:22.427876 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.427724 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0" containerName="istio-proxy" Jul 10 14:38:22.430771 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.430752 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:22.436457 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.436430 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-ce362d-openshift-default-dockercfg-cqrnc\"" Jul 10 14:38:22.500339 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.500306 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m"] Jul 10 14:38:22.551521 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.551491 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3592f36d-d621-4a8c-86b3-39c1009756f3-istio-podinfo\") pod \"e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:22.551677 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.551526 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3592f36d-d621-4a8c-86b3-39c1009756f3-workload-socket\") pod \"e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:22.551677 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.551563 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3592f36d-d621-4a8c-86b3-39c1009756f3-credential-socket\") pod \"e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:22.551677 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.551607 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3592f36d-d621-4a8c-86b3-39c1009756f3-istio-token\") pod \"e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:22.551677 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.551639 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3592f36d-d621-4a8c-86b3-39c1009756f3-istio-envoy\") pod \"e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:22.551833 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.551710 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3592f36d-d621-4a8c-86b3-39c1009756f3-workload-certs\") pod \"e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:22.551833 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.551738 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5tcp\" (UniqueName: \"kubernetes.io/projected/3592f36d-d621-4a8c-86b3-39c1009756f3-kube-api-access-z5tcp\") pod \"e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:22.551833 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.551757 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3592f36d-d621-4a8c-86b3-39c1009756f3-istio-data\") pod \"e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:22.551833 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.551775 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3592f36d-d621-4a8c-86b3-39c1009756f3-istiod-ca-cert\") pod \"e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:22.653205 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.653170 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3592f36d-d621-4a8c-86b3-39c1009756f3-istio-envoy\") pod \"e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:22.653383 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.653224 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3592f36d-d621-4a8c-86b3-39c1009756f3-workload-certs\") pod \"e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:22.653383 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.653338 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5tcp\" (UniqueName: \"kubernetes.io/projected/3592f36d-d621-4a8c-86b3-39c1009756f3-kube-api-access-z5tcp\") pod \"e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:22.653499 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.653380 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3592f36d-d621-4a8c-86b3-39c1009756f3-istio-data\") pod \"e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:22.653499 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.653403 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3592f36d-d621-4a8c-86b3-39c1009756f3-istiod-ca-cert\") pod \"e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:22.653499 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.653455 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3592f36d-d621-4a8c-86b3-39c1009756f3-istio-podinfo\") pod \"e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:22.653499 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.653480 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3592f36d-d621-4a8c-86b3-39c1009756f3-workload-socket\") pod \"e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:22.653694 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.653543 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3592f36d-d621-4a8c-86b3-39c1009756f3-workload-certs\") pod \"e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:22.653694 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.653551 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3592f36d-d621-4a8c-86b3-39c1009756f3-credential-socket\") pod \"e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:22.653801 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.653725 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3592f36d-d621-4a8c-86b3-39c1009756f3-istio-data\") pod \"e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:22.653801 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.653730 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3592f36d-d621-4a8c-86b3-39c1009756f3-istio-token\") pod \"e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:22.653910 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.653810 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3592f36d-d621-4a8c-86b3-39c1009756f3-credential-socket\") pod \"e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:22.653910 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.653869 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3592f36d-d621-4a8c-86b3-39c1009756f3-workload-socket\") pod \"e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:22.654207 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.654189 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3592f36d-d621-4a8c-86b3-39c1009756f3-istiod-ca-cert\") pod \"e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:22.655510 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.655490 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3592f36d-d621-4a8c-86b3-39c1009756f3-istio-envoy\") pod \"e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:22.655832 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.655814 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3592f36d-d621-4a8c-86b3-39c1009756f3-istio-podinfo\") pod \"e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:22.666755 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.666733 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5tcp\" (UniqueName: \"kubernetes.io/projected/3592f36d-d621-4a8c-86b3-39c1009756f3-kube-api-access-z5tcp\") pod \"e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:22.666755 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.666742 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3592f36d-d621-4a8c-86b3-39c1009756f3-istio-token\") pod \"e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:22.741482 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.741411 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:22.909282 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.909223 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m"] Jul 10 14:38:22.911424 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:38:22.911401 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3592f36d_d621_4a8c_86b3_39c1009756f3.slice/crio-60697943f056229cf63c11837e095f2316a64742249f7ff982809136a17018c8 WatchSource:0}: Error finding container 60697943f056229cf63c11837e095f2316a64742249f7ff982809136a17018c8: Status 404 returned error can't find the container with id 60697943f056229cf63c11837e095f2316a64742249f7ff982809136a17018c8 Jul 10 14:38:22.913456 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.913415 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:38:22.913574 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.913503 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:38:22.913574 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:22.913548 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:38:23.600198 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:23.600164 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" event={"ID":"3592f36d-d621-4a8c-86b3-39c1009756f3","Type":"ContainerStarted","Data":"276756ac443d612fe6c1b71d9ebb5878faa5c1bd6dd3c837b05cae7e2de7bf84"} Jul 10 14:38:23.600674 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:23.600213 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" event={"ID":"3592f36d-d621-4a8c-86b3-39c1009756f3","Type":"ContainerStarted","Data":"60697943f056229cf63c11837e095f2316a64742249f7ff982809136a17018c8"} Jul 10 14:38:23.629634 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:23.629589 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" podStartSLOduration=1.629569 podStartE2EDuration="1.629569s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:38:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:38:23.626978172 +0000 UTC m=+1827.053202493" watchObservedRunningTime="2026-07-10 14:38:23.629569 +0000 UTC m=+1827.055793321" Jul 10 14:38:23.741678 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:23.741638 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:23.747249 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:23.747217 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:24.607869 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:24.607825 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:24.608651 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:24.608630 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:30.911920 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:30.911890 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q"] Jul 10 14:38:30.912404 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:30.912377 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="19e4d3cb-1e8d-47b2-bbc5-c34c5558fef0" containerName="istio-proxy" Jul 10 14:38:30.915448 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:30.915430 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:30.925040 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:30.925021 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-a8bf33-openshift-default-dockercfg-4k7l7\"" Jul 10 14:38:30.930740 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:30.930718 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q"] Jul 10 14:38:31.028218 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.028179 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63e27472-7559-472a-9d33-66591daf7f9a-istio-data\") pod \"e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:31.028218 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.028214 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63e27472-7559-472a-9d33-66591daf7f9a-istio-envoy\") pod \"e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:31.028419 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.028327 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e27472-7559-472a-9d33-66591daf7f9a-workload-socket\") pod \"e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:31.028419 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.028353 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e27472-7559-472a-9d33-66591daf7f9a-credential-socket\") pod \"e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:31.028419 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.028374 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63e27472-7559-472a-9d33-66591daf7f9a-istio-token\") pod \"e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:31.028419 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.028403 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63e27472-7559-472a-9d33-66591daf7f9a-istio-podinfo\") pod \"e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:31.028570 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.028421 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63e27472-7559-472a-9d33-66591daf7f9a-istiod-ca-cert\") pod \"e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:31.028570 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.028442 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63e27472-7559-472a-9d33-66591daf7f9a-workload-certs\") pod \"e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:31.028570 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.028533 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbjds\" (UniqueName: \"kubernetes.io/projected/63e27472-7559-472a-9d33-66591daf7f9a-kube-api-access-dbjds\") pod \"e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:31.130036 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.129998 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63e27472-7559-472a-9d33-66591daf7f9a-istio-data\") pod \"e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:31.130036 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.130039 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63e27472-7559-472a-9d33-66591daf7f9a-istio-envoy\") pod \"e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:31.130296 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.130148 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e27472-7559-472a-9d33-66591daf7f9a-workload-socket\") pod \"e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:31.130296 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.130173 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e27472-7559-472a-9d33-66591daf7f9a-credential-socket\") pod \"e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:31.130296 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.130200 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63e27472-7559-472a-9d33-66591daf7f9a-istio-token\") pod \"e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:31.130296 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.130230 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63e27472-7559-472a-9d33-66591daf7f9a-istio-podinfo\") pod \"e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:31.130296 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.130253 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63e27472-7559-472a-9d33-66591daf7f9a-istiod-ca-cert\") pod \"e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:31.130296 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.130286 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63e27472-7559-472a-9d33-66591daf7f9a-workload-certs\") pod \"e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:31.130596 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.130357 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbjds\" (UniqueName: \"kubernetes.io/projected/63e27472-7559-472a-9d33-66591daf7f9a-kube-api-access-dbjds\") pod \"e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:31.130596 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.130475 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63e27472-7559-472a-9d33-66591daf7f9a-istio-data\") pod \"e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:31.130596 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.130538 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e27472-7559-472a-9d33-66591daf7f9a-workload-socket\") pod \"e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:31.130729 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.130675 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e27472-7559-472a-9d33-66591daf7f9a-credential-socket\") pod \"e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:31.130766 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.130728 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63e27472-7559-472a-9d33-66591daf7f9a-workload-certs\") pod \"e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:31.131277 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.131254 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63e27472-7559-472a-9d33-66591daf7f9a-istiod-ca-cert\") pod \"e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:31.132700 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.132671 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63e27472-7559-472a-9d33-66591daf7f9a-istio-envoy\") pod \"e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:31.132700 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.132687 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63e27472-7559-472a-9d33-66591daf7f9a-istio-podinfo\") pod \"e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:31.139902 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.139883 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63e27472-7559-472a-9d33-66591daf7f9a-istio-token\") pod \"e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:31.140215 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.140194 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbjds\" (UniqueName: \"kubernetes.io/projected/63e27472-7559-472a-9d33-66591daf7f9a-kube-api-access-dbjds\") pod \"e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:31.226016 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.225919 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:31.364922 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.364897 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q"] Jul 10 14:38:31.366502 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:38:31.366464 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63e27472_7559_472a_9d33_66591daf7f9a.slice/crio-ea63f96b8a0a1f4dcfe5468d70706007323b6f54d732a50856bdea32a5f032fb WatchSource:0}: Error finding container ea63f96b8a0a1f4dcfe5468d70706007323b6f54d732a50856bdea32a5f032fb: Status 404 returned error can't find the container with id ea63f96b8a0a1f4dcfe5468d70706007323b6f54d732a50856bdea32a5f032fb Jul 10 14:38:31.368906 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.368874 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:38:31.369014 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.368940 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:38:31.369014 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.368997 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:38:31.640219 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.640181 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" event={"ID":"63e27472-7559-472a-9d33-66591daf7f9a","Type":"ContainerStarted","Data":"264e2324be6faf2637e420315fababd03522c3e4fa3c57b823ef61e87c9e3bca"} Jul 10 14:38:31.640411 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.640247 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" event={"ID":"63e27472-7559-472a-9d33-66591daf7f9a","Type":"ContainerStarted","Data":"ea63f96b8a0a1f4dcfe5468d70706007323b6f54d732a50856bdea32a5f032fb"} Jul 10 14:38:31.669649 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:31.669604 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" podStartSLOduration=1.669588946 podStartE2EDuration="1.669588946s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:38:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:38:31.667622873 +0000 UTC m=+1835.093847193" watchObservedRunningTime="2026-07-10 14:38:31.669588946 +0000 UTC m=+1835.095813265" Jul 10 14:38:32.226435 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:32.226408 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:32.231689 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:32.231665 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:32.644696 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:32.644670 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:32.645715 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:32.645695 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:40.650162 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:40.650124 2579 patch_prober.go:28] interesting pod/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 10 14:38:40.650629 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:40.650204 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" podUID="3592f36d-d621-4a8c-86b3-39c1009756f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 10 14:38:41.691885 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:41.691853 2579 generic.go:356] "Generic (PLEG): container finished" podID="3592f36d-d621-4a8c-86b3-39c1009756f3" containerID="276756ac443d612fe6c1b71d9ebb5878faa5c1bd6dd3c837b05cae7e2de7bf84" exitCode=0 Jul 10 14:38:41.692324 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:41.691907 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" event={"ID":"3592f36d-d621-4a8c-86b3-39c1009756f3","Type":"ContainerDied","Data":"276756ac443d612fe6c1b71d9ebb5878faa5c1bd6dd3c837b05cae7e2de7bf84"} Jul 10 14:38:41.692371 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:41.692325 2579 scope.go:117] "RemoveContainer" containerID="276756ac443d612fe6c1b71d9ebb5878faa5c1bd6dd3c837b05cae7e2de7bf84" Jul 10 14:38:41.693324 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:41.693295 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:38:41.693397 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:41.693383 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:38:41.693434 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:41.693420 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:38:42.698756 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:42.698716 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" event={"ID":"3592f36d-d621-4a8c-86b3-39c1009756f3","Type":"ContainerStarted","Data":"a73d2a0a76d1a828d799f3090db9a630c258e283522fa193b6b10aa05d5cd562"} Jul 10 14:38:42.742279 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:42.742236 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:42.742483 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:42.742362 2579 patch_prober.go:28] interesting pod/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 10 14:38:42.742483 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:42.742406 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" podUID="3592f36d-d621-4a8c-86b3-39c1009756f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 10 14:38:43.742125 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:43.742084 2579 patch_prober.go:28] interesting pod/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 10 14:38:43.742640 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:43.742160 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" podUID="3592f36d-d621-4a8c-86b3-39c1009756f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 10 14:38:44.741907 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:44.741861 2579 patch_prober.go:28] interesting pod/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 10 14:38:44.742145 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:44.741943 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" podUID="3592f36d-d621-4a8c-86b3-39c1009756f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 10 14:38:45.742496 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:45.742447 2579 patch_prober.go:28] interesting pod/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 10 14:38:45.743009 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:45.742536 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" podUID="3592f36d-d621-4a8c-86b3-39c1009756f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 10 14:38:46.746404 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:46.746377 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:46.746823 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:46.746737 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:46.747458 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:46.747436 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:38:47.978208 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:47.977050 2579 patch_prober.go:28] interesting pod/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": read tcp 10.132.0.2:44436->10.132.0.45:15021: read: connection reset by peer" start-of-body= Jul 10 14:38:47.978208 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:47.977112 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" podUID="63e27472-7559-472a-9d33-66591daf7f9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": read tcp 10.132.0.2:44436->10.132.0.45:15021: read: connection reset by peer" Jul 10 14:38:48.728050 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:48.728015 2579 generic.go:356] "Generic (PLEG): container finished" podID="63e27472-7559-472a-9d33-66591daf7f9a" containerID="264e2324be6faf2637e420315fababd03522c3e4fa3c57b823ef61e87c9e3bca" exitCode=0 Jul 10 14:38:48.728246 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:48.728090 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" event={"ID":"63e27472-7559-472a-9d33-66591daf7f9a","Type":"ContainerDied","Data":"264e2324be6faf2637e420315fababd03522c3e4fa3c57b823ef61e87c9e3bca"} Jul 10 14:38:48.728595 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:48.728578 2579 scope.go:117] "RemoveContainer" containerID="264e2324be6faf2637e420315fababd03522c3e4fa3c57b823ef61e87c9e3bca" Jul 10 14:38:48.729490 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:48.729463 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:38:48.729580 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:48.729546 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:38:48.729642 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:48.729590 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:38:49.738852 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:49.738812 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" event={"ID":"63e27472-7559-472a-9d33-66591daf7f9a","Type":"ContainerStarted","Data":"2f29d0cf7685801465841338c98d580092a7e1109a880df22e7f3f936c3eccfb"} Jul 10 14:38:50.227157 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:50.227120 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:50.227462 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:50.227371 2579 patch_prober.go:28] interesting pod/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 10 14:38:50.227628 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:50.227604 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" podUID="63e27472-7559-472a-9d33-66591daf7f9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 10 14:38:51.226744 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:51.226701 2579 patch_prober.go:28] interesting pod/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 10 14:38:51.227256 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:51.226779 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" podUID="63e27472-7559-472a-9d33-66591daf7f9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 10 14:38:52.227256 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:52.227215 2579 patch_prober.go:28] interesting pod/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 10 14:38:52.227858 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:52.227824 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" podUID="63e27472-7559-472a-9d33-66591daf7f9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 10 14:38:53.240975 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:53.237368 2579 patch_prober.go:28] interesting pod/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 10 14:38:53.240975 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:53.237431 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" podUID="63e27472-7559-472a-9d33-66591daf7f9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 10 14:38:54.229861 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:54.229833 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:54.230191 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:54.230169 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:38:54.230882 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:38:54.230864 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:40:21.176347 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:21.176318 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m"] Jul 10 14:40:21.177093 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:21.176536 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" podUID="3592f36d-d621-4a8c-86b3-39c1009756f3" containerName="istio-proxy" containerID="cri-o://a73d2a0a76d1a828d799f3090db9a630c258e283522fa193b6b10aa05d5cd562" gracePeriod=30 Jul 10 14:40:26.434021 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:26.433995 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:40:26.571446 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:26.571359 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3592f36d-d621-4a8c-86b3-39c1009756f3-credential-socket\") pod \"3592f36d-d621-4a8c-86b3-39c1009756f3\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " Jul 10 14:40:26.571446 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:26.571400 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3592f36d-d621-4a8c-86b3-39c1009756f3-istio-podinfo\") pod \"3592f36d-d621-4a8c-86b3-39c1009756f3\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " Jul 10 14:40:26.571446 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:26.571444 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3592f36d-d621-4a8c-86b3-39c1009756f3-istio-token\") pod \"3592f36d-d621-4a8c-86b3-39c1009756f3\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " Jul 10 14:40:26.571728 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:26.571466 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5tcp\" (UniqueName: \"kubernetes.io/projected/3592f36d-d621-4a8c-86b3-39c1009756f3-kube-api-access-z5tcp\") pod \"3592f36d-d621-4a8c-86b3-39c1009756f3\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " Jul 10 14:40:26.571728 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:26.571496 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3592f36d-d621-4a8c-86b3-39c1009756f3-istiod-ca-cert\") pod \"3592f36d-d621-4a8c-86b3-39c1009756f3\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " Jul 10 14:40:26.571728 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:26.571535 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3592f36d-d621-4a8c-86b3-39c1009756f3-istio-data\") pod \"3592f36d-d621-4a8c-86b3-39c1009756f3\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " Jul 10 14:40:26.571728 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:26.571609 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3592f36d-d621-4a8c-86b3-39c1009756f3-workload-socket\") pod \"3592f36d-d621-4a8c-86b3-39c1009756f3\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " Jul 10 14:40:26.571728 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:26.571632 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3592f36d-d621-4a8c-86b3-39c1009756f3-workload-certs\") pod \"3592f36d-d621-4a8c-86b3-39c1009756f3\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " Jul 10 14:40:26.571728 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:26.571679 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3592f36d-d621-4a8c-86b3-39c1009756f3-istio-envoy\") pod \"3592f36d-d621-4a8c-86b3-39c1009756f3\" (UID: \"3592f36d-d621-4a8c-86b3-39c1009756f3\") " Jul 10 14:40:26.571728 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:26.571695 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3592f36d-d621-4a8c-86b3-39c1009756f3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3592f36d-d621-4a8c-86b3-39c1009756f3" (UID: "3592f36d-d621-4a8c-86b3-39c1009756f3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:40:26.572128 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:26.571918 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3592f36d-d621-4a8c-86b3-39c1009756f3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3592f36d-d621-4a8c-86b3-39c1009756f3" (UID: "3592f36d-d621-4a8c-86b3-39c1009756f3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:40:26.572128 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:26.571933 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3592f36d-d621-4a8c-86b3-39c1009756f3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3592f36d-d621-4a8c-86b3-39c1009756f3" (UID: "3592f36d-d621-4a8c-86b3-39c1009756f3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:40:26.572128 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:26.572015 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3592f36d-d621-4a8c-86b3-39c1009756f3-workload-socket\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:40:26.572128 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:26.572033 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3592f36d-d621-4a8c-86b3-39c1009756f3-credential-socket\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:40:26.572335 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:26.572214 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3592f36d-d621-4a8c-86b3-39c1009756f3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3592f36d-d621-4a8c-86b3-39c1009756f3" (UID: "3592f36d-d621-4a8c-86b3-39c1009756f3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:40:26.572561 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:26.572531 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3592f36d-d621-4a8c-86b3-39c1009756f3-istio-data" (OuterVolumeSpecName: "istio-data") pod "3592f36d-d621-4a8c-86b3-39c1009756f3" (UID: "3592f36d-d621-4a8c-86b3-39c1009756f3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:40:26.573835 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:26.573801 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3592f36d-d621-4a8c-86b3-39c1009756f3-istio-token" (OuterVolumeSpecName: "istio-token") pod "3592f36d-d621-4a8c-86b3-39c1009756f3" (UID: "3592f36d-d621-4a8c-86b3-39c1009756f3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:40:26.573982 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:26.573860 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3592f36d-d621-4a8c-86b3-39c1009756f3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3592f36d-d621-4a8c-86b3-39c1009756f3" (UID: "3592f36d-d621-4a8c-86b3-39c1009756f3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 14:40:26.573982 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:26.573968 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3592f36d-d621-4a8c-86b3-39c1009756f3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3592f36d-d621-4a8c-86b3-39c1009756f3" (UID: "3592f36d-d621-4a8c-86b3-39c1009756f3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:40:26.574104 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:26.573977 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3592f36d-d621-4a8c-86b3-39c1009756f3-kube-api-access-z5tcp" (OuterVolumeSpecName: "kube-api-access-z5tcp") pod "3592f36d-d621-4a8c-86b3-39c1009756f3" (UID: "3592f36d-d621-4a8c-86b3-39c1009756f3"). InnerVolumeSpecName "kube-api-access-z5tcp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:40:26.673094 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:26.673061 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3592f36d-d621-4a8c-86b3-39c1009756f3-workload-certs\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:40:26.673094 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:26.673087 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3592f36d-d621-4a8c-86b3-39c1009756f3-istio-envoy\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:40:26.673094 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:26.673096 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3592f36d-d621-4a8c-86b3-39c1009756f3-istio-podinfo\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:40:26.673094 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:26.673104 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3592f36d-d621-4a8c-86b3-39c1009756f3-istio-token\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:40:26.673342 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:26.673113 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5tcp\" (UniqueName: \"kubernetes.io/projected/3592f36d-d621-4a8c-86b3-39c1009756f3-kube-api-access-z5tcp\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:40:26.673342 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:26.673123 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3592f36d-d621-4a8c-86b3-39c1009756f3-istiod-ca-cert\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:40:26.673342 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:26.673131 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3592f36d-d621-4a8c-86b3-39c1009756f3-istio-data\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:40:27.206116 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:27.206083 2579 generic.go:356] "Generic (PLEG): container finished" podID="3592f36d-d621-4a8c-86b3-39c1009756f3" containerID="a73d2a0a76d1a828d799f3090db9a630c258e283522fa193b6b10aa05d5cd562" exitCode=0 Jul 10 14:40:27.206291 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:27.206155 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" Jul 10 14:40:27.206291 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:27.206166 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" event={"ID":"3592f36d-d621-4a8c-86b3-39c1009756f3","Type":"ContainerDied","Data":"a73d2a0a76d1a828d799f3090db9a630c258e283522fa193b6b10aa05d5cd562"} Jul 10 14:40:27.206291 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:27.206218 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m" event={"ID":"3592f36d-d621-4a8c-86b3-39c1009756f3","Type":"ContainerDied","Data":"60697943f056229cf63c11837e095f2316a64742249f7ff982809136a17018c8"} Jul 10 14:40:27.206291 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:27.206240 2579 scope.go:117] "RemoveContainer" containerID="a73d2a0a76d1a828d799f3090db9a630c258e283522fa193b6b10aa05d5cd562" Jul 10 14:40:27.215307 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:27.215281 2579 scope.go:117] "RemoveContainer" containerID="276756ac443d612fe6c1b71d9ebb5878faa5c1bd6dd3c837b05cae7e2de7bf84" Jul 10 14:40:27.222969 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:27.222934 2579 scope.go:117] "RemoveContainer" containerID="a73d2a0a76d1a828d799f3090db9a630c258e283522fa193b6b10aa05d5cd562" Jul 10 14:40:27.223197 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:40:27.223179 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a73d2a0a76d1a828d799f3090db9a630c258e283522fa193b6b10aa05d5cd562\": container with ID starting with a73d2a0a76d1a828d799f3090db9a630c258e283522fa193b6b10aa05d5cd562 not found: ID does not exist" containerID="a73d2a0a76d1a828d799f3090db9a630c258e283522fa193b6b10aa05d5cd562" Jul 10 14:40:27.223259 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:27.223205 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a73d2a0a76d1a828d799f3090db9a630c258e283522fa193b6b10aa05d5cd562"} err="failed to get container status \"a73d2a0a76d1a828d799f3090db9a630c258e283522fa193b6b10aa05d5cd562\": rpc error: code = NotFound desc = could not find container \"a73d2a0a76d1a828d799f3090db9a630c258e283522fa193b6b10aa05d5cd562\": container with ID starting with a73d2a0a76d1a828d799f3090db9a630c258e283522fa193b6b10aa05d5cd562 not found: ID does not exist" Jul 10 14:40:27.223259 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:27.223222 2579 scope.go:117] "RemoveContainer" containerID="276756ac443d612fe6c1b71d9ebb5878faa5c1bd6dd3c837b05cae7e2de7bf84" Jul 10 14:40:27.223470 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:40:27.223453 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"276756ac443d612fe6c1b71d9ebb5878faa5c1bd6dd3c837b05cae7e2de7bf84\": container with ID starting with 276756ac443d612fe6c1b71d9ebb5878faa5c1bd6dd3c837b05cae7e2de7bf84 not found: ID does not exist" containerID="276756ac443d612fe6c1b71d9ebb5878faa5c1bd6dd3c837b05cae7e2de7bf84" Jul 10 14:40:27.223510 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:27.223476 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"276756ac443d612fe6c1b71d9ebb5878faa5c1bd6dd3c837b05cae7e2de7bf84"} err="failed to get container status \"276756ac443d612fe6c1b71d9ebb5878faa5c1bd6dd3c837b05cae7e2de7bf84\": rpc error: code = NotFound desc = could not find container \"276756ac443d612fe6c1b71d9ebb5878faa5c1bd6dd3c837b05cae7e2de7bf84\": container with ID starting with 276756ac443d612fe6c1b71d9ebb5878faa5c1bd6dd3c837b05cae7e2de7bf84 not found: ID does not exist" Jul 10 14:40:27.228554 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:27.228532 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m"] Jul 10 14:40:27.233591 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:27.233572 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-ce362d-openshift-default-7bddfd8cd7-tc52m"] Jul 10 14:40:28.938297 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:28.938265 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q"] Jul 10 14:40:28.938745 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:28.938477 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" podUID="63e27472-7559-472a-9d33-66591daf7f9a" containerName="istio-proxy" containerID="cri-o://2f29d0cf7685801465841338c98d580092a7e1109a880df22e7f3f936c3eccfb" gracePeriod=30 Jul 10 14:40:29.102057 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:29.102016 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3592f36d-d621-4a8c-86b3-39c1009756f3" path="/var/lib/kubelet/pods/3592f36d-d621-4a8c-86b3-39c1009756f3/volumes" Jul 10 14:40:29.811392 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:29.811362 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt"] Jul 10 14:40:29.811803 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:29.811787 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3592f36d-d621-4a8c-86b3-39c1009756f3" containerName="istio-proxy" Jul 10 14:40:29.811897 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:29.811806 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3592f36d-d621-4a8c-86b3-39c1009756f3" containerName="istio-proxy" Jul 10 14:40:29.811897 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:29.811830 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3592f36d-d621-4a8c-86b3-39c1009756f3" containerName="istio-proxy" Jul 10 14:40:29.811897 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:29.811839 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3592f36d-d621-4a8c-86b3-39c1009756f3" containerName="istio-proxy" Jul 10 14:40:29.812079 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:29.811922 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3592f36d-d621-4a8c-86b3-39c1009756f3" containerName="istio-proxy" Jul 10 14:40:29.816381 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:29.816356 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:29.820375 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:29.820357 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-5757a4-openshift-default-dockercfg-lw7ls\"" Jul 10 14:40:29.829531 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:29.829510 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt"] Jul 10 14:40:29.903059 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:29.903020 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57d9a163-a776-435e-9403-1befa5891784-workload-socket\") pod \"e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:29.903059 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:29.903069 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57d9a163-a776-435e-9403-1befa5891784-istio-podinfo\") pod \"e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:29.903306 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:29.903095 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57d9a163-a776-435e-9403-1befa5891784-istio-token\") pod \"e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:29.903306 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:29.903190 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57d9a163-a776-435e-9403-1befa5891784-istio-envoy\") pod \"e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:29.903306 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:29.903242 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57d9a163-a776-435e-9403-1befa5891784-credential-socket\") pod \"e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:29.903479 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:29.903380 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57d9a163-a776-435e-9403-1befa5891784-workload-certs\") pod \"e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:29.903479 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:29.903417 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57d9a163-a776-435e-9403-1befa5891784-istio-data\") pod \"e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:29.903479 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:29.903446 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gv2v\" (UniqueName: \"kubernetes.io/projected/57d9a163-a776-435e-9403-1befa5891784-kube-api-access-5gv2v\") pod \"e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:29.903633 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:29.903488 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57d9a163-a776-435e-9403-1befa5891784-istiod-ca-cert\") pod \"e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:30.004545 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:30.004514 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57d9a163-a776-435e-9403-1befa5891784-workload-certs\") pod \"e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:30.004984 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:30.004552 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57d9a163-a776-435e-9403-1befa5891784-istio-data\") pod \"e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:30.004984 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:30.004573 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gv2v\" (UniqueName: \"kubernetes.io/projected/57d9a163-a776-435e-9403-1befa5891784-kube-api-access-5gv2v\") pod \"e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:30.004984 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:30.004596 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57d9a163-a776-435e-9403-1befa5891784-istiod-ca-cert\") pod \"e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:30.004984 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:30.004614 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57d9a163-a776-435e-9403-1befa5891784-workload-socket\") pod \"e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:30.004984 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:30.004630 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57d9a163-a776-435e-9403-1befa5891784-istio-podinfo\") pod \"e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:30.004984 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:30.004644 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57d9a163-a776-435e-9403-1befa5891784-istio-token\") pod \"e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:30.004984 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:30.004670 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57d9a163-a776-435e-9403-1befa5891784-istio-envoy\") pod \"e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:30.004984 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:30.004694 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57d9a163-a776-435e-9403-1befa5891784-credential-socket\") pod \"e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:30.005403 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:30.005346 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57d9a163-a776-435e-9403-1befa5891784-workload-certs\") pod \"e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:30.005461 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:30.005410 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57d9a163-a776-435e-9403-1befa5891784-istio-data\") pod \"e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:30.005638 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:30.005604 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57d9a163-a776-435e-9403-1befa5891784-workload-socket\") pod \"e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:30.006341 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:30.006314 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57d9a163-a776-435e-9403-1befa5891784-credential-socket\") pod \"e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:30.015538 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:30.006479 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57d9a163-a776-435e-9403-1befa5891784-istiod-ca-cert\") pod \"e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:30.015538 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:30.008725 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57d9a163-a776-435e-9403-1befa5891784-istio-envoy\") pod \"e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:30.016972 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:30.016924 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57d9a163-a776-435e-9403-1befa5891784-istio-podinfo\") pod \"e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:30.018870 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:30.018844 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57d9a163-a776-435e-9403-1befa5891784-istio-token\") pod \"e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:30.019125 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:30.019101 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gv2v\" (UniqueName: \"kubernetes.io/projected/57d9a163-a776-435e-9403-1befa5891784-kube-api-access-5gv2v\") pod \"e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:30.128689 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:30.128657 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:30.283170 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:30.283143 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt"] Jul 10 14:40:30.283855 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:40:30.283827 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57d9a163_a776_435e_9403_1befa5891784.slice/crio-b7adfe42333ae46b70ee0e81679d216b86c446f847f243282efc184a7235fb4e WatchSource:0}: Error finding container b7adfe42333ae46b70ee0e81679d216b86c446f847f243282efc184a7235fb4e: Status 404 returned error can't find the container with id b7adfe42333ae46b70ee0e81679d216b86c446f847f243282efc184a7235fb4e Jul 10 14:40:30.286440 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:30.286406 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:40:30.286534 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:30.286470 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:40:30.286534 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:30.286501 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:40:31.230794 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:31.230757 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" event={"ID":"57d9a163-a776-435e-9403-1befa5891784","Type":"ContainerStarted","Data":"ea26c0c50c73a00b2cd0ef3e667fa09e05972d781969055c71e7d57f0ee3d2e0"} Jul 10 14:40:31.231217 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:31.230813 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" event={"ID":"57d9a163-a776-435e-9403-1befa5891784","Type":"ContainerStarted","Data":"b7adfe42333ae46b70ee0e81679d216b86c446f847f243282efc184a7235fb4e"} Jul 10 14:40:31.256674 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:31.256632 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" podStartSLOduration=2.256618479 podStartE2EDuration="2.256618479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:40:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:40:31.254641776 +0000 UTC m=+1954.680866096" watchObservedRunningTime="2026-07-10 14:40:31.256618479 +0000 UTC m=+1954.682842799" Jul 10 14:40:32.129453 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:32.129417 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:32.134083 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:32.134057 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:32.236014 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:32.235990 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:32.237035 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:32.237015 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:34.207299 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.207245 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:40:34.247923 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.247897 2579 generic.go:356] "Generic (PLEG): container finished" podID="63e27472-7559-472a-9d33-66591daf7f9a" containerID="2f29d0cf7685801465841338c98d580092a7e1109a880df22e7f3f936c3eccfb" exitCode=0 Jul 10 14:40:34.248086 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.247935 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" Jul 10 14:40:34.248086 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.247981 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" event={"ID":"63e27472-7559-472a-9d33-66591daf7f9a","Type":"ContainerDied","Data":"2f29d0cf7685801465841338c98d580092a7e1109a880df22e7f3f936c3eccfb"} Jul 10 14:40:34.248086 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.248036 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q" event={"ID":"63e27472-7559-472a-9d33-66591daf7f9a","Type":"ContainerDied","Data":"ea63f96b8a0a1f4dcfe5468d70706007323b6f54d732a50856bdea32a5f032fb"} Jul 10 14:40:34.248086 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.248066 2579 scope.go:117] "RemoveContainer" containerID="2f29d0cf7685801465841338c98d580092a7e1109a880df22e7f3f936c3eccfb" Jul 10 14:40:34.257564 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.257549 2579 scope.go:117] "RemoveContainer" containerID="264e2324be6faf2637e420315fababd03522c3e4fa3c57b823ef61e87c9e3bca" Jul 10 14:40:34.265488 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.265471 2579 scope.go:117] "RemoveContainer" containerID="2f29d0cf7685801465841338c98d580092a7e1109a880df22e7f3f936c3eccfb" Jul 10 14:40:34.265751 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:40:34.265722 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f29d0cf7685801465841338c98d580092a7e1109a880df22e7f3f936c3eccfb\": container with ID starting with 2f29d0cf7685801465841338c98d580092a7e1109a880df22e7f3f936c3eccfb not found: ID does not exist" containerID="2f29d0cf7685801465841338c98d580092a7e1109a880df22e7f3f936c3eccfb" Jul 10 14:40:34.265832 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.265758 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f29d0cf7685801465841338c98d580092a7e1109a880df22e7f3f936c3eccfb"} err="failed to get container status \"2f29d0cf7685801465841338c98d580092a7e1109a880df22e7f3f936c3eccfb\": rpc error: code = NotFound desc = could not find container \"2f29d0cf7685801465841338c98d580092a7e1109a880df22e7f3f936c3eccfb\": container with ID starting with 2f29d0cf7685801465841338c98d580092a7e1109a880df22e7f3f936c3eccfb not found: ID does not exist" Jul 10 14:40:34.265832 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.265775 2579 scope.go:117] "RemoveContainer" containerID="264e2324be6faf2637e420315fababd03522c3e4fa3c57b823ef61e87c9e3bca" Jul 10 14:40:34.266079 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:40:34.266060 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"264e2324be6faf2637e420315fababd03522c3e4fa3c57b823ef61e87c9e3bca\": container with ID starting with 264e2324be6faf2637e420315fababd03522c3e4fa3c57b823ef61e87c9e3bca not found: ID does not exist" containerID="264e2324be6faf2637e420315fababd03522c3e4fa3c57b823ef61e87c9e3bca" Jul 10 14:40:34.266174 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.266086 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"264e2324be6faf2637e420315fababd03522c3e4fa3c57b823ef61e87c9e3bca"} err="failed to get container status \"264e2324be6faf2637e420315fababd03522c3e4fa3c57b823ef61e87c9e3bca\": rpc error: code = NotFound desc = could not find container \"264e2324be6faf2637e420315fababd03522c3e4fa3c57b823ef61e87c9e3bca\": container with ID starting with 264e2324be6faf2637e420315fababd03522c3e4fa3c57b823ef61e87c9e3bca not found: ID does not exist" Jul 10 14:40:34.347096 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.347064 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63e27472-7559-472a-9d33-66591daf7f9a-istio-podinfo\") pod \"63e27472-7559-472a-9d33-66591daf7f9a\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " Jul 10 14:40:34.347273 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.347121 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63e27472-7559-472a-9d33-66591daf7f9a-istio-data\") pod \"63e27472-7559-472a-9d33-66591daf7f9a\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " Jul 10 14:40:34.347273 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.347153 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63e27472-7559-472a-9d33-66591daf7f9a-istio-envoy\") pod \"63e27472-7559-472a-9d33-66591daf7f9a\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " Jul 10 14:40:34.347273 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.347184 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63e27472-7559-472a-9d33-66591daf7f9a-workload-certs\") pod \"63e27472-7559-472a-9d33-66591daf7f9a\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " Jul 10 14:40:34.347273 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.347205 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e27472-7559-472a-9d33-66591daf7f9a-credential-socket\") pod \"63e27472-7559-472a-9d33-66591daf7f9a\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " Jul 10 14:40:34.347273 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.347236 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e27472-7559-472a-9d33-66591daf7f9a-workload-socket\") pod \"63e27472-7559-472a-9d33-66591daf7f9a\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " Jul 10 14:40:34.347273 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.347263 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63e27472-7559-472a-9d33-66591daf7f9a-istio-token\") pod \"63e27472-7559-472a-9d33-66591daf7f9a\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " Jul 10 14:40:34.347572 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.347311 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbjds\" (UniqueName: \"kubernetes.io/projected/63e27472-7559-472a-9d33-66591daf7f9a-kube-api-access-dbjds\") pod \"63e27472-7559-472a-9d33-66591daf7f9a\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " Jul 10 14:40:34.347572 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.347358 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63e27472-7559-472a-9d33-66591daf7f9a-istiod-ca-cert\") pod \"63e27472-7559-472a-9d33-66591daf7f9a\" (UID: \"63e27472-7559-472a-9d33-66591daf7f9a\") " Jul 10 14:40:34.347677 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.347574 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63e27472-7559-472a-9d33-66591daf7f9a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "63e27472-7559-472a-9d33-66591daf7f9a" (UID: "63e27472-7559-472a-9d33-66591daf7f9a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:40:34.347677 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.347586 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63e27472-7559-472a-9d33-66591daf7f9a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "63e27472-7559-472a-9d33-66591daf7f9a" (UID: "63e27472-7559-472a-9d33-66591daf7f9a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:40:34.347782 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.347765 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63e27472-7559-472a-9d33-66591daf7f9a-workload-certs\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:40:34.347838 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.347786 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e27472-7559-472a-9d33-66591daf7f9a-credential-socket\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:40:34.347920 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.347892 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63e27472-7559-472a-9d33-66591daf7f9a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "63e27472-7559-472a-9d33-66591daf7f9a" (UID: "63e27472-7559-472a-9d33-66591daf7f9a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:40:34.348186 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.348149 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63e27472-7559-472a-9d33-66591daf7f9a-istio-data" (OuterVolumeSpecName: "istio-data") pod "63e27472-7559-472a-9d33-66591daf7f9a" (UID: "63e27472-7559-472a-9d33-66591daf7f9a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:40:34.348309 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.348246 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63e27472-7559-472a-9d33-66591daf7f9a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "63e27472-7559-472a-9d33-66591daf7f9a" (UID: "63e27472-7559-472a-9d33-66591daf7f9a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:40:34.349553 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.349533 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63e27472-7559-472a-9d33-66591daf7f9a-istio-token" (OuterVolumeSpecName: "istio-token") pod "63e27472-7559-472a-9d33-66591daf7f9a" (UID: "63e27472-7559-472a-9d33-66591daf7f9a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:40:34.349682 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.349661 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63e27472-7559-472a-9d33-66591daf7f9a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "63e27472-7559-472a-9d33-66591daf7f9a" (UID: "63e27472-7559-472a-9d33-66591daf7f9a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:40:34.349813 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.349798 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/63e27472-7559-472a-9d33-66591daf7f9a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "63e27472-7559-472a-9d33-66591daf7f9a" (UID: "63e27472-7559-472a-9d33-66591daf7f9a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 14:40:34.350017 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.349994 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63e27472-7559-472a-9d33-66591daf7f9a-kube-api-access-dbjds" (OuterVolumeSpecName: "kube-api-access-dbjds") pod "63e27472-7559-472a-9d33-66591daf7f9a" (UID: "63e27472-7559-472a-9d33-66591daf7f9a"). InnerVolumeSpecName "kube-api-access-dbjds". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:40:34.448909 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.448877 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e27472-7559-472a-9d33-66591daf7f9a-workload-socket\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:40:34.448909 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.448903 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63e27472-7559-472a-9d33-66591daf7f9a-istio-token\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:40:34.449129 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.448917 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbjds\" (UniqueName: \"kubernetes.io/projected/63e27472-7559-472a-9d33-66591daf7f9a-kube-api-access-dbjds\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:40:34.449129 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.448930 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63e27472-7559-472a-9d33-66591daf7f9a-istiod-ca-cert\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:40:34.449129 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.448941 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63e27472-7559-472a-9d33-66591daf7f9a-istio-podinfo\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:40:34.449129 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.448978 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63e27472-7559-472a-9d33-66591daf7f9a-istio-data\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:40:34.449129 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.448990 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63e27472-7559-472a-9d33-66591daf7f9a-istio-envoy\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:40:34.575179 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.575147 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q"] Jul 10 14:40:34.580353 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:34.580330 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-a8bf33-openshift-default-cfdc7d7cc-jb66q"] Jul 10 14:40:35.106732 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:35.106699 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63e27472-7559-472a-9d33-66591daf7f9a" path="/var/lib/kubelet/pods/63e27472-7559-472a-9d33-66591daf7f9a/volumes" Jul 10 14:40:48.278136 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:48.278094 2579 patch_prober.go:28] interesting pod/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 10 14:40:48.278533 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:48.278162 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" podUID="57d9a163-a776-435e-9403-1befa5891784" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 10 14:40:49.316917 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:49.316827 2579 generic.go:356] "Generic (PLEG): container finished" podID="57d9a163-a776-435e-9403-1befa5891784" containerID="ea26c0c50c73a00b2cd0ef3e667fa09e05972d781969055c71e7d57f0ee3d2e0" exitCode=0 Jul 10 14:40:49.317338 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:49.316907 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" event={"ID":"57d9a163-a776-435e-9403-1befa5891784","Type":"ContainerDied","Data":"ea26c0c50c73a00b2cd0ef3e667fa09e05972d781969055c71e7d57f0ee3d2e0"} Jul 10 14:40:49.317338 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:49.317296 2579 scope.go:117] "RemoveContainer" containerID="ea26c0c50c73a00b2cd0ef3e667fa09e05972d781969055c71e7d57f0ee3d2e0" Jul 10 14:40:49.318790 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:49.318753 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:40:49.319013 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:49.318992 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:40:49.319169 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:49.319151 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:40:50.325059 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:50.325026 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" event={"ID":"57d9a163-a776-435e-9403-1befa5891784","Type":"ContainerStarted","Data":"422d15d03fc82a0c41576544feb9c6d89a3c6aea47488dc375c1b824ad55c8e9"} Jul 10 14:40:51.129825 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:51.129787 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:51.130082 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:51.130053 2579 patch_prober.go:28] interesting pod/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 10 14:40:51.130165 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:51.130114 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" podUID="57d9a163-a776-435e-9403-1befa5891784" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 10 14:40:52.129598 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:52.129562 2579 patch_prober.go:28] interesting pod/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 10 14:40:52.130220 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:52.130189 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" podUID="57d9a163-a776-435e-9403-1befa5891784" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 10 14:40:53.129729 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:53.129693 2579 patch_prober.go:28] interesting pod/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 10 14:40:53.130333 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:53.130303 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" podUID="57d9a163-a776-435e-9403-1befa5891784" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 10 14:40:54.129651 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:54.129604 2579 patch_prober.go:28] interesting pod/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 10 14:40:54.129870 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:54.129687 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" podUID="57d9a163-a776-435e-9403-1befa5891784" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 10 14:40:55.132852 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:55.132823 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:55.133265 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:55.133182 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:40:55.133750 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:40:55.133734 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:41:03.858439 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:03.858406 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt"] Jul 10 14:41:03.858918 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:03.858665 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" podUID="57d9a163-a776-435e-9403-1befa5891784" containerName="istio-proxy" containerID="cri-o://422d15d03fc82a0c41576544feb9c6d89a3c6aea47488dc375c1b824ad55c8e9" gracePeriod=30 Jul 10 14:41:09.134492 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.134420 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:41:09.182714 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.182676 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57d9a163-a776-435e-9403-1befa5891784-istiod-ca-cert\") pod \"57d9a163-a776-435e-9403-1befa5891784\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " Jul 10 14:41:09.182876 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.182736 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57d9a163-a776-435e-9403-1befa5891784-istio-podinfo\") pod \"57d9a163-a776-435e-9403-1befa5891784\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " Jul 10 14:41:09.182876 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.182777 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gv2v\" (UniqueName: \"kubernetes.io/projected/57d9a163-a776-435e-9403-1befa5891784-kube-api-access-5gv2v\") pod \"57d9a163-a776-435e-9403-1befa5891784\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " Jul 10 14:41:09.182876 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.182807 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57d9a163-a776-435e-9403-1befa5891784-workload-certs\") pod \"57d9a163-a776-435e-9403-1befa5891784\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " Jul 10 14:41:09.182876 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.182841 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57d9a163-a776-435e-9403-1befa5891784-istio-token\") pod \"57d9a163-a776-435e-9403-1befa5891784\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " Jul 10 14:41:09.183110 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.182910 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57d9a163-a776-435e-9403-1befa5891784-workload-socket\") pod \"57d9a163-a776-435e-9403-1befa5891784\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " Jul 10 14:41:09.183110 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.182938 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57d9a163-a776-435e-9403-1befa5891784-credential-socket\") pod \"57d9a163-a776-435e-9403-1befa5891784\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " Jul 10 14:41:09.183110 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.183014 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57d9a163-a776-435e-9403-1befa5891784-istio-envoy\") pod \"57d9a163-a776-435e-9403-1befa5891784\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " Jul 10 14:41:09.183110 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.183043 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57d9a163-a776-435e-9403-1befa5891784-istio-data\") pod \"57d9a163-a776-435e-9403-1befa5891784\" (UID: \"57d9a163-a776-435e-9403-1befa5891784\") " Jul 10 14:41:09.183320 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.183163 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57d9a163-a776-435e-9403-1befa5891784-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "57d9a163-a776-435e-9403-1befa5891784" (UID: "57d9a163-a776-435e-9403-1befa5891784"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:41:09.183320 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.183203 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57d9a163-a776-435e-9403-1befa5891784-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "57d9a163-a776-435e-9403-1befa5891784" (UID: "57d9a163-a776-435e-9403-1befa5891784"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:41:09.183320 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.183243 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57d9a163-a776-435e-9403-1befa5891784-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "57d9a163-a776-435e-9403-1befa5891784" (UID: "57d9a163-a776-435e-9403-1befa5891784"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:41:09.183471 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.183437 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57d9a163-a776-435e-9403-1befa5891784-workload-socket\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:41:09.183527 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.183473 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57d9a163-a776-435e-9403-1befa5891784-istiod-ca-cert\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:41:09.183527 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.183475 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57d9a163-a776-435e-9403-1befa5891784-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "57d9a163-a776-435e-9403-1befa5891784" (UID: "57d9a163-a776-435e-9403-1befa5891784"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:41:09.183527 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.183488 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57d9a163-a776-435e-9403-1befa5891784-workload-certs\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:41:09.184220 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.184193 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57d9a163-a776-435e-9403-1befa5891784-istio-data" (OuterVolumeSpecName: "istio-data") pod "57d9a163-a776-435e-9403-1befa5891784" (UID: "57d9a163-a776-435e-9403-1befa5891784"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:41:09.185042 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.185020 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/57d9a163-a776-435e-9403-1befa5891784-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "57d9a163-a776-435e-9403-1befa5891784" (UID: "57d9a163-a776-435e-9403-1befa5891784"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 14:41:09.185368 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.185343 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57d9a163-a776-435e-9403-1befa5891784-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "57d9a163-a776-435e-9403-1befa5891784" (UID: "57d9a163-a776-435e-9403-1befa5891784"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:41:09.185504 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.185483 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57d9a163-a776-435e-9403-1befa5891784-istio-token" (OuterVolumeSpecName: "istio-token") pod "57d9a163-a776-435e-9403-1befa5891784" (UID: "57d9a163-a776-435e-9403-1befa5891784"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:41:09.185591 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.185572 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57d9a163-a776-435e-9403-1befa5891784-kube-api-access-5gv2v" (OuterVolumeSpecName: "kube-api-access-5gv2v") pod "57d9a163-a776-435e-9403-1befa5891784" (UID: "57d9a163-a776-435e-9403-1befa5891784"). InnerVolumeSpecName "kube-api-access-5gv2v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:41:09.284330 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.284280 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57d9a163-a776-435e-9403-1befa5891784-istio-token\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:41:09.284330 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.284323 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57d9a163-a776-435e-9403-1befa5891784-credential-socket\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:41:09.284330 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.284336 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57d9a163-a776-435e-9403-1befa5891784-istio-envoy\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:41:09.284576 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.284348 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57d9a163-a776-435e-9403-1befa5891784-istio-data\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:41:09.284576 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.284359 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57d9a163-a776-435e-9403-1befa5891784-istio-podinfo\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:41:09.284576 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.284371 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gv2v\" (UniqueName: \"kubernetes.io/projected/57d9a163-a776-435e-9403-1befa5891784-kube-api-access-5gv2v\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:41:09.428289 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.428200 2579 generic.go:356] "Generic (PLEG): container finished" podID="57d9a163-a776-435e-9403-1befa5891784" containerID="422d15d03fc82a0c41576544feb9c6d89a3c6aea47488dc375c1b824ad55c8e9" exitCode=0 Jul 10 14:41:09.428289 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.428261 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" Jul 10 14:41:09.428521 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.428284 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" event={"ID":"57d9a163-a776-435e-9403-1befa5891784","Type":"ContainerDied","Data":"422d15d03fc82a0c41576544feb9c6d89a3c6aea47488dc375c1b824ad55c8e9"} Jul 10 14:41:09.428521 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.428349 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt" event={"ID":"57d9a163-a776-435e-9403-1befa5891784","Type":"ContainerDied","Data":"b7adfe42333ae46b70ee0e81679d216b86c446f847f243282efc184a7235fb4e"} Jul 10 14:41:09.428521 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.428378 2579 scope.go:117] "RemoveContainer" containerID="422d15d03fc82a0c41576544feb9c6d89a3c6aea47488dc375c1b824ad55c8e9" Jul 10 14:41:09.437480 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.437463 2579 scope.go:117] "RemoveContainer" containerID="ea26c0c50c73a00b2cd0ef3e667fa09e05972d781969055c71e7d57f0ee3d2e0" Jul 10 14:41:09.445528 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.445512 2579 scope.go:117] "RemoveContainer" containerID="422d15d03fc82a0c41576544feb9c6d89a3c6aea47488dc375c1b824ad55c8e9" Jul 10 14:41:09.445771 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:41:09.445753 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"422d15d03fc82a0c41576544feb9c6d89a3c6aea47488dc375c1b824ad55c8e9\": container with ID starting with 422d15d03fc82a0c41576544feb9c6d89a3c6aea47488dc375c1b824ad55c8e9 not found: ID does not exist" containerID="422d15d03fc82a0c41576544feb9c6d89a3c6aea47488dc375c1b824ad55c8e9" Jul 10 14:41:09.445812 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.445780 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"422d15d03fc82a0c41576544feb9c6d89a3c6aea47488dc375c1b824ad55c8e9"} err="failed to get container status \"422d15d03fc82a0c41576544feb9c6d89a3c6aea47488dc375c1b824ad55c8e9\": rpc error: code = NotFound desc = could not find container \"422d15d03fc82a0c41576544feb9c6d89a3c6aea47488dc375c1b824ad55c8e9\": container with ID starting with 422d15d03fc82a0c41576544feb9c6d89a3c6aea47488dc375c1b824ad55c8e9 not found: ID does not exist" Jul 10 14:41:09.445812 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.445796 2579 scope.go:117] "RemoveContainer" containerID="ea26c0c50c73a00b2cd0ef3e667fa09e05972d781969055c71e7d57f0ee3d2e0" Jul 10 14:41:09.446563 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:41:09.446505 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea26c0c50c73a00b2cd0ef3e667fa09e05972d781969055c71e7d57f0ee3d2e0\": container with ID starting with ea26c0c50c73a00b2cd0ef3e667fa09e05972d781969055c71e7d57f0ee3d2e0 not found: ID does not exist" containerID="ea26c0c50c73a00b2cd0ef3e667fa09e05972d781969055c71e7d57f0ee3d2e0" Jul 10 14:41:09.446563 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.446537 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea26c0c50c73a00b2cd0ef3e667fa09e05972d781969055c71e7d57f0ee3d2e0"} err="failed to get container status \"ea26c0c50c73a00b2cd0ef3e667fa09e05972d781969055c71e7d57f0ee3d2e0\": rpc error: code = NotFound desc = could not find container \"ea26c0c50c73a00b2cd0ef3e667fa09e05972d781969055c71e7d57f0ee3d2e0\": container with ID starting with ea26c0c50c73a00b2cd0ef3e667fa09e05972d781969055c71e7d57f0ee3d2e0 not found: ID does not exist" Jul 10 14:41:09.451293 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.451271 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt"] Jul 10 14:41:09.456178 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:09.456158 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-5757a4-openshift-default-79447c6989-k4ptt"] Jul 10 14:41:11.100885 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:11.100851 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57d9a163-a776-435e-9403-1befa5891784" path="/var/lib/kubelet/pods/57d9a163-a776-435e-9403-1befa5891784/volumes" Jul 10 14:41:12.099903 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.099871 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p"] Jul 10 14:41:12.100319 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.100299 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63e27472-7559-472a-9d33-66591daf7f9a" containerName="istio-proxy" Jul 10 14:41:12.100319 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.100318 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="63e27472-7559-472a-9d33-66591daf7f9a" containerName="istio-proxy" Jul 10 14:41:12.100478 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.100329 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57d9a163-a776-435e-9403-1befa5891784" containerName="istio-proxy" Jul 10 14:41:12.100478 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.100334 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="57d9a163-a776-435e-9403-1befa5891784" containerName="istio-proxy" Jul 10 14:41:12.100478 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.100347 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57d9a163-a776-435e-9403-1befa5891784" containerName="istio-proxy" Jul 10 14:41:12.100478 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.100353 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="57d9a163-a776-435e-9403-1befa5891784" containerName="istio-proxy" Jul 10 14:41:12.100478 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.100423 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="63e27472-7559-472a-9d33-66591daf7f9a" containerName="istio-proxy" Jul 10 14:41:12.100478 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.100431 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="57d9a163-a776-435e-9403-1befa5891784" containerName="istio-proxy" Jul 10 14:41:12.100478 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.100437 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="63e27472-7559-472a-9d33-66591daf7f9a" containerName="istio-proxy" Jul 10 14:41:12.100478 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.100443 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="57d9a163-a776-435e-9403-1befa5891784" containerName="istio-proxy" Jul 10 14:41:12.100478 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.100452 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3592f36d-d621-4a8c-86b3-39c1009756f3" containerName="istio-proxy" Jul 10 14:41:12.104735 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.104718 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:12.109300 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.109279 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-9e5d79-openshift-default-dockercfg-jzr6h\"" Jul 10 14:41:12.209440 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.209405 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-istio-data\") pod \"e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:12.209440 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.209440 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfnwg\" (UniqueName: \"kubernetes.io/projected/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-kube-api-access-qfnwg\") pod \"e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:12.209684 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.209512 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-workload-socket\") pod \"e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:12.209684 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.209539 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-istiod-ca-cert\") pod \"e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:12.209684 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.209566 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-istio-envoy\") pod \"e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:12.209684 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.209674 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-istio-token\") pod \"e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:12.209892 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.209712 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-credential-socket\") pod \"e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:12.209892 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.209751 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-istio-podinfo\") pod \"e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:12.209892 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.209780 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-workload-certs\") pod \"e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:12.290118 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.290083 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p"] Jul 10 14:41:12.310565 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.310530 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-istio-data\") pod \"e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:12.310752 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.310590 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfnwg\" (UniqueName: \"kubernetes.io/projected/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-kube-api-access-qfnwg\") pod \"e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:12.310752 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.310654 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-workload-socket\") pod \"e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:12.310752 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.310689 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-istiod-ca-cert\") pod \"e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:12.310752 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.310737 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-istio-envoy\") pod \"e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:12.310988 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.310802 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-istio-token\") pod \"e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:12.310988 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.310847 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-credential-socket\") pod \"e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:12.310988 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.310894 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-istio-podinfo\") pod \"e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:12.310988 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.310925 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-workload-certs\") pod \"e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:12.311202 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.311004 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-istio-data\") pod \"e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:12.311271 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.311251 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-workload-certs\") pod \"e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:12.311749 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.311725 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-workload-socket\") pod \"e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:12.311896 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.311823 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-credential-socket\") pod \"e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:12.312386 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.312361 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-istiod-ca-cert\") pod \"e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:12.313661 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.313641 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-istio-envoy\") pod \"e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:12.313897 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.313878 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-istio-podinfo\") pod \"e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:12.326735 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.326714 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfnwg\" (UniqueName: \"kubernetes.io/projected/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-kube-api-access-qfnwg\") pod \"e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:12.340492 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.340473 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-istio-token\") pod \"e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:12.421570 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.421504 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:12.575279 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.575254 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p"] Jul 10 14:41:12.575727 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:41:12.575705 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6e265f5_6f9d_4c2b_96c2_c458a24ef168.slice/crio-994216478e4a9a2fe8ddfc7ef6cd7841730e4dc2467caeff9f0801d62c1bc551 WatchSource:0}: Error finding container 994216478e4a9a2fe8ddfc7ef6cd7841730e4dc2467caeff9f0801d62c1bc551: Status 404 returned error can't find the container with id 994216478e4a9a2fe8ddfc7ef6cd7841730e4dc2467caeff9f0801d62c1bc551 Jul 10 14:41:12.577793 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.577762 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:41:12.577857 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.577826 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:41:12.577891 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:12.577857 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:41:13.450503 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:13.450469 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" event={"ID":"e6e265f5-6f9d-4c2b-96c2-c458a24ef168","Type":"ContainerStarted","Data":"b66cd1347dcc70ca73bf4a2aece2fd11dc02c84340083244bc886e2484107fd1"} Jul 10 14:41:13.450890 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:13.450518 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" event={"ID":"e6e265f5-6f9d-4c2b-96c2-c458a24ef168","Type":"ContainerStarted","Data":"994216478e4a9a2fe8ddfc7ef6cd7841730e4dc2467caeff9f0801d62c1bc551"} Jul 10 14:41:13.475736 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:13.475685 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" podStartSLOduration=1.475668934 podStartE2EDuration="1.475668934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:41:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:41:13.474064907 +0000 UTC m=+1996.900289227" watchObservedRunningTime="2026-07-10 14:41:13.475668934 +0000 UTC m=+1996.901893254" Jul 10 14:41:14.422444 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:14.422409 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:14.427239 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:14.427215 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:14.455444 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:14.455419 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:14.456423 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:14.456405 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:29.457114 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:29.457077 2579 patch_prober.go:28] interesting pod/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 10 14:41:29.457523 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:29.457132 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" podUID="e6e265f5-6f9d-4c2b-96c2-c458a24ef168" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 10 14:41:29.530450 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:29.530420 2579 generic.go:356] "Generic (PLEG): container finished" podID="e6e265f5-6f9d-4c2b-96c2-c458a24ef168" containerID="b66cd1347dcc70ca73bf4a2aece2fd11dc02c84340083244bc886e2484107fd1" exitCode=0 Jul 10 14:41:29.530632 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:29.530493 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" event={"ID":"e6e265f5-6f9d-4c2b-96c2-c458a24ef168","Type":"ContainerDied","Data":"b66cd1347dcc70ca73bf4a2aece2fd11dc02c84340083244bc886e2484107fd1"} Jul 10 14:41:29.531077 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:29.531056 2579 scope.go:117] "RemoveContainer" containerID="b66cd1347dcc70ca73bf4a2aece2fd11dc02c84340083244bc886e2484107fd1" Jul 10 14:41:29.532051 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:29.532027 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:41:29.532110 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:29.532091 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:41:29.532147 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:29.532122 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:41:30.541968 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:30.541905 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" event={"ID":"e6e265f5-6f9d-4c2b-96c2-c458a24ef168","Type":"ContainerStarted","Data":"9772fb4b231c6ab26c7303534bd9e7468ee66ce2fe29f2552ff88c25cc18f01f"} Jul 10 14:41:31.422322 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:31.422289 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:31.422540 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:31.422514 2579 patch_prober.go:28] interesting pod/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 10 14:41:31.422604 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:31.422574 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" podUID="e6e265f5-6f9d-4c2b-96c2-c458a24ef168" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 10 14:41:32.422619 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:32.422574 2579 patch_prober.go:28] interesting pod/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 10 14:41:32.423031 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:32.422643 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" podUID="e6e265f5-6f9d-4c2b-96c2-c458a24ef168" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 10 14:41:33.422540 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:33.422505 2579 patch_prober.go:28] interesting pod/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 10 14:41:33.422730 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:33.422564 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" podUID="e6e265f5-6f9d-4c2b-96c2-c458a24ef168" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 10 14:41:34.422451 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:34.422417 2579 patch_prober.go:28] interesting pod/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 10 14:41:34.422682 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:34.422471 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" podUID="e6e265f5-6f9d-4c2b-96c2-c458a24ef168" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 10 14:41:35.425521 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:35.425490 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:35.425915 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:35.425712 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:41:35.426480 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:41:35.426459 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:42:26.321715 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:26.321680 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt"] Jul 10 14:42:26.322152 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:26.322105 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63e27472-7559-472a-9d33-66591daf7f9a" containerName="istio-proxy" Jul 10 14:42:26.322152 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:26.322117 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="63e27472-7559-472a-9d33-66591daf7f9a" containerName="istio-proxy" Jul 10 14:42:26.325178 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:26.325162 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt" Jul 10 14:42:26.329583 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:26.329560 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-feed7a\"/\"auth-test-model-feed7a-kserve-self-signed-certs\"" Jul 10 14:42:26.330173 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:26.330157 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-feed7a\"/\"kube-root-ca.crt\"" Jul 10 14:42:26.330845 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:26.330827 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-feed7a\"/\"default-dockercfg-rq5bd\"" Jul 10 14:42:26.330845 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:26.330834 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-feed7a\"/\"openshift-service-ca.crt\"" Jul 10 14:42:26.342825 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:26.342799 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt"] Jul 10 14:42:26.459740 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:26.459709 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4cea9590-20f5-4727-b9fe-0d094aa94643-home\") pod \"auth-test-model-feed7a-kserve-55589f45c9-sd7dt\" (UID: \"4cea9590-20f5-4727-b9fe-0d094aa94643\") " pod="ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt" Jul 10 14:42:26.459740 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:26.459741 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pqz8\" (UniqueName: \"kubernetes.io/projected/4cea9590-20f5-4727-b9fe-0d094aa94643-kube-api-access-4pqz8\") pod \"auth-test-model-feed7a-kserve-55589f45c9-sd7dt\" (UID: \"4cea9590-20f5-4727-b9fe-0d094aa94643\") " pod="ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt" Jul 10 14:42:26.459930 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:26.459771 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4cea9590-20f5-4727-b9fe-0d094aa94643-tmp-dir\") pod \"auth-test-model-feed7a-kserve-55589f45c9-sd7dt\" (UID: \"4cea9590-20f5-4727-b9fe-0d094aa94643\") " pod="ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt" Jul 10 14:42:26.459930 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:26.459842 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4cea9590-20f5-4727-b9fe-0d094aa94643-tls-certs\") pod \"auth-test-model-feed7a-kserve-55589f45c9-sd7dt\" (UID: \"4cea9590-20f5-4727-b9fe-0d094aa94643\") " pod="ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt" Jul 10 14:42:26.459930 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:26.459895 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4cea9590-20f5-4727-b9fe-0d094aa94643-model-cache\") pod \"auth-test-model-feed7a-kserve-55589f45c9-sd7dt\" (UID: \"4cea9590-20f5-4727-b9fe-0d094aa94643\") " pod="ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt" Jul 10 14:42:26.460052 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:26.459987 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4cea9590-20f5-4727-b9fe-0d094aa94643-dshm\") pod \"auth-test-model-feed7a-kserve-55589f45c9-sd7dt\" (UID: \"4cea9590-20f5-4727-b9fe-0d094aa94643\") " pod="ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt" Jul 10 14:42:26.560671 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:26.560637 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4cea9590-20f5-4727-b9fe-0d094aa94643-home\") pod \"auth-test-model-feed7a-kserve-55589f45c9-sd7dt\" (UID: \"4cea9590-20f5-4727-b9fe-0d094aa94643\") " pod="ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt" Jul 10 14:42:26.560671 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:26.560675 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pqz8\" (UniqueName: \"kubernetes.io/projected/4cea9590-20f5-4727-b9fe-0d094aa94643-kube-api-access-4pqz8\") pod \"auth-test-model-feed7a-kserve-55589f45c9-sd7dt\" (UID: \"4cea9590-20f5-4727-b9fe-0d094aa94643\") " pod="ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt" Jul 10 14:42:26.560909 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:26.560702 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4cea9590-20f5-4727-b9fe-0d094aa94643-tmp-dir\") pod \"auth-test-model-feed7a-kserve-55589f45c9-sd7dt\" (UID: \"4cea9590-20f5-4727-b9fe-0d094aa94643\") " pod="ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt" Jul 10 14:42:26.560909 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:26.560731 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4cea9590-20f5-4727-b9fe-0d094aa94643-tls-certs\") pod \"auth-test-model-feed7a-kserve-55589f45c9-sd7dt\" (UID: \"4cea9590-20f5-4727-b9fe-0d094aa94643\") " pod="ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt" Jul 10 14:42:26.560909 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:26.560775 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4cea9590-20f5-4727-b9fe-0d094aa94643-model-cache\") pod \"auth-test-model-feed7a-kserve-55589f45c9-sd7dt\" (UID: \"4cea9590-20f5-4727-b9fe-0d094aa94643\") " pod="ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt" Jul 10 14:42:26.560909 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:26.560800 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4cea9590-20f5-4727-b9fe-0d094aa94643-dshm\") pod \"auth-test-model-feed7a-kserve-55589f45c9-sd7dt\" (UID: \"4cea9590-20f5-4727-b9fe-0d094aa94643\") " pod="ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt" Jul 10 14:42:26.561185 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:26.561162 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4cea9590-20f5-4727-b9fe-0d094aa94643-home\") pod \"auth-test-model-feed7a-kserve-55589f45c9-sd7dt\" (UID: \"4cea9590-20f5-4727-b9fe-0d094aa94643\") " pod="ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt" Jul 10 14:42:26.561251 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:26.561183 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4cea9590-20f5-4727-b9fe-0d094aa94643-tmp-dir\") pod \"auth-test-model-feed7a-kserve-55589f45c9-sd7dt\" (UID: \"4cea9590-20f5-4727-b9fe-0d094aa94643\") " pod="ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt" Jul 10 14:42:26.561251 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:26.561231 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4cea9590-20f5-4727-b9fe-0d094aa94643-model-cache\") pod \"auth-test-model-feed7a-kserve-55589f45c9-sd7dt\" (UID: \"4cea9590-20f5-4727-b9fe-0d094aa94643\") " pod="ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt" Jul 10 14:42:26.563040 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:26.563018 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4cea9590-20f5-4727-b9fe-0d094aa94643-dshm\") pod \"auth-test-model-feed7a-kserve-55589f45c9-sd7dt\" (UID: \"4cea9590-20f5-4727-b9fe-0d094aa94643\") " pod="ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt" Jul 10 14:42:26.563310 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:26.563295 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4cea9590-20f5-4727-b9fe-0d094aa94643-tls-certs\") pod \"auth-test-model-feed7a-kserve-55589f45c9-sd7dt\" (UID: \"4cea9590-20f5-4727-b9fe-0d094aa94643\") " pod="ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt" Jul 10 14:42:26.571187 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:26.571167 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pqz8\" (UniqueName: \"kubernetes.io/projected/4cea9590-20f5-4727-b9fe-0d094aa94643-kube-api-access-4pqz8\") pod \"auth-test-model-feed7a-kserve-55589f45c9-sd7dt\" (UID: \"4cea9590-20f5-4727-b9fe-0d094aa94643\") " pod="ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt" Jul 10 14:42:26.634373 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:26.634352 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt" Jul 10 14:42:26.774086 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:26.774062 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt"] Jul 10 14:42:26.776543 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:42:26.776520 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4cea9590_20f5_4727_b9fe_0d094aa94643.slice/crio-28781c4685906deb33a0dfc95269bebb07d306f9c9544faa64dae2baab0932f5 WatchSource:0}: Error finding container 28781c4685906deb33a0dfc95269bebb07d306f9c9544faa64dae2baab0932f5: Status 404 returned error can't find the container with id 28781c4685906deb33a0dfc95269bebb07d306f9c9544faa64dae2baab0932f5 Jul 10 14:42:26.820519 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:26.820479 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt" event={"ID":"4cea9590-20f5-4727-b9fe-0d094aa94643","Type":"ContainerStarted","Data":"28781c4685906deb33a0dfc95269bebb07d306f9c9544faa64dae2baab0932f5"} Jul 10 14:42:27.826388 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:27.826345 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt" event={"ID":"4cea9590-20f5-4727-b9fe-0d094aa94643","Type":"ContainerStarted","Data":"06f350b1ef75c57af4bcee4fd99e4b81d6b8135e75b509f324bd38170bf95c39"} Jul 10 14:42:27.846243 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:27.846191 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt" podStartSLOduration=1.8461773030000002 podStartE2EDuration="1.846177303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:42:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:42:27.844677343 +0000 UTC m=+2071.270901662" watchObservedRunningTime="2026-07-10 14:42:27.846177303 +0000 UTC m=+2071.272401620" Jul 10 14:42:36.635407 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:36.635376 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt" Jul 10 14:42:36.635872 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:36.635418 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt" Jul 10 14:42:36.647790 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:36.647767 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt" Jul 10 14:42:36.877967 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:36.877927 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt" Jul 10 14:42:57.280908 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:57.280858 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-znjf2_99ef7290-2248-4e0c-9fda-100370c1ac2d/console-operator/1.log" Jul 10 14:42:57.283847 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:57.283826 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-znjf2_99ef7290-2248-4e0c-9fda-100370c1ac2d/console-operator/1.log" Jul 10 14:42:57.289978 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:57.289939 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jwwrp_6ce1e1c6-c734-4df5-9079-0295f7de80f6/ovn-acl-logging/0.log" Jul 10 14:42:57.293087 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:42:57.293069 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jwwrp_6ce1e1c6-c734-4df5-9079-0295f7de80f6/ovn-acl-logging/0.log" Jul 10 14:44:25.754747 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:25.754669 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt"] Jul 10 14:44:30.659882 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:30.659845 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd"] Jul 10 14:44:30.664017 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:30.663987 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd" Jul 10 14:44:30.668398 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:30.668374 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9e5d79\"/\"kube-root-ca.crt\"" Jul 10 14:44:30.668526 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:30.668376 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9e5d79\"/\"sub-test-model-9e5d79-kserve-self-signed-certs\"" Jul 10 14:44:30.668526 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:30.668403 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9e5d79\"/\"default-dockercfg-85sdv\"" Jul 10 14:44:30.668526 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:30.668423 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9e5d79\"/\"openshift-service-ca.crt\"" Jul 10 14:44:30.679691 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:30.679670 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd"] Jul 10 14:44:30.751631 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:30.751607 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c167d5c0-54d4-411b-9339-82895534e715-tls-certs\") pod \"sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd\" (UID: \"c167d5c0-54d4-411b-9339-82895534e715\") " pod="ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd" Jul 10 14:44:30.751797 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:30.751657 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c167d5c0-54d4-411b-9339-82895534e715-home\") pod \"sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd\" (UID: \"c167d5c0-54d4-411b-9339-82895534e715\") " pod="ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd" Jul 10 14:44:30.751797 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:30.751718 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c167d5c0-54d4-411b-9339-82895534e715-model-cache\") pod \"sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd\" (UID: \"c167d5c0-54d4-411b-9339-82895534e715\") " pod="ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd" Jul 10 14:44:30.751797 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:30.751752 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-926d9\" (UniqueName: \"kubernetes.io/projected/c167d5c0-54d4-411b-9339-82895534e715-kube-api-access-926d9\") pod \"sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd\" (UID: \"c167d5c0-54d4-411b-9339-82895534e715\") " pod="ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd" Jul 10 14:44:30.751797 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:30.751784 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c167d5c0-54d4-411b-9339-82895534e715-tmp-dir\") pod \"sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd\" (UID: \"c167d5c0-54d4-411b-9339-82895534e715\") " pod="ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd" Jul 10 14:44:30.751990 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:30.751885 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c167d5c0-54d4-411b-9339-82895534e715-dshm\") pod \"sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd\" (UID: \"c167d5c0-54d4-411b-9339-82895534e715\") " pod="ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd" Jul 10 14:44:30.852803 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:30.852769 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-926d9\" (UniqueName: \"kubernetes.io/projected/c167d5c0-54d4-411b-9339-82895534e715-kube-api-access-926d9\") pod \"sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd\" (UID: \"c167d5c0-54d4-411b-9339-82895534e715\") " pod="ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd" Jul 10 14:44:30.852803 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:30.852807 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c167d5c0-54d4-411b-9339-82895534e715-tmp-dir\") pod \"sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd\" (UID: \"c167d5c0-54d4-411b-9339-82895534e715\") " pod="ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd" Jul 10 14:44:30.853130 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:30.852854 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c167d5c0-54d4-411b-9339-82895534e715-dshm\") pod \"sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd\" (UID: \"c167d5c0-54d4-411b-9339-82895534e715\") " pod="ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd" Jul 10 14:44:30.853130 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:30.852876 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c167d5c0-54d4-411b-9339-82895534e715-tls-certs\") pod \"sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd\" (UID: \"c167d5c0-54d4-411b-9339-82895534e715\") " pod="ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd" Jul 10 14:44:30.853130 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:30.852903 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c167d5c0-54d4-411b-9339-82895534e715-home\") pod \"sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd\" (UID: \"c167d5c0-54d4-411b-9339-82895534e715\") " pod="ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd" Jul 10 14:44:30.853130 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:30.852933 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c167d5c0-54d4-411b-9339-82895534e715-model-cache\") pod \"sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd\" (UID: \"c167d5c0-54d4-411b-9339-82895534e715\") " pod="ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd" Jul 10 14:44:30.853320 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:30.853300 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c167d5c0-54d4-411b-9339-82895534e715-tmp-dir\") pod \"sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd\" (UID: \"c167d5c0-54d4-411b-9339-82895534e715\") " pod="ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd" Jul 10 14:44:30.853404 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:30.853372 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c167d5c0-54d4-411b-9339-82895534e715-home\") pod \"sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd\" (UID: \"c167d5c0-54d4-411b-9339-82895534e715\") " pod="ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd" Jul 10 14:44:30.853441 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:30.853403 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c167d5c0-54d4-411b-9339-82895534e715-model-cache\") pod \"sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd\" (UID: \"c167d5c0-54d4-411b-9339-82895534e715\") " pod="ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd" Jul 10 14:44:30.855280 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:30.855253 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c167d5c0-54d4-411b-9339-82895534e715-dshm\") pod \"sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd\" (UID: \"c167d5c0-54d4-411b-9339-82895534e715\") " pod="ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd" Jul 10 14:44:30.855573 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:30.855551 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c167d5c0-54d4-411b-9339-82895534e715-tls-certs\") pod \"sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd\" (UID: \"c167d5c0-54d4-411b-9339-82895534e715\") " pod="ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd" Jul 10 14:44:30.861671 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:30.861653 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-926d9\" (UniqueName: \"kubernetes.io/projected/c167d5c0-54d4-411b-9339-82895534e715-kube-api-access-926d9\") pod \"sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd\" (UID: \"c167d5c0-54d4-411b-9339-82895534e715\") " pod="ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd" Jul 10 14:44:30.974625 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:30.974556 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd" Jul 10 14:44:31.107061 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:31.107039 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd"] Jul 10 14:44:31.108768 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:44:31.108742 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc167d5c0_54d4_411b_9339_82895534e715.slice/crio-36a24677d6630b634ffac510ca8a248e121c554bebedee36dcbecb1e1bea941f WatchSource:0}: Error finding container 36a24677d6630b634ffac510ca8a248e121c554bebedee36dcbecb1e1bea941f: Status 404 returned error can't find the container with id 36a24677d6630b634ffac510ca8a248e121c554bebedee36dcbecb1e1bea941f Jul 10 14:44:31.401201 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:31.401170 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd" event={"ID":"c167d5c0-54d4-411b-9339-82895534e715","Type":"ContainerStarted","Data":"3b4cf07471c67ca085bef28bf8d15a75d220b5f7f9afbea4d894e4a9fc6eef61"} Jul 10 14:44:31.401375 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:31.401209 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd" event={"ID":"c167d5c0-54d4-411b-9339-82895534e715","Type":"ContainerStarted","Data":"36a24677d6630b634ffac510ca8a248e121c554bebedee36dcbecb1e1bea941f"} Jul 10 14:44:31.423050 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:31.423001 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd" podStartSLOduration=1.422984059 podStartE2EDuration="1.422984059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:44:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:44:31.420854737 +0000 UTC m=+2194.847079069" watchObservedRunningTime="2026-07-10 14:44:31.422984059 +0000 UTC m=+2194.849208378" Jul 10 14:44:40.774628 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:40.774556 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt" podUID="4cea9590-20f5-4727-b9fe-0d094aa94643" containerName="main" containerID="cri-o://06f350b1ef75c57af4bcee4fd99e4b81d6b8135e75b509f324bd38170bf95c39" gracePeriod=45 Jul 10 14:44:40.975121 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:40.975092 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd" Jul 10 14:44:40.975293 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:40.975133 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd" Jul 10 14:44:40.987448 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:40.987425 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd" Jul 10 14:44:41.019261 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:41.019241 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt" Jul 10 14:44:41.146799 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:41.146772 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4cea9590-20f5-4727-b9fe-0d094aa94643-home\") pod \"4cea9590-20f5-4727-b9fe-0d094aa94643\" (UID: \"4cea9590-20f5-4727-b9fe-0d094aa94643\") " Jul 10 14:44:41.146942 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:41.146817 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4cea9590-20f5-4727-b9fe-0d094aa94643-tls-certs\") pod \"4cea9590-20f5-4727-b9fe-0d094aa94643\" (UID: \"4cea9590-20f5-4727-b9fe-0d094aa94643\") " Jul 10 14:44:41.146942 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:41.146886 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pqz8\" (UniqueName: \"kubernetes.io/projected/4cea9590-20f5-4727-b9fe-0d094aa94643-kube-api-access-4pqz8\") pod \"4cea9590-20f5-4727-b9fe-0d094aa94643\" (UID: \"4cea9590-20f5-4727-b9fe-0d094aa94643\") " Jul 10 14:44:41.146942 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:41.146924 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4cea9590-20f5-4727-b9fe-0d094aa94643-tmp-dir\") pod \"4cea9590-20f5-4727-b9fe-0d094aa94643\" (UID: \"4cea9590-20f5-4727-b9fe-0d094aa94643\") " Jul 10 14:44:41.147156 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:41.147038 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4cea9590-20f5-4727-b9fe-0d094aa94643-model-cache\") pod \"4cea9590-20f5-4727-b9fe-0d094aa94643\" (UID: \"4cea9590-20f5-4727-b9fe-0d094aa94643\") " Jul 10 14:44:41.147156 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:41.147069 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cea9590-20f5-4727-b9fe-0d094aa94643-home" (OuterVolumeSpecName: "home") pod "4cea9590-20f5-4727-b9fe-0d094aa94643" (UID: "4cea9590-20f5-4727-b9fe-0d094aa94643"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:44:41.147156 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:41.147104 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4cea9590-20f5-4727-b9fe-0d094aa94643-dshm\") pod \"4cea9590-20f5-4727-b9fe-0d094aa94643\" (UID: \"4cea9590-20f5-4727-b9fe-0d094aa94643\") " Jul 10 14:44:41.147382 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:41.147190 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cea9590-20f5-4727-b9fe-0d094aa94643-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4cea9590-20f5-4727-b9fe-0d094aa94643" (UID: "4cea9590-20f5-4727-b9fe-0d094aa94643"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:44:41.147382 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:41.147288 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cea9590-20f5-4727-b9fe-0d094aa94643-model-cache" (OuterVolumeSpecName: "model-cache") pod "4cea9590-20f5-4727-b9fe-0d094aa94643" (UID: "4cea9590-20f5-4727-b9fe-0d094aa94643"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:44:41.147487 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:41.147412 2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4cea9590-20f5-4727-b9fe-0d094aa94643-tmp-dir\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:44:41.147487 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:41.147425 2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4cea9590-20f5-4727-b9fe-0d094aa94643-model-cache\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:44:41.147487 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:41.147435 2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4cea9590-20f5-4727-b9fe-0d094aa94643-home\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:44:41.149067 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:41.149045 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cea9590-20f5-4727-b9fe-0d094aa94643-dshm" (OuterVolumeSpecName: "dshm") pod "4cea9590-20f5-4727-b9fe-0d094aa94643" (UID: "4cea9590-20f5-4727-b9fe-0d094aa94643"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:44:41.149176 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:41.149127 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cea9590-20f5-4727-b9fe-0d094aa94643-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4cea9590-20f5-4727-b9fe-0d094aa94643" (UID: "4cea9590-20f5-4727-b9fe-0d094aa94643"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:44:41.149176 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:41.149156 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cea9590-20f5-4727-b9fe-0d094aa94643-kube-api-access-4pqz8" (OuterVolumeSpecName: "kube-api-access-4pqz8") pod "4cea9590-20f5-4727-b9fe-0d094aa94643" (UID: "4cea9590-20f5-4727-b9fe-0d094aa94643"). InnerVolumeSpecName "kube-api-access-4pqz8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:44:41.248315 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:41.248280 2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4cea9590-20f5-4727-b9fe-0d094aa94643-dshm\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:44:41.248315 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:41.248310 2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4cea9590-20f5-4727-b9fe-0d094aa94643-tls-certs\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:44:41.248315 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:41.248320 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pqz8\" (UniqueName: \"kubernetes.io/projected/4cea9590-20f5-4727-b9fe-0d094aa94643-kube-api-access-4pqz8\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:44:41.455344 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:41.455260 2579 generic.go:356] "Generic (PLEG): container finished" podID="4cea9590-20f5-4727-b9fe-0d094aa94643" containerID="06f350b1ef75c57af4bcee4fd99e4b81d6b8135e75b509f324bd38170bf95c39" exitCode=0 Jul 10 14:44:41.455344 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:41.455314 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt" Jul 10 14:44:41.455542 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:41.455341 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt" event={"ID":"4cea9590-20f5-4727-b9fe-0d094aa94643","Type":"ContainerDied","Data":"06f350b1ef75c57af4bcee4fd99e4b81d6b8135e75b509f324bd38170bf95c39"} Jul 10 14:44:41.455542 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:41.455391 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt" event={"ID":"4cea9590-20f5-4727-b9fe-0d094aa94643","Type":"ContainerDied","Data":"28781c4685906deb33a0dfc95269bebb07d306f9c9544faa64dae2baab0932f5"} Jul 10 14:44:41.455542 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:41.455419 2579 scope.go:117] "RemoveContainer" containerID="06f350b1ef75c57af4bcee4fd99e4b81d6b8135e75b509f324bd38170bf95c39" Jul 10 14:44:41.465375 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:41.465353 2579 scope.go:117] "RemoveContainer" containerID="06f350b1ef75c57af4bcee4fd99e4b81d6b8135e75b509f324bd38170bf95c39" Jul 10 14:44:41.465637 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:44:41.465616 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06f350b1ef75c57af4bcee4fd99e4b81d6b8135e75b509f324bd38170bf95c39\": container with ID starting with 06f350b1ef75c57af4bcee4fd99e4b81d6b8135e75b509f324bd38170bf95c39 not found: ID does not exist" containerID="06f350b1ef75c57af4bcee4fd99e4b81d6b8135e75b509f324bd38170bf95c39" Jul 10 14:44:41.465692 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:41.465649 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06f350b1ef75c57af4bcee4fd99e4b81d6b8135e75b509f324bd38170bf95c39"} err="failed to get container status \"06f350b1ef75c57af4bcee4fd99e4b81d6b8135e75b509f324bd38170bf95c39\": rpc error: code = NotFound desc = could not find container \"06f350b1ef75c57af4bcee4fd99e4b81d6b8135e75b509f324bd38170bf95c39\": container with ID starting with 06f350b1ef75c57af4bcee4fd99e4b81d6b8135e75b509f324bd38170bf95c39 not found: ID does not exist" Jul 10 14:44:41.467490 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:41.467473 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd" Jul 10 14:44:41.480541 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:41.480515 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt"] Jul 10 14:44:41.484576 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:41.484557 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-feed7a/auth-test-model-feed7a-kserve-55589f45c9-sd7dt"] Jul 10 14:44:43.100991 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:44:43.100942 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cea9590-20f5-4727-b9fe-0d094aa94643" path="/var/lib/kubelet/pods/4cea9590-20f5-4727-b9fe-0d094aa94643/volumes" Jul 10 14:46:00.245580 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:00.245545 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd"] Jul 10 14:46:15.265435 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:15.265396 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd" podUID="c167d5c0-54d4-411b-9339-82895534e715" containerName="main" containerID="cri-o://3b4cf07471c67ca085bef28bf8d15a75d220b5f7f9afbea4d894e4a9fc6eef61" gracePeriod=45 Jul 10 14:46:15.521372 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:15.521310 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd" Jul 10 14:46:15.596883 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:15.596853 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-926d9\" (UniqueName: \"kubernetes.io/projected/c167d5c0-54d4-411b-9339-82895534e715-kube-api-access-926d9\") pod \"c167d5c0-54d4-411b-9339-82895534e715\" (UID: \"c167d5c0-54d4-411b-9339-82895534e715\") " Jul 10 14:46:15.597318 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:15.597294 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c167d5c0-54d4-411b-9339-82895534e715-dshm\") pod \"c167d5c0-54d4-411b-9339-82895534e715\" (UID: \"c167d5c0-54d4-411b-9339-82895534e715\") " Jul 10 14:46:15.597435 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:15.597357 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c167d5c0-54d4-411b-9339-82895534e715-tmp-dir\") pod \"c167d5c0-54d4-411b-9339-82895534e715\" (UID: \"c167d5c0-54d4-411b-9339-82895534e715\") " Jul 10 14:46:15.597510 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:15.597451 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c167d5c0-54d4-411b-9339-82895534e715-tls-certs\") pod \"c167d5c0-54d4-411b-9339-82895534e715\" (UID: \"c167d5c0-54d4-411b-9339-82895534e715\") " Jul 10 14:46:15.597510 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:15.597495 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c167d5c0-54d4-411b-9339-82895534e715-home\") pod \"c167d5c0-54d4-411b-9339-82895534e715\" (UID: \"c167d5c0-54d4-411b-9339-82895534e715\") " Jul 10 14:46:15.597710 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:15.597554 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c167d5c0-54d4-411b-9339-82895534e715-model-cache\") pod \"c167d5c0-54d4-411b-9339-82895534e715\" (UID: \"c167d5c0-54d4-411b-9339-82895534e715\") " Jul 10 14:46:15.597710 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:15.597647 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c167d5c0-54d4-411b-9339-82895534e715-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c167d5c0-54d4-411b-9339-82895534e715" (UID: "c167d5c0-54d4-411b-9339-82895534e715"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:46:15.597808 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:15.597782 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c167d5c0-54d4-411b-9339-82895534e715-home" (OuterVolumeSpecName: "home") pod "c167d5c0-54d4-411b-9339-82895534e715" (UID: "c167d5c0-54d4-411b-9339-82895534e715"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:46:15.597896 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:15.597866 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c167d5c0-54d4-411b-9339-82895534e715-model-cache" (OuterVolumeSpecName: "model-cache") pod "c167d5c0-54d4-411b-9339-82895534e715" (UID: "c167d5c0-54d4-411b-9339-82895534e715"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:46:15.598036 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:15.597997 2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c167d5c0-54d4-411b-9339-82895534e715-tmp-dir\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:46:15.598036 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:15.598015 2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c167d5c0-54d4-411b-9339-82895534e715-home\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:46:15.598036 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:15.598030 2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c167d5c0-54d4-411b-9339-82895534e715-model-cache\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:46:15.599311 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:15.599286 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c167d5c0-54d4-411b-9339-82895534e715-dshm" (OuterVolumeSpecName: "dshm") pod "c167d5c0-54d4-411b-9339-82895534e715" (UID: "c167d5c0-54d4-411b-9339-82895534e715"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:46:15.599449 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:15.599428 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c167d5c0-54d4-411b-9339-82895534e715-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c167d5c0-54d4-411b-9339-82895534e715" (UID: "c167d5c0-54d4-411b-9339-82895534e715"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:46:15.599503 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:15.599434 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c167d5c0-54d4-411b-9339-82895534e715-kube-api-access-926d9" (OuterVolumeSpecName: "kube-api-access-926d9") pod "c167d5c0-54d4-411b-9339-82895534e715" (UID: "c167d5c0-54d4-411b-9339-82895534e715"). InnerVolumeSpecName "kube-api-access-926d9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:46:15.698913 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:15.698889 2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c167d5c0-54d4-411b-9339-82895534e715-tls-certs\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:46:15.698913 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:15.698911 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-926d9\" (UniqueName: \"kubernetes.io/projected/c167d5c0-54d4-411b-9339-82895534e715-kube-api-access-926d9\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:46:15.699074 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:15.698920 2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c167d5c0-54d4-411b-9339-82895534e715-dshm\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:46:15.904137 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:15.904105 2579 generic.go:356] "Generic (PLEG): container finished" podID="c167d5c0-54d4-411b-9339-82895534e715" containerID="3b4cf07471c67ca085bef28bf8d15a75d220b5f7f9afbea4d894e4a9fc6eef61" exitCode=0 Jul 10 14:46:15.904309 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:15.904146 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd" Jul 10 14:46:15.904309 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:15.904163 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd" event={"ID":"c167d5c0-54d4-411b-9339-82895534e715","Type":"ContainerDied","Data":"3b4cf07471c67ca085bef28bf8d15a75d220b5f7f9afbea4d894e4a9fc6eef61"} Jul 10 14:46:15.904309 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:15.904201 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd" event={"ID":"c167d5c0-54d4-411b-9339-82895534e715","Type":"ContainerDied","Data":"36a24677d6630b634ffac510ca8a248e121c554bebedee36dcbecb1e1bea941f"} Jul 10 14:46:15.904309 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:15.904225 2579 scope.go:117] "RemoveContainer" containerID="3b4cf07471c67ca085bef28bf8d15a75d220b5f7f9afbea4d894e4a9fc6eef61" Jul 10 14:46:15.913261 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:15.913251 2579 scope.go:117] "RemoveContainer" containerID="3b4cf07471c67ca085bef28bf8d15a75d220b5f7f9afbea4d894e4a9fc6eef61" Jul 10 14:46:15.913506 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:46:15.913488 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b4cf07471c67ca085bef28bf8d15a75d220b5f7f9afbea4d894e4a9fc6eef61\": container with ID starting with 3b4cf07471c67ca085bef28bf8d15a75d220b5f7f9afbea4d894e4a9fc6eef61 not found: ID does not exist" containerID="3b4cf07471c67ca085bef28bf8d15a75d220b5f7f9afbea4d894e4a9fc6eef61" Jul 10 14:46:15.913565 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:15.913518 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b4cf07471c67ca085bef28bf8d15a75d220b5f7f9afbea4d894e4a9fc6eef61"} err="failed to get container status \"3b4cf07471c67ca085bef28bf8d15a75d220b5f7f9afbea4d894e4a9fc6eef61\": rpc error: code = NotFound desc = could not find container \"3b4cf07471c67ca085bef28bf8d15a75d220b5f7f9afbea4d894e4a9fc6eef61\": container with ID starting with 3b4cf07471c67ca085bef28bf8d15a75d220b5f7f9afbea4d894e4a9fc6eef61 not found: ID does not exist" Jul 10 14:46:15.927427 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:15.927404 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd"] Jul 10 14:46:15.929149 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:15.929130 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-9e5d79/sub-test-model-9e5d79-kserve-5b9dcc7bb9-qgnpd"] Jul 10 14:46:17.103015 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:17.102974 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c167d5c0-54d4-411b-9339-82895534e715" path="/var/lib/kubelet/pods/c167d5c0-54d4-411b-9339-82895534e715/volumes" Jul 10 14:46:37.674788 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:37.674757 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj"] Jul 10 14:46:37.675218 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:37.675172 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c167d5c0-54d4-411b-9339-82895534e715" containerName="main" Jul 10 14:46:37.675218 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:37.675184 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c167d5c0-54d4-411b-9339-82895534e715" containerName="main" Jul 10 14:46:37.675218 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:37.675195 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cea9590-20f5-4727-b9fe-0d094aa94643" containerName="main" Jul 10 14:46:37.675218 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:37.675201 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cea9590-20f5-4727-b9fe-0d094aa94643" containerName="main" Jul 10 14:46:37.675380 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:37.675266 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cea9590-20f5-4727-b9fe-0d094aa94643" containerName="main" Jul 10 14:46:37.675380 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:37.675276 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c167d5c0-54d4-411b-9339-82895534e715" containerName="main" Jul 10 14:46:37.678265 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:37.678250 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj" Jul 10 14:46:37.681371 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:37.681334 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-feed7a\"/\"openshift-service-ca.crt\"" Jul 10 14:46:37.682604 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:37.682582 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-feed7a\"/\"kube-root-ca.crt\"" Jul 10 14:46:37.682604 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:37.682594 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-feed7a\"/\"rate-test-model-feed7a-kserve-self-signed-certs\"" Jul 10 14:46:37.682763 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:37.682594 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-feed7a\"/\"default-dockercfg-rq5bd\"" Jul 10 14:46:37.694711 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:37.694688 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj"] Jul 10 14:46:37.784032 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:37.784008 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-model-cache\") pod \"rate-test-model-feed7a-kserve-ff794d9b7-mr7rj\" (UID: \"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d\") " pod="ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj" Jul 10 14:46:37.784166 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:37.784042 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrtfc\" (UniqueName: \"kubernetes.io/projected/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-kube-api-access-hrtfc\") pod \"rate-test-model-feed7a-kserve-ff794d9b7-mr7rj\" (UID: \"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d\") " pod="ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj" Jul 10 14:46:37.784166 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:37.784062 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-home\") pod \"rate-test-model-feed7a-kserve-ff794d9b7-mr7rj\" (UID: \"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d\") " pod="ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj" Jul 10 14:46:37.784166 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:37.784152 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-tmp-dir\") pod \"rate-test-model-feed7a-kserve-ff794d9b7-mr7rj\" (UID: \"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d\") " pod="ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj" Jul 10 14:46:37.784297 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:37.784182 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-dshm\") pod \"rate-test-model-feed7a-kserve-ff794d9b7-mr7rj\" (UID: \"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d\") " pod="ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj" Jul 10 14:46:37.784297 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:37.784223 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-tls-certs\") pod \"rate-test-model-feed7a-kserve-ff794d9b7-mr7rj\" (UID: \"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d\") " pod="ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj" Jul 10 14:46:37.885522 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:37.885497 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-tmp-dir\") pod \"rate-test-model-feed7a-kserve-ff794d9b7-mr7rj\" (UID: \"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d\") " pod="ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj" Jul 10 14:46:37.885698 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:37.885527 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-dshm\") pod \"rate-test-model-feed7a-kserve-ff794d9b7-mr7rj\" (UID: \"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d\") " pod="ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj" Jul 10 14:46:37.885698 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:37.885560 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-tls-certs\") pod \"rate-test-model-feed7a-kserve-ff794d9b7-mr7rj\" (UID: \"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d\") " pod="ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj" Jul 10 14:46:37.885698 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:37.885596 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-model-cache\") pod \"rate-test-model-feed7a-kserve-ff794d9b7-mr7rj\" (UID: \"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d\") " pod="ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj" Jul 10 14:46:37.885698 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:37.885616 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrtfc\" (UniqueName: \"kubernetes.io/projected/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-kube-api-access-hrtfc\") pod \"rate-test-model-feed7a-kserve-ff794d9b7-mr7rj\" (UID: \"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d\") " pod="ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj" Jul 10 14:46:37.885698 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:37.885636 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-home\") pod \"rate-test-model-feed7a-kserve-ff794d9b7-mr7rj\" (UID: \"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d\") " pod="ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj" Jul 10 14:46:37.886062 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:37.886033 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-home\") pod \"rate-test-model-feed7a-kserve-ff794d9b7-mr7rj\" (UID: \"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d\") " pod="ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj" Jul 10 14:46:37.886062 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:37.886051 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-model-cache\") pod \"rate-test-model-feed7a-kserve-ff794d9b7-mr7rj\" (UID: \"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d\") " pod="ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj" Jul 10 14:46:37.886231 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:37.886154 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-tmp-dir\") pod \"rate-test-model-feed7a-kserve-ff794d9b7-mr7rj\" (UID: \"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d\") " pod="ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj" Jul 10 14:46:37.887800 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:37.887780 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-dshm\") pod \"rate-test-model-feed7a-kserve-ff794d9b7-mr7rj\" (UID: \"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d\") " pod="ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj" Jul 10 14:46:37.887928 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:37.887912 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-tls-certs\") pod \"rate-test-model-feed7a-kserve-ff794d9b7-mr7rj\" (UID: \"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d\") " pod="ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj" Jul 10 14:46:37.895228 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:37.895208 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrtfc\" (UniqueName: \"kubernetes.io/projected/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-kube-api-access-hrtfc\") pod \"rate-test-model-feed7a-kserve-ff794d9b7-mr7rj\" (UID: \"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d\") " pod="ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj" Jul 10 14:46:37.987324 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:37.987248 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj" Jul 10 14:46:38.130098 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:38.130072 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj"] Jul 10 14:46:38.132354 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:46:38.132327 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3812f581_e1a8_42a6_b7b5_2353d4a5ed6d.slice/crio-36904c8da13a94fc6168dee73ce0f54722bce8c2992f3c66192e94086c919d63 WatchSource:0}: Error finding container 36904c8da13a94fc6168dee73ce0f54722bce8c2992f3c66192e94086c919d63: Status 404 returned error can't find the container with id 36904c8da13a94fc6168dee73ce0f54722bce8c2992f3c66192e94086c919d63 Jul 10 14:46:39.014575 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:39.014530 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj" event={"ID":"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d","Type":"ContainerStarted","Data":"992dbe7c9c7e90ec4247c0e874047f55c92355aa3cb2220f4f394a18c1eb6a84"} Jul 10 14:46:39.014998 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:39.014582 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj" event={"ID":"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d","Type":"ContainerStarted","Data":"36904c8da13a94fc6168dee73ce0f54722bce8c2992f3c66192e94086c919d63"} Jul 10 14:46:39.035787 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:39.035736 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj" podStartSLOduration=2.035720981 podStartE2EDuration="2.035720981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:46:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:46:39.034783407 +0000 UTC m=+2322.461007727" watchObservedRunningTime="2026-07-10 14:46:39.035720981 +0000 UTC m=+2322.461945300" Jul 10 14:46:47.987423 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:47.987389 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj" Jul 10 14:46:47.987910 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:47.987444 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj" Jul 10 14:46:48.001062 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:48.001038 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj" Jul 10 14:46:48.066768 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:46:48.066732 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj" Jul 10 14:47:27.938718 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:27.938681 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj"] Jul 10 14:47:42.962569 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:42.962529 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj" podUID="3812f581-e1a8-42a6-b7b5-2353d4a5ed6d" containerName="main" containerID="cri-o://992dbe7c9c7e90ec4247c0e874047f55c92355aa3cb2220f4f394a18c1eb6a84" gracePeriod=45 Jul 10 14:47:43.217983 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:43.217912 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj" Jul 10 14:47:43.320543 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:43.320512 2579 generic.go:356] "Generic (PLEG): container finished" podID="3812f581-e1a8-42a6-b7b5-2353d4a5ed6d" containerID="992dbe7c9c7e90ec4247c0e874047f55c92355aa3cb2220f4f394a18c1eb6a84" exitCode=0 Jul 10 14:47:43.320714 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:43.320552 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj" Jul 10 14:47:43.320714 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:43.320602 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj" event={"ID":"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d","Type":"ContainerDied","Data":"992dbe7c9c7e90ec4247c0e874047f55c92355aa3cb2220f4f394a18c1eb6a84"} Jul 10 14:47:43.320714 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:43.320646 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj" event={"ID":"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d","Type":"ContainerDied","Data":"36904c8da13a94fc6168dee73ce0f54722bce8c2992f3c66192e94086c919d63"} Jul 10 14:47:43.320714 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:43.320668 2579 scope.go:117] "RemoveContainer" containerID="992dbe7c9c7e90ec4247c0e874047f55c92355aa3cb2220f4f394a18c1eb6a84" Jul 10 14:47:43.328937 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:43.328920 2579 scope.go:117] "RemoveContainer" containerID="992dbe7c9c7e90ec4247c0e874047f55c92355aa3cb2220f4f394a18c1eb6a84" Jul 10 14:47:43.329197 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:47:43.329179 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"992dbe7c9c7e90ec4247c0e874047f55c92355aa3cb2220f4f394a18c1eb6a84\": container with ID starting with 992dbe7c9c7e90ec4247c0e874047f55c92355aa3cb2220f4f394a18c1eb6a84 not found: ID does not exist" containerID="992dbe7c9c7e90ec4247c0e874047f55c92355aa3cb2220f4f394a18c1eb6a84" Jul 10 14:47:43.329246 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:43.329207 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"992dbe7c9c7e90ec4247c0e874047f55c92355aa3cb2220f4f394a18c1eb6a84"} err="failed to get container status \"992dbe7c9c7e90ec4247c0e874047f55c92355aa3cb2220f4f394a18c1eb6a84\": rpc error: code = NotFound desc = could not find container \"992dbe7c9c7e90ec4247c0e874047f55c92355aa3cb2220f4f394a18c1eb6a84\": container with ID starting with 992dbe7c9c7e90ec4247c0e874047f55c92355aa3cb2220f4f394a18c1eb6a84 not found: ID does not exist" Jul 10 14:47:43.349663 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:43.349639 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrtfc\" (UniqueName: \"kubernetes.io/projected/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-kube-api-access-hrtfc\") pod \"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d\" (UID: \"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d\") " Jul 10 14:47:43.349740 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:43.349691 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-tmp-dir\") pod \"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d\" (UID: \"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d\") " Jul 10 14:47:43.349740 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:43.349730 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-tls-certs\") pod \"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d\" (UID: \"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d\") " Jul 10 14:47:43.349812 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:43.349758 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-home\") pod \"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d\" (UID: \"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d\") " Jul 10 14:47:43.349812 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:43.349782 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-dshm\") pod \"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d\" (UID: \"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d\") " Jul 10 14:47:43.349982 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:43.349966 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-model-cache\") pod \"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d\" (UID: \"3812f581-e1a8-42a6-b7b5-2353d4a5ed6d\") " Jul 10 14:47:43.350076 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:43.350038 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3812f581-e1a8-42a6-b7b5-2353d4a5ed6d" (UID: "3812f581-e1a8-42a6-b7b5-2353d4a5ed6d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:47:43.350076 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:43.350044 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-home" (OuterVolumeSpecName: "home") pod "3812f581-e1a8-42a6-b7b5-2353d4a5ed6d" (UID: "3812f581-e1a8-42a6-b7b5-2353d4a5ed6d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:47:43.350288 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:43.350215 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-model-cache" (OuterVolumeSpecName: "model-cache") pod "3812f581-e1a8-42a6-b7b5-2353d4a5ed6d" (UID: "3812f581-e1a8-42a6-b7b5-2353d4a5ed6d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:47:43.350339 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:43.350291 2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-tmp-dir\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:47:43.350339 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:43.350310 2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-home\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:47:43.350339 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:43.350321 2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-model-cache\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:47:43.351786 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:43.351754 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-dshm" (OuterVolumeSpecName: "dshm") pod "3812f581-e1a8-42a6-b7b5-2353d4a5ed6d" (UID: "3812f581-e1a8-42a6-b7b5-2353d4a5ed6d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:47:43.351786 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:43.351770 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-kube-api-access-hrtfc" (OuterVolumeSpecName: "kube-api-access-hrtfc") pod "3812f581-e1a8-42a6-b7b5-2353d4a5ed6d" (UID: "3812f581-e1a8-42a6-b7b5-2353d4a5ed6d"). InnerVolumeSpecName "kube-api-access-hrtfc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:47:43.351908 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:43.351835 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3812f581-e1a8-42a6-b7b5-2353d4a5ed6d" (UID: "3812f581-e1a8-42a6-b7b5-2353d4a5ed6d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:47:43.450923 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:43.450894 2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-tls-certs\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:47:43.450923 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:43.450919 2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-dshm\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:47:43.451121 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:43.450932 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrtfc\" (UniqueName: \"kubernetes.io/projected/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d-kube-api-access-hrtfc\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:47:43.643406 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:43.643376 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj"] Jul 10 14:47:43.647465 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:43.647441 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-feed7a/rate-test-model-feed7a-kserve-ff794d9b7-mr7rj"] Jul 10 14:47:45.101285 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:45.101255 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3812f581-e1a8-42a6-b7b5-2353d4a5ed6d" path="/var/lib/kubelet/pods/3812f581-e1a8-42a6-b7b5-2353d4a5ed6d/volumes" Jul 10 14:47:54.413913 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:54.413881 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p"] Jul 10 14:47:54.414316 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:54.414101 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" podUID="e6e265f5-6f9d-4c2b-96c2-c458a24ef168" containerName="istio-proxy" containerID="cri-o://9772fb4b231c6ab26c7303534bd9e7468ee66ce2fe29f2552ff88c25cc18f01f" gracePeriod=30 Jul 10 14:47:57.311305 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:57.311276 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-znjf2_99ef7290-2248-4e0c-9fda-100370c1ac2d/console-operator/1.log" Jul 10 14:47:57.315457 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:57.315437 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-znjf2_99ef7290-2248-4e0c-9fda-100370c1ac2d/console-operator/1.log" Jul 10 14:47:57.320905 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:57.320887 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jwwrp_6ce1e1c6-c734-4df5-9079-0295f7de80f6/ovn-acl-logging/0.log" Jul 10 14:47:57.324301 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:57.324284 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jwwrp_6ce1e1c6-c734-4df5-9079-0295f7de80f6/ovn-acl-logging/0.log" Jul 10 14:47:59.675979 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:59.675905 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:47:59.797343 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:59.797315 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-workload-socket\") pod \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " Jul 10 14:47:59.797520 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:59.797349 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-istio-token\") pod \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " Jul 10 14:47:59.797520 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:59.797387 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-credential-socket\") pod \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " Jul 10 14:47:59.797520 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:59.797432 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-istio-podinfo\") pod \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " Jul 10 14:47:59.797520 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:59.797487 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-istiod-ca-cert\") pod \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " Jul 10 14:47:59.797520 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:59.797515 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-workload-certs\") pod \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " Jul 10 14:47:59.797814 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:59.797583 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfnwg\" (UniqueName: \"kubernetes.io/projected/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-kube-api-access-qfnwg\") pod \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " Jul 10 14:47:59.797814 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:59.797606 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-istio-envoy\") pod \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " Jul 10 14:47:59.797814 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:59.797606 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e6e265f5-6f9d-4c2b-96c2-c458a24ef168" (UID: "e6e265f5-6f9d-4c2b-96c2-c458a24ef168"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:47:59.797814 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:59.797638 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-istio-data\") pod \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\" (UID: \"e6e265f5-6f9d-4c2b-96c2-c458a24ef168\") " Jul 10 14:47:59.798031 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:59.797869 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e6e265f5-6f9d-4c2b-96c2-c458a24ef168" (UID: "e6e265f5-6f9d-4c2b-96c2-c458a24ef168"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:47:59.798031 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:59.797987 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e6e265f5-6f9d-4c2b-96c2-c458a24ef168" (UID: "e6e265f5-6f9d-4c2b-96c2-c458a24ef168"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:47:59.798031 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:59.798013 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-workload-certs\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:47:59.798195 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:59.798066 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-workload-socket\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:47:59.798406 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:59.798379 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e6e265f5-6f9d-4c2b-96c2-c458a24ef168" (UID: "e6e265f5-6f9d-4c2b-96c2-c458a24ef168"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:47:59.798888 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:59.798859 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-istio-data" (OuterVolumeSpecName: "istio-data") pod "e6e265f5-6f9d-4c2b-96c2-c458a24ef168" (UID: "e6e265f5-6f9d-4c2b-96c2-c458a24ef168"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:47:59.799757 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:59.799724 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-istio-token" (OuterVolumeSpecName: "istio-token") pod "e6e265f5-6f9d-4c2b-96c2-c458a24ef168" (UID: "e6e265f5-6f9d-4c2b-96c2-c458a24ef168"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:47:59.800209 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:59.800180 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e6e265f5-6f9d-4c2b-96c2-c458a24ef168" (UID: "e6e265f5-6f9d-4c2b-96c2-c458a24ef168"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 14:47:59.800286 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:59.800222 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e6e265f5-6f9d-4c2b-96c2-c458a24ef168" (UID: "e6e265f5-6f9d-4c2b-96c2-c458a24ef168"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:47:59.800286 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:59.800231 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-kube-api-access-qfnwg" (OuterVolumeSpecName: "kube-api-access-qfnwg") pod "e6e265f5-6f9d-4c2b-96c2-c458a24ef168" (UID: "e6e265f5-6f9d-4c2b-96c2-c458a24ef168"). InnerVolumeSpecName "kube-api-access-qfnwg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:47:59.898485 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:59.898460 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfnwg\" (UniqueName: \"kubernetes.io/projected/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-kube-api-access-qfnwg\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:47:59.898485 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:59.898484 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-istio-envoy\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:47:59.898672 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:59.898493 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-istio-data\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:47:59.898672 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:59.898501 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-istio-token\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:47:59.898672 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:59.898509 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-credential-socket\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:47:59.898672 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:59.898516 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-istio-podinfo\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:47:59.898672 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:47:59.898524 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6e265f5-6f9d-4c2b-96c2-c458a24ef168-istiod-ca-cert\") on node \"ip-10-0-135-64.ec2.internal\" DevicePath \"\"" Jul 10 14:48:00.407450 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:00.407414 2579 generic.go:356] "Generic (PLEG): container finished" podID="e6e265f5-6f9d-4c2b-96c2-c458a24ef168" containerID="9772fb4b231c6ab26c7303534bd9e7468ee66ce2fe29f2552ff88c25cc18f01f" exitCode=0 Jul 10 14:48:00.407645 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:00.407473 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" Jul 10 14:48:00.407645 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:00.407493 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" event={"ID":"e6e265f5-6f9d-4c2b-96c2-c458a24ef168","Type":"ContainerDied","Data":"9772fb4b231c6ab26c7303534bd9e7468ee66ce2fe29f2552ff88c25cc18f01f"} Jul 10 14:48:00.407645 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:00.407545 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p" event={"ID":"e6e265f5-6f9d-4c2b-96c2-c458a24ef168","Type":"ContainerDied","Data":"994216478e4a9a2fe8ddfc7ef6cd7841730e4dc2467caeff9f0801d62c1bc551"} Jul 10 14:48:00.407645 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:00.407566 2579 scope.go:117] "RemoveContainer" containerID="9772fb4b231c6ab26c7303534bd9e7468ee66ce2fe29f2552ff88c25cc18f01f" Jul 10 14:48:00.417062 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:00.417044 2579 scope.go:117] "RemoveContainer" containerID="b66cd1347dcc70ca73bf4a2aece2fd11dc02c84340083244bc886e2484107fd1" Jul 10 14:48:00.424722 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:00.424705 2579 scope.go:117] "RemoveContainer" containerID="9772fb4b231c6ab26c7303534bd9e7468ee66ce2fe29f2552ff88c25cc18f01f" Jul 10 14:48:00.424972 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:48:00.424940 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9772fb4b231c6ab26c7303534bd9e7468ee66ce2fe29f2552ff88c25cc18f01f\": container with ID starting with 9772fb4b231c6ab26c7303534bd9e7468ee66ce2fe29f2552ff88c25cc18f01f not found: ID does not exist" containerID="9772fb4b231c6ab26c7303534bd9e7468ee66ce2fe29f2552ff88c25cc18f01f" Jul 10 14:48:00.425039 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:00.424978 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9772fb4b231c6ab26c7303534bd9e7468ee66ce2fe29f2552ff88c25cc18f01f"} err="failed to get container status \"9772fb4b231c6ab26c7303534bd9e7468ee66ce2fe29f2552ff88c25cc18f01f\": rpc error: code = NotFound desc = could not find container \"9772fb4b231c6ab26c7303534bd9e7468ee66ce2fe29f2552ff88c25cc18f01f\": container with ID starting with 9772fb4b231c6ab26c7303534bd9e7468ee66ce2fe29f2552ff88c25cc18f01f not found: ID does not exist" Jul 10 14:48:00.425039 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:00.424992 2579 scope.go:117] "RemoveContainer" containerID="b66cd1347dcc70ca73bf4a2aece2fd11dc02c84340083244bc886e2484107fd1" Jul 10 14:48:00.425217 ip-10-0-135-64 kubenswrapper[2579]: E0710 14:48:00.425200 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b66cd1347dcc70ca73bf4a2aece2fd11dc02c84340083244bc886e2484107fd1\": container with ID starting with b66cd1347dcc70ca73bf4a2aece2fd11dc02c84340083244bc886e2484107fd1 not found: ID does not exist" containerID="b66cd1347dcc70ca73bf4a2aece2fd11dc02c84340083244bc886e2484107fd1" Jul 10 14:48:00.425257 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:00.425221 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b66cd1347dcc70ca73bf4a2aece2fd11dc02c84340083244bc886e2484107fd1"} err="failed to get container status \"b66cd1347dcc70ca73bf4a2aece2fd11dc02c84340083244bc886e2484107fd1\": rpc error: code = NotFound desc = could not find container \"b66cd1347dcc70ca73bf4a2aece2fd11dc02c84340083244bc886e2484107fd1\": container with ID starting with b66cd1347dcc70ca73bf4a2aece2fd11dc02c84340083244bc886e2484107fd1 not found: ID does not exist" Jul 10 14:48:00.434671 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:00.434647 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p"] Jul 10 14:48:00.438457 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:00.438438 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-9e5d79-openshift-default-8576bd5c4c-2vs9p"] Jul 10 14:48:01.102203 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:01.102170 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6e265f5-6f9d-4c2b-96c2-c458a24ef168" path="/var/lib/kubelet/pods/e6e265f5-6f9d-4c2b-96c2-c458a24ef168/volumes" Jul 10 14:48:08.251821 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:08.251783 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d47b746d6-6bxtx_cbaae726-7e51-4d6b-91e5-063ae0a4a966/manager/0.log" Jul 10 14:48:08.265312 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:08.265288 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d47b746d6-6bxtx_cbaae726-7e51-4d6b-91e5-063ae0a4a966/copy-manifests/0.log" Jul 10 14:48:09.025075 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:09.025038 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-cqd6z_dad11190-2bf2-401d-bc19-498260448de8/postgres/0.log" Jul 10 14:48:11.318073 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:11.318040 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-dxh6s_12e1b218-be9a-4271-a142-be336da650d9/manager/0.log" Jul 10 14:48:11.688846 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:11.688819 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4gqkd9_7030bbeb-5332-407d-99ac-8b2c06d9afd5/istio-proxy/0.log" Jul 10 14:48:12.192438 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:12.192391 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9fxmm_7b70e341-1ab3-4e0b-a724-ecb87b6ec91f/istio-proxy/1.log" Jul 10 14:48:12.577588 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:12.577505 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74c7c45ff4-cg9w4_8ef37476-3f4b-430b-abfd-c43a4e2b73ea/router/0.log" Jul 10 14:48:12.939532 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:12.939502 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-4hbqr_12140959-558c-4aa1-847e-bf3bd0cf731d/main/0.log" Jul 10 14:48:13.293770 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:13.293687 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8htgw_5aa2c284-9217-4db2-bc83-337275e0cea6/main/0.log" Jul 10 14:48:20.487529 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:20.487448 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-86t8x_d30d948f-76fb-4888-a860-adf9622c2f3f/global-pull-secret-syncer/0.log" Jul 10 14:48:20.707981 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:20.707935 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-whgbp_60fe63fb-184b-4a4a-838e-e5c3317392e9/konnectivity-agent/0.log" Jul 10 14:48:20.768338 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:20.768257 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-64.ec2.internal_d42f5dcd4d345727f40495ab04e52e31/haproxy/0.log" Jul 10 14:48:26.680999 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:26.680962 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-dxh6s_12e1b218-be9a-4271-a142-be336da650d9/manager/0.log" Jul 10 14:48:28.594410 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:28.594362 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-lq8n4_262f42ab-f88a-4689-99ba-0c130a08dde1/cluster-monitoring-operator/0.log" Jul 10 14:48:28.756682 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:28.756650 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6kh94_8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf/node-exporter/0.log" Jul 10 14:48:28.785712 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:28.785683 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6kh94_8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf/kube-rbac-proxy/0.log" Jul 10 14:48:28.805893 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:28.805872 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6kh94_8fbbad3b-2ae9-4e1d-8e33-91c5d58b55cf/init-textfile/0.log" Jul 10 14:48:29.262828 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:29.262804 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-v6fzx_9c9ef0e2-0c71-49fb-8d35-203b7748caf2/prometheus-operator/0.log" Jul 10 14:48:29.279971 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:29.279929 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-v6fzx_9c9ef0e2-0c71-49fb-8d35-203b7748caf2/kube-rbac-proxy/0.log" Jul 10 14:48:29.303551 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:29.303520 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-db82z_e4b55c26-a8df-4225-9c2b-e08243a2b3b6/prometheus-operator-admission-webhook/0.log" Jul 10 14:48:30.498158 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:30.498126 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hrtpc/perf-node-gather-daemonset-wg9nd"] Jul 10 14:48:30.498682 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:30.498496 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6e265f5-6f9d-4c2b-96c2-c458a24ef168" containerName="istio-proxy" Jul 10 14:48:30.498682 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:30.498507 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6e265f5-6f9d-4c2b-96c2-c458a24ef168" containerName="istio-proxy" Jul 10 14:48:30.498682 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:30.498518 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3812f581-e1a8-42a6-b7b5-2353d4a5ed6d" containerName="main" Jul 10 14:48:30.498682 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:30.498524 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3812f581-e1a8-42a6-b7b5-2353d4a5ed6d" containerName="main" Jul 10 14:48:30.498682 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:30.498604 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6e265f5-6f9d-4c2b-96c2-c458a24ef168" containerName="istio-proxy" Jul 10 14:48:30.498682 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:30.498616 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6e265f5-6f9d-4c2b-96c2-c458a24ef168" containerName="istio-proxy" Jul 10 14:48:30.498682 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:30.498622 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3812f581-e1a8-42a6-b7b5-2353d4a5ed6d" containerName="main" Jul 10 14:48:30.501710 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:30.501691 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-wg9nd" Jul 10 14:48:30.505453 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:30.505434 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hrtpc\"/\"openshift-service-ca.crt\"" Jul 10 14:48:30.506813 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:30.506798 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hrtpc\"/\"default-dockercfg-sf26v\"" Jul 10 14:48:30.506981 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:30.506963 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hrtpc\"/\"kube-root-ca.crt\"" Jul 10 14:48:30.513809 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:30.513788 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hrtpc/perf-node-gather-daemonset-wg9nd"] Jul 10 14:48:30.558706 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:30.558683 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/40cea66d-bee8-4b8c-aa44-1820d584916f-podres\") pod \"perf-node-gather-daemonset-wg9nd\" (UID: \"40cea66d-bee8-4b8c-aa44-1820d584916f\") " pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-wg9nd" Jul 10 14:48:30.558844 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:30.558718 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/40cea66d-bee8-4b8c-aa44-1820d584916f-proc\") pod \"perf-node-gather-daemonset-wg9nd\" (UID: \"40cea66d-bee8-4b8c-aa44-1820d584916f\") " pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-wg9nd" Jul 10 14:48:30.558844 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:30.558735 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40cea66d-bee8-4b8c-aa44-1820d584916f-sys\") pod \"perf-node-gather-daemonset-wg9nd\" (UID: \"40cea66d-bee8-4b8c-aa44-1820d584916f\") " pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-wg9nd" Jul 10 14:48:30.558922 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:30.558862 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/40cea66d-bee8-4b8c-aa44-1820d584916f-lib-modules\") pod \"perf-node-gather-daemonset-wg9nd\" (UID: \"40cea66d-bee8-4b8c-aa44-1820d584916f\") " pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-wg9nd" Jul 10 14:48:30.558922 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:30.558889 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpjwn\" (UniqueName: \"kubernetes.io/projected/40cea66d-bee8-4b8c-aa44-1820d584916f-kube-api-access-bpjwn\") pod \"perf-node-gather-daemonset-wg9nd\" (UID: \"40cea66d-bee8-4b8c-aa44-1820d584916f\") " pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-wg9nd" Jul 10 14:48:30.660074 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:30.660040 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/40cea66d-bee8-4b8c-aa44-1820d584916f-proc\") pod \"perf-node-gather-daemonset-wg9nd\" (UID: \"40cea66d-bee8-4b8c-aa44-1820d584916f\") " pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-wg9nd" Jul 10 14:48:30.660074 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:30.660077 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40cea66d-bee8-4b8c-aa44-1820d584916f-sys\") pod \"perf-node-gather-daemonset-wg9nd\" (UID: \"40cea66d-bee8-4b8c-aa44-1820d584916f\") " pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-wg9nd" Jul 10 14:48:30.660308 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:30.660162 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/40cea66d-bee8-4b8c-aa44-1820d584916f-proc\") pod \"perf-node-gather-daemonset-wg9nd\" (UID: \"40cea66d-bee8-4b8c-aa44-1820d584916f\") " pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-wg9nd" Jul 10 14:48:30.660308 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:30.660166 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/40cea66d-bee8-4b8c-aa44-1820d584916f-lib-modules\") pod \"perf-node-gather-daemonset-wg9nd\" (UID: \"40cea66d-bee8-4b8c-aa44-1820d584916f\") " pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-wg9nd" Jul 10 14:48:30.660308 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:30.660221 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpjwn\" (UniqueName: \"kubernetes.io/projected/40cea66d-bee8-4b8c-aa44-1820d584916f-kube-api-access-bpjwn\") pod \"perf-node-gather-daemonset-wg9nd\" (UID: \"40cea66d-bee8-4b8c-aa44-1820d584916f\") " pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-wg9nd" Jul 10 14:48:30.660308 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:30.660250 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40cea66d-bee8-4b8c-aa44-1820d584916f-sys\") pod \"perf-node-gather-daemonset-wg9nd\" (UID: \"40cea66d-bee8-4b8c-aa44-1820d584916f\") " pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-wg9nd" Jul 10 14:48:30.660308 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:30.660279 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/40cea66d-bee8-4b8c-aa44-1820d584916f-podres\") pod \"perf-node-gather-daemonset-wg9nd\" (UID: \"40cea66d-bee8-4b8c-aa44-1820d584916f\") " pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-wg9nd" Jul 10 14:48:30.660308 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:30.660283 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/40cea66d-bee8-4b8c-aa44-1820d584916f-lib-modules\") pod \"perf-node-gather-daemonset-wg9nd\" (UID: \"40cea66d-bee8-4b8c-aa44-1820d584916f\") " pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-wg9nd" Jul 10 14:48:30.660514 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:30.660352 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/40cea66d-bee8-4b8c-aa44-1820d584916f-podres\") pod \"perf-node-gather-daemonset-wg9nd\" (UID: \"40cea66d-bee8-4b8c-aa44-1820d584916f\") " pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-wg9nd" Jul 10 14:48:30.669726 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:30.669701 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpjwn\" (UniqueName: \"kubernetes.io/projected/40cea66d-bee8-4b8c-aa44-1820d584916f-kube-api-access-bpjwn\") pod \"perf-node-gather-daemonset-wg9nd\" (UID: \"40cea66d-bee8-4b8c-aa44-1820d584916f\") " pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-wg9nd" Jul 10 14:48:30.745341 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:30.745308 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-fgxcc_f49ccccf-cd07-4740-838d-11c0426f7273/networking-console-plugin/0.log" Jul 10 14:48:30.812125 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:30.812045 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-wg9nd" Jul 10 14:48:30.941989 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:30.941943 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hrtpc/perf-node-gather-daemonset-wg9nd"] Jul 10 14:48:30.943530 ip-10-0-135-64 kubenswrapper[2579]: W0710 14:48:30.943505 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod40cea66d_bee8_4b8c_aa44_1820d584916f.slice/crio-d18ff30a2a75eee9e0faec86bc9d8aded4cea328458f879f1f0b33c071a78ce3 WatchSource:0}: Error finding container d18ff30a2a75eee9e0faec86bc9d8aded4cea328458f879f1f0b33c071a78ce3: Status 404 returned error can't find the container with id d18ff30a2a75eee9e0faec86bc9d8aded4cea328458f879f1f0b33c071a78ce3 Jul 10 14:48:31.337860 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:31.337828 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-znjf2_99ef7290-2248-4e0c-9fda-100370c1ac2d/console-operator/1.log" Jul 10 14:48:31.346177 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:31.346154 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-znjf2_99ef7290-2248-4e0c-9fda-100370c1ac2d/console-operator/2.log" Jul 10 14:48:31.552304 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:31.552272 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-wg9nd" event={"ID":"40cea66d-bee8-4b8c-aa44-1820d584916f","Type":"ContainerStarted","Data":"32820b47cb0e26c7bc3a48082358179eb516046f98621ec52e954572ebf74b4c"} Jul 10 14:48:31.552696 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:31.552319 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-wg9nd" event={"ID":"40cea66d-bee8-4b8c-aa44-1820d584916f","Type":"ContainerStarted","Data":"d18ff30a2a75eee9e0faec86bc9d8aded4cea328458f879f1f0b33c071a78ce3"} Jul 10 14:48:31.552696 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:31.552406 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-wg9nd" Jul 10 14:48:31.572157 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:31.572113 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-wg9nd" podStartSLOduration=1.572097973 podStartE2EDuration="1.572097973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:48:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:48:31.570062677 +0000 UTC m=+2434.996286997" watchObservedRunningTime="2026-07-10 14:48:31.572097973 +0000 UTC m=+2434.998322293" Jul 10 14:48:31.850482 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:31.850455 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-jxvq8_202c32b7-79a9-4d76-b943-c8624099e36f/download-server/0.log" Jul 10 14:48:32.439445 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:32.439412 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-76jtw_702d9fee-e3a5-400c-b53a-e2ce3be19af3/volume-data-source-validator/0.log" Jul 10 14:48:33.571295 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:33.571268 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dzg7b_599b3c3c-524d-49e8-9260-ef807f63fea6/dns/0.log" Jul 10 14:48:33.600543 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:33.600519 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dzg7b_599b3c3c-524d-49e8-9260-ef807f63fea6/kube-rbac-proxy/0.log" Jul 10 14:48:33.758764 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:33.758737 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gz2xn_d5297778-2ed8-4173-a78f-55109e6e5503/dns-node-resolver/0.log" Jul 10 14:48:34.565338 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:34.565309 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t4t72_f8d41bc8-bad3-456a-8374-1c795e333862/node-ca/0.log" Jul 10 14:48:35.755993 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:35.755940 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4gqkd9_7030bbeb-5332-407d-99ac-8b2c06d9afd5/istio-proxy/0.log" Jul 10 14:48:35.992268 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:35.992239 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9fxmm_7b70e341-1ab3-4e0b-a724-ecb87b6ec91f/istio-proxy/0.log" Jul 10 14:48:36.050364 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:36.050279 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9fxmm_7b70e341-1ab3-4e0b-a724-ecb87b6ec91f/istio-proxy/1.log" Jul 10 14:48:36.148724 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:36.148686 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74c7c45ff4-cg9w4_8ef37476-3f4b-430b-abfd-c43a4e2b73ea/router/0.log" Jul 10 14:48:36.937933 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:36.937904 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wv479_c09a8bb4-23ae-4bec-8d56-63e2f705d3ef/serve-healthcheck-canary/0.log" Jul 10 14:48:37.448583 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:37.448524 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-vz755_7f9d2e13-3a46-4539-b046-2c9ae7fe5f94/insights-operator/0.log" Jul 10 14:48:37.449416 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:37.449395 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-vz755_7f9d2e13-3a46-4539-b046-2c9ae7fe5f94/insights-operator/1.log" Jul 10 14:48:37.566571 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:37.566543 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hrtpc/perf-node-gather-daemonset-wg9nd" Jul 10 14:48:37.647832 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:37.647800 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pflwv_ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c/kube-rbac-proxy/0.log" Jul 10 14:48:37.673168 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:37.673144 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pflwv_ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c/exporter/0.log" Jul 10 14:48:37.698487 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:37.698465 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pflwv_ac9d9e26-b9bf-4a63-b7b2-7ecaae71588c/extractor/0.log" Jul 10 14:48:40.856356 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:40.856322 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d47b746d6-6bxtx_cbaae726-7e51-4d6b-91e5-063ae0a4a966/manager/0.log" Jul 10 14:48:40.869565 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:40.869539 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4gqkd9_7030bbeb-5332-407d-99ac-8b2c06d9afd5/istio-proxy/0.log" Jul 10 14:48:40.904088 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:40.904065 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d47b746d6-6bxtx_cbaae726-7e51-4d6b-91e5-063ae0a4a966/copy-manifests/0.log" Jul 10 14:48:41.052785 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:41.052693 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9fxmm_7b70e341-1ab3-4e0b-a724-ecb87b6ec91f/istio-proxy/0.log" Jul 10 14:48:41.108112 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:41.108087 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9fxmm_7b70e341-1ab3-4e0b-a724-ecb87b6ec91f/istio-proxy/1.log" Jul 10 14:48:41.186602 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:41.186566 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74c7c45ff4-cg9w4_8ef37476-3f4b-430b-abfd-c43a4e2b73ea/router/0.log" Jul 10 14:48:42.332454 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:42.332423 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5d5554d48-4zn98_bfde1597-c60a-4d6e-8e40-26ade28fcf1b/manager/0.log" Jul 10 14:48:42.441155 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:42.441127 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4gqkd9_7030bbeb-5332-407d-99ac-8b2c06d9afd5/istio-proxy/0.log" Jul 10 14:48:42.642440 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:42.642341 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9fxmm_7b70e341-1ab3-4e0b-a724-ecb87b6ec91f/istio-proxy/0.log" Jul 10 14:48:42.697794 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:42.697767 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9fxmm_7b70e341-1ab3-4e0b-a724-ecb87b6ec91f/istio-proxy/1.log" Jul 10 14:48:42.769120 ip-10-0-135-64 kubenswrapper[2579]: I0710 14:48:42.769089 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74c7c45ff4-cg9w4_8ef37476-3f4b-430b-abfd-c43a4e2b73ea/router/0.log"