Jul 17 18:09:44.629251 ip-10-0-132-68 systemd[1]: Starting Kubernetes Kubelet... Jul 17 18:09:44.956243 ip-10-0-132-68 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 18:09:44.956243 ip-10-0-132-68 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 17 18:09:44.956243 ip-10-0-132-68 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 18:09:44.956243 ip-10-0-132-68 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 17 18:09:44.956243 ip-10-0-132-68 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 18:09:44.957000 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.956921 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 17 18:09:44.961244 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961232 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 18:09:44.961244 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961244 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 18:09:44.961305 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961248 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 18:09:44.961305 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961251 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 18:09:44.961305 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961254 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 18:09:44.961305 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961257 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 18:09:44.961305 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961262 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 18:09:44.961305 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961266 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 18:09:44.961305 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961269 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 18:09:44.961305 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961273 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 18:09:44.961305 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961276 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 18:09:44.961305 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961279 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 18:09:44.961305 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961282 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 18:09:44.961305 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961285 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 18:09:44.961305 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961288 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 18:09:44.961305 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961290 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 18:09:44.961305 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961293 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 18:09:44.961305 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961295 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 18:09:44.961305 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961298 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 18:09:44.961305 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961301 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 18:09:44.961305 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961303 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 18:09:44.961305 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961306 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 18:09:44.961745 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961309 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 18:09:44.961745 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961311 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 18:09:44.961745 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961314 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 18:09:44.961745 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961317 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 18:09:44.961745 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961320 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 18:09:44.961745 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961322 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 18:09:44.961745 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961324 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 18:09:44.961745 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961327 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 18:09:44.961745 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961329 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 18:09:44.961745 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961332 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 18:09:44.961745 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961334 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 18:09:44.961745 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961337 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 18:09:44.961745 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961340 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 18:09:44.961745 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961342 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 18:09:44.961745 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961345 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 18:09:44.961745 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961347 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 18:09:44.961745 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961349 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 18:09:44.961745 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961352 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 18:09:44.961745 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961355 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 18:09:44.961745 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961357 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 18:09:44.962210 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961360 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 18:09:44.962210 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961362 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 18:09:44.962210 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961364 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 18:09:44.962210 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961367 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 18:09:44.962210 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961369 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 18:09:44.962210 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961371 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 18:09:44.962210 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961374 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 18:09:44.962210 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961376 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 18:09:44.962210 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961379 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 18:09:44.962210 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961381 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 18:09:44.962210 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961384 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 18:09:44.962210 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961386 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 18:09:44.962210 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961389 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 18:09:44.962210 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961392 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 18:09:44.962210 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961394 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 18:09:44.962210 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961397 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 18:09:44.962210 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961399 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 18:09:44.962210 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961402 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 18:09:44.962210 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961404 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 18:09:44.962210 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961407 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 18:09:44.962663 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961410 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 18:09:44.962663 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961413 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 18:09:44.962663 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961416 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 18:09:44.962663 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961418 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 18:09:44.962663 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961421 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 18:09:44.962663 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961423 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 18:09:44.962663 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961426 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 18:09:44.962663 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961428 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 18:09:44.962663 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961430 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 18:09:44.962663 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961433 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 18:09:44.962663 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961435 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 18:09:44.962663 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961438 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 18:09:44.962663 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961440 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 18:09:44.962663 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961442 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 18:09:44.962663 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961446 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 18:09:44.962663 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961448 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 17 18:09:44.962663 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961451 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 18:09:44.962663 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961455 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 18:09:44.962663 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961457 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 18:09:44.963100 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961460 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 18:09:44.963100 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961463 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 18:09:44.963100 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961467 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 18:09:44.963100 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961470 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 18:09:44.963100 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961472 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 18:09:44.963100 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961474 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 18:09:44.963100 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961478 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 18:09:44.963100 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961481 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 18:09:44.963100 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961484 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 18:09:44.963100 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961488 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 18:09:44.963100 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961491 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 18:09:44.963100 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961494 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 18:09:44.963100 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961498 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 18:09:44.963100 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961502 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 18:09:44.963100 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961504 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 18:09:44.963100 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961508 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 18:09:44.963100 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961512 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 18:09:44.963100 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.961514 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 18:09:44.963100 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962203 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 18:09:44.963533 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962209 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 18:09:44.963533 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962212 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 18:09:44.963533 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962215 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 18:09:44.963533 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962218 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 18:09:44.963533 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962221 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 18:09:44.963533 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962224 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 18:09:44.963533 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962227 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 18:09:44.963533 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962229 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 18:09:44.963533 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962233 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 18:09:44.963533 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962236 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 18:09:44.963533 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962238 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 18:09:44.963533 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962241 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 18:09:44.963533 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962243 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 18:09:44.963533 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962246 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 18:09:44.963533 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962249 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 18:09:44.963533 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962251 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 18:09:44.963533 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962253 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 18:09:44.963533 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962256 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 18:09:44.963533 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962258 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 18:09:44.963533 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962261 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 18:09:44.964003 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962263 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 18:09:44.964003 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962266 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 18:09:44.964003 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962269 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 18:09:44.964003 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962273 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 18:09:44.964003 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962276 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 18:09:44.964003 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962278 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 18:09:44.964003 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962281 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 18:09:44.964003 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962283 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 18:09:44.964003 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962285 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 18:09:44.964003 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962287 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 18:09:44.964003 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962290 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 18:09:44.964003 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962293 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 18:09:44.964003 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962295 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 18:09:44.964003 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962297 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 18:09:44.964003 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962300 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 18:09:44.964003 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962302 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 18:09:44.964003 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962305 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 18:09:44.964003 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962307 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 18:09:44.964003 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962309 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 18:09:44.964003 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962312 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 18:09:44.964471 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962315 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 18:09:44.964471 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962319 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 18:09:44.964471 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962323 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 18:09:44.964471 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962326 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 18:09:44.964471 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962328 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 18:09:44.964471 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962331 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 18:09:44.964471 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962333 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 18:09:44.964471 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962336 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 18:09:44.964471 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962338 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 18:09:44.964471 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962341 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 18:09:44.964471 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962343 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 18:09:44.964471 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962346 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 18:09:44.964471 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962348 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 18:09:44.964471 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962351 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 18:09:44.964471 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962353 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 18:09:44.964471 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962355 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 18:09:44.964471 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962358 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 18:09:44.964471 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962360 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 18:09:44.964471 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962363 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 18:09:44.965031 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962365 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 18:09:44.965031 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962367 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 18:09:44.965031 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962370 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 18:09:44.965031 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962373 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 18:09:44.965031 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962376 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 18:09:44.965031 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962378 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 18:09:44.965031 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962381 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 18:09:44.965031 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962384 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 18:09:44.965031 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962386 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 18:09:44.965031 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962389 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 18:09:44.965031 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962391 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 18:09:44.965031 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962393 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 18:09:44.965031 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962396 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 18:09:44.965031 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962400 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 18:09:44.965031 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962403 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 18:09:44.965031 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962405 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 18:09:44.965031 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962409 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 18:09:44.965031 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962412 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 18:09:44.965031 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962414 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 18:09:44.965472 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962417 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 18:09:44.965472 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962419 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 18:09:44.965472 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962421 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 18:09:44.965472 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962424 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 18:09:44.965472 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962427 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 18:09:44.965472 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962429 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 18:09:44.965472 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962433 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 18:09:44.965472 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962435 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 18:09:44.965472 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962438 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 18:09:44.965472 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962440 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 17 18:09:44.965472 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962448 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 18:09:44.965472 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962451 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 18:09:44.965472 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962453 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 18:09:44.965472 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962456 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 18:09:44.965472 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962458 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 18:09:44.965472 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962461 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 18:09:44.965472 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962463 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 18:09:44.965472 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962466 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 18:09:44.965472 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962468 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 18:09:44.965472 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962471 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 18:09:44.965950 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962833 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 18:09:44.965950 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962837 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 18:09:44.965950 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962840 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 18:09:44.965950 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962842 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 18:09:44.965950 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962845 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 18:09:44.965950 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962848 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 18:09:44.965950 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962850 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 18:09:44.965950 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962854 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 18:09:44.965950 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962857 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 18:09:44.965950 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962860 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 18:09:44.965950 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962863 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 18:09:44.965950 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962865 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 18:09:44.965950 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962867 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 18:09:44.965950 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962870 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 18:09:44.965950 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962872 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 18:09:44.965950 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962875 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 18:09:44.965950 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962878 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 18:09:44.965950 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962880 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 18:09:44.965950 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962882 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 18:09:44.966405 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962885 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 18:09:44.966405 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962887 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 18:09:44.966405 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962890 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 18:09:44.966405 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962894 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 18:09:44.966405 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962896 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 18:09:44.966405 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962898 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 18:09:44.966405 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962901 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 18:09:44.966405 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962903 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 18:09:44.966405 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962906 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 18:09:44.966405 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962908 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 18:09:44.966405 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962910 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 18:09:44.966405 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962913 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 18:09:44.966405 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962916 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 18:09:44.966405 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962918 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 18:09:44.966405 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962920 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 18:09:44.966405 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962923 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 18:09:44.966405 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962925 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 18:09:44.966405 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962928 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 18:09:44.966405 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962930 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 18:09:44.966405 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962932 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 18:09:44.966856 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962935 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 18:09:44.966856 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962937 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 18:09:44.966856 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962940 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 18:09:44.966856 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962942 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 18:09:44.966856 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962945 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 18:09:44.966856 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962947 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 18:09:44.966856 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962949 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 18:09:44.966856 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962952 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 18:09:44.966856 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962956 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 18:09:44.966856 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962959 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 18:09:44.966856 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962961 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 17 18:09:44.966856 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962964 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 18:09:44.966856 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962967 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 18:09:44.966856 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962970 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 18:09:44.966856 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962988 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 18:09:44.966856 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962992 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 18:09:44.966856 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962995 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 18:09:44.966856 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.962997 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 18:09:44.966856 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963000 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 18:09:44.966856 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963002 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 18:09:44.967368 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963005 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 18:09:44.967368 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963008 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 18:09:44.967368 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963010 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 18:09:44.967368 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963013 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 18:09:44.967368 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963019 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 18:09:44.967368 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963021 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 18:09:44.967368 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963024 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 18:09:44.967368 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963026 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 18:09:44.967368 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963029 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 18:09:44.967368 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963031 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 18:09:44.967368 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963033 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 18:09:44.967368 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963036 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 18:09:44.967368 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963038 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 18:09:44.967368 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963041 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 18:09:44.967368 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963043 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 18:09:44.967368 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963046 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 18:09:44.967368 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963051 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 18:09:44.967368 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963054 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 18:09:44.967368 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963057 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 18:09:44.967368 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963059 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 18:09:44.967828 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963062 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 18:09:44.967828 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963064 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 18:09:44.967828 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963067 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 18:09:44.967828 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963069 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 18:09:44.967828 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963073 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 18:09:44.967828 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963075 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 18:09:44.967828 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963077 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 18:09:44.967828 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963081 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 18:09:44.967828 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963084 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 18:09:44.967828 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963086 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 18:09:44.967828 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963089 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 18:09:44.967828 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963091 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 18:09:44.967828 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963094 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 18:09:44.967828 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963097 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 18:09:44.967828 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963100 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 18:09:44.967828 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963103 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 18:09:44.967828 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963105 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 18:09:44.967828 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963108 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 18:09:44.967828 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963111 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 18:09:44.968295 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963114 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 18:09:44.968295 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963177 2576 flags.go:64] FLAG: --address="0.0.0.0" Jul 17 18:09:44.968295 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963184 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 17 18:09:44.968295 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963192 2576 flags.go:64] FLAG: --anonymous-auth="true" Jul 17 18:09:44.968295 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963196 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 17 18:09:44.968295 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963200 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 17 18:09:44.968295 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963203 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 17 18:09:44.968295 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963207 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 17 18:09:44.968295 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963211 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 17 18:09:44.968295 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963214 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 17 18:09:44.968295 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963217 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 17 18:09:44.968295 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963220 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 17 18:09:44.968295 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963224 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 17 18:09:44.968295 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963227 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 17 18:09:44.968295 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963229 2576 flags.go:64] FLAG: --cgroup-root="" Jul 17 18:09:44.968295 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963232 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 17 18:09:44.968295 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963235 2576 flags.go:64] FLAG: --client-ca-file="" Jul 17 18:09:44.968295 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963238 2576 flags.go:64] FLAG: --cloud-provider="external" Jul 17 18:09:44.968295 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963241 2576 flags.go:64] FLAG: --cluster-dns="[]" Jul 17 18:09:44.968295 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963245 2576 flags.go:64] FLAG: --cluster-domain="" Jul 17 18:09:44.968295 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963249 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 17 18:09:44.968295 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963253 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 17 18:09:44.968295 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963256 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 17 18:09:44.968295 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963259 2576 flags.go:64] FLAG: --container-log-max-files="5" Jul 17 18:09:44.968880 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963262 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 17 18:09:44.968880 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963265 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 17 18:09:44.968880 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963269 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 17 18:09:44.968880 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963272 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 17 18:09:44.968880 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963275 2576 flags.go:64] FLAG: --contention-profiling="false" Jul 17 18:09:44.968880 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963278 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 17 18:09:44.968880 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963280 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 17 18:09:44.968880 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963284 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 17 18:09:44.968880 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963287 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 17 18:09:44.968880 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963291 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 17 18:09:44.968880 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963294 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 17 18:09:44.968880 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963296 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 17 18:09:44.968880 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963299 2576 flags.go:64] FLAG: --enable-load-reader="false" Jul 17 18:09:44.968880 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963302 2576 flags.go:64] FLAG: --enable-server="true" Jul 17 18:09:44.968880 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963304 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 17 18:09:44.968880 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963310 2576 flags.go:64] FLAG: --event-burst="100" Jul 17 18:09:44.968880 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963313 2576 flags.go:64] FLAG: --event-qps="50" Jul 17 18:09:44.968880 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963315 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 17 18:09:44.968880 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963318 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 17 18:09:44.968880 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963321 2576 flags.go:64] FLAG: --eviction-hard="" Jul 17 18:09:44.968880 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963324 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 17 18:09:44.968880 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963327 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 17 18:09:44.968880 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963330 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 17 18:09:44.968880 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963333 2576 flags.go:64] FLAG: --eviction-soft="" Jul 17 18:09:44.968880 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963335 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 17 18:09:44.969446 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963338 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 17 18:09:44.969446 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963341 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 17 18:09:44.969446 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963344 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jul 17 18:09:44.969446 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963348 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 17 18:09:44.969446 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963350 2576 flags.go:64] FLAG: --fail-swap-on="true" Jul 17 18:09:44.969446 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963353 2576 flags.go:64] FLAG: --feature-gates="" Jul 17 18:09:44.969446 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963357 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jul 17 18:09:44.969446 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963359 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 17 18:09:44.969446 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963362 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 17 18:09:44.969446 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963365 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 17 18:09:44.969446 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963368 2576 flags.go:64] FLAG: --healthz-port="10248" Jul 17 18:09:44.969446 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963371 2576 flags.go:64] FLAG: --help="false" Jul 17 18:09:44.969446 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963373 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-132-68.ec2.internal" Jul 17 18:09:44.969446 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963376 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 17 18:09:44.969446 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963379 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jul 17 18:09:44.969446 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963382 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 17 18:09:44.969446 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963385 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 17 18:09:44.969446 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963389 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 17 18:09:44.969446 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963391 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 17 18:09:44.969446 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963394 2576 flags.go:64] FLAG: --image-service-endpoint="" Jul 17 18:09:44.969446 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963397 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 17 18:09:44.969446 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963399 2576 flags.go:64] FLAG: --kube-api-burst="100" Jul 17 18:09:44.969446 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963404 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 17 18:09:44.970017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963407 2576 flags.go:64] FLAG: --kube-api-qps="50" Jul 17 18:09:44.970017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963410 2576 flags.go:64] FLAG: --kube-reserved="" Jul 17 18:09:44.970017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963412 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 17 18:09:44.970017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963415 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 17 18:09:44.970017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963418 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jul 17 18:09:44.970017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963420 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 17 18:09:44.970017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963423 2576 flags.go:64] FLAG: --lock-file="" Jul 17 18:09:44.970017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963426 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 17 18:09:44.970017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963429 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 17 18:09:44.970017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963431 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 17 18:09:44.970017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963436 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jul 17 18:09:44.970017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963439 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 17 18:09:44.970017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963444 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jul 17 18:09:44.970017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963446 2576 flags.go:64] FLAG: --logging-format="text" Jul 17 18:09:44.970017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963449 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 17 18:09:44.970017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963452 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 17 18:09:44.970017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963455 2576 flags.go:64] FLAG: --manifest-url="" Jul 17 18:09:44.970017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963458 2576 flags.go:64] FLAG: --manifest-url-header="" Jul 17 18:09:44.970017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963462 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 17 18:09:44.970017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963465 2576 flags.go:64] FLAG: --max-open-files="1000000" Jul 17 18:09:44.970017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963469 2576 flags.go:64] FLAG: --max-pods="110" Jul 17 18:09:44.970017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963472 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 17 18:09:44.970017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963474 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 17 18:09:44.970017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963477 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jul 17 18:09:44.970017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963480 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 17 18:09:44.970780 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963483 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 17 18:09:44.970780 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963486 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 17 18:09:44.970780 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963489 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 17 18:09:44.970780 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963495 2576 flags.go:64] FLAG: --node-status-max-images="50" Jul 17 18:09:44.970780 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963498 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 17 18:09:44.970780 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963501 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jul 17 18:09:44.970780 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963505 2576 flags.go:64] FLAG: --pod-cidr="" Jul 17 18:09:44.970780 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963508 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 17 18:09:44.970780 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963513 2576 flags.go:64] FLAG: --pod-manifest-path="" Jul 17 18:09:44.970780 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963516 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jul 17 18:09:44.970780 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963519 2576 flags.go:64] FLAG: --pods-per-core="0" Jul 17 18:09:44.970780 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963522 2576 flags.go:64] FLAG: --port="10250" Jul 17 18:09:44.970780 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963525 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 17 18:09:44.970780 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963527 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e73b22e4cac886f6" Jul 17 18:09:44.970780 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963530 2576 flags.go:64] FLAG: --qos-reserved="" Jul 17 18:09:44.970780 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963533 2576 flags.go:64] FLAG: --read-only-port="10255" Jul 17 18:09:44.970780 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963539 2576 flags.go:64] FLAG: --register-node="true" Jul 17 18:09:44.970780 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963542 2576 flags.go:64] FLAG: --register-with-taints="" Jul 17 18:09:44.970780 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963546 2576 flags.go:64] FLAG: --registry-burst="10" Jul 17 18:09:44.970780 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963549 2576 flags.go:64] FLAG: --registry-qps="5" Jul 17 18:09:44.970780 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963552 2576 flags.go:64] FLAG: --reserved-cpus="" Jul 17 18:09:44.970780 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963555 2576 flags.go:64] FLAG: --reserved-memory="" Jul 17 18:09:44.970780 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963558 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 17 18:09:44.970780 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963561 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 17 18:09:44.970780 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963564 2576 flags.go:64] FLAG: --rotate-certificates="false" Jul 17 18:09:44.971628 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963567 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 17 18:09:44.971628 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963569 2576 flags.go:64] FLAG: --runonce="false" Jul 17 18:09:44.971628 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963572 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 17 18:09:44.971628 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963575 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 17 18:09:44.971628 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963578 2576 flags.go:64] FLAG: --seccomp-default="false" Jul 17 18:09:44.971628 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963581 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 17 18:09:44.971628 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963583 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 17 18:09:44.971628 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963586 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 17 18:09:44.971628 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963592 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 17 18:09:44.971628 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963595 2576 flags.go:64] FLAG: --storage-driver-password="root" Jul 17 18:09:44.971628 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963598 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jul 17 18:09:44.971628 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963600 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jul 17 18:09:44.971628 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963603 2576 flags.go:64] FLAG: --storage-driver-user="root" Jul 17 18:09:44.971628 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963606 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 17 18:09:44.971628 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963610 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 17 18:09:44.971628 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963613 2576 flags.go:64] FLAG: --system-cgroups="" Jul 17 18:09:44.971628 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963616 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 17 18:09:44.971628 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963621 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 17 18:09:44.971628 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963623 2576 flags.go:64] FLAG: --tls-cert-file="" Jul 17 18:09:44.971628 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963626 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 17 18:09:44.971628 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963630 2576 flags.go:64] FLAG: --tls-min-version="" Jul 17 18:09:44.971628 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963633 2576 flags.go:64] FLAG: --tls-private-key-file="" Jul 17 18:09:44.971628 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963636 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jul 17 18:09:44.971628 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963638 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 17 18:09:44.971628 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963641 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jul 17 18:09:44.972237 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963644 2576 flags.go:64] FLAG: --v="2" Jul 17 18:09:44.972237 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963647 2576 flags.go:64] FLAG: --version="false" Jul 17 18:09:44.972237 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963651 2576 flags.go:64] FLAG: --vmodule="" Jul 17 18:09:44.972237 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963654 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 17 18:09:44.972237 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.963657 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 17 18:09:44.972237 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963784 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 18:09:44.972237 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963788 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 18:09:44.972237 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963791 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 18:09:44.972237 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963793 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 18:09:44.972237 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963796 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 18:09:44.972237 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963798 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 18:09:44.972237 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963801 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 18:09:44.972237 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963803 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 18:09:44.972237 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963806 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 18:09:44.972237 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963809 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 18:09:44.972237 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963811 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 18:09:44.972237 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963819 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 18:09:44.972237 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963828 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 18:09:44.972237 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963830 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 18:09:44.972237 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963833 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 18:09:44.972237 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963835 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 18:09:44.972752 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963840 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 18:09:44.972752 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963842 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 18:09:44.972752 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963845 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 18:09:44.972752 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963848 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 18:09:44.972752 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963850 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 18:09:44.972752 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963854 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 18:09:44.972752 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963857 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 18:09:44.972752 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963860 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 18:09:44.972752 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963862 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 18:09:44.972752 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963865 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 18:09:44.972752 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963867 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 18:09:44.972752 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963870 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 18:09:44.972752 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963872 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 18:09:44.972752 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963875 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 18:09:44.972752 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963877 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 18:09:44.972752 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963880 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 18:09:44.972752 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963882 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 18:09:44.972752 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963885 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 18:09:44.972752 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963887 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 18:09:44.972752 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963890 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 18:09:44.973233 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963892 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 18:09:44.973233 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963894 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 18:09:44.973233 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963897 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 18:09:44.973233 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963899 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 18:09:44.973233 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963902 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 18:09:44.973233 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963904 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 18:09:44.973233 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963907 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 18:09:44.973233 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963909 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 18:09:44.973233 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963917 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 18:09:44.973233 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963919 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 18:09:44.973233 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963922 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 18:09:44.973233 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963924 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 18:09:44.973233 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963928 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 18:09:44.973233 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963930 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 18:09:44.973233 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963933 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 18:09:44.973233 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963935 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 18:09:44.973233 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963938 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 18:09:44.973233 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963942 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 18:09:44.973233 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963945 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 18:09:44.973674 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963947 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 18:09:44.973674 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963950 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 18:09:44.973674 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963953 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 18:09:44.973674 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963956 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 18:09:44.973674 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963958 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 18:09:44.973674 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963961 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 18:09:44.973674 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963963 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 18:09:44.973674 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963966 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 18:09:44.973674 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963969 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 18:09:44.973674 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963972 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 18:09:44.973674 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963987 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 18:09:44.973674 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963990 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 18:09:44.973674 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963993 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 18:09:44.973674 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963996 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 18:09:44.973674 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.963998 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 18:09:44.973674 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.964001 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 18:09:44.973674 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.964003 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 18:09:44.973674 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.964006 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 18:09:44.973674 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.964008 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 18:09:44.973674 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.964011 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 18:09:44.974138 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.964014 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 18:09:44.974138 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.964016 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 18:09:44.974138 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.964026 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 17 18:09:44.974138 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.964028 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 18:09:44.974138 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.964031 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 18:09:44.974138 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.964036 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 18:09:44.974138 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.964041 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 18:09:44.974138 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.964044 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 18:09:44.974138 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.964047 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 18:09:44.974138 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.964049 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 18:09:44.974138 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.964052 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 18:09:44.974138 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.964055 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 18:09:44.974138 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.964057 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 18:09:44.974138 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.964060 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 18:09:44.974138 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.964062 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 18:09:44.974138 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.964065 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 18:09:44.974138 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.964067 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 18:09:44.974138 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.964070 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 18:09:44.974138 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.964073 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 18:09:44.974582 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.964075 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 18:09:44.974582 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.964078 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 18:09:44.974582 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.964080 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 18:09:44.974582 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.964083 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 18:09:44.974582 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.964085 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 18:09:44.974582 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.964671 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 18:09:44.974582 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.972219 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 17 18:09:44.974582 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.972233 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 17 18:09:44.974582 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.972251 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 17 18:09:44.974582 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.972259 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 17 18:09:44.974582 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972313 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 18:09:44.974582 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972318 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 18:09:44.974582 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972322 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 18:09:44.974582 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972325 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 18:09:44.974907 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972328 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 18:09:44.974907 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972331 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 18:09:44.974907 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972333 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 18:09:44.974907 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972336 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 18:09:44.974907 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972338 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 18:09:44.974907 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972341 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 18:09:44.974907 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972343 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 18:09:44.974907 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972346 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 18:09:44.974907 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972348 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 18:09:44.974907 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972351 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 18:09:44.974907 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972354 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 18:09:44.974907 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972356 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 18:09:44.974907 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972359 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 18:09:44.974907 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972361 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 18:09:44.974907 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972364 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 18:09:44.974907 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972366 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 18:09:44.974907 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972369 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 18:09:44.974907 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972371 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 18:09:44.974907 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972374 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 18:09:44.975358 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972376 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 18:09:44.975358 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972379 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 18:09:44.975358 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972381 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 18:09:44.975358 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972388 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 18:09:44.975358 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972391 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 18:09:44.975358 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972394 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 18:09:44.975358 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972397 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 18:09:44.975358 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972400 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 18:09:44.975358 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972403 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 18:09:44.975358 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972405 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 18:09:44.975358 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972408 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 18:09:44.975358 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972411 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 18:09:44.975358 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972413 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 18:09:44.975358 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972415 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 18:09:44.975358 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972418 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 18:09:44.975358 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972420 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 18:09:44.975358 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972423 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 18:09:44.975358 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972426 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 18:09:44.975358 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972428 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 18:09:44.975358 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972431 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 18:09:44.975810 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972433 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 18:09:44.975810 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972436 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 18:09:44.975810 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972439 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 18:09:44.975810 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972441 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 18:09:44.975810 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972444 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 18:09:44.975810 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972446 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 18:09:44.975810 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972449 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 18:09:44.975810 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972451 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 18:09:44.975810 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972454 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 18:09:44.975810 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972456 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 18:09:44.975810 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972459 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 18:09:44.975810 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972461 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 18:09:44.975810 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972464 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 18:09:44.975810 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972466 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 18:09:44.975810 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972468 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 18:09:44.975810 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972471 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 18:09:44.975810 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972473 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 18:09:44.975810 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972476 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 18:09:44.975810 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972478 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 18:09:44.975810 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972481 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 18:09:44.976292 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972483 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 18:09:44.976292 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972486 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 18:09:44.976292 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972488 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 18:09:44.976292 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972491 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 18:09:44.976292 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972493 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 18:09:44.976292 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972496 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 18:09:44.976292 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972499 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 18:09:44.976292 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972501 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 18:09:44.976292 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972504 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 18:09:44.976292 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972506 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 18:09:44.976292 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972508 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 18:09:44.976292 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972513 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 18:09:44.976292 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972516 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 18:09:44.976292 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972520 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 18:09:44.976292 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972523 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 18:09:44.976292 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972527 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 18:09:44.976292 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972535 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 18:09:44.976292 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972539 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 18:09:44.976292 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972542 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 18:09:44.976729 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972544 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 18:09:44.976729 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972547 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 18:09:44.976729 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972549 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 18:09:44.976729 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972552 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 18:09:44.976729 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972555 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 18:09:44.976729 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972557 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 18:09:44.976729 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972560 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 18:09:44.976729 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972562 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 18:09:44.976729 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972565 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 17 18:09:44.976729 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972567 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 18:09:44.976729 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972570 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 18:09:44.976729 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972572 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 18:09:44.976729 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972575 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 18:09:44.976729 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972577 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 18:09:44.976729 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972580 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 18:09:44.976729 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972582 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 18:09:44.976729 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972585 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 18:09:44.977160 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.972589 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 18:09:44.977160 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972706 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 18:09:44.977160 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972711 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 18:09:44.977160 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972714 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 18:09:44.977160 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972717 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 18:09:44.977160 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972720 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 18:09:44.977160 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972722 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 18:09:44.977160 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972725 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 18:09:44.977160 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972727 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 18:09:44.977160 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972730 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 18:09:44.977160 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972732 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 18:09:44.977160 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972734 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 18:09:44.977160 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972737 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 18:09:44.977160 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972740 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 18:09:44.977160 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972743 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 18:09:44.977517 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972745 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 18:09:44.977517 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972747 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 18:09:44.977517 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972750 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 18:09:44.977517 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972752 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 18:09:44.977517 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972755 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 18:09:44.977517 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972758 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 18:09:44.977517 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972761 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 18:09:44.977517 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972763 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 18:09:44.977517 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972766 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 18:09:44.977517 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972769 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 18:09:44.977517 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972771 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 18:09:44.977517 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972774 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 18:09:44.977517 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972776 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 18:09:44.977517 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972779 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 18:09:44.977517 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972781 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 18:09:44.977517 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972784 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 18:09:44.977517 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972786 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 18:09:44.977517 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972789 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 18:09:44.977517 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972791 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 18:09:44.977517 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972794 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 18:09:44.978029 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972796 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 18:09:44.978029 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972799 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 18:09:44.978029 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972801 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 18:09:44.978029 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972803 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 18:09:44.978029 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972806 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 18:09:44.978029 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972808 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 18:09:44.978029 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972811 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 18:09:44.978029 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972814 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 18:09:44.978029 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972816 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 18:09:44.978029 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972819 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 18:09:44.978029 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972821 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 18:09:44.978029 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972825 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 18:09:44.978029 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972829 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 18:09:44.978029 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972832 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 18:09:44.978029 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972834 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 18:09:44.978029 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972837 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 18:09:44.978029 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972839 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 18:09:44.978029 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972842 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 18:09:44.978029 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972844 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 18:09:44.978480 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972847 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 18:09:44.978480 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972849 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 18:09:44.978480 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972852 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 18:09:44.978480 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972854 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 18:09:44.978480 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972857 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 18:09:44.978480 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972859 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 17 18:09:44.978480 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972862 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 18:09:44.978480 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972866 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 18:09:44.978480 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972869 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 18:09:44.978480 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972872 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 18:09:44.978480 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972875 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 18:09:44.978480 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972878 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 18:09:44.978480 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972880 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 18:09:44.978480 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972883 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 18:09:44.978480 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972885 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 18:09:44.978480 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972888 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 18:09:44.978480 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972890 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 18:09:44.978480 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972893 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 18:09:44.978480 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972896 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 18:09:44.978911 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972898 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 18:09:44.978911 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972901 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 18:09:44.978911 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972903 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 18:09:44.978911 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972905 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 18:09:44.978911 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972908 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 18:09:44.978911 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972910 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 18:09:44.978911 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972913 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 18:09:44.978911 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972915 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 18:09:44.978911 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972918 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 18:09:44.978911 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972920 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 18:09:44.978911 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972925 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 18:09:44.978911 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972927 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 18:09:44.978911 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972930 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 18:09:44.978911 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972933 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 18:09:44.978911 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972936 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 18:09:44.978911 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972939 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 18:09:44.978911 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972942 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 18:09:44.978911 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972945 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 18:09:44.978911 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972948 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 18:09:44.978911 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972950 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 18:09:44.979379 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972953 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 18:09:44.979379 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972956 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 18:09:44.979379 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972958 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 18:09:44.979379 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972961 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 18:09:44.979379 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972963 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 18:09:44.979379 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972966 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 18:09:44.979379 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:44.972969 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 18:09:44.979379 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.972993 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 18:09:44.979379 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.973098 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jul 17 18:09:44.979379 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.976790 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 17 18:09:44.979379 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.977942 2576 server.go:1019] "Starting client certificate rotation" Jul 17 18:09:44.979379 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.978002 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 18:09:44.979379 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.978062 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 18:09:44.980161 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.980149 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 18:09:44.981294 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.981282 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 18:09:44.989230 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.989213 2576 log.go:25] "Validated CRI v1 runtime API" Jul 17 18:09:44.991549 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.991535 2576 log.go:25] "Validated CRI v1 image API" Jul 17 18:09:44.992912 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.992898 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 17 18:09:44.994811 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.994791 2576 fs.go:135] Filesystem UUIDs: map[4deb11de-4ad7-4c31-9f80-278da250726c:/dev/nvme0n1p4 79002d19-f1e9-4693-96da-19b2d96684c7:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 17 18:09:44.994859 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:44.994812 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 17 18:09:45.000847 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.000612 2576 manager.go:216] Machine: {Timestamp:2026-07-17 18:09:44.999471547 +0000 UTC m=+0.273082681 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3191057 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25595dc0429f06230c9de1354e731e SystemUUID:ec25595d-c042-9f06-230c-9de1354e731e BootID:c797b8c3-f187-46b4-998c-2308bc2e8159 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:60:af:75:b6:0f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:60:af:75:b6:0f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:86:a5:aa:f3:67 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 17 18:09:45.000847 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.000836 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 17 18:09:45.000963 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.000936 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 17 18:09:45.001188 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.001175 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 18:09:45.003451 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.003425 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 17 18:09:45.003579 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.003453 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-68.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 17 18:09:45.004112 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.004102 2576 topology_manager.go:138] "Creating topology manager with none policy" Jul 17 18:09:45.004143 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.004114 2576 container_manager_linux.go:309] "Creating device plugin manager" Jul 17 18:09:45.004143 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.004121 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 18:09:45.004723 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.004713 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 18:09:45.006055 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.006046 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 17 18:09:45.009748 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.009736 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 17 18:09:45.009865 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.009855 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 17 18:09:45.009896 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.009884 2576 kubelet.go:486] "Attempting to sync node with API server" Jul 17 18:09:45.009923 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.009897 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 17 18:09:45.009923 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.009919 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 17 18:09:45.009987 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.009931 2576 kubelet.go:398] "Adding apiserver pod source" Jul 17 18:09:45.009987 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.009942 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 17 18:09:45.010341 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.010329 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 18:09:45.010378 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.010348 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 18:09:45.012192 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.012179 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 17 18:09:45.013965 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.013953 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 17 18:09:45.014027 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.013998 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 17 18:09:45.015083 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.015070 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 17 18:09:45.015117 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.015096 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 17 18:09:45.015117 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.015107 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 17 18:09:45.015117 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.015115 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 17 18:09:45.015203 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.015127 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 17 18:09:45.015203 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.015135 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 17 18:09:45.015203 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.015148 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 17 18:09:45.015203 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.015156 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 17 18:09:45.015203 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.015165 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 17 18:09:45.015203 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.015173 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 17 18:09:45.015203 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.015185 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 17 18:09:45.015203 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.015193 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 17 18:09:45.015889 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.015877 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 17 18:09:45.015925 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.015896 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 17 18:09:45.018750 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.018738 2576 server.go:1268] "Started kubelet" Jul 17 18:09:45.018840 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.018817 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 17 18:09:45.018892 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.018859 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 17 18:09:45.018892 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.018836 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 17 18:09:45.019466 ip-10-0-132-68 systemd[1]: Started Kubernetes Kubelet. Jul 17 18:09:45.020280 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:45.020253 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 17 18:09:45.020628 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:45.020430 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 17 18:09:45.020628 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.020536 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 17 18:09:45.020628 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.020579 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-68.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 17 18:09:45.021180 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.021166 2576 server.go:310] "Adding debug handlers to kubelet server" Jul 17 18:09:45.022959 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:45.022933 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 17 18:09:45.023496 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:45.022748 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-68.ec2.internal.18c3261d6295622a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-68.ec2.internal,UID:ip-10-0-132-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-68.ec2.internal,},FirstTimestamp:2026-07-17 18:09:45.018712618 +0000 UTC m=+0.292323809,LastTimestamp:2026-07-17 18:09:45.018712618 +0000 UTC m=+0.292323809,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-68.ec2.internal,}" Jul 17 18:09:45.026849 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.026830 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 17 18:09:45.026849 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.026839 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 17 18:09:45.027011 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:45.026923 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-68.ec2.internal\" not found" Jul 17 18:09:45.027373 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.027355 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 17 18:09:45.027442 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.027385 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 17 18:09:45.027442 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.027397 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 17 18:09:45.027893 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.027875 2576 factory.go:153] Registering CRI-O factory Jul 17 18:09:45.027893 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.027894 2576 factory.go:223] Registration of the crio container factory successfully Jul 17 18:09:45.028038 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.027934 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 17 18:09:45.028038 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.027941 2576 factory.go:55] Registering systemd factory Jul 17 18:09:45.028038 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.027946 2576 factory.go:223] Registration of the systemd container factory successfully Jul 17 18:09:45.028038 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.027965 2576 factory.go:103] Registering Raw factory Jul 17 18:09:45.028038 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.027993 2576 manager.go:1196] Started watching for new ooms in manager Jul 17 18:09:45.028267 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.028160 2576 reconstruct.go:97] "Volume reconstruction finished" Jul 17 18:09:45.028267 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.028169 2576 reconciler.go:29] "Reconciler: start to sync state" Jul 17 18:09:45.028403 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.028390 2576 manager.go:349] Starting recovery of all containers Jul 17 18:09:45.029058 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:45.029029 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 17 18:09:45.029463 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:45.029417 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 17 18:09:45.039292 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.039272 2576 manager.go:354] Recovery completed Jul 17 18:09:45.043087 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.043076 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 18:09:45.045482 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.045419 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasSufficientMemory" Jul 17 18:09:45.045482 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.045444 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 18:09:45.045482 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.045453 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasSufficientPID" Jul 17 18:09:45.045820 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.045799 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dtzcm" Jul 17 18:09:45.046033 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.046015 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 18:09:45.046033 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.046031 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 17 18:09:45.046194 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.046042 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 17 18:09:45.046194 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.046063 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 17 18:09:45.046635 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.046620 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasSufficientMemory" Jul 17 18:09:45.046689 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.046646 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 18:09:45.046689 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.046656 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasSufficientPID" Jul 17 18:09:45.048159 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.048145 2576 policy_none.go:49] "None policy: Start" Jul 17 18:09:45.048241 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.048164 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 17 18:09:45.048241 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.048176 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 17 18:09:45.050164 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.050152 2576 policy_none.go:47] "Start" Jul 17 18:09:45.053374 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:45.053315 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-68.ec2.internal.18c3261d642d1288 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-68.ec2.internal,UID:ip-10-0-132-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-68.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-68.ec2.internal,},FirstTimestamp:2026-07-17 18:09:45.04543092 +0000 UTC m=+0.319042052,LastTimestamp:2026-07-17 18:09:45.04543092 +0000 UTC m=+0.319042052,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-68.ec2.internal,}" Jul 17 18:09:45.054703 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.054688 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dtzcm" Jul 17 18:09:45.056749 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:45.056692 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-68.ec2.internal.18c3261d642d5693 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-68.ec2.internal,UID:ip-10-0-132-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-68.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-68.ec2.internal,},FirstTimestamp:2026-07-17 18:09:45.045448339 +0000 UTC m=+0.319059473,LastTimestamp:2026-07-17 18:09:45.045448339 +0000 UTC m=+0.319059473,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-68.ec2.internal,}" Jul 17 18:09:45.089559 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.089469 2576 manager.go:337] "Starting Device Plugin manager" Jul 17 18:09:45.089648 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:45.089591 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 17 18:09:45.089648 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.089601 2576 server.go:87] "Starting device plugin registration server" Jul 17 18:09:45.090206 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.090194 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 17 18:09:45.090253 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.090208 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 17 18:09:45.090312 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.090296 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 17 18:09:45.090389 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.090374 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 17 18:09:45.090389 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.090388 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 17 18:09:45.090770 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:45.090754 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 17 18:09:45.090833 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:45.090794 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-68.ec2.internal\" not found" Jul 17 18:09:45.178618 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.178599 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 17 18:09:45.180765 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.179693 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 17 18:09:45.180765 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.179724 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 17 18:09:45.180765 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.179740 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jul 17 18:09:45.180765 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:45.179767 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 17 18:09:45.182362 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.182345 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 18:09:45.191264 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.191254 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 18:09:45.191923 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.191909 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasSufficientMemory" Jul 17 18:09:45.192015 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.191931 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 18:09:45.192015 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.191941 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasSufficientPID" Jul 17 18:09:45.192015 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.191964 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-68.ec2.internal" Jul 17 18:09:45.201541 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.201528 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-68.ec2.internal" Jul 17 18:09:45.201594 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:45.201546 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-68.ec2.internal\": node \"ip-10-0-132-68.ec2.internal\" not found" Jul 17 18:09:45.225613 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:45.225571 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-68.ec2.internal\" not found" Jul 17 18:09:45.280469 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.280446 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-68.ec2.internal"] Jul 17 18:09:45.280530 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.280509 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 18:09:45.281656 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.281643 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasSufficientMemory" Jul 17 18:09:45.281722 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.281665 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 18:09:45.281722 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.281673 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasSufficientPID" Jul 17 18:09:45.283902 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.283891 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 18:09:45.284014 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.284001 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal" Jul 17 18:09:45.284053 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.284039 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 18:09:45.284497 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.284484 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasSufficientMemory" Jul 17 18:09:45.284497 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.284493 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasSufficientMemory" Jul 17 18:09:45.284609 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.284507 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 18:09:45.284609 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.284512 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 18:09:45.284609 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.284521 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasSufficientPID" Jul 17 18:09:45.284609 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.284521 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasSufficientPID" Jul 17 18:09:45.286813 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.286799 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-68.ec2.internal" Jul 17 18:09:45.286859 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.286824 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 18:09:45.287450 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.287437 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasSufficientMemory" Jul 17 18:09:45.287514 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.287460 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 18:09:45.287514 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.287469 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasSufficientPID" Jul 17 18:09:45.314549 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:45.314535 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-68.ec2.internal\" not found" node="ip-10-0-132-68.ec2.internal" Jul 17 18:09:45.319004 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:45.318988 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-68.ec2.internal\" not found" node="ip-10-0-132-68.ec2.internal" Jul 17 18:09:45.326395 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:45.326379 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-68.ec2.internal\" not found" Jul 17 18:09:45.330941 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.330926 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/058d024324ce103e994a009799d7facb-config\") pod \"kube-apiserver-proxy-ip-10-0-132-68.ec2.internal\" (UID: \"058d024324ce103e994a009799d7facb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-68.ec2.internal" Jul 17 18:09:45.331001 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.330978 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/34d985b57e6f9343f193eb8b07f4675f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal\" (UID: \"34d985b57e6f9343f193eb8b07f4675f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal" Jul 17 18:09:45.331110 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.331008 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34d985b57e6f9343f193eb8b07f4675f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal\" (UID: \"34d985b57e6f9343f193eb8b07f4675f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal" Jul 17 18:09:45.429791 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:45.429770 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-68.ec2.internal\" not found" Jul 17 18:09:45.432156 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.432136 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/34d985b57e6f9343f193eb8b07f4675f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal\" (UID: \"34d985b57e6f9343f193eb8b07f4675f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal" Jul 17 18:09:45.432204 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.432167 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34d985b57e6f9343f193eb8b07f4675f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal\" (UID: \"34d985b57e6f9343f193eb8b07f4675f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal" Jul 17 18:09:45.432204 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.432184 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/058d024324ce103e994a009799d7facb-config\") pod \"kube-apiserver-proxy-ip-10-0-132-68.ec2.internal\" (UID: \"058d024324ce103e994a009799d7facb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-68.ec2.internal" Jul 17 18:09:45.432274 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.432217 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/058d024324ce103e994a009799d7facb-config\") pod \"kube-apiserver-proxy-ip-10-0-132-68.ec2.internal\" (UID: \"058d024324ce103e994a009799d7facb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-68.ec2.internal" Jul 17 18:09:45.432274 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.432228 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/34d985b57e6f9343f193eb8b07f4675f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal\" (UID: \"34d985b57e6f9343f193eb8b07f4675f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal" Jul 17 18:09:45.432274 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.432237 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34d985b57e6f9343f193eb8b07f4675f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal\" (UID: \"34d985b57e6f9343f193eb8b07f4675f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal" Jul 17 18:09:45.530434 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:45.530391 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-68.ec2.internal\" not found" Jul 17 18:09:45.624953 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.624930 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-68.ec2.internal" Jul 17 18:09:45.624953 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.624934 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal" Jul 17 18:09:45.630619 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:45.630594 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-68.ec2.internal\" not found" Jul 17 18:09:45.730805 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:45.730778 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-68.ec2.internal\" not found" Jul 17 18:09:45.831069 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:45.831045 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-68.ec2.internal\" not found" Jul 17 18:09:45.931515 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:45.931490 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-68.ec2.internal\" not found" Jul 17 18:09:45.977788 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.977772 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 17 18:09:45.978126 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:45.977895 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 17 18:09:46.031664 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:46.031647 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-68.ec2.internal\" not found" Jul 17 18:09:46.059772 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:46.059742 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 18:04:45 +0000 UTC" deadline="2028-04-16 23:48:01.08900313 +0000 UTC" Jul 17 18:09:46.059858 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:46.059793 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15341h38m15.029217253s" Jul 17 18:09:46.082005 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:46.081949 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 18:09:46.083242 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:46.083227 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasSufficientMemory" Jul 17 18:09:46.083311 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:46.083255 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 18:09:46.083311 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:46.083264 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasSufficientPID" Jul 17 18:09:46.131710 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:46.131690 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-68.ec2.internal\" not found" Jul 17 18:09:46.133749 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:46.133735 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 18:09:46.207697 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:46.207677 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 18:09:46.227499 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:46.227480 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-68.ec2.internal" Jul 17 18:09:46.237289 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:46.237272 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 18:09:46.238819 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:46.238808 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal" Jul 17 18:09:46.250427 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:46.250412 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 18:09:46.443950 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:46.443923 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod058d024324ce103e994a009799d7facb.slice/crio-fcec4cd6719414ea3466a92fa817850c78ce582c0b75b5e1ac85823efc855024 WatchSource:0}: Error finding container fcec4cd6719414ea3466a92fa817850c78ce582c0b75b5e1ac85823efc855024: Status 404 returned error can't find the container with id fcec4cd6719414ea3466a92fa817850c78ce582c0b75b5e1ac85823efc855024 Jul 17 18:09:46.450495 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:46.450479 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 18:09:46.455377 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:46.455357 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34d985b57e6f9343f193eb8b07f4675f.slice/crio-75bf08e85bf6b7c7307bb03fd564ca5735c128a2db0488f16db5cc964036d0a5 WatchSource:0}: Error finding container 75bf08e85bf6b7c7307bb03fd564ca5735c128a2db0488f16db5cc964036d0a5: Status 404 returned error can't find the container with id 75bf08e85bf6b7c7307bb03fd564ca5735c128a2db0488f16db5cc964036d0a5 Jul 17 18:09:46.511278 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:46.511254 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 18:09:47.011385 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.011366 2576 apiserver.go:52] "Watching apiserver" Jul 17 18:09:47.019773 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.019751 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 17 18:09:47.020996 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.020960 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-5hrpr","openshift-image-registry/node-ca-hpwk9","openshift-multus/network-metrics-daemon-fgr6m","openshift-network-diagnostics/network-check-target-srkxv","openshift-network-operator/iptables-alerter-xmmdk","kube-system/konnectivity-agent-lv9fl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhj7k","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal","openshift-multus/multus-additional-cni-plugins-4zb24","openshift-multus/multus-wrth6","openshift-ovn-kubernetes/ovnkube-node-6pqqj","kube-system/global-pull-secret-syncer-9sg94","kube-system/kube-apiserver-proxy-ip-10-0-132-68.ec2.internal","openshift-cluster-node-tuning-operator/tuned-klj72"] Jul 17 18:09:47.023673 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.023653 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhj7k" Jul 17 18:09:47.026189 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.026163 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.026286 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.026246 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 17 18:09:47.026524 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.026507 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 17 18:09:47.026875 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.026847 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 17 18:09:47.026972 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.026887 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lxtgc\"" Jul 17 18:09:47.027896 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.027865 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 17 18:09:47.028894 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.028632 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgr6m" Jul 17 18:09:47.028894 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:47.028701 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgr6m" podUID="31390317-6109-491f-8d6a-6530a57f25c2" Jul 17 18:09:47.030450 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.030425 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 17 18:09:47.031265 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.030946 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srkxv" Jul 17 18:09:47.031265 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:47.031030 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srkxv" podUID="bb8f1a9f-2737-4a45-8507-997facd5c5fb" Jul 17 18:09:47.031411 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.031318 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 17 18:09:47.031633 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.031467 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 17 18:09:47.031633 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.031580 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dlx5g\"" Jul 17 18:09:47.031633 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.031594 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 17 18:09:47.033918 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.033356 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 17 18:09:47.033918 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.033555 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 17 18:09:47.034104 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.034045 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xmmdk" Jul 17 18:09:47.036880 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.036455 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8qgnd\"" Jul 17 18:09:47.036880 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.036472 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 17 18:09:47.036880 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.036489 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 17 18:09:47.036880 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.036568 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 17 18:09:47.037960 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.037938 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lv9fl" Jul 17 18:09:47.038371 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.038311 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/edecfdc6-4c0a-4fa4-860a-5632fce0eba9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vhj7k\" (UID: \"edecfdc6-4c0a-4fa4-860a-5632fce0eba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhj7k" Jul 17 18:09:47.038371 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.038347 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-host-slash\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.038564 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.038372 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a67c7573-deca-4960-b69f-5ad3bda075a8-ovnkube-config\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.038564 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.038395 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a67c7573-deca-4960-b69f-5ad3bda075a8-env-overrides\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.038564 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.038419 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a67c7573-deca-4960-b69f-5ad3bda075a8-ovnkube-script-lib\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.038564 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.038443 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/edecfdc6-4c0a-4fa4-860a-5632fce0eba9-device-dir\") pod \"aws-ebs-csi-driver-node-vhj7k\" (UID: \"edecfdc6-4c0a-4fa4-860a-5632fce0eba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhj7k" Jul 17 18:09:47.038564 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.038466 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-node-log\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.038564 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.038490 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-host-run-ovn-kubernetes\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.038564 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.038515 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.038564 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.038544 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/edecfdc6-4c0a-4fa4-860a-5632fce0eba9-etc-selinux\") pod \"aws-ebs-csi-driver-node-vhj7k\" (UID: \"edecfdc6-4c0a-4fa4-860a-5632fce0eba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhj7k" Jul 17 18:09:47.039059 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.038569 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgx22\" (UniqueName: \"kubernetes.io/projected/a67c7573-deca-4960-b69f-5ad3bda075a8-kube-api-access-wgx22\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.039059 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.038594 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/edecfdc6-4c0a-4fa4-860a-5632fce0eba9-socket-dir\") pod \"aws-ebs-csi-driver-node-vhj7k\" (UID: \"edecfdc6-4c0a-4fa4-860a-5632fce0eba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhj7k" Jul 17 18:09:47.039059 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.038619 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/edecfdc6-4c0a-4fa4-860a-5632fce0eba9-registration-dir\") pod \"aws-ebs-csi-driver-node-vhj7k\" (UID: \"edecfdc6-4c0a-4fa4-860a-5632fce0eba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhj7k" Jul 17 18:09:47.039059 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.038642 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-var-lib-openvswitch\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.039059 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.038666 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31390317-6109-491f-8d6a-6530a57f25c2-metrics-certs\") pod \"network-metrics-daemon-fgr6m\" (UID: \"31390317-6109-491f-8d6a-6530a57f25c2\") " pod="openshift-multus/network-metrics-daemon-fgr6m" Jul 17 18:09:47.039059 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.038691 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kj79\" (UniqueName: \"kubernetes.io/projected/31390317-6109-491f-8d6a-6530a57f25c2-kube-api-access-8kj79\") pod \"network-metrics-daemon-fgr6m\" (UID: \"31390317-6109-491f-8d6a-6530a57f25c2\") " pod="openshift-multus/network-metrics-daemon-fgr6m" Jul 17 18:09:47.039059 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.038714 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-host-run-netns\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.039059 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.038775 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-host-cni-bin\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.039059 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.038807 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-host-cni-netd\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.039059 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.038843 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/edecfdc6-4c0a-4fa4-860a-5632fce0eba9-sys-fs\") pod \"aws-ebs-csi-driver-node-vhj7k\" (UID: \"edecfdc6-4c0a-4fa4-860a-5632fce0eba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhj7k" Jul 17 18:09:47.039059 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.038872 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcbrg\" (UniqueName: \"kubernetes.io/projected/edecfdc6-4c0a-4fa4-860a-5632fce0eba9-kube-api-access-gcbrg\") pod \"aws-ebs-csi-driver-node-vhj7k\" (UID: \"edecfdc6-4c0a-4fa4-860a-5632fce0eba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhj7k" Jul 17 18:09:47.039059 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.038948 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-host-kubelet\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.039059 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.038978 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-run-systemd\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.039059 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.039020 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-systemd-units\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.039679 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.039073 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-etc-openvswitch\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.039679 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.039108 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-run-openvswitch\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.039679 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.039133 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-run-ovn\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.039679 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.039164 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-log-socket\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.039679 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.039189 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a67c7573-deca-4960-b69f-5ad3bda075a8-ovn-node-metrics-cert\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.040916 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.040770 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4zb24" Jul 17 18:09:47.040916 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.040826 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zx66f\"" Jul 17 18:09:47.041143 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.040770 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 17 18:09:47.042101 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.041990 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 17 18:09:47.043430 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.043273 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 17 18:09:47.043430 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.043287 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 17 18:09:47.043430 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.043353 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 17 18:09:47.043430 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.043386 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 17 18:09:47.043674 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.043509 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 17 18:09:47.043674 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.043613 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g2rkf\"" Jul 17 18:09:47.044227 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.043899 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.047187 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.046503 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hpwk9" Jul 17 18:09:47.047187 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.046845 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 17 18:09:47.047187 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.046987 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 18:09:47.047187 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.047017 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-m4jrg\"" Jul 17 18:09:47.047494 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.047299 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 17 18:09:47.049508 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.049340 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 17 18:09:47.049508 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.049395 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 17 18:09:47.049752 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.049705 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.052375 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.051844 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5hrpr" Jul 17 18:09:47.054329 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.054309 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:09:47.054425 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:47.054377 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sg94" podUID="a0e11cff-8760-45ef-80a5-d966038cf469" Jul 17 18:09:47.056424 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.056402 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 17 18:09:47.056648 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.056626 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 17 18:09:47.056729 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.056716 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 17 18:09:47.056830 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.056796 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 17 18:09:47.056931 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.056796 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ztbhl\"" Jul 17 18:09:47.057018 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.056971 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jn8lw\"" Jul 17 18:09:47.057085 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.057072 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lld4k\"" Jul 17 18:09:47.092327 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.092308 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-m4tdt" Jul 17 18:09:47.100831 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.100813 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-m4tdt" Jul 17 18:09:47.129525 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.129502 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 17 18:09:47.140251 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.139537 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31390317-6109-491f-8d6a-6530a57f25c2-metrics-certs\") pod \"network-metrics-daemon-fgr6m\" (UID: \"31390317-6109-491f-8d6a-6530a57f25c2\") " pod="openshift-multus/network-metrics-daemon-fgr6m" Jul 17 18:09:47.140251 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.139575 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/780d0c42-753a-4fd5-96d3-8a6fd8177494-serviceca\") pod \"node-ca-hpwk9\" (UID: \"780d0c42-753a-4fd5-96d3-8a6fd8177494\") " pod="openshift-image-registry/node-ca-hpwk9" Jul 17 18:09:47.140251 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.139601 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-host-run-k8s-cni-cncf-io\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.140251 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:47.139759 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:09:47.140251 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.139627 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0d528ef6-e34a-4823-81d4-b9a0348c7edd-multus-daemon-config\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.140251 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.139812 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d74aab62-4360-4e21-9d51-57f2a63da3c4-tmp-dir\") pod \"node-resolver-5hrpr\" (UID: \"d74aab62-4360-4e21-9d51-57f2a63da3c4\") " pod="openshift-dns/node-resolver-5hrpr" Jul 17 18:09:47.140251 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:47.139838 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31390317-6109-491f-8d6a-6530a57f25c2-metrics-certs podName:31390317-6109-491f-8d6a-6530a57f25c2 nodeName:}" failed. No retries permitted until 2026-07-17 18:09:47.63980545 +0000 UTC m=+2.913416586 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31390317-6109-491f-8d6a-6530a57f25c2-metrics-certs") pod "network-metrics-daemon-fgr6m" (UID: "31390317-6109-491f-8d6a-6530a57f25c2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:09:47.140251 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.139878 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-host-run-netns\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.140251 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.139911 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-host-cni-netd\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.140251 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.139941 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7451bfe9-39fa-4a5f-9358-f05ee2836298-var-lib-kubelet\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.140251 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.139965 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7451bfe9-39fa-4a5f-9358-f05ee2836298-host\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.140251 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.139996 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdgmh\" (UniqueName: \"kubernetes.io/projected/7451bfe9-39fa-4a5f-9358-f05ee2836298-kube-api-access-qdgmh\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.140251 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140033 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-host-cni-netd\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.140251 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140069 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d74aab62-4360-4e21-9d51-57f2a63da3c4-hosts-file\") pod \"node-resolver-5hrpr\" (UID: \"d74aab62-4360-4e21-9d51-57f2a63da3c4\") " pod="openshift-dns/node-resolver-5hrpr" Jul 17 18:09:47.140251 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140096 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbt6t\" (UniqueName: \"kubernetes.io/projected/690f5d91-c2cf-477a-9097-c594fc754625-kube-api-access-dbt6t\") pod \"iptables-alerter-xmmdk\" (UID: \"690f5d91-c2cf-477a-9097-c594fc754625\") " pod="openshift-network-operator/iptables-alerter-xmmdk" Jul 17 18:09:47.140251 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140138 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2k59\" (UniqueName: \"kubernetes.io/projected/780d0c42-753a-4fd5-96d3-8a6fd8177494-kube-api-access-s2k59\") pod \"node-ca-hpwk9\" (UID: \"780d0c42-753a-4fd5-96d3-8a6fd8177494\") " pod="openshift-image-registry/node-ca-hpwk9" Jul 17 18:09:47.140251 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140141 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-host-run-netns\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.141264 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140188 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmw9c\" (UniqueName: \"kubernetes.io/projected/bb8f1a9f-2737-4a45-8507-997facd5c5fb-kube-api-access-kmw9c\") pod \"network-check-target-srkxv\" (UID: \"bb8f1a9f-2737-4a45-8507-997facd5c5fb\") " pod="openshift-network-diagnostics/network-check-target-srkxv" Jul 17 18:09:47.141264 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140222 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-host-var-lib-kubelet\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.141264 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140248 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5fbd\" (UniqueName: \"kubernetes.io/projected/d74aab62-4360-4e21-9d51-57f2a63da3c4-kube-api-access-r5fbd\") pod \"node-resolver-5hrpr\" (UID: \"d74aab62-4360-4e21-9d51-57f2a63da3c4\") " pod="openshift-dns/node-resolver-5hrpr" Jul 17 18:09:47.141264 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140279 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcbrg\" (UniqueName: \"kubernetes.io/projected/edecfdc6-4c0a-4fa4-860a-5632fce0eba9-kube-api-access-gcbrg\") pod \"aws-ebs-csi-driver-node-vhj7k\" (UID: \"edecfdc6-4c0a-4fa4-860a-5632fce0eba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhj7k" Jul 17 18:09:47.141264 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140304 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7451bfe9-39fa-4a5f-9358-f05ee2836298-etc-kubernetes\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.141264 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140325 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7451bfe9-39fa-4a5f-9358-f05ee2836298-run\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.141264 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140349 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-host-var-lib-cni-multus\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.141264 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140375 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-systemd-units\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.141264 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140400 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-run-openvswitch\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.141264 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140427 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-log-socket\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.141264 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140455 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a67c7573-deca-4960-b69f-5ad3bda075a8-ovn-node-metrics-cert\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.141264 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140478 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7451bfe9-39fa-4a5f-9358-f05ee2836298-etc-sysconfig\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.141264 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140502 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-cnibin\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.141264 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140526 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-multus-socket-dir-parent\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.141264 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140530 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-systemd-units\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.141264 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140552 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/edecfdc6-4c0a-4fa4-860a-5632fce0eba9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vhj7k\" (UID: \"edecfdc6-4c0a-4fa4-860a-5632fce0eba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhj7k" Jul 17 18:09:47.141264 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140577 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-host-slash\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.142228 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140601 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a67c7573-deca-4960-b69f-5ad3bda075a8-env-overrides\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.142228 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140629 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-run-openvswitch\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.142228 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140644 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-host-var-lib-cni-bin\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.142228 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140669 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-hostroot\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.142228 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140678 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-log-socket\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.142228 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140692 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-host-run-multus-certs\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.142228 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140719 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/edecfdc6-4c0a-4fa4-860a-5632fce0eba9-device-dir\") pod \"aws-ebs-csi-driver-node-vhj7k\" (UID: \"edecfdc6-4c0a-4fa4-860a-5632fce0eba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhj7k" Jul 17 18:09:47.142228 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140743 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-node-log\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.142228 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140776 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5ff5649-c98d-4586-a8b2-27e68c67fdca-cnibin\") pod \"multus-additional-cni-plugins-4zb24\" (UID: \"b5ff5649-c98d-4586-a8b2-27e68c67fdca\") " pod="openshift-multus/multus-additional-cni-plugins-4zb24" Jul 17 18:09:47.142228 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140783 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/edecfdc6-4c0a-4fa4-860a-5632fce0eba9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vhj7k\" (UID: \"edecfdc6-4c0a-4fa4-860a-5632fce0eba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhj7k" Jul 17 18:09:47.142228 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140797 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-host-run-netns\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.142228 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140831 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgx22\" (UniqueName: \"kubernetes.io/projected/a67c7573-deca-4960-b69f-5ad3bda075a8-kube-api-access-wgx22\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.142228 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140857 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/690f5d91-c2cf-477a-9097-c594fc754625-iptables-alerter-script\") pod \"iptables-alerter-xmmdk\" (UID: \"690f5d91-c2cf-477a-9097-c594fc754625\") " pod="openshift-network-operator/iptables-alerter-xmmdk" Jul 17 18:09:47.142228 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140881 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5ff5649-c98d-4586-a8b2-27e68c67fdca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4zb24\" (UID: \"b5ff5649-c98d-4586-a8b2-27e68c67fdca\") " pod="openshift-multus/multus-additional-cni-plugins-4zb24" Jul 17 18:09:47.142228 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140886 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-node-log\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.142228 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140904 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a0e11cff-8760-45ef-80a5-d966038cf469-dbus\") pod \"global-pull-secret-syncer-9sg94\" (UID: \"a0e11cff-8760-45ef-80a5-d966038cf469\") " pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:09:47.142228 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140923 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 17 18:09:47.143083 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140979 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/edecfdc6-4c0a-4fa4-860a-5632fce0eba9-device-dir\") pod \"aws-ebs-csi-driver-node-vhj7k\" (UID: \"edecfdc6-4c0a-4fa4-860a-5632fce0eba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhj7k" Jul 17 18:09:47.143083 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140933 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-host-slash\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.143083 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.140928 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7451bfe9-39fa-4a5f-9358-f05ee2836298-etc-sysctl-d\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.143083 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.141107 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kj79\" (UniqueName: \"kubernetes.io/projected/31390317-6109-491f-8d6a-6530a57f25c2-kube-api-access-8kj79\") pod \"network-metrics-daemon-fgr6m\" (UID: \"31390317-6109-491f-8d6a-6530a57f25c2\") " pod="openshift-multus/network-metrics-daemon-fgr6m" Jul 17 18:09:47.143083 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.141144 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ddb5f6e9-3b9b-4087-8196-b55e879f7c62-agent-certs\") pod \"konnectivity-agent-lv9fl\" (UID: \"ddb5f6e9-3b9b-4087-8196-b55e879f7c62\") " pod="kube-system/konnectivity-agent-lv9fl" Jul 17 18:09:47.143083 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.141178 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7451bfe9-39fa-4a5f-9358-f05ee2836298-etc-tuned\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.143083 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.141303 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-system-cni-dir\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.143083 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.141324 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a67c7573-deca-4960-b69f-5ad3bda075a8-env-overrides\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.143083 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.141329 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-multus-cni-dir\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.143083 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.141374 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-host-cni-bin\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.143083 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.141405 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ddb5f6e9-3b9b-4087-8196-b55e879f7c62-konnectivity-ca\") pod \"konnectivity-agent-lv9fl\" (UID: \"ddb5f6e9-3b9b-4087-8196-b55e879f7c62\") " pod="kube-system/konnectivity-agent-lv9fl" Jul 17 18:09:47.143083 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.141432 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7451bfe9-39fa-4a5f-9358-f05ee2836298-etc-modprobe-d\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.143083 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.141456 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7451bfe9-39fa-4a5f-9358-f05ee2836298-sys\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.143083 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.141472 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-host-cni-bin\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.143083 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.141495 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/edecfdc6-4c0a-4fa4-860a-5632fce0eba9-sys-fs\") pod \"aws-ebs-csi-driver-node-vhj7k\" (UID: \"edecfdc6-4c0a-4fa4-860a-5632fce0eba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhj7k" Jul 17 18:09:47.143083 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.141522 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-host-kubelet\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.143083 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.141546 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-run-systemd\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.143941 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.141557 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/edecfdc6-4c0a-4fa4-860a-5632fce0eba9-sys-fs\") pod \"aws-ebs-csi-driver-node-vhj7k\" (UID: \"edecfdc6-4c0a-4fa4-860a-5632fce0eba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhj7k" Jul 17 18:09:47.143941 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.141573 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7451bfe9-39fa-4a5f-9358-f05ee2836298-etc-sysctl-conf\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.143941 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.141596 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7451bfe9-39fa-4a5f-9358-f05ee2836298-tmp\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.143941 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.141610 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-host-kubelet\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.143941 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.141620 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-multus-conf-dir\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.143941 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.141644 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-etc-kubernetes\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.143941 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.141670 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc7h8\" (UniqueName: \"kubernetes.io/projected/0d528ef6-e34a-4823-81d4-b9a0348c7edd-kube-api-access-rc7h8\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.143941 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.141659 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-run-systemd\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.143941 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.141698 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-etc-openvswitch\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.143941 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.141745 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-etc-openvswitch\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.143941 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.141736 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-run-ovn\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.143941 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.141788 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-run-ovn\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.143941 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.141797 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/690f5d91-c2cf-477a-9097-c594fc754625-host-slash\") pod \"iptables-alerter-xmmdk\" (UID: \"690f5d91-c2cf-477a-9097-c594fc754625\") " pod="openshift-network-operator/iptables-alerter-xmmdk" Jul 17 18:09:47.143941 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.141832 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6szt\" (UniqueName: \"kubernetes.io/projected/b5ff5649-c98d-4586-a8b2-27e68c67fdca-kube-api-access-k6szt\") pod \"multus-additional-cni-plugins-4zb24\" (UID: \"b5ff5649-c98d-4586-a8b2-27e68c67fdca\") " pod="openshift-multus/multus-additional-cni-plugins-4zb24" Jul 17 18:09:47.143941 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.141872 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/780d0c42-753a-4fd5-96d3-8a6fd8177494-host\") pod \"node-ca-hpwk9\" (UID: \"780d0c42-753a-4fd5-96d3-8a6fd8177494\") " pod="openshift-image-registry/node-ca-hpwk9" Jul 17 18:09:47.143941 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.141907 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a67c7573-deca-4960-b69f-5ad3bda075a8-ovnkube-config\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.143941 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.141939 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a67c7573-deca-4960-b69f-5ad3bda075a8-ovnkube-script-lib\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.144825 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.142557 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a67c7573-deca-4960-b69f-5ad3bda075a8-ovnkube-script-lib\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.144825 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.142603 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0e11cff-8760-45ef-80a5-d966038cf469-original-pull-secret\") pod \"global-pull-secret-syncer-9sg94\" (UID: \"a0e11cff-8760-45ef-80a5-d966038cf469\") " pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:09:47.144825 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.142637 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7451bfe9-39fa-4a5f-9358-f05ee2836298-etc-systemd\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.144825 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.142660 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7451bfe9-39fa-4a5f-9358-f05ee2836298-lib-modules\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.144825 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.142702 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-host-run-ovn-kubernetes\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.144825 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.142732 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a67c7573-deca-4960-b69f-5ad3bda075a8-ovnkube-config\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.144825 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.142759 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.144825 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.142802 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-host-run-ovn-kubernetes\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.144825 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.142844 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5ff5649-c98d-4586-a8b2-27e68c67fdca-cni-binary-copy\") pod \"multus-additional-cni-plugins-4zb24\" (UID: \"b5ff5649-c98d-4586-a8b2-27e68c67fdca\") " pod="openshift-multus/multus-additional-cni-plugins-4zb24" Jul 17 18:09:47.144825 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.142869 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.144825 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.142915 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b5ff5649-c98d-4586-a8b2-27e68c67fdca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4zb24\" (UID: \"b5ff5649-c98d-4586-a8b2-27e68c67fdca\") " pod="openshift-multus/multus-additional-cni-plugins-4zb24" Jul 17 18:09:47.144825 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.142967 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/edecfdc6-4c0a-4fa4-860a-5632fce0eba9-etc-selinux\") pod \"aws-ebs-csi-driver-node-vhj7k\" (UID: \"edecfdc6-4c0a-4fa4-860a-5632fce0eba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhj7k" Jul 17 18:09:47.144825 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.143020 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5ff5649-c98d-4586-a8b2-27e68c67fdca-system-cni-dir\") pod \"multus-additional-cni-plugins-4zb24\" (UID: \"b5ff5649-c98d-4586-a8b2-27e68c67fdca\") " pod="openshift-multus/multus-additional-cni-plugins-4zb24" Jul 17 18:09:47.144825 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.143048 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5ff5649-c98d-4586-a8b2-27e68c67fdca-os-release\") pod \"multus-additional-cni-plugins-4zb24\" (UID: \"b5ff5649-c98d-4586-a8b2-27e68c67fdca\") " pod="openshift-multus/multus-additional-cni-plugins-4zb24" Jul 17 18:09:47.144825 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.143081 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b5ff5649-c98d-4586-a8b2-27e68c67fdca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4zb24\" (UID: \"b5ff5649-c98d-4586-a8b2-27e68c67fdca\") " pod="openshift-multus/multus-additional-cni-plugins-4zb24" Jul 17 18:09:47.144825 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.143106 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a0e11cff-8760-45ef-80a5-d966038cf469-kubelet-config\") pod \"global-pull-secret-syncer-9sg94\" (UID: \"a0e11cff-8760-45ef-80a5-d966038cf469\") " pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:09:47.145609 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.143129 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-os-release\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.145609 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.143152 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0d528ef6-e34a-4823-81d4-b9a0348c7edd-cni-binary-copy\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.145609 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.143187 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/edecfdc6-4c0a-4fa4-860a-5632fce0eba9-socket-dir\") pod \"aws-ebs-csi-driver-node-vhj7k\" (UID: \"edecfdc6-4c0a-4fa4-860a-5632fce0eba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhj7k" Jul 17 18:09:47.145609 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.143212 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/edecfdc6-4c0a-4fa4-860a-5632fce0eba9-registration-dir\") pod \"aws-ebs-csi-driver-node-vhj7k\" (UID: \"edecfdc6-4c0a-4fa4-860a-5632fce0eba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhj7k" Jul 17 18:09:47.145609 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.143236 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-var-lib-openvswitch\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.145609 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.143325 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a67c7573-deca-4960-b69f-5ad3bda075a8-var-lib-openvswitch\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.145609 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.143417 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/edecfdc6-4c0a-4fa4-860a-5632fce0eba9-etc-selinux\") pod \"aws-ebs-csi-driver-node-vhj7k\" (UID: \"edecfdc6-4c0a-4fa4-860a-5632fce0eba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhj7k" Jul 17 18:09:47.145609 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.143548 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/edecfdc6-4c0a-4fa4-860a-5632fce0eba9-socket-dir\") pod \"aws-ebs-csi-driver-node-vhj7k\" (UID: \"edecfdc6-4c0a-4fa4-860a-5632fce0eba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhj7k" Jul 17 18:09:47.145609 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.143595 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/edecfdc6-4c0a-4fa4-860a-5632fce0eba9-registration-dir\") pod \"aws-ebs-csi-driver-node-vhj7k\" (UID: \"edecfdc6-4c0a-4fa4-860a-5632fce0eba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhj7k" Jul 17 18:09:47.145609 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.145156 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a67c7573-deca-4960-b69f-5ad3bda075a8-ovn-node-metrics-cert\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.150101 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.149145 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcbrg\" (UniqueName: \"kubernetes.io/projected/edecfdc6-4c0a-4fa4-860a-5632fce0eba9-kube-api-access-gcbrg\") pod \"aws-ebs-csi-driver-node-vhj7k\" (UID: \"edecfdc6-4c0a-4fa4-860a-5632fce0eba9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhj7k" Jul 17 18:09:47.152733 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.152267 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgx22\" (UniqueName: \"kubernetes.io/projected/a67c7573-deca-4960-b69f-5ad3bda075a8-kube-api-access-wgx22\") pod \"ovnkube-node-6pqqj\" (UID: \"a67c7573-deca-4960-b69f-5ad3bda075a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.153574 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.153519 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kj79\" (UniqueName: \"kubernetes.io/projected/31390317-6109-491f-8d6a-6530a57f25c2-kube-api-access-8kj79\") pod \"network-metrics-daemon-fgr6m\" (UID: \"31390317-6109-491f-8d6a-6530a57f25c2\") " pod="openshift-multus/network-metrics-daemon-fgr6m" Jul 17 18:09:47.184662 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.184589 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal" event={"ID":"34d985b57e6f9343f193eb8b07f4675f","Type":"ContainerStarted","Data":"75bf08e85bf6b7c7307bb03fd564ca5735c128a2db0488f16db5cc964036d0a5"} Jul 17 18:09:47.186503 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.186477 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-68.ec2.internal" event={"ID":"058d024324ce103e994a009799d7facb","Type":"ContainerStarted","Data":"fcec4cd6719414ea3466a92fa817850c78ce582c0b75b5e1ac85823efc855024"} Jul 17 18:09:47.244509 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.244236 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5ff5649-c98d-4586-a8b2-27e68c67fdca-cnibin\") pod \"multus-additional-cni-plugins-4zb24\" (UID: \"b5ff5649-c98d-4586-a8b2-27e68c67fdca\") " pod="openshift-multus/multus-additional-cni-plugins-4zb24" Jul 17 18:09:47.244509 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.244275 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-host-run-netns\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.244509 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.244300 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/690f5d91-c2cf-477a-9097-c594fc754625-iptables-alerter-script\") pod \"iptables-alerter-xmmdk\" (UID: \"690f5d91-c2cf-477a-9097-c594fc754625\") " pod="openshift-network-operator/iptables-alerter-xmmdk" Jul 17 18:09:47.244509 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.244327 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5ff5649-c98d-4586-a8b2-27e68c67fdca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4zb24\" (UID: \"b5ff5649-c98d-4586-a8b2-27e68c67fdca\") " pod="openshift-multus/multus-additional-cni-plugins-4zb24" Jul 17 18:09:47.244509 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.244352 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a0e11cff-8760-45ef-80a5-d966038cf469-dbus\") pod \"global-pull-secret-syncer-9sg94\" (UID: \"a0e11cff-8760-45ef-80a5-d966038cf469\") " pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:09:47.244509 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.244376 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7451bfe9-39fa-4a5f-9358-f05ee2836298-etc-sysctl-d\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.244509 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.244383 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-host-run-netns\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.244509 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.244399 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ddb5f6e9-3b9b-4087-8196-b55e879f7c62-agent-certs\") pod \"konnectivity-agent-lv9fl\" (UID: \"ddb5f6e9-3b9b-4087-8196-b55e879f7c62\") " pod="kube-system/konnectivity-agent-lv9fl" Jul 17 18:09:47.244509 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.244423 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7451bfe9-39fa-4a5f-9358-f05ee2836298-etc-tuned\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.244509 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.244446 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-system-cni-dir\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.244509 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.244447 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5ff5649-c98d-4586-a8b2-27e68c67fdca-cnibin\") pod \"multus-additional-cni-plugins-4zb24\" (UID: \"b5ff5649-c98d-4586-a8b2-27e68c67fdca\") " pod="openshift-multus/multus-additional-cni-plugins-4zb24" Jul 17 18:09:47.244509 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.244468 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-multus-cni-dir\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.244509 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.244492 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ddb5f6e9-3b9b-4087-8196-b55e879f7c62-konnectivity-ca\") pod \"konnectivity-agent-lv9fl\" (UID: \"ddb5f6e9-3b9b-4087-8196-b55e879f7c62\") " pod="kube-system/konnectivity-agent-lv9fl" Jul 17 18:09:47.244509 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.244517 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7451bfe9-39fa-4a5f-9358-f05ee2836298-etc-modprobe-d\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.245298 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.244538 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7451bfe9-39fa-4a5f-9358-f05ee2836298-sys\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.245298 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.244564 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7451bfe9-39fa-4a5f-9358-f05ee2836298-etc-sysctl-conf\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.245298 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.244570 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7451bfe9-39fa-4a5f-9358-f05ee2836298-etc-sysctl-d\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.245298 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.244586 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7451bfe9-39fa-4a5f-9358-f05ee2836298-tmp\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.245298 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.244610 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-multus-conf-dir\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.245298 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.244634 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-etc-kubernetes\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.245298 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.244658 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc7h8\" (UniqueName: \"kubernetes.io/projected/0d528ef6-e34a-4823-81d4-b9a0348c7edd-kube-api-access-rc7h8\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.245298 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.244686 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/690f5d91-c2cf-477a-9097-c594fc754625-host-slash\") pod \"iptables-alerter-xmmdk\" (UID: \"690f5d91-c2cf-477a-9097-c594fc754625\") " pod="openshift-network-operator/iptables-alerter-xmmdk" Jul 17 18:09:47.245298 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.244711 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6szt\" (UniqueName: \"kubernetes.io/projected/b5ff5649-c98d-4586-a8b2-27e68c67fdca-kube-api-access-k6szt\") pod \"multus-additional-cni-plugins-4zb24\" (UID: \"b5ff5649-c98d-4586-a8b2-27e68c67fdca\") " pod="openshift-multus/multus-additional-cni-plugins-4zb24" Jul 17 18:09:47.245298 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.244736 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/780d0c42-753a-4fd5-96d3-8a6fd8177494-host\") pod \"node-ca-hpwk9\" (UID: \"780d0c42-753a-4fd5-96d3-8a6fd8177494\") " pod="openshift-image-registry/node-ca-hpwk9" Jul 17 18:09:47.245298 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.244773 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0e11cff-8760-45ef-80a5-d966038cf469-original-pull-secret\") pod \"global-pull-secret-syncer-9sg94\" (UID: \"a0e11cff-8760-45ef-80a5-d966038cf469\") " pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:09:47.245298 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.244797 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7451bfe9-39fa-4a5f-9358-f05ee2836298-etc-systemd\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.245298 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.244819 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7451bfe9-39fa-4a5f-9358-f05ee2836298-lib-modules\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.245298 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.244845 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5ff5649-c98d-4586-a8b2-27e68c67fdca-cni-binary-copy\") pod \"multus-additional-cni-plugins-4zb24\" (UID: \"b5ff5649-c98d-4586-a8b2-27e68c67fdca\") " pod="openshift-multus/multus-additional-cni-plugins-4zb24" Jul 17 18:09:47.245298 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.244870 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b5ff5649-c98d-4586-a8b2-27e68c67fdca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4zb24\" (UID: \"b5ff5649-c98d-4586-a8b2-27e68c67fdca\") " pod="openshift-multus/multus-additional-cni-plugins-4zb24" Jul 17 18:09:47.245298 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.244908 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5ff5649-c98d-4586-a8b2-27e68c67fdca-system-cni-dir\") pod \"multus-additional-cni-plugins-4zb24\" (UID: \"b5ff5649-c98d-4586-a8b2-27e68c67fdca\") " pod="openshift-multus/multus-additional-cni-plugins-4zb24" Jul 17 18:09:47.245298 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.244934 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5ff5649-c98d-4586-a8b2-27e68c67fdca-os-release\") pod \"multus-additional-cni-plugins-4zb24\" (UID: \"b5ff5649-c98d-4586-a8b2-27e68c67fdca\") " pod="openshift-multus/multus-additional-cni-plugins-4zb24" Jul 17 18:09:47.246141 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.244958 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b5ff5649-c98d-4586-a8b2-27e68c67fdca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4zb24\" (UID: \"b5ff5649-c98d-4586-a8b2-27e68c67fdca\") " pod="openshift-multus/multus-additional-cni-plugins-4zb24" Jul 17 18:09:47.246141 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.244984 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a0e11cff-8760-45ef-80a5-d966038cf469-kubelet-config\") pod \"global-pull-secret-syncer-9sg94\" (UID: \"a0e11cff-8760-45ef-80a5-d966038cf469\") " pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:09:47.246141 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.245008 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-os-release\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.246141 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.245037 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0d528ef6-e34a-4823-81d4-b9a0348c7edd-cni-binary-copy\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.246141 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.245108 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/780d0c42-753a-4fd5-96d3-8a6fd8177494-serviceca\") pod \"node-ca-hpwk9\" (UID: \"780d0c42-753a-4fd5-96d3-8a6fd8177494\") " pod="openshift-image-registry/node-ca-hpwk9" Jul 17 18:09:47.246141 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.245132 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-host-run-k8s-cni-cncf-io\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.246141 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.245156 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0d528ef6-e34a-4823-81d4-b9a0348c7edd-multus-daemon-config\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.246141 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.245218 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d74aab62-4360-4e21-9d51-57f2a63da3c4-tmp-dir\") pod \"node-resolver-5hrpr\" (UID: \"d74aab62-4360-4e21-9d51-57f2a63da3c4\") " pod="openshift-dns/node-resolver-5hrpr" Jul 17 18:09:47.246141 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.245244 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/690f5d91-c2cf-477a-9097-c594fc754625-iptables-alerter-script\") pod \"iptables-alerter-xmmdk\" (UID: \"690f5d91-c2cf-477a-9097-c594fc754625\") " pod="openshift-network-operator/iptables-alerter-xmmdk" Jul 17 18:09:47.246141 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.245266 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7451bfe9-39fa-4a5f-9358-f05ee2836298-var-lib-kubelet\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.246141 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.245297 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7451bfe9-39fa-4a5f-9358-f05ee2836298-host\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.246141 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.245325 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdgmh\" (UniqueName: \"kubernetes.io/projected/7451bfe9-39fa-4a5f-9358-f05ee2836298-kube-api-access-qdgmh\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.246141 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.245352 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d74aab62-4360-4e21-9d51-57f2a63da3c4-hosts-file\") pod \"node-resolver-5hrpr\" (UID: \"d74aab62-4360-4e21-9d51-57f2a63da3c4\") " pod="openshift-dns/node-resolver-5hrpr" Jul 17 18:09:47.246141 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.245377 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbt6t\" (UniqueName: \"kubernetes.io/projected/690f5d91-c2cf-477a-9097-c594fc754625-kube-api-access-dbt6t\") pod \"iptables-alerter-xmmdk\" (UID: \"690f5d91-c2cf-477a-9097-c594fc754625\") " pod="openshift-network-operator/iptables-alerter-xmmdk" Jul 17 18:09:47.246141 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.245404 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2k59\" (UniqueName: \"kubernetes.io/projected/780d0c42-753a-4fd5-96d3-8a6fd8177494-kube-api-access-s2k59\") pod \"node-ca-hpwk9\" (UID: \"780d0c42-753a-4fd5-96d3-8a6fd8177494\") " pod="openshift-image-registry/node-ca-hpwk9" Jul 17 18:09:47.246141 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.245430 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmw9c\" (UniqueName: \"kubernetes.io/projected/bb8f1a9f-2737-4a45-8507-997facd5c5fb-kube-api-access-kmw9c\") pod \"network-check-target-srkxv\" (UID: \"bb8f1a9f-2737-4a45-8507-997facd5c5fb\") " pod="openshift-network-diagnostics/network-check-target-srkxv" Jul 17 18:09:47.246141 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.245446 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a0e11cff-8760-45ef-80a5-d966038cf469-dbus\") pod \"global-pull-secret-syncer-9sg94\" (UID: \"a0e11cff-8760-45ef-80a5-d966038cf469\") " pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:09:47.247042 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.245457 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-host-var-lib-kubelet\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.247042 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.245494 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5fbd\" (UniqueName: \"kubernetes.io/projected/d74aab62-4360-4e21-9d51-57f2a63da3c4-kube-api-access-r5fbd\") pod \"node-resolver-5hrpr\" (UID: \"d74aab62-4360-4e21-9d51-57f2a63da3c4\") " pod="openshift-dns/node-resolver-5hrpr" Jul 17 18:09:47.247042 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.245519 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7451bfe9-39fa-4a5f-9358-f05ee2836298-host\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.247042 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.245520 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/780d0c42-753a-4fd5-96d3-8a6fd8177494-host\") pod \"node-ca-hpwk9\" (UID: \"780d0c42-753a-4fd5-96d3-8a6fd8177494\") " pod="openshift-image-registry/node-ca-hpwk9" Jul 17 18:09:47.247042 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.245529 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7451bfe9-39fa-4a5f-9358-f05ee2836298-etc-kubernetes\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.247042 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.245576 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7451bfe9-39fa-4a5f-9358-f05ee2836298-etc-kubernetes\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.247042 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.245579 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d74aab62-4360-4e21-9d51-57f2a63da3c4-hosts-file\") pod \"node-resolver-5hrpr\" (UID: \"d74aab62-4360-4e21-9d51-57f2a63da3c4\") " pod="openshift-dns/node-resolver-5hrpr" Jul 17 18:09:47.247042 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.245585 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7451bfe9-39fa-4a5f-9358-f05ee2836298-etc-systemd\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.247042 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:47.245658 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 18:09:47.247042 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.245690 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0d528ef6-e34a-4823-81d4-b9a0348c7edd-multus-daemon-config\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.247042 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.245718 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7451bfe9-39fa-4a5f-9358-f05ee2836298-lib-modules\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.247042 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.245774 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-multus-cni-dir\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.247042 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.245904 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7451bfe9-39fa-4a5f-9358-f05ee2836298-etc-sysctl-conf\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.247042 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.245953 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-multus-conf-dir\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.247042 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.246042 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7451bfe9-39fa-4a5f-9358-f05ee2836298-etc-modprobe-d\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.247042 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:47.246016 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0e11cff-8760-45ef-80a5-d966038cf469-original-pull-secret podName:a0e11cff-8760-45ef-80a5-d966038cf469 nodeName:}" failed. No retries permitted until 2026-07-17 18:09:47.745990512 +0000 UTC m=+3.019601643 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0e11cff-8760-45ef-80a5-d966038cf469-original-pull-secret") pod "global-pull-secret-syncer-9sg94" (UID: "a0e11cff-8760-45ef-80a5-d966038cf469") : object "kube-system"/"original-pull-secret" not registered Jul 17 18:09:47.247042 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.246109 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7451bfe9-39fa-4a5f-9358-f05ee2836298-run\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.247042 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.246126 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/780d0c42-753a-4fd5-96d3-8a6fd8177494-serviceca\") pod \"node-ca-hpwk9\" (UID: \"780d0c42-753a-4fd5-96d3-8a6fd8177494\") " pod="openshift-image-registry/node-ca-hpwk9" Jul 17 18:09:47.247910 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.246141 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-host-var-lib-kubelet\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.247910 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.246142 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-host-var-lib-cni-multus\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.247910 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.246178 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-host-var-lib-cni-multus\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.247910 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.246207 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7451bfe9-39fa-4a5f-9358-f05ee2836298-etc-sysconfig\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.247910 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.246230 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d74aab62-4360-4e21-9d51-57f2a63da3c4-tmp-dir\") pod \"node-resolver-5hrpr\" (UID: \"d74aab62-4360-4e21-9d51-57f2a63da3c4\") " pod="openshift-dns/node-resolver-5hrpr" Jul 17 18:09:47.247910 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.246257 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7451bfe9-39fa-4a5f-9358-f05ee2836298-run\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.247910 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.246263 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7451bfe9-39fa-4a5f-9358-f05ee2836298-etc-sysconfig\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.247910 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.246106 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7451bfe9-39fa-4a5f-9358-f05ee2836298-var-lib-kubelet\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.247910 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.246263 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-system-cni-dir\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.247910 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.246304 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5ff5649-c98d-4586-a8b2-27e68c67fdca-cni-binary-copy\") pod \"multus-additional-cni-plugins-4zb24\" (UID: \"b5ff5649-c98d-4586-a8b2-27e68c67fdca\") " pod="openshift-multus/multus-additional-cni-plugins-4zb24" Jul 17 18:09:47.247910 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.246315 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5ff5649-c98d-4586-a8b2-27e68c67fdca-os-release\") pod \"multus-additional-cni-plugins-4zb24\" (UID: \"b5ff5649-c98d-4586-a8b2-27e68c67fdca\") " pod="openshift-multus/multus-additional-cni-plugins-4zb24" Jul 17 18:09:47.247910 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.246332 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a0e11cff-8760-45ef-80a5-d966038cf469-kubelet-config\") pod \"global-pull-secret-syncer-9sg94\" (UID: \"a0e11cff-8760-45ef-80a5-d966038cf469\") " pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:09:47.247910 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.246388 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5ff5649-c98d-4586-a8b2-27e68c67fdca-system-cni-dir\") pod \"multus-additional-cni-plugins-4zb24\" (UID: \"b5ff5649-c98d-4586-a8b2-27e68c67fdca\") " pod="openshift-multus/multus-additional-cni-plugins-4zb24" Jul 17 18:09:47.247910 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.246429 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5ff5649-c98d-4586-a8b2-27e68c67fdca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4zb24\" (UID: \"b5ff5649-c98d-4586-a8b2-27e68c67fdca\") " pod="openshift-multus/multus-additional-cni-plugins-4zb24" Jul 17 18:09:47.247910 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.246456 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-os-release\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.247910 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.246507 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7451bfe9-39fa-4a5f-9358-f05ee2836298-sys\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.247910 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.246660 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-etc-kubernetes\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.247910 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.246706 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ddb5f6e9-3b9b-4087-8196-b55e879f7c62-konnectivity-ca\") pod \"konnectivity-agent-lv9fl\" (UID: \"ddb5f6e9-3b9b-4087-8196-b55e879f7c62\") " pod="kube-system/konnectivity-agent-lv9fl" Jul 17 18:09:47.248864 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.246752 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-cnibin\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.248864 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.246780 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-multus-socket-dir-parent\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.248864 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.246811 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-host-var-lib-cni-bin\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.248864 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.246868 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-hostroot\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.248864 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.246898 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-host-run-multus-certs\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.248864 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.246919 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b5ff5649-c98d-4586-a8b2-27e68c67fdca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4zb24\" (UID: \"b5ff5649-c98d-4586-a8b2-27e68c67fdca\") " pod="openshift-multus/multus-additional-cni-plugins-4zb24" Jul 17 18:09:47.248864 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.246981 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-host-run-multus-certs\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.248864 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.247001 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-host-run-k8s-cni-cncf-io\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.248864 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.247025 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/690f5d91-c2cf-477a-9097-c594fc754625-host-slash\") pod \"iptables-alerter-xmmdk\" (UID: \"690f5d91-c2cf-477a-9097-c594fc754625\") " pod="openshift-network-operator/iptables-alerter-xmmdk" Jul 17 18:09:47.248864 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.247038 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-host-var-lib-cni-bin\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.248864 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.247057 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-multus-socket-dir-parent\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.248864 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.247101 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-hostroot\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.248864 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.247104 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0d528ef6-e34a-4823-81d4-b9a0348c7edd-cnibin\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.248864 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.247148 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0d528ef6-e34a-4823-81d4-b9a0348c7edd-cni-binary-copy\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.248864 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.247152 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b5ff5649-c98d-4586-a8b2-27e68c67fdca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4zb24\" (UID: \"b5ff5649-c98d-4586-a8b2-27e68c67fdca\") " pod="openshift-multus/multus-additional-cni-plugins-4zb24" Jul 17 18:09:47.249691 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.249201 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7451bfe9-39fa-4a5f-9358-f05ee2836298-tmp\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.249691 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.249291 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ddb5f6e9-3b9b-4087-8196-b55e879f7c62-agent-certs\") pod \"konnectivity-agent-lv9fl\" (UID: \"ddb5f6e9-3b9b-4087-8196-b55e879f7c62\") " pod="kube-system/konnectivity-agent-lv9fl" Jul 17 18:09:47.250041 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.249944 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7451bfe9-39fa-4a5f-9358-f05ee2836298-etc-tuned\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.255049 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.255025 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5fbd\" (UniqueName: \"kubernetes.io/projected/d74aab62-4360-4e21-9d51-57f2a63da3c4-kube-api-access-r5fbd\") pod \"node-resolver-5hrpr\" (UID: \"d74aab62-4360-4e21-9d51-57f2a63da3c4\") " pod="openshift-dns/node-resolver-5hrpr" Jul 17 18:09:47.255432 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:47.255197 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 18:09:47.255432 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:47.255221 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 18:09:47.255432 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:47.255236 2576 projected.go:196] Error preparing data for projected volume kube-api-access-kmw9c for pod openshift-network-diagnostics/network-check-target-srkxv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:09:47.255432 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:47.255289 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb8f1a9f-2737-4a45-8507-997facd5c5fb-kube-api-access-kmw9c podName:bb8f1a9f-2737-4a45-8507-997facd5c5fb nodeName:}" failed. No retries permitted until 2026-07-17 18:09:47.755273124 +0000 UTC m=+3.028884269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kmw9c" (UniqueName: "kubernetes.io/projected/bb8f1a9f-2737-4a45-8507-997facd5c5fb-kube-api-access-kmw9c") pod "network-check-target-srkxv" (UID: "bb8f1a9f-2737-4a45-8507-997facd5c5fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:09:47.258322 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.258281 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2k59\" (UniqueName: \"kubernetes.io/projected/780d0c42-753a-4fd5-96d3-8a6fd8177494-kube-api-access-s2k59\") pod \"node-ca-hpwk9\" (UID: \"780d0c42-753a-4fd5-96d3-8a6fd8177494\") " pod="openshift-image-registry/node-ca-hpwk9" Jul 17 18:09:47.260000 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.259974 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbt6t\" (UniqueName: \"kubernetes.io/projected/690f5d91-c2cf-477a-9097-c594fc754625-kube-api-access-dbt6t\") pod \"iptables-alerter-xmmdk\" (UID: \"690f5d91-c2cf-477a-9097-c594fc754625\") " pod="openshift-network-operator/iptables-alerter-xmmdk" Jul 17 18:09:47.260636 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.260593 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc7h8\" (UniqueName: \"kubernetes.io/projected/0d528ef6-e34a-4823-81d4-b9a0348c7edd-kube-api-access-rc7h8\") pod \"multus-wrth6\" (UID: \"0d528ef6-e34a-4823-81d4-b9a0348c7edd\") " pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.261384 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.261338 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdgmh\" (UniqueName: \"kubernetes.io/projected/7451bfe9-39fa-4a5f-9358-f05ee2836298-kube-api-access-qdgmh\") pod \"tuned-klj72\" (UID: \"7451bfe9-39fa-4a5f-9358-f05ee2836298\") " pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.262373 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.262305 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6szt\" (UniqueName: \"kubernetes.io/projected/b5ff5649-c98d-4586-a8b2-27e68c67fdca-kube-api-access-k6szt\") pod \"multus-additional-cni-plugins-4zb24\" (UID: \"b5ff5649-c98d-4586-a8b2-27e68c67fdca\") " pod="openshift-multus/multus-additional-cni-plugins-4zb24" Jul 17 18:09:47.336400 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.336371 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhj7k" Jul 17 18:09:47.347752 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.347708 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:09:47.349232 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:47.349191 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedecfdc6_4c0a_4fa4_860a_5632fce0eba9.slice/crio-33a1e523bee78693b376dd133df0160479c131021bb7b004ab17766b0a0e5bfa WatchSource:0}: Error finding container 33a1e523bee78693b376dd133df0160479c131021bb7b004ab17766b0a0e5bfa: Status 404 returned error can't find the container with id 33a1e523bee78693b376dd133df0160479c131021bb7b004ab17766b0a0e5bfa Jul 17 18:09:47.357960 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.357863 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xmmdk" Jul 17 18:09:47.360078 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:47.360021 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda67c7573_deca_4960_b69f_5ad3bda075a8.slice/crio-24e429402c9afa7a9d6b3cdc37a421bcebef477f4cc089a21bdd41a64fe7b5c0 WatchSource:0}: Error finding container 24e429402c9afa7a9d6b3cdc37a421bcebef477f4cc089a21bdd41a64fe7b5c0: Status 404 returned error can't find the container with id 24e429402c9afa7a9d6b3cdc37a421bcebef477f4cc089a21bdd41a64fe7b5c0 Jul 17 18:09:47.365197 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.365179 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lv9fl" Jul 17 18:09:47.368112 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:47.367935 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod690f5d91_c2cf_477a_9097_c594fc754625.slice/crio-e6a7e7f11b50bc28e30771dac5c2033c7df3b783ae7cd07d6674f66790f2f9c5 WatchSource:0}: Error finding container e6a7e7f11b50bc28e30771dac5c2033c7df3b783ae7cd07d6674f66790f2f9c5: Status 404 returned error can't find the container with id e6a7e7f11b50bc28e30771dac5c2033c7df3b783ae7cd07d6674f66790f2f9c5 Jul 17 18:09:47.374175 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.374107 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4zb24" Jul 17 18:09:47.374722 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:47.374692 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddb5f6e9_3b9b_4087_8196_b55e879f7c62.slice/crio-617d4050f0553e72965b16b5c02cb95766bd1400c5e6cdb2696f4479fdf772ac WatchSource:0}: Error finding container 617d4050f0553e72965b16b5c02cb95766bd1400c5e6cdb2696f4479fdf772ac: Status 404 returned error can't find the container with id 617d4050f0553e72965b16b5c02cb95766bd1400c5e6cdb2696f4479fdf772ac Jul 17 18:09:47.382147 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.382063 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-klj72" Jul 17 18:09:47.385411 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:47.385380 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5ff5649_c98d_4586_a8b2_27e68c67fdca.slice/crio-7d5727a73ce963b40ceb864bb822968619a87c980cea6af45aec80660605dcef WatchSource:0}: Error finding container 7d5727a73ce963b40ceb864bb822968619a87c980cea6af45aec80660605dcef: Status 404 returned error can't find the container with id 7d5727a73ce963b40ceb864bb822968619a87c980cea6af45aec80660605dcef Jul 17 18:09:47.388826 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.388804 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hpwk9" Jul 17 18:09:47.392878 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:47.392855 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7451bfe9_39fa_4a5f_9358_f05ee2836298.slice/crio-8fb19bacba0e61028bb639acdf80fbd78718b5c16f626855a3e3ce74c877c077 WatchSource:0}: Error finding container 8fb19bacba0e61028bb639acdf80fbd78718b5c16f626855a3e3ce74c877c077: Status 404 returned error can't find the container with id 8fb19bacba0e61028bb639acdf80fbd78718b5c16f626855a3e3ce74c877c077 Jul 17 18:09:47.397313 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.397288 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wrth6" Jul 17 18:09:47.399743 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:47.399718 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod780d0c42_753a_4fd5_96d3_8a6fd8177494.slice/crio-67c059f921c792045904e60bcfc9886b5f30ec49a315796efef42efd0e570327 WatchSource:0}: Error finding container 67c059f921c792045904e60bcfc9886b5f30ec49a315796efef42efd0e570327: Status 404 returned error can't find the container with id 67c059f921c792045904e60bcfc9886b5f30ec49a315796efef42efd0e570327 Jul 17 18:09:47.405120 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.405095 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5hrpr" Jul 17 18:09:47.410209 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:47.410184 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d528ef6_e34a_4823_81d4_b9a0348c7edd.slice/crio-95cdcd7c9f96c35f3715b6974c79e9886300eb2ba2e02c62dcac25407e46200b WatchSource:0}: Error finding container 95cdcd7c9f96c35f3715b6974c79e9886300eb2ba2e02c62dcac25407e46200b: Status 404 returned error can't find the container with id 95cdcd7c9f96c35f3715b6974c79e9886300eb2ba2e02c62dcac25407e46200b Jul 17 18:09:47.420869 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:09:47.420836 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd74aab62_4360_4e21_9d51_57f2a63da3c4.slice/crio-1c94efbf7733b97665628ba0573e96c36a1376241e2e8ac755549fbc081adacf WatchSource:0}: Error finding container 1c94efbf7733b97665628ba0573e96c36a1376241e2e8ac755549fbc081adacf: Status 404 returned error can't find the container with id 1c94efbf7733b97665628ba0573e96c36a1376241e2e8ac755549fbc081adacf Jul 17 18:09:47.470207 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.470174 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 18:09:47.649604 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.649575 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31390317-6109-491f-8d6a-6530a57f25c2-metrics-certs\") pod \"network-metrics-daemon-fgr6m\" (UID: \"31390317-6109-491f-8d6a-6530a57f25c2\") " pod="openshift-multus/network-metrics-daemon-fgr6m" Jul 17 18:09:47.649749 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:47.649705 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:09:47.649798 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:47.649764 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31390317-6109-491f-8d6a-6530a57f25c2-metrics-certs podName:31390317-6109-491f-8d6a-6530a57f25c2 nodeName:}" failed. No retries permitted until 2026-07-17 18:09:48.649746925 +0000 UTC m=+3.923358064 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31390317-6109-491f-8d6a-6530a57f25c2-metrics-certs") pod "network-metrics-daemon-fgr6m" (UID: "31390317-6109-491f-8d6a-6530a57f25c2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:09:47.750900 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.750855 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0e11cff-8760-45ef-80a5-d966038cf469-original-pull-secret\") pod \"global-pull-secret-syncer-9sg94\" (UID: \"a0e11cff-8760-45ef-80a5-d966038cf469\") " pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:09:47.751089 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:47.750981 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 18:09:47.751089 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:47.751085 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0e11cff-8760-45ef-80a5-d966038cf469-original-pull-secret podName:a0e11cff-8760-45ef-80a5-d966038cf469 nodeName:}" failed. No retries permitted until 2026-07-17 18:09:48.751065624 +0000 UTC m=+4.024676750 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0e11cff-8760-45ef-80a5-d966038cf469-original-pull-secret") pod "global-pull-secret-syncer-9sg94" (UID: "a0e11cff-8760-45ef-80a5-d966038cf469") : object "kube-system"/"original-pull-secret" not registered Jul 17 18:09:47.851837 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:47.851805 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmw9c\" (UniqueName: \"kubernetes.io/projected/bb8f1a9f-2737-4a45-8507-997facd5c5fb-kube-api-access-kmw9c\") pod \"network-check-target-srkxv\" (UID: \"bb8f1a9f-2737-4a45-8507-997facd5c5fb\") " pod="openshift-network-diagnostics/network-check-target-srkxv" Jul 17 18:09:47.851967 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:47.851936 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 18:09:47.851967 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:47.851950 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 18:09:47.851967 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:47.851959 2576 projected.go:196] Error preparing data for projected volume kube-api-access-kmw9c for pod openshift-network-diagnostics/network-check-target-srkxv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:09:47.852085 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:47.852020 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb8f1a9f-2737-4a45-8507-997facd5c5fb-kube-api-access-kmw9c podName:bb8f1a9f-2737-4a45-8507-997facd5c5fb nodeName:}" failed. No retries permitted until 2026-07-17 18:09:48.851993766 +0000 UTC m=+4.125604888 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kmw9c" (UniqueName: "kubernetes.io/projected/bb8f1a9f-2737-4a45-8507-997facd5c5fb-kube-api-access-kmw9c") pod "network-check-target-srkxv" (UID: "bb8f1a9f-2737-4a45-8507-997facd5c5fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:09:48.105170 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:48.105112 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 18:04:47 +0000 UTC" deadline="2028-02-27 14:34:28.345509953 +0000 UTC" Jul 17 18:09:48.105170 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:48.105161 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14156h24m40.240351451s" Jul 17 18:09:48.189160 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:48.189121 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zb24" event={"ID":"b5ff5649-c98d-4586-a8b2-27e68c67fdca","Type":"ContainerStarted","Data":"7d5727a73ce963b40ceb864bb822968619a87c980cea6af45aec80660605dcef"} Jul 17 18:09:48.190205 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:48.190171 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" event={"ID":"a67c7573-deca-4960-b69f-5ad3bda075a8","Type":"ContainerStarted","Data":"24e429402c9afa7a9d6b3cdc37a421bcebef477f4cc089a21bdd41a64fe7b5c0"} Jul 17 18:09:48.191477 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:48.191450 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhj7k" event={"ID":"edecfdc6-4c0a-4fa4-860a-5632fce0eba9","Type":"ContainerStarted","Data":"33a1e523bee78693b376dd133df0160479c131021bb7b004ab17766b0a0e5bfa"} Jul 17 18:09:48.192617 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:48.192584 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wrth6" event={"ID":"0d528ef6-e34a-4823-81d4-b9a0348c7edd","Type":"ContainerStarted","Data":"95cdcd7c9f96c35f3715b6974c79e9886300eb2ba2e02c62dcac25407e46200b"} Jul 17 18:09:48.194181 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:48.194158 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hpwk9" event={"ID":"780d0c42-753a-4fd5-96d3-8a6fd8177494","Type":"ContainerStarted","Data":"67c059f921c792045904e60bcfc9886b5f30ec49a315796efef42efd0e570327"} Jul 17 18:09:48.195355 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:48.195335 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-klj72" event={"ID":"7451bfe9-39fa-4a5f-9358-f05ee2836298","Type":"ContainerStarted","Data":"8fb19bacba0e61028bb639acdf80fbd78718b5c16f626855a3e3ce74c877c077"} Jul 17 18:09:48.196321 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:48.196301 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lv9fl" event={"ID":"ddb5f6e9-3b9b-4087-8196-b55e879f7c62","Type":"ContainerStarted","Data":"617d4050f0553e72965b16b5c02cb95766bd1400c5e6cdb2696f4479fdf772ac"} Jul 17 18:09:48.197261 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:48.197244 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xmmdk" event={"ID":"690f5d91-c2cf-477a-9097-c594fc754625","Type":"ContainerStarted","Data":"e6a7e7f11b50bc28e30771dac5c2033c7df3b783ae7cd07d6674f66790f2f9c5"} Jul 17 18:09:48.198251 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:48.198233 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5hrpr" event={"ID":"d74aab62-4360-4e21-9d51-57f2a63da3c4","Type":"ContainerStarted","Data":"1c94efbf7733b97665628ba0573e96c36a1376241e2e8ac755549fbc081adacf"} Jul 17 18:09:48.657932 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:48.657556 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31390317-6109-491f-8d6a-6530a57f25c2-metrics-certs\") pod \"network-metrics-daemon-fgr6m\" (UID: \"31390317-6109-491f-8d6a-6530a57f25c2\") " pod="openshift-multus/network-metrics-daemon-fgr6m" Jul 17 18:09:48.657932 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:48.657751 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:09:48.657932 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:48.657827 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31390317-6109-491f-8d6a-6530a57f25c2-metrics-certs podName:31390317-6109-491f-8d6a-6530a57f25c2 nodeName:}" failed. No retries permitted until 2026-07-17 18:09:50.657808871 +0000 UTC m=+5.931420009 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31390317-6109-491f-8d6a-6530a57f25c2-metrics-certs") pod "network-metrics-daemon-fgr6m" (UID: "31390317-6109-491f-8d6a-6530a57f25c2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:09:48.759144 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:48.758581 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0e11cff-8760-45ef-80a5-d966038cf469-original-pull-secret\") pod \"global-pull-secret-syncer-9sg94\" (UID: \"a0e11cff-8760-45ef-80a5-d966038cf469\") " pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:09:48.759144 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:48.758748 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 18:09:48.759144 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:48.758809 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0e11cff-8760-45ef-80a5-d966038cf469-original-pull-secret podName:a0e11cff-8760-45ef-80a5-d966038cf469 nodeName:}" failed. No retries permitted until 2026-07-17 18:09:50.758790595 +0000 UTC m=+6.032401741 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0e11cff-8760-45ef-80a5-d966038cf469-original-pull-secret") pod "global-pull-secret-syncer-9sg94" (UID: "a0e11cff-8760-45ef-80a5-d966038cf469") : object "kube-system"/"original-pull-secret" not registered Jul 17 18:09:48.860638 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:48.860427 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmw9c\" (UniqueName: \"kubernetes.io/projected/bb8f1a9f-2737-4a45-8507-997facd5c5fb-kube-api-access-kmw9c\") pod \"network-check-target-srkxv\" (UID: \"bb8f1a9f-2737-4a45-8507-997facd5c5fb\") " pod="openshift-network-diagnostics/network-check-target-srkxv" Jul 17 18:09:48.860778 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:48.860757 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 18:09:48.860844 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:48.860790 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 18:09:48.860844 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:48.860805 2576 projected.go:196] Error preparing data for projected volume kube-api-access-kmw9c for pod openshift-network-diagnostics/network-check-target-srkxv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:09:48.860942 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:48.860860 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb8f1a9f-2737-4a45-8507-997facd5c5fb-kube-api-access-kmw9c podName:bb8f1a9f-2737-4a45-8507-997facd5c5fb nodeName:}" failed. No retries permitted until 2026-07-17 18:09:50.860839819 +0000 UTC m=+6.134450959 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kmw9c" (UniqueName: "kubernetes.io/projected/bb8f1a9f-2737-4a45-8507-997facd5c5fb-kube-api-access-kmw9c") pod "network-check-target-srkxv" (UID: "bb8f1a9f-2737-4a45-8507-997facd5c5fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:09:49.105583 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:49.105538 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 18:04:47 +0000 UTC" deadline="2027-12-14 09:25:50.371213607 +0000 UTC" Jul 17 18:09:49.105583 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:49.105576 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12351h16m1.265641612s" Jul 17 18:09:49.180820 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:49.180786 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgr6m" Jul 17 18:09:49.181335 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:49.181064 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:09:49.181335 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:49.181154 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sg94" podUID="a0e11cff-8760-45ef-80a5-d966038cf469" Jul 17 18:09:49.181335 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:49.181042 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgr6m" podUID="31390317-6109-491f-8d6a-6530a57f25c2" Jul 17 18:09:49.181335 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:49.180786 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srkxv" Jul 17 18:09:49.181335 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:49.181258 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srkxv" podUID="bb8f1a9f-2737-4a45-8507-997facd5c5fb" Jul 17 18:09:49.207122 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:49.206381 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-68.ec2.internal" event={"ID":"058d024324ce103e994a009799d7facb","Type":"ContainerStarted","Data":"a53345cc79bc1f0aa7aca5f28edac8d47b3bc7378a48076c27487fb6764f1b0d"} Jul 17 18:09:50.223360 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:50.222252 2576 generic.go:356] "Generic (PLEG): container finished" podID="34d985b57e6f9343f193eb8b07f4675f" containerID="f59b589795a621244205f21a3273a4fa484cc2373682453c20f11fb636b21de6" exitCode=0 Jul 17 18:09:50.223360 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:50.223105 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal" event={"ID":"34d985b57e6f9343f193eb8b07f4675f","Type":"ContainerDied","Data":"f59b589795a621244205f21a3273a4fa484cc2373682453c20f11fb636b21de6"} Jul 17 18:09:50.239438 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:50.239383 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-68.ec2.internal" podStartSLOduration=3.239364283 podStartE2EDuration="3.239364283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:09:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:09:49.223460704 +0000 UTC m=+4.497071851" watchObservedRunningTime="2026-07-17 18:09:50.239364283 +0000 UTC m=+5.512975431" Jul 17 18:09:50.677522 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:50.676917 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31390317-6109-491f-8d6a-6530a57f25c2-metrics-certs\") pod \"network-metrics-daemon-fgr6m\" (UID: \"31390317-6109-491f-8d6a-6530a57f25c2\") " pod="openshift-multus/network-metrics-daemon-fgr6m" Jul 17 18:09:50.677522 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:50.677092 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:09:50.677522 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:50.677160 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31390317-6109-491f-8d6a-6530a57f25c2-metrics-certs podName:31390317-6109-491f-8d6a-6530a57f25c2 nodeName:}" failed. No retries permitted until 2026-07-17 18:09:54.677140369 +0000 UTC m=+9.950751493 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31390317-6109-491f-8d6a-6530a57f25c2-metrics-certs") pod "network-metrics-daemon-fgr6m" (UID: "31390317-6109-491f-8d6a-6530a57f25c2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:09:50.778679 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:50.778031 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0e11cff-8760-45ef-80a5-d966038cf469-original-pull-secret\") pod \"global-pull-secret-syncer-9sg94\" (UID: \"a0e11cff-8760-45ef-80a5-d966038cf469\") " pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:09:50.778679 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:50.778223 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 18:09:50.778679 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:50.778292 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0e11cff-8760-45ef-80a5-d966038cf469-original-pull-secret podName:a0e11cff-8760-45ef-80a5-d966038cf469 nodeName:}" failed. No retries permitted until 2026-07-17 18:09:54.778269338 +0000 UTC m=+10.051880466 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0e11cff-8760-45ef-80a5-d966038cf469-original-pull-secret") pod "global-pull-secret-syncer-9sg94" (UID: "a0e11cff-8760-45ef-80a5-d966038cf469") : object "kube-system"/"original-pull-secret" not registered Jul 17 18:09:50.878769 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:50.878731 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmw9c\" (UniqueName: \"kubernetes.io/projected/bb8f1a9f-2737-4a45-8507-997facd5c5fb-kube-api-access-kmw9c\") pod \"network-check-target-srkxv\" (UID: \"bb8f1a9f-2737-4a45-8507-997facd5c5fb\") " pod="openshift-network-diagnostics/network-check-target-srkxv" Jul 17 18:09:50.878954 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:50.878887 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 18:09:50.878954 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:50.878911 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 18:09:50.878954 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:50.878925 2576 projected.go:196] Error preparing data for projected volume kube-api-access-kmw9c for pod openshift-network-diagnostics/network-check-target-srkxv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:09:50.879234 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:50.878986 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb8f1a9f-2737-4a45-8507-997facd5c5fb-kube-api-access-kmw9c podName:bb8f1a9f-2737-4a45-8507-997facd5c5fb nodeName:}" failed. No retries permitted until 2026-07-17 18:09:54.878967996 +0000 UTC m=+10.152579120 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kmw9c" (UniqueName: "kubernetes.io/projected/bb8f1a9f-2737-4a45-8507-997facd5c5fb-kube-api-access-kmw9c") pod "network-check-target-srkxv" (UID: "bb8f1a9f-2737-4a45-8507-997facd5c5fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:09:51.181405 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:51.180732 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgr6m" Jul 17 18:09:51.181405 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:51.180876 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgr6m" podUID="31390317-6109-491f-8d6a-6530a57f25c2" Jul 17 18:09:51.181405 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:51.180732 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:09:51.181405 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:51.180978 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sg94" podUID="a0e11cff-8760-45ef-80a5-d966038cf469" Jul 17 18:09:51.181405 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:51.181075 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srkxv" Jul 17 18:09:51.181405 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:51.181164 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srkxv" podUID="bb8f1a9f-2737-4a45-8507-997facd5c5fb" Jul 17 18:09:51.228596 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:51.228563 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal" event={"ID":"34d985b57e6f9343f193eb8b07f4675f","Type":"ContainerStarted","Data":"93d897d284082cd2071a7b2426ca37eb1ce500eb7a1bcd203268461f589e4868"} Jul 17 18:09:53.181450 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:53.180931 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgr6m" Jul 17 18:09:53.181450 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:53.181098 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgr6m" podUID="31390317-6109-491f-8d6a-6530a57f25c2" Jul 17 18:09:53.181450 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:53.181264 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srkxv" Jul 17 18:09:53.181450 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:53.181306 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:09:53.181450 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:53.181390 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sg94" podUID="a0e11cff-8760-45ef-80a5-d966038cf469" Jul 17 18:09:53.182106 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:53.181543 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srkxv" podUID="bb8f1a9f-2737-4a45-8507-997facd5c5fb" Jul 17 18:09:54.710889 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:54.710849 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31390317-6109-491f-8d6a-6530a57f25c2-metrics-certs\") pod \"network-metrics-daemon-fgr6m\" (UID: \"31390317-6109-491f-8d6a-6530a57f25c2\") " pod="openshift-multus/network-metrics-daemon-fgr6m" Jul 17 18:09:54.711426 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:54.711005 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:09:54.711426 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:54.711089 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31390317-6109-491f-8d6a-6530a57f25c2-metrics-certs podName:31390317-6109-491f-8d6a-6530a57f25c2 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:02.711060547 +0000 UTC m=+17.984671674 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31390317-6109-491f-8d6a-6530a57f25c2-metrics-certs") pod "network-metrics-daemon-fgr6m" (UID: "31390317-6109-491f-8d6a-6530a57f25c2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:09:54.811811 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:54.811774 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0e11cff-8760-45ef-80a5-d966038cf469-original-pull-secret\") pod \"global-pull-secret-syncer-9sg94\" (UID: \"a0e11cff-8760-45ef-80a5-d966038cf469\") " pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:09:54.811966 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:54.811950 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 18:09:54.812062 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:54.812044 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0e11cff-8760-45ef-80a5-d966038cf469-original-pull-secret podName:a0e11cff-8760-45ef-80a5-d966038cf469 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:02.812023008 +0000 UTC m=+18.085634189 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0e11cff-8760-45ef-80a5-d966038cf469-original-pull-secret") pod "global-pull-secret-syncer-9sg94" (UID: "a0e11cff-8760-45ef-80a5-d966038cf469") : object "kube-system"/"original-pull-secret" not registered Jul 17 18:09:54.912932 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:54.912896 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmw9c\" (UniqueName: \"kubernetes.io/projected/bb8f1a9f-2737-4a45-8507-997facd5c5fb-kube-api-access-kmw9c\") pod \"network-check-target-srkxv\" (UID: \"bb8f1a9f-2737-4a45-8507-997facd5c5fb\") " pod="openshift-network-diagnostics/network-check-target-srkxv" Jul 17 18:09:54.913127 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:54.913051 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 18:09:54.913127 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:54.913075 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 18:09:54.913127 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:54.913090 2576 projected.go:196] Error preparing data for projected volume kube-api-access-kmw9c for pod openshift-network-diagnostics/network-check-target-srkxv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:09:54.913292 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:54.913150 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb8f1a9f-2737-4a45-8507-997facd5c5fb-kube-api-access-kmw9c podName:bb8f1a9f-2737-4a45-8507-997facd5c5fb nodeName:}" failed. No retries permitted until 2026-07-17 18:10:02.913132267 +0000 UTC m=+18.186743411 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kmw9c" (UniqueName: "kubernetes.io/projected/bb8f1a9f-2737-4a45-8507-997facd5c5fb-kube-api-access-kmw9c") pod "network-check-target-srkxv" (UID: "bb8f1a9f-2737-4a45-8507-997facd5c5fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:09:55.182627 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:55.182588 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgr6m" Jul 17 18:09:55.182866 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:55.182772 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgr6m" podUID="31390317-6109-491f-8d6a-6530a57f25c2" Jul 17 18:09:55.183330 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:55.183030 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srkxv" Jul 17 18:09:55.183330 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:55.183138 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srkxv" podUID="bb8f1a9f-2737-4a45-8507-997facd5c5fb" Jul 17 18:09:55.183330 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:55.183186 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:09:55.185341 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:55.184325 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sg94" podUID="a0e11cff-8760-45ef-80a5-d966038cf469" Jul 17 18:09:57.180883 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:57.180421 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:09:57.180883 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:57.180559 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sg94" podUID="a0e11cff-8760-45ef-80a5-d966038cf469" Jul 17 18:09:57.180883 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:57.180594 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srkxv" Jul 17 18:09:57.180883 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:57.180611 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgr6m" Jul 17 18:09:57.180883 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:57.180709 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srkxv" podUID="bb8f1a9f-2737-4a45-8507-997facd5c5fb" Jul 17 18:09:57.180883 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:57.180807 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgr6m" podUID="31390317-6109-491f-8d6a-6530a57f25c2" Jul 17 18:09:59.180151 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:59.180117 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:09:59.180541 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:59.180122 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgr6m" Jul 17 18:09:59.180541 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:59.180240 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sg94" podUID="a0e11cff-8760-45ef-80a5-d966038cf469" Jul 17 18:09:59.180541 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:09:59.180131 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srkxv" Jul 17 18:09:59.180541 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:59.180319 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgr6m" podUID="31390317-6109-491f-8d6a-6530a57f25c2" Jul 17 18:09:59.180541 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:09:59.180384 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srkxv" podUID="bb8f1a9f-2737-4a45-8507-997facd5c5fb" Jul 17 18:10:01.180466 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:01.180436 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srkxv" Jul 17 18:10:01.180883 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:01.180433 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgr6m" Jul 17 18:10:01.180883 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:01.180566 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srkxv" podUID="bb8f1a9f-2737-4a45-8507-997facd5c5fb" Jul 17 18:10:01.180883 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:01.180433 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:10:01.180883 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:01.180657 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgr6m" podUID="31390317-6109-491f-8d6a-6530a57f25c2" Jul 17 18:10:01.180883 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:01.180773 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sg94" podUID="a0e11cff-8760-45ef-80a5-d966038cf469" Jul 17 18:10:02.775445 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:02.775411 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31390317-6109-491f-8d6a-6530a57f25c2-metrics-certs\") pod \"network-metrics-daemon-fgr6m\" (UID: \"31390317-6109-491f-8d6a-6530a57f25c2\") " pod="openshift-multus/network-metrics-daemon-fgr6m" Jul 17 18:10:02.775943 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:02.775526 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:10:02.775943 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:02.775593 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31390317-6109-491f-8d6a-6530a57f25c2-metrics-certs podName:31390317-6109-491f-8d6a-6530a57f25c2 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:18.775574891 +0000 UTC m=+34.049186028 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31390317-6109-491f-8d6a-6530a57f25c2-metrics-certs") pod "network-metrics-daemon-fgr6m" (UID: "31390317-6109-491f-8d6a-6530a57f25c2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:10:02.876104 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:02.876078 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0e11cff-8760-45ef-80a5-d966038cf469-original-pull-secret\") pod \"global-pull-secret-syncer-9sg94\" (UID: \"a0e11cff-8760-45ef-80a5-d966038cf469\") " pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:10:02.876250 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:02.876236 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 18:10:02.876304 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:02.876298 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0e11cff-8760-45ef-80a5-d966038cf469-original-pull-secret podName:a0e11cff-8760-45ef-80a5-d966038cf469 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:18.876281803 +0000 UTC m=+34.149892928 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0e11cff-8760-45ef-80a5-d966038cf469-original-pull-secret") pod "global-pull-secret-syncer-9sg94" (UID: "a0e11cff-8760-45ef-80a5-d966038cf469") : object "kube-system"/"original-pull-secret" not registered Jul 17 18:10:02.976605 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:02.976563 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmw9c\" (UniqueName: \"kubernetes.io/projected/bb8f1a9f-2737-4a45-8507-997facd5c5fb-kube-api-access-kmw9c\") pod \"network-check-target-srkxv\" (UID: \"bb8f1a9f-2737-4a45-8507-997facd5c5fb\") " pod="openshift-network-diagnostics/network-check-target-srkxv" Jul 17 18:10:02.976767 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:02.976682 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 18:10:02.976767 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:02.976700 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 18:10:02.976767 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:02.976710 2576 projected.go:196] Error preparing data for projected volume kube-api-access-kmw9c for pod openshift-network-diagnostics/network-check-target-srkxv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:10:02.976767 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:02.976760 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb8f1a9f-2737-4a45-8507-997facd5c5fb-kube-api-access-kmw9c podName:bb8f1a9f-2737-4a45-8507-997facd5c5fb nodeName:}" failed. No retries permitted until 2026-07-17 18:10:18.976744616 +0000 UTC m=+34.250355746 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kmw9c" (UniqueName: "kubernetes.io/projected/bb8f1a9f-2737-4a45-8507-997facd5c5fb-kube-api-access-kmw9c") pod "network-check-target-srkxv" (UID: "bb8f1a9f-2737-4a45-8507-997facd5c5fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:10:03.180217 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:03.180181 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgr6m" Jul 17 18:10:03.180367 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:03.180181 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srkxv" Jul 17 18:10:03.180367 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:03.180278 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgr6m" podUID="31390317-6109-491f-8d6a-6530a57f25c2" Jul 17 18:10:03.180367 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:03.180361 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srkxv" podUID="bb8f1a9f-2737-4a45-8507-997facd5c5fb" Jul 17 18:10:03.180534 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:03.180186 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:10:03.180534 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:03.180437 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sg94" podUID="a0e11cff-8760-45ef-80a5-d966038cf469" Jul 17 18:10:05.180779 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:05.180743 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:10:05.181270 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:05.180841 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgr6m" Jul 17 18:10:05.181270 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:05.180856 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sg94" podUID="a0e11cff-8760-45ef-80a5-d966038cf469" Jul 17 18:10:05.181270 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:05.181001 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srkxv" Jul 17 18:10:05.181270 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:05.181002 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgr6m" podUID="31390317-6109-491f-8d6a-6530a57f25c2" Jul 17 18:10:05.181270 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:05.181098 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srkxv" podUID="bb8f1a9f-2737-4a45-8507-997facd5c5fb" Jul 17 18:10:07.180542 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:07.180069 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgr6m" Jul 17 18:10:07.180542 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:07.180070 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:10:07.180542 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:07.180205 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgr6m" podUID="31390317-6109-491f-8d6a-6530a57f25c2" Jul 17 18:10:07.180542 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:07.180299 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sg94" podUID="a0e11cff-8760-45ef-80a5-d966038cf469" Jul 17 18:10:07.180542 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:07.180364 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srkxv" Jul 17 18:10:07.180542 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:07.180437 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srkxv" podUID="bb8f1a9f-2737-4a45-8507-997facd5c5fb" Jul 17 18:10:07.258491 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:07.258256 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zb24" event={"ID":"b5ff5649-c98d-4586-a8b2-27e68c67fdca","Type":"ContainerStarted","Data":"3064a50f9e8a08ffafdc65de24e07cdf491781e4672f825490001ec01b6c78e0"} Jul 17 18:10:07.259928 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:07.259893 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhj7k" event={"ID":"edecfdc6-4c0a-4fa4-860a-5632fce0eba9","Type":"ContainerStarted","Data":"e8dedb5afd36bffa8062e6878aad6f4a8711e49e039b7638124bf734dc8ec75b"} Jul 17 18:10:07.261476 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:07.261447 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wrth6" event={"ID":"0d528ef6-e34a-4823-81d4-b9a0348c7edd","Type":"ContainerStarted","Data":"e95892c5604774b37d5f4065cfa80e5e4c57ee5821c1c1e4454e59eebf848646"} Jul 17 18:10:07.262987 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:07.262933 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hpwk9" event={"ID":"780d0c42-753a-4fd5-96d3-8a6fd8177494","Type":"ContainerStarted","Data":"6599388f5e51a850be9867c8416a6b245576808b287eaa0e07cec45f683a200e"} Jul 17 18:10:07.264590 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:07.264560 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-klj72" event={"ID":"7451bfe9-39fa-4a5f-9358-f05ee2836298","Type":"ContainerStarted","Data":"5f56fd3769da4f3d7554a3cc89495bae79106a44cc960bff68b3dd3895bb2953"} Jul 17 18:10:07.266204 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:07.266165 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lv9fl" event={"ID":"ddb5f6e9-3b9b-4087-8196-b55e879f7c62","Type":"ContainerStarted","Data":"6c9d834a22a230dd0ea49c07848ae46b10a0953cadab326606adf1d132d2474b"} Jul 17 18:10:07.267628 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:07.267605 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5hrpr" event={"ID":"d74aab62-4360-4e21-9d51-57f2a63da3c4","Type":"ContainerStarted","Data":"a0e7f607cbcb7397dcd7b085088ad1652a1ebc3a349e416db092304e7178ec21"} Jul 17 18:10:07.279388 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:07.279350 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal" podStartSLOduration=20.27933808 podStartE2EDuration="20.27933808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:09:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:09:51.2441196 +0000 UTC m=+6.517730748" watchObservedRunningTime="2026-07-17 18:10:07.27933808 +0000 UTC m=+22.552949224" Jul 17 18:10:07.296368 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:07.296331 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wrth6" podStartSLOduration=1.6740465260000001 podStartE2EDuration="21.29631679s" totalImagesPullingTime="19.622270264s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:09:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:10:07.29532658 +0000 UTC m=+22.568937721" watchObservedRunningTime="2026-07-17 18:10:07.29631679 +0000 UTC m=+22.569927931" Jul 17 18:10:07.309447 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:07.309396 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5hrpr" podStartSLOduration=9.897923452 podStartE2EDuration="21.309376264s" totalImagesPullingTime="11.411452812s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:09:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:10:07.308324166 +0000 UTC m=+22.581935318" watchObservedRunningTime="2026-07-17 18:10:07.309376264 +0000 UTC m=+22.582987407" Jul 17 18:10:07.322902 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:07.322861 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lv9fl" podStartSLOduration=9.865586514 podStartE2EDuration="21.322846351s" totalImagesPullingTime="11.457259837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:09:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:10:07.322423457 +0000 UTC m=+22.596034598" watchObservedRunningTime="2026-07-17 18:10:07.322846351 +0000 UTC m=+22.596457506" Jul 17 18:10:07.371018 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:07.370950 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-klj72" podStartSLOduration=1.784825289 podStartE2EDuration="21.370933683s" totalImagesPullingTime="19.586108394s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:09:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:10:07.338429715 +0000 UTC m=+22.612040856" watchObservedRunningTime="2026-07-17 18:10:07.370933683 +0000 UTC m=+22.644544819" Jul 17 18:10:07.371205 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:07.371176 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hpwk9" podStartSLOduration=9.967570041 podStartE2EDuration="21.371164624s" totalImagesPullingTime="11.403594583s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:09:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:10:07.371094068 +0000 UTC m=+22.644705196" watchObservedRunningTime="2026-07-17 18:10:07.371164624 +0000 UTC m=+22.644775767" Jul 17 18:10:08.270942 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:08.270885 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xmmdk" event={"ID":"690f5d91-c2cf-477a-9097-c594fc754625","Type":"ContainerStarted","Data":"549fbe195414001b059e16f86511f2704845209660c21594a28565b7a412eaa0"} Jul 17 18:10:08.272204 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:08.272180 2576 generic.go:356] "Generic (PLEG): container finished" podID="b5ff5649-c98d-4586-a8b2-27e68c67fdca" containerID="3064a50f9e8a08ffafdc65de24e07cdf491781e4672f825490001ec01b6c78e0" exitCode=0 Jul 17 18:10:08.272296 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:08.272268 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zb24" event={"ID":"b5ff5649-c98d-4586-a8b2-27e68c67fdca","Type":"ContainerDied","Data":"3064a50f9e8a08ffafdc65de24e07cdf491781e4672f825490001ec01b6c78e0"} Jul 17 18:10:08.275041 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:08.275025 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6pqqj_a67c7573-deca-4960-b69f-5ad3bda075a8/ovn-acl-logging/0.log" Jul 17 18:10:08.275372 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:08.275354 2576 generic.go:356] "Generic (PLEG): container finished" podID="a67c7573-deca-4960-b69f-5ad3bda075a8" containerID="b03505796283d6b50ab14cbd4493dda85903343bb938d49845954a7ed431f251" exitCode=1 Jul 17 18:10:08.275480 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:08.275451 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" event={"ID":"a67c7573-deca-4960-b69f-5ad3bda075a8","Type":"ContainerStarted","Data":"4dcff3f614b2cc40f55ab68192001e971faf7b023c8617d1311f14c5f9be78bd"} Jul 17 18:10:08.275551 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:08.275532 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" event={"ID":"a67c7573-deca-4960-b69f-5ad3bda075a8","Type":"ContainerStarted","Data":"f3662017a751a351455f08a6d5aaef7232bf3ccba9404d4b89ae54f8ee9eecfa"} Jul 17 18:10:08.275591 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:08.275581 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" event={"ID":"a67c7573-deca-4960-b69f-5ad3bda075a8","Type":"ContainerStarted","Data":"c5293c677ad1e259d9c6953ca7b8086ed39baec6bc3a72405ff09435adb7f004"} Jul 17 18:10:08.275638 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:08.275627 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" event={"ID":"a67c7573-deca-4960-b69f-5ad3bda075a8","Type":"ContainerStarted","Data":"eee0ae643ef0bd6b0602331e27eb08613ad6c94765c588c2f674fa8f7b041946"} Jul 17 18:10:08.275687 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:08.275676 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" event={"ID":"a67c7573-deca-4960-b69f-5ad3bda075a8","Type":"ContainerDied","Data":"b03505796283d6b50ab14cbd4493dda85903343bb938d49845954a7ed431f251"} Jul 17 18:10:08.275736 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:08.275724 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" event={"ID":"a67c7573-deca-4960-b69f-5ad3bda075a8","Type":"ContainerStarted","Data":"3ab447dd67c37c557e0bba77f0a2e0d47116d6ad64eb87f84ab0d426ae8fc5d3"} Jul 17 18:10:08.568534 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:08.568509 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 17 18:10:09.103584 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:09.103470 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T18:10:08.568526839Z","UUID":"1073cf19-fc4d-4d21-b9e5-bf5761f3c68e","Handler":null,"Name":"","Endpoint":""} Jul 17 18:10:09.104849 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:09.104828 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 17 18:10:09.104956 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:09.104865 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 17 18:10:09.180575 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:09.180550 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srkxv" Jul 17 18:10:09.180716 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:09.180549 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgr6m" Jul 17 18:10:09.180716 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:09.180658 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srkxv" podUID="bb8f1a9f-2737-4a45-8507-997facd5c5fb" Jul 17 18:10:09.180833 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:09.180756 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgr6m" podUID="31390317-6109-491f-8d6a-6530a57f25c2" Jul 17 18:10:09.180833 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:09.180559 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:10:09.180936 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:09.180846 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sg94" podUID="a0e11cff-8760-45ef-80a5-d966038cf469" Jul 17 18:10:09.279730 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:09.279692 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhj7k" event={"ID":"edecfdc6-4c0a-4fa4-860a-5632fce0eba9","Type":"ContainerStarted","Data":"2b727e3106d59d5ed080d73272f36716f6146583881d012f39bb8ded21feed50"} Jul 17 18:10:09.293236 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:09.293183 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xmmdk" podStartSLOduration=11.82731897 podStartE2EDuration="23.293166424s" totalImagesPullingTime="11.465847454s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:09:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:10:09.293071326 +0000 UTC m=+24.566682467" watchObservedRunningTime="2026-07-17 18:10:09.293166424 +0000 UTC m=+24.566777566" Jul 17 18:10:09.488801 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:09.488734 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lv9fl" Jul 17 18:10:09.489373 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:09.489340 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lv9fl" Jul 17 18:10:10.284907 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:10.284697 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6pqqj_a67c7573-deca-4960-b69f-5ad3bda075a8/ovn-acl-logging/0.log" Jul 17 18:10:10.285325 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:10.285295 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" event={"ID":"a67c7573-deca-4960-b69f-5ad3bda075a8","Type":"ContainerStarted","Data":"d361a8cbd3233113cb4e419fc621315130c0cb26b7b6f556e19755dfdf224ead"} Jul 17 18:10:10.287444 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:10.287418 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhj7k" event={"ID":"edecfdc6-4c0a-4fa4-860a-5632fce0eba9","Type":"ContainerStarted","Data":"e986cc7e043b6a897270b70d665c001c8ab980a8af06eeaf46ba9eafd254df7c"} Jul 17 18:10:10.287693 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:10.287669 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lv9fl" Jul 17 18:10:10.288562 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:10.288546 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lv9fl" Jul 17 18:10:10.303189 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:10.303152 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhj7k" podStartSLOduration=10.077297965 podStartE2EDuration="24.303141292s" totalImagesPullingTime="14.225843327s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:09:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:10:10.303003791 +0000 UTC m=+25.576614927" watchObservedRunningTime="2026-07-17 18:10:10.303141292 +0000 UTC m=+25.576752434" Jul 17 18:10:11.180787 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:11.180749 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgr6m" Jul 17 18:10:11.180787 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:11.180765 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srkxv" Jul 17 18:10:11.181099 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:11.180803 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:10:11.181099 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:11.180868 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgr6m" podUID="31390317-6109-491f-8d6a-6530a57f25c2" Jul 17 18:10:11.181099 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:11.181013 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srkxv" podUID="bb8f1a9f-2737-4a45-8507-997facd5c5fb" Jul 17 18:10:11.181099 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:11.181083 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sg94" podUID="a0e11cff-8760-45ef-80a5-d966038cf469" Jul 17 18:10:13.179986 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:13.179954 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:10:13.180598 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:13.179958 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgr6m" Jul 17 18:10:13.180598 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:13.180076 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sg94" podUID="a0e11cff-8760-45ef-80a5-d966038cf469" Jul 17 18:10:13.180598 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:13.180109 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srkxv" Jul 17 18:10:13.180598 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:13.180213 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgr6m" podUID="31390317-6109-491f-8d6a-6530a57f25c2" Jul 17 18:10:13.180598 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:13.180293 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srkxv" podUID="bb8f1a9f-2737-4a45-8507-997facd5c5fb" Jul 17 18:10:14.297288 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:14.297108 2576 generic.go:356] "Generic (PLEG): container finished" podID="b5ff5649-c98d-4586-a8b2-27e68c67fdca" containerID="4bfd3f0ed556c367c8aa328f736b52a47abb3de7551ff1c4c752cc5e98b63d83" exitCode=0 Jul 17 18:10:14.297938 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:14.297184 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zb24" event={"ID":"b5ff5649-c98d-4586-a8b2-27e68c67fdca","Type":"ContainerDied","Data":"4bfd3f0ed556c367c8aa328f736b52a47abb3de7551ff1c4c752cc5e98b63d83"} Jul 17 18:10:14.300771 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:14.300753 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6pqqj_a67c7573-deca-4960-b69f-5ad3bda075a8/ovn-acl-logging/0.log" Jul 17 18:10:14.301130 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:14.301109 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" event={"ID":"a67c7573-deca-4960-b69f-5ad3bda075a8","Type":"ContainerStarted","Data":"186fb51eb845196120046dd4cef51cea420227691b9bcc3b9b6c356651839409"} Jul 17 18:10:14.301376 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:14.301359 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:10:14.301446 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:14.301420 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:10:14.301505 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:14.301468 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:10:14.301505 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:14.301482 2576 scope.go:117] "RemoveContainer" containerID="b03505796283d6b50ab14cbd4493dda85903343bb938d49845954a7ed431f251" Jul 17 18:10:14.315838 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:14.315820 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:10:14.316562 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:14.316548 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:10:15.182068 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:15.182037 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srkxv" Jul 17 18:10:15.182328 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:15.182037 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgr6m" Jul 17 18:10:15.182328 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:15.182141 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srkxv" podUID="bb8f1a9f-2737-4a45-8507-997facd5c5fb" Jul 17 18:10:15.182328 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:15.182164 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:10:15.182328 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:15.182238 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgr6m" podUID="31390317-6109-491f-8d6a-6530a57f25c2" Jul 17 18:10:15.182328 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:15.182308 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sg94" podUID="a0e11cff-8760-45ef-80a5-d966038cf469" Jul 17 18:10:15.305416 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:15.305388 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zb24" event={"ID":"b5ff5649-c98d-4586-a8b2-27e68c67fdca","Type":"ContainerStarted","Data":"a60f3a8490092b6c7d126c8c03d8ee12959c17c2839ed0385daad7f353ad0ccf"} Jul 17 18:10:15.309060 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:15.309041 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6pqqj_a67c7573-deca-4960-b69f-5ad3bda075a8/ovn-acl-logging/0.log" Jul 17 18:10:15.309440 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:15.309411 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" event={"ID":"a67c7573-deca-4960-b69f-5ad3bda075a8","Type":"ContainerStarted","Data":"0c9d0012b20c11b8f7650fc2c5452892cf1df088038cbd5de4e18e6586b63232"} Jul 17 18:10:15.357181 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:15.357143 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" podStartSLOduration=9.47242506 podStartE2EDuration="29.357127666s" totalImagesPullingTime="19.884702606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:09:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:10:15.356491069 +0000 UTC m=+30.630102212" watchObservedRunningTime="2026-07-17 18:10:15.357127666 +0000 UTC m=+30.630738809" Jul 17 18:10:15.611608 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:15.611584 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fgr6m"] Jul 17 18:10:15.611726 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:15.611702 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgr6m" Jul 17 18:10:15.611808 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:15.611777 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgr6m" podUID="31390317-6109-491f-8d6a-6530a57f25c2" Jul 17 18:10:15.615246 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:15.615223 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-srkxv"] Jul 17 18:10:15.615331 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:15.615311 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srkxv" Jul 17 18:10:15.615407 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:15.615387 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srkxv" podUID="bb8f1a9f-2737-4a45-8507-997facd5c5fb" Jul 17 18:10:15.615891 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:15.615872 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9sg94"] Jul 17 18:10:15.615972 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:15.615960 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:10:15.616061 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:15.616043 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sg94" podUID="a0e11cff-8760-45ef-80a5-d966038cf469" Jul 17 18:10:16.314605 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:16.314472 2576 generic.go:356] "Generic (PLEG): container finished" podID="b5ff5649-c98d-4586-a8b2-27e68c67fdca" containerID="a60f3a8490092b6c7d126c8c03d8ee12959c17c2839ed0385daad7f353ad0ccf" exitCode=0 Jul 17 18:10:16.314605 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:16.314510 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zb24" event={"ID":"b5ff5649-c98d-4586-a8b2-27e68c67fdca","Type":"ContainerDied","Data":"a60f3a8490092b6c7d126c8c03d8ee12959c17c2839ed0385daad7f353ad0ccf"} Jul 17 18:10:17.180432 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:17.180271 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srkxv" Jul 17 18:10:17.180583 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:17.180271 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgr6m" Jul 17 18:10:17.180583 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:17.180500 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srkxv" podUID="bb8f1a9f-2737-4a45-8507-997facd5c5fb" Jul 17 18:10:17.180583 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:17.180276 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:10:17.180732 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:17.180577 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgr6m" podUID="31390317-6109-491f-8d6a-6530a57f25c2" Jul 17 18:10:17.180732 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:17.180677 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sg94" podUID="a0e11cff-8760-45ef-80a5-d966038cf469" Jul 17 18:10:18.323783 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:18.323752 2576 generic.go:356] "Generic (PLEG): container finished" podID="b5ff5649-c98d-4586-a8b2-27e68c67fdca" containerID="10796c6b23f53f7d7338d82df2ca25df773ee5301076c367a00ae68e1ee29578" exitCode=0 Jul 17 18:10:18.324183 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:18.323815 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zb24" event={"ID":"b5ff5649-c98d-4586-a8b2-27e68c67fdca","Type":"ContainerDied","Data":"10796c6b23f53f7d7338d82df2ca25df773ee5301076c367a00ae68e1ee29578"} Jul 17 18:10:18.803867 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:18.803836 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31390317-6109-491f-8d6a-6530a57f25c2-metrics-certs\") pod \"network-metrics-daemon-fgr6m\" (UID: \"31390317-6109-491f-8d6a-6530a57f25c2\") " pod="openshift-multus/network-metrics-daemon-fgr6m" Jul 17 18:10:18.803996 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:18.803962 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:10:18.804035 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:18.804027 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31390317-6109-491f-8d6a-6530a57f25c2-metrics-certs podName:31390317-6109-491f-8d6a-6530a57f25c2 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:50.804014509 +0000 UTC m=+66.077625629 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31390317-6109-491f-8d6a-6530a57f25c2-metrics-certs") pod "network-metrics-daemon-fgr6m" (UID: "31390317-6109-491f-8d6a-6530a57f25c2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 18:10:18.904805 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:18.904777 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0e11cff-8760-45ef-80a5-d966038cf469-original-pull-secret\") pod \"global-pull-secret-syncer-9sg94\" (UID: \"a0e11cff-8760-45ef-80a5-d966038cf469\") " pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:10:18.904925 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:18.904893 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 18:10:18.905002 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:18.904955 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0e11cff-8760-45ef-80a5-d966038cf469-original-pull-secret podName:a0e11cff-8760-45ef-80a5-d966038cf469 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:50.904938235 +0000 UTC m=+66.178549357 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0e11cff-8760-45ef-80a5-d966038cf469-original-pull-secret") pod "global-pull-secret-syncer-9sg94" (UID: "a0e11cff-8760-45ef-80a5-d966038cf469") : object "kube-system"/"original-pull-secret" not registered Jul 17 18:10:19.005564 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:19.005533 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmw9c\" (UniqueName: \"kubernetes.io/projected/bb8f1a9f-2737-4a45-8507-997facd5c5fb-kube-api-access-kmw9c\") pod \"network-check-target-srkxv\" (UID: \"bb8f1a9f-2737-4a45-8507-997facd5c5fb\") " pod="openshift-network-diagnostics/network-check-target-srkxv" Jul 17 18:10:19.005725 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:19.005705 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 18:10:19.005845 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:19.005736 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 18:10:19.005845 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:19.005749 2576 projected.go:196] Error preparing data for projected volume kube-api-access-kmw9c for pod openshift-network-diagnostics/network-check-target-srkxv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:10:19.005845 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:19.005810 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb8f1a9f-2737-4a45-8507-997facd5c5fb-kube-api-access-kmw9c podName:bb8f1a9f-2737-4a45-8507-997facd5c5fb nodeName:}" failed. No retries permitted until 2026-07-17 18:10:51.005789334 +0000 UTC m=+66.279400473 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kmw9c" (UniqueName: "kubernetes.io/projected/bb8f1a9f-2737-4a45-8507-997facd5c5fb-kube-api-access-kmw9c") pod "network-check-target-srkxv" (UID: "bb8f1a9f-2737-4a45-8507-997facd5c5fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 18:10:19.180520 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:19.180484 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgr6m" Jul 17 18:10:19.180655 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:19.180484 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:10:19.180655 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:19.180601 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fgr6m" podUID="31390317-6109-491f-8d6a-6530a57f25c2" Jul 17 18:10:19.180758 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:19.180484 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srkxv" Jul 17 18:10:19.180758 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:19.180689 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sg94" podUID="a0e11cff-8760-45ef-80a5-d966038cf469" Jul 17 18:10:19.180758 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:19.180746 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srkxv" podUID="bb8f1a9f-2737-4a45-8507-997facd5c5fb" Jul 17 18:10:21.063291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.063262 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeReady" Jul 17 18:10:21.063875 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.063364 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 17 18:10:21.097051 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.097023 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-l8njm"] Jul 17 18:10:21.101110 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.101084 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-jxfz9"] Jul 17 18:10:21.101746 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.101722 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-l8njm" Jul 17 18:10:21.103640 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.103619 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-khxtt\"" Jul 17 18:10:21.103857 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.103837 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 17 18:10:21.103989 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.103920 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 17 18:10:21.104928 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.104908 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6598fb4596-t7r2p"] Jul 17 18:10:21.105062 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.105043 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-jxfz9" Jul 17 18:10:21.107273 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.107253 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 17 18:10:21.107381 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.107258 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 17 18:10:21.107381 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.107299 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 17 18:10:21.107381 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.107262 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-6bmds\"" Jul 17 18:10:21.107727 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.107708 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 17 18:10:21.108918 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.108793 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-rsbql"] Jul 17 18:10:21.108918 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.108891 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:10:21.113214 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.112751 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-nwqlr"] Jul 17 18:10:21.113940 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.113745 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 17 18:10:21.113940 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.113777 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ksssl\"" Jul 17 18:10:21.113940 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.113842 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 17 18:10:21.114712 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.113924 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-rsbql" Jul 17 18:10:21.114712 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.114044 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 17 18:10:21.116912 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.116758 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 17 18:10:21.117051 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.117034 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 17 18:10:21.117201 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.117175 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-75v7p"] Jul 17 18:10:21.117354 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.117340 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-nwqlr" Jul 17 18:10:21.121349 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.121045 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 17 18:10:21.121349 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.121072 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 17 18:10:21.121349 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.121171 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qr485\"" Jul 17 18:10:21.123497 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.122608 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-l8njm"] Jul 17 18:10:21.123497 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.122714 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-75v7p" Jul 17 18:10:21.126468 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.126115 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-jxfz9"] Jul 17 18:10:21.127597 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.127545 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-rsbql"] Jul 17 18:10:21.129944 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.129882 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 17 18:10:21.131530 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.131513 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 17 18:10:21.131936 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.131918 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hghkd"] Jul 17 18:10:21.133142 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.133126 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 17 18:10:21.133247 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.133228 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 17 18:10:21.133444 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.133353 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 17 18:10:21.133444 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.133404 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 17 18:10:21.133724 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.133598 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 17 18:10:21.133724 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.133682 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-8qcz9\"" Jul 17 18:10:21.133948 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.133739 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-whdt8\"" Jul 17 18:10:21.133948 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.133803 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 17 18:10:21.134111 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.133961 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 17 18:10:21.134111 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.133999 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 17 18:10:21.135406 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.135387 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6g7gt"] Jul 17 18:10:21.135570 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.135553 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hghkd" Jul 17 18:10:21.138607 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.138587 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 17 18:10:21.138697 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.138605 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 17 18:10:21.138697 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.138629 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 17 18:10:21.138697 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.138606 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-b4h4w\"" Jul 17 18:10:21.139044 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.139025 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6b45f6d8d8-rp2wb"] Jul 17 18:10:21.139127 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.139092 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6g7gt" Jul 17 18:10:21.139288 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.139263 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 17 18:10:21.140904 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.140888 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 17 18:10:21.143924 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.143904 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-9bn2j"] Jul 17 18:10:21.145153 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.144056 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" Jul 17 18:10:21.147357 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.146787 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 17 18:10:21.147463 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.147402 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 17 18:10:21.147523 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.147506 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6598fb4596-t7r2p"] Jul 17 18:10:21.147578 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.147534 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-nwqlr"] Jul 17 18:10:21.147578 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.147560 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6g7gt"] Jul 17 18:10:21.147683 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.147583 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hghkd"] Jul 17 18:10:21.147683 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.147600 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-9bn2j"] Jul 17 18:10:21.147683 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.147620 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gx8nh"] Jul 17 18:10:21.147683 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.147639 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 17 18:10:21.147925 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.147838 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5wfbr\"" Jul 17 18:10:21.148120 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.148075 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-9bn2j" Jul 17 18:10:21.151251 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.151232 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 17 18:10:21.151441 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.151425 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 17 18:10:21.151511 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.151302 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 17 18:10:21.151567 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.151508 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 17 18:10:21.151615 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.151322 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 17 18:10:21.151615 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.151432 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vl9w9\"" Jul 17 18:10:21.151711 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.151198 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 17 18:10:21.151938 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.151919 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8jm6x"] Jul 17 18:10:21.152065 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.152049 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gx8nh" Jul 17 18:10:21.152820 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.152340 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-fkdn9\"" Jul 17 18:10:21.152820 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.152469 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 17 18:10:21.153023 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.152918 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 17 18:10:21.153961 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.153941 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 17 18:10:21.155538 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.155506 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b45f6d8d8-rp2wb"] Jul 17 18:10:21.155694 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.155652 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 17 18:10:21.155813 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.155734 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-75v7p"] Jul 17 18:10:21.155902 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.155829 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8jm6x" Jul 17 18:10:21.156170 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.156144 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 17 18:10:21.157142 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.157043 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7247w\"" Jul 17 18:10:21.158032 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.158013 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 17 18:10:21.158211 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.158192 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vkv2q\"" Jul 17 18:10:21.158280 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.158096 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 17 18:10:21.164391 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.164373 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gx8nh"] Jul 17 18:10:21.166026 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.166006 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8jm6x"] Jul 17 18:10:21.180125 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.180105 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:10:21.180261 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.180243 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srkxv" Jul 17 18:10:21.180542 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.180528 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgr6m" Jul 17 18:10:21.183153 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.183137 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 18:10:21.183254 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.183170 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 18:10:21.183254 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.183203 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-47jdr\"" Jul 17 18:10:21.183254 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.183138 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nj845\"" Jul 17 18:10:21.221157 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.221135 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-779tp\" (UniqueName: \"kubernetes.io/projected/f102d994-82b5-4785-ac0e-04453f06bab6-kube-api-access-779tp\") pod \"cluster-samples-operator-79b7c55f87-6g7gt\" (UID: \"f102d994-82b5-4785-ac0e-04453f06bab6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6g7gt" Jul 17 18:10:21.221249 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.221171 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a24dfc7c-8415-4449-908f-4376cf8c694c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-rsbql\" (UID: \"a24dfc7c-8415-4449-908f-4376cf8c694c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-rsbql" Jul 17 18:10:21.221249 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.221196 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/52639dcf-cedf-46de-a944-316eac2db0a8-config\") pod \"service-ca-operator-5bcbc94c78-75v7p\" (UID: \"52639dcf-cedf-46de-a944-316eac2db0a8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-75v7p" Jul 17 18:10:21.221249 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.221215 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-trusted-ca\") pod \"image-registry-6598fb4596-t7r2p\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:10:21.221249 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.221239 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-installation-pull-secrets\") pod \"image-registry-6598fb4596-t7r2p\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:10:21.221420 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.221309 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/490303ef-c958-4260-84ee-1852150aae55-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-hghkd\" (UID: \"490303ef-c958-4260-84ee-1852150aae55\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hghkd" Jul 17 18:10:21.221420 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.221384 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e82b2034-7625-41a9-a5f0-cec5b7605b5c-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-jxfz9\" (UID: \"e82b2034-7625-41a9-a5f0-cec5b7605b5c\") " pod="openshift-insights/insights-operator-555d9d7885-jxfz9" Jul 17 18:10:21.221420 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.221414 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e82b2034-7625-41a9-a5f0-cec5b7605b5c-serving-cert\") pod \"insights-operator-555d9d7885-jxfz9\" (UID: \"e82b2034-7625-41a9-a5f0-cec5b7605b5c\") " pod="openshift-insights/insights-operator-555d9d7885-jxfz9" Jul 17 18:10:21.221537 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.221439 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-registry-certificates\") pod \"image-registry-6598fb4596-t7r2p\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:10:21.221537 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.221463 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-stats-auth\") pod \"router-default-6b45f6d8d8-rp2wb\" (UID: \"ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27\") " pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" Jul 17 18:10:21.221537 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.221486 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-image-registry-private-configuration\") pod \"image-registry-6598fb4596-t7r2p\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:10:21.221537 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.221520 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e82b2034-7625-41a9-a5f0-cec5b7605b5c-snapshots\") pod \"insights-operator-555d9d7885-jxfz9\" (UID: \"e82b2034-7625-41a9-a5f0-cec5b7605b5c\") " pod="openshift-insights/insights-operator-555d9d7885-jxfz9" Jul 17 18:10:21.221708 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.221542 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e82b2034-7625-41a9-a5f0-cec5b7605b5c-tmp\") pod \"insights-operator-555d9d7885-jxfz9\" (UID: \"e82b2034-7625-41a9-a5f0-cec5b7605b5c\") " pod="openshift-insights/insights-operator-555d9d7885-jxfz9" Jul 17 18:10:21.221708 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.221563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8vbs\" (UniqueName: \"kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-kube-api-access-t8vbs\") pod \"image-registry-6598fb4596-t7r2p\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:10:21.221708 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.221577 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-registry-tls\") pod \"image-registry-6598fb4596-t7r2p\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:10:21.221708 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.221600 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c6017e7d-5ed2-4d7d-ba64-ba9ce933828f-trusted-ca\") pod \"console-operator-565b7b569d-nwqlr\" (UID: \"c6017e7d-5ed2-4d7d-ba64-ba9ce933828f\") " pod="openshift-console-operator/console-operator-565b7b569d-nwqlr" Jul 17 18:10:21.221708 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.221624 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t47lz\" (UniqueName: \"kubernetes.io/projected/c6017e7d-5ed2-4d7d-ba64-ba9ce933828f-kube-api-access-t47lz\") pod \"console-operator-565b7b569d-nwqlr\" (UID: \"c6017e7d-5ed2-4d7d-ba64-ba9ce933828f\") " pod="openshift-console-operator/console-operator-565b7b569d-nwqlr" Jul 17 18:10:21.221708 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.221649 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f102d994-82b5-4785-ac0e-04453f06bab6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-6g7gt\" (UID: \"f102d994-82b5-4785-ac0e-04453f06bab6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6g7gt" Jul 17 18:10:21.221708 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.221679 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c6017e7d-5ed2-4d7d-ba64-ba9ce933828f-config\") pod \"console-operator-565b7b569d-nwqlr\" (UID: \"c6017e7d-5ed2-4d7d-ba64-ba9ce933828f\") " pod="openshift-console-operator/console-operator-565b7b569d-nwqlr" Jul 17 18:10:21.221708 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.221696 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/490303ef-c958-4260-84ee-1852150aae55-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-hghkd\" (UID: \"490303ef-c958-4260-84ee-1852150aae55\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hghkd" Jul 17 18:10:21.222077 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.221718 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-service-ca-bundle\") pod \"router-default-6b45f6d8d8-rp2wb\" (UID: \"ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27\") " pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" Jul 17 18:10:21.222077 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.221744 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c6017e7d-5ed2-4d7d-ba64-ba9ce933828f-serving-cert\") pod \"console-operator-565b7b569d-nwqlr\" (UID: \"c6017e7d-5ed2-4d7d-ba64-ba9ce933828f\") " pod="openshift-console-operator/console-operator-565b7b569d-nwqlr" Jul 17 18:10:21.222077 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.221766 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e82b2034-7625-41a9-a5f0-cec5b7605b5c-service-ca-bundle\") pod \"insights-operator-555d9d7885-jxfz9\" (UID: \"e82b2034-7625-41a9-a5f0-cec5b7605b5c\") " pod="openshift-insights/insights-operator-555d9d7885-jxfz9" Jul 17 18:10:21.222077 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.221789 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr7kw\" (UniqueName: \"kubernetes.io/projected/52639dcf-cedf-46de-a944-316eac2db0a8-kube-api-access-vr7kw\") pod \"service-ca-operator-5bcbc94c78-75v7p\" (UID: \"52639dcf-cedf-46de-a944-316eac2db0a8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-75v7p" Jul 17 18:10:21.222077 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.221817 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a24dfc7c-8415-4449-908f-4376cf8c694c-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-rsbql\" (UID: \"a24dfc7c-8415-4449-908f-4376cf8c694c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-rsbql" Jul 17 18:10:21.222077 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.221850 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prvj4\" (UniqueName: \"kubernetes.io/projected/a24dfc7c-8415-4449-908f-4376cf8c694c-kube-api-access-prvj4\") pod \"cluster-monitoring-operator-76cf8966f8-rsbql\" (UID: \"a24dfc7c-8415-4449-908f-4376cf8c694c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-rsbql" Jul 17 18:10:21.222077 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.221890 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzg47\" (UniqueName: \"kubernetes.io/projected/490303ef-c958-4260-84ee-1852150aae55-kube-api-access-vzg47\") pod \"kube-storage-version-migrator-operator-7658d9b749-hghkd\" (UID: \"490303ef-c958-4260-84ee-1852150aae55\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hghkd" Jul 17 18:10:21.222077 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.221930 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/52639dcf-cedf-46de-a944-316eac2db0a8-serving-cert\") pod \"service-ca-operator-5bcbc94c78-75v7p\" (UID: \"52639dcf-cedf-46de-a944-316eac2db0a8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-75v7p" Jul 17 18:10:21.222077 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.221970 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-default-certificate\") pod \"router-default-6b45f6d8d8-rp2wb\" (UID: \"ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27\") " pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" Jul 17 18:10:21.222077 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.222027 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-metrics-certs\") pod \"router-default-6b45f6d8d8-rp2wb\" (UID: \"ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27\") " pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" Jul 17 18:10:21.222468 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.222086 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2pss\" (UniqueName: \"kubernetes.io/projected/0d37e971-7201-4f9b-a44c-e79ba57d5baa-kube-api-access-m2pss\") pod \"volume-data-source-validator-78cf4c6f6-l8njm\" (UID: \"0d37e971-7201-4f9b-a44c-e79ba57d5baa\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-l8njm" Jul 17 18:10:21.222468 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.222105 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-ca-trust-extracted\") pod \"image-registry-6598fb4596-t7r2p\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:10:21.222468 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.222125 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpmpc\" (UniqueName: \"kubernetes.io/projected/e82b2034-7625-41a9-a5f0-cec5b7605b5c-kube-api-access-dpmpc\") pod \"insights-operator-555d9d7885-jxfz9\" (UID: \"e82b2034-7625-41a9-a5f0-cec5b7605b5c\") " pod="openshift-insights/insights-operator-555d9d7885-jxfz9" Jul 17 18:10:21.222468 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.222140 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-bound-sa-token\") pod \"image-registry-6598fb4596-t7r2p\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:10:21.222468 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.222154 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9drh\" (UniqueName: \"kubernetes.io/projected/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-kube-api-access-b9drh\") pod \"router-default-6b45f6d8d8-rp2wb\" (UID: \"ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27\") " pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" Jul 17 18:10:21.322792 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.322735 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e82b2034-7625-41a9-a5f0-cec5b7605b5c-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-jxfz9\" (UID: \"e82b2034-7625-41a9-a5f0-cec5b7605b5c\") " pod="openshift-insights/insights-operator-555d9d7885-jxfz9" Jul 17 18:10:21.322792 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.322767 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e82b2034-7625-41a9-a5f0-cec5b7605b5c-serving-cert\") pod \"insights-operator-555d9d7885-jxfz9\" (UID: \"e82b2034-7625-41a9-a5f0-cec5b7605b5c\") " pod="openshift-insights/insights-operator-555d9d7885-jxfz9" Jul 17 18:10:21.322951 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.322793 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-registry-certificates\") pod \"image-registry-6598fb4596-t7r2p\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:10:21.322951 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.322817 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-stats-auth\") pod \"router-default-6b45f6d8d8-rp2wb\" (UID: \"ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27\") " pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" Jul 17 18:10:21.322951 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.322839 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-image-registry-private-configuration\") pod \"image-registry-6598fb4596-t7r2p\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:10:21.322951 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.322864 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e82b2034-7625-41a9-a5f0-cec5b7605b5c-snapshots\") pod \"insights-operator-555d9d7885-jxfz9\" (UID: \"e82b2034-7625-41a9-a5f0-cec5b7605b5c\") " pod="openshift-insights/insights-operator-555d9d7885-jxfz9" Jul 17 18:10:21.322951 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.322886 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e82b2034-7625-41a9-a5f0-cec5b7605b5c-tmp\") pod \"insights-operator-555d9d7885-jxfz9\" (UID: \"e82b2034-7625-41a9-a5f0-cec5b7605b5c\") " pod="openshift-insights/insights-operator-555d9d7885-jxfz9" Jul 17 18:10:21.322951 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.322908 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8vbs\" (UniqueName: \"kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-kube-api-access-t8vbs\") pod \"image-registry-6598fb4596-t7r2p\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:10:21.322951 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.322936 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm7v4\" (UniqueName: \"kubernetes.io/projected/852a630b-6cf7-4355-ae0b-49347eb3c4e1-kube-api-access-xm7v4\") pod \"dns-default-8jm6x\" (UID: \"852a630b-6cf7-4355-ae0b-49347eb3c4e1\") " pod="openshift-dns/dns-default-8jm6x" Jul 17 18:10:21.323304 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.322960 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-registry-tls\") pod \"image-registry-6598fb4596-t7r2p\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:10:21.323304 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323005 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c6017e7d-5ed2-4d7d-ba64-ba9ce933828f-trusted-ca\") pod \"console-operator-565b7b569d-nwqlr\" (UID: \"c6017e7d-5ed2-4d7d-ba64-ba9ce933828f\") " pod="openshift-console-operator/console-operator-565b7b569d-nwqlr" Jul 17 18:10:21.323304 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323033 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t47lz\" (UniqueName: \"kubernetes.io/projected/c6017e7d-5ed2-4d7d-ba64-ba9ce933828f-kube-api-access-t47lz\") pod \"console-operator-565b7b569d-nwqlr\" (UID: \"c6017e7d-5ed2-4d7d-ba64-ba9ce933828f\") " pod="openshift-console-operator/console-operator-565b7b569d-nwqlr" Jul 17 18:10:21.323304 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323074 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f102d994-82b5-4785-ac0e-04453f06bab6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-6g7gt\" (UID: \"f102d994-82b5-4785-ac0e-04453f06bab6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6g7gt" Jul 17 18:10:21.323304 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323108 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtm6m\" (UniqueName: \"kubernetes.io/projected/86296674-d8de-4f65-9729-3dc6cbf134a2-kube-api-access-qtm6m\") pod \"network-check-source-7bc5b6bf85-9bn2j\" (UID: \"86296674-d8de-4f65-9729-3dc6cbf134a2\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-9bn2j" Jul 17 18:10:21.323304 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323140 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c6017e7d-5ed2-4d7d-ba64-ba9ce933828f-config\") pod \"console-operator-565b7b569d-nwqlr\" (UID: \"c6017e7d-5ed2-4d7d-ba64-ba9ce933828f\") " pod="openshift-console-operator/console-operator-565b7b569d-nwqlr" Jul 17 18:10:21.323304 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323167 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/490303ef-c958-4260-84ee-1852150aae55-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-hghkd\" (UID: \"490303ef-c958-4260-84ee-1852150aae55\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hghkd" Jul 17 18:10:21.323304 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323193 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-service-ca-bundle\") pod \"router-default-6b45f6d8d8-rp2wb\" (UID: \"ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27\") " pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" Jul 17 18:10:21.323304 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323218 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/852a630b-6cf7-4355-ae0b-49347eb3c4e1-config-volume\") pod \"dns-default-8jm6x\" (UID: \"852a630b-6cf7-4355-ae0b-49347eb3c4e1\") " pod="openshift-dns/dns-default-8jm6x" Jul 17 18:10:21.323304 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323247 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c6017e7d-5ed2-4d7d-ba64-ba9ce933828f-serving-cert\") pod \"console-operator-565b7b569d-nwqlr\" (UID: \"c6017e7d-5ed2-4d7d-ba64-ba9ce933828f\") " pod="openshift-console-operator/console-operator-565b7b569d-nwqlr" Jul 17 18:10:21.323304 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323288 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e82b2034-7625-41a9-a5f0-cec5b7605b5c-service-ca-bundle\") pod \"insights-operator-555d9d7885-jxfz9\" (UID: \"e82b2034-7625-41a9-a5f0-cec5b7605b5c\") " pod="openshift-insights/insights-operator-555d9d7885-jxfz9" Jul 17 18:10:21.323784 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323312 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/852a630b-6cf7-4355-ae0b-49347eb3c4e1-tmp-dir\") pod \"dns-default-8jm6x\" (UID: \"852a630b-6cf7-4355-ae0b-49347eb3c4e1\") " pod="openshift-dns/dns-default-8jm6x" Jul 17 18:10:21.323784 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323340 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr7kw\" (UniqueName: \"kubernetes.io/projected/52639dcf-cedf-46de-a944-316eac2db0a8-kube-api-access-vr7kw\") pod \"service-ca-operator-5bcbc94c78-75v7p\" (UID: \"52639dcf-cedf-46de-a944-316eac2db0a8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-75v7p" Jul 17 18:10:21.323784 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323371 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a24dfc7c-8415-4449-908f-4376cf8c694c-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-rsbql\" (UID: \"a24dfc7c-8415-4449-908f-4376cf8c694c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-rsbql" Jul 17 18:10:21.323784 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323399 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prvj4\" (UniqueName: \"kubernetes.io/projected/a24dfc7c-8415-4449-908f-4376cf8c694c-kube-api-access-prvj4\") pod \"cluster-monitoring-operator-76cf8966f8-rsbql\" (UID: \"a24dfc7c-8415-4449-908f-4376cf8c694c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-rsbql" Jul 17 18:10:21.323784 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323422 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-registry-certificates\") pod \"image-registry-6598fb4596-t7r2p\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:10:21.323784 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323440 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzg47\" (UniqueName: \"kubernetes.io/projected/490303ef-c958-4260-84ee-1852150aae55-kube-api-access-vzg47\") pod \"kube-storage-version-migrator-operator-7658d9b749-hghkd\" (UID: \"490303ef-c958-4260-84ee-1852150aae55\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hghkd" Jul 17 18:10:21.323784 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323511 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/52639dcf-cedf-46de-a944-316eac2db0a8-serving-cert\") pod \"service-ca-operator-5bcbc94c78-75v7p\" (UID: \"52639dcf-cedf-46de-a944-316eac2db0a8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-75v7p" Jul 17 18:10:21.323784 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323535 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-default-certificate\") pod \"router-default-6b45f6d8d8-rp2wb\" (UID: \"ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27\") " pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" Jul 17 18:10:21.323784 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323560 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-metrics-certs\") pod \"router-default-6b45f6d8d8-rp2wb\" (UID: \"ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27\") " pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" Jul 17 18:10:21.323784 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323600 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2pss\" (UniqueName: \"kubernetes.io/projected/0d37e971-7201-4f9b-a44c-e79ba57d5baa-kube-api-access-m2pss\") pod \"volume-data-source-validator-78cf4c6f6-l8njm\" (UID: \"0d37e971-7201-4f9b-a44c-e79ba57d5baa\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-l8njm" Jul 17 18:10:21.323784 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323631 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-ca-trust-extracted\") pod \"image-registry-6598fb4596-t7r2p\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:10:21.323784 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323654 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e82b2034-7625-41a9-a5f0-cec5b7605b5c-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-jxfz9\" (UID: \"e82b2034-7625-41a9-a5f0-cec5b7605b5c\") " pod="openshift-insights/insights-operator-555d9d7885-jxfz9" Jul 17 18:10:21.323784 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323668 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpmpc\" (UniqueName: \"kubernetes.io/projected/e82b2034-7625-41a9-a5f0-cec5b7605b5c-kube-api-access-dpmpc\") pod \"insights-operator-555d9d7885-jxfz9\" (UID: \"e82b2034-7625-41a9-a5f0-cec5b7605b5c\") " pod="openshift-insights/insights-operator-555d9d7885-jxfz9" Jul 17 18:10:21.323784 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323692 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-bound-sa-token\") pod \"image-registry-6598fb4596-t7r2p\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:10:21.323784 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323716 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9drh\" (UniqueName: \"kubernetes.io/projected/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-kube-api-access-b9drh\") pod \"router-default-6b45f6d8d8-rp2wb\" (UID: \"ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27\") " pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" Jul 17 18:10:21.324461 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323753 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-779tp\" (UniqueName: \"kubernetes.io/projected/f102d994-82b5-4785-ac0e-04453f06bab6-kube-api-access-779tp\") pod \"cluster-samples-operator-79b7c55f87-6g7gt\" (UID: \"f102d994-82b5-4785-ac0e-04453f06bab6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6g7gt" Jul 17 18:10:21.324461 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323785 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a24dfc7c-8415-4449-908f-4376cf8c694c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-rsbql\" (UID: \"a24dfc7c-8415-4449-908f-4376cf8c694c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-rsbql" Jul 17 18:10:21.324461 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323809 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/52639dcf-cedf-46de-a944-316eac2db0a8-config\") pod \"service-ca-operator-5bcbc94c78-75v7p\" (UID: \"52639dcf-cedf-46de-a944-316eac2db0a8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-75v7p" Jul 17 18:10:21.324461 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323835 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f345c916-a0a1-4610-90b8-113fada2a49a-cert\") pod \"ingress-canary-gx8nh\" (UID: \"f345c916-a0a1-4610-90b8-113fada2a49a\") " pod="openshift-ingress-canary/ingress-canary-gx8nh" Jul 17 18:10:21.324461 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323859 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9989\" (UniqueName: \"kubernetes.io/projected/f345c916-a0a1-4610-90b8-113fada2a49a-kube-api-access-l9989\") pod \"ingress-canary-gx8nh\" (UID: \"f345c916-a0a1-4610-90b8-113fada2a49a\") " pod="openshift-ingress-canary/ingress-canary-gx8nh" Jul 17 18:10:21.324461 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323883 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/852a630b-6cf7-4355-ae0b-49347eb3c4e1-metrics-tls\") pod \"dns-default-8jm6x\" (UID: \"852a630b-6cf7-4355-ae0b-49347eb3c4e1\") " pod="openshift-dns/dns-default-8jm6x" Jul 17 18:10:21.324461 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323909 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-trusted-ca\") pod \"image-registry-6598fb4596-t7r2p\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:10:21.324461 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323937 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-installation-pull-secrets\") pod \"image-registry-6598fb4596-t7r2p\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:10:21.324461 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.323967 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/490303ef-c958-4260-84ee-1852150aae55-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-hghkd\" (UID: \"490303ef-c958-4260-84ee-1852150aae55\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hghkd" Jul 17 18:10:21.324461 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.324064 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c6017e7d-5ed2-4d7d-ba64-ba9ce933828f-config\") pod \"console-operator-565b7b569d-nwqlr\" (UID: \"c6017e7d-5ed2-4d7d-ba64-ba9ce933828f\") " pod="openshift-console-operator/console-operator-565b7b569d-nwqlr" Jul 17 18:10:21.324461 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.324171 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e82b2034-7625-41a9-a5f0-cec5b7605b5c-service-ca-bundle\") pod \"insights-operator-555d9d7885-jxfz9\" (UID: \"e82b2034-7625-41a9-a5f0-cec5b7605b5c\") " pod="openshift-insights/insights-operator-555d9d7885-jxfz9" Jul 17 18:10:21.324877 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.324766 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/490303ef-c958-4260-84ee-1852150aae55-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-hghkd\" (UID: \"490303ef-c958-4260-84ee-1852150aae55\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hghkd" Jul 17 18:10:21.324924 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:21.324896 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-service-ca-bundle podName:ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:21.824877677 +0000 UTC m=+37.098488816 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-service-ca-bundle") pod "router-default-6b45f6d8d8-rp2wb" (UID: "ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27") : configmap references non-existent config key: service-ca.crt Jul 17 18:10:21.325315 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.325013 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a24dfc7c-8415-4449-908f-4376cf8c694c-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-rsbql\" (UID: \"a24dfc7c-8415-4449-908f-4376cf8c694c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-rsbql" Jul 17 18:10:21.325315 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:21.325275 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 18:10:21.325462 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:21.325343 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a24dfc7c-8415-4449-908f-4376cf8c694c-cluster-monitoring-operator-tls podName:a24dfc7c-8415-4449-908f-4376cf8c694c nodeName:}" failed. No retries permitted until 2026-07-17 18:10:21.825324623 +0000 UTC m=+37.098935748 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a24dfc7c-8415-4449-908f-4376cf8c694c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-rsbql" (UID: "a24dfc7c-8415-4449-908f-4376cf8c694c") : secret "cluster-monitoring-operator-tls" not found Jul 17 18:10:21.325661 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.325637 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-ca-trust-extracted\") pod \"image-registry-6598fb4596-t7r2p\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:10:21.325739 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:21.325722 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 18:10:21.325790 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.325754 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/52639dcf-cedf-46de-a944-316eac2db0a8-config\") pod \"service-ca-operator-5bcbc94c78-75v7p\" (UID: \"52639dcf-cedf-46de-a944-316eac2db0a8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-75v7p" Jul 17 18:10:21.325790 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:21.325774 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-metrics-certs podName:ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:21.825759654 +0000 UTC m=+37.099370782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-metrics-certs") pod "router-default-6b45f6d8d8-rp2wb" (UID: "ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27") : secret "router-metrics-certs-default" not found Jul 17 18:10:21.328472 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.326637 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-trusted-ca\") pod \"image-registry-6598fb4596-t7r2p\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:10:21.328472 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.326686 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e82b2034-7625-41a9-a5f0-cec5b7605b5c-snapshots\") pod \"insights-operator-555d9d7885-jxfz9\" (UID: \"e82b2034-7625-41a9-a5f0-cec5b7605b5c\") " pod="openshift-insights/insights-operator-555d9d7885-jxfz9" Jul 17 18:10:21.328472 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.326933 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e82b2034-7625-41a9-a5f0-cec5b7605b5c-tmp\") pod \"insights-operator-555d9d7885-jxfz9\" (UID: \"e82b2034-7625-41a9-a5f0-cec5b7605b5c\") " pod="openshift-insights/insights-operator-555d9d7885-jxfz9" Jul 17 18:10:21.328472 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:21.327330 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 18:10:21.328472 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:21.327384 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f102d994-82b5-4785-ac0e-04453f06bab6-samples-operator-tls podName:f102d994-82b5-4785-ac0e-04453f06bab6 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:21.827369333 +0000 UTC m=+37.100980466 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f102d994-82b5-4785-ac0e-04453f06bab6-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-6g7gt" (UID: "f102d994-82b5-4785-ac0e-04453f06bab6") : secret "samples-operator-tls" not found Jul 17 18:10:21.328472 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:21.327411 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 18:10:21.328472 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:21.327428 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6598fb4596-t7r2p: secret "image-registry-tls" not found Jul 17 18:10:21.328472 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:21.327468 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-registry-tls podName:3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:21.827453159 +0000 UTC m=+37.101064281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-registry-tls") pod "image-registry-6598fb4596-t7r2p" (UID: "3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6") : secret "image-registry-tls" not found Jul 17 18:10:21.328472 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.328276 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c6017e7d-5ed2-4d7d-ba64-ba9ce933828f-trusted-ca\") pod \"console-operator-565b7b569d-nwqlr\" (UID: \"c6017e7d-5ed2-4d7d-ba64-ba9ce933828f\") " pod="openshift-console-operator/console-operator-565b7b569d-nwqlr" Jul 17 18:10:21.328930 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.328836 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/490303ef-c958-4260-84ee-1852150aae55-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-hghkd\" (UID: \"490303ef-c958-4260-84ee-1852150aae55\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hghkd" Jul 17 18:10:21.328930 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.328838 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/52639dcf-cedf-46de-a944-316eac2db0a8-serving-cert\") pod \"service-ca-operator-5bcbc94c78-75v7p\" (UID: \"52639dcf-cedf-46de-a944-316eac2db0a8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-75v7p" Jul 17 18:10:21.329202 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.329180 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e82b2034-7625-41a9-a5f0-cec5b7605b5c-serving-cert\") pod \"insights-operator-555d9d7885-jxfz9\" (UID: \"e82b2034-7625-41a9-a5f0-cec5b7605b5c\") " pod="openshift-insights/insights-operator-555d9d7885-jxfz9" Jul 17 18:10:21.329511 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.329455 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-default-certificate\") pod \"router-default-6b45f6d8d8-rp2wb\" (UID: \"ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27\") " pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" Jul 17 18:10:21.329604 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.329562 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c6017e7d-5ed2-4d7d-ba64-ba9ce933828f-serving-cert\") pod \"console-operator-565b7b569d-nwqlr\" (UID: \"c6017e7d-5ed2-4d7d-ba64-ba9ce933828f\") " pod="openshift-console-operator/console-operator-565b7b569d-nwqlr" Jul 17 18:10:21.330043 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.330021 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-installation-pull-secrets\") pod \"image-registry-6598fb4596-t7r2p\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:10:21.330381 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.330354 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-image-registry-private-configuration\") pod \"image-registry-6598fb4596-t7r2p\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:10:21.331323 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.331302 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-stats-auth\") pod \"router-default-6b45f6d8d8-rp2wb\" (UID: \"ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27\") " pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" Jul 17 18:10:21.333293 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.333225 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prvj4\" (UniqueName: \"kubernetes.io/projected/a24dfc7c-8415-4449-908f-4376cf8c694c-kube-api-access-prvj4\") pod \"cluster-monitoring-operator-76cf8966f8-rsbql\" (UID: \"a24dfc7c-8415-4449-908f-4376cf8c694c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-rsbql" Jul 17 18:10:21.333393 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.333310 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr7kw\" (UniqueName: \"kubernetes.io/projected/52639dcf-cedf-46de-a944-316eac2db0a8-kube-api-access-vr7kw\") pod \"service-ca-operator-5bcbc94c78-75v7p\" (UID: \"52639dcf-cedf-46de-a944-316eac2db0a8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-75v7p" Jul 17 18:10:21.338051 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.335494 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-bound-sa-token\") pod \"image-registry-6598fb4596-t7r2p\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:10:21.341200 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.341177 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9drh\" (UniqueName: \"kubernetes.io/projected/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-kube-api-access-b9drh\") pod \"router-default-6b45f6d8d8-rp2wb\" (UID: \"ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27\") " pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" Jul 17 18:10:21.341478 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.341455 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpmpc\" (UniqueName: \"kubernetes.io/projected/e82b2034-7625-41a9-a5f0-cec5b7605b5c-kube-api-access-dpmpc\") pod \"insights-operator-555d9d7885-jxfz9\" (UID: \"e82b2034-7625-41a9-a5f0-cec5b7605b5c\") " pod="openshift-insights/insights-operator-555d9d7885-jxfz9" Jul 17 18:10:21.341554 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.341511 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2pss\" (UniqueName: \"kubernetes.io/projected/0d37e971-7201-4f9b-a44c-e79ba57d5baa-kube-api-access-m2pss\") pod \"volume-data-source-validator-78cf4c6f6-l8njm\" (UID: \"0d37e971-7201-4f9b-a44c-e79ba57d5baa\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-l8njm" Jul 17 18:10:21.341951 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.341933 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t47lz\" (UniqueName: \"kubernetes.io/projected/c6017e7d-5ed2-4d7d-ba64-ba9ce933828f-kube-api-access-t47lz\") pod \"console-operator-565b7b569d-nwqlr\" (UID: \"c6017e7d-5ed2-4d7d-ba64-ba9ce933828f\") " pod="openshift-console-operator/console-operator-565b7b569d-nwqlr" Jul 17 18:10:21.342414 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.342384 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzg47\" (UniqueName: \"kubernetes.io/projected/490303ef-c958-4260-84ee-1852150aae55-kube-api-access-vzg47\") pod \"kube-storage-version-migrator-operator-7658d9b749-hghkd\" (UID: \"490303ef-c958-4260-84ee-1852150aae55\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hghkd" Jul 17 18:10:21.343355 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.343334 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8vbs\" (UniqueName: \"kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-kube-api-access-t8vbs\") pod \"image-registry-6598fb4596-t7r2p\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:10:21.343702 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.343683 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-779tp\" (UniqueName: \"kubernetes.io/projected/f102d994-82b5-4785-ac0e-04453f06bab6-kube-api-access-779tp\") pod \"cluster-samples-operator-79b7c55f87-6g7gt\" (UID: \"f102d994-82b5-4785-ac0e-04453f06bab6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6g7gt" Jul 17 18:10:21.414560 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.414535 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-l8njm" Jul 17 18:10:21.425082 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.425056 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f345c916-a0a1-4610-90b8-113fada2a49a-cert\") pod \"ingress-canary-gx8nh\" (UID: \"f345c916-a0a1-4610-90b8-113fada2a49a\") " pod="openshift-ingress-canary/ingress-canary-gx8nh" Jul 17 18:10:21.425182 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.425095 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9989\" (UniqueName: \"kubernetes.io/projected/f345c916-a0a1-4610-90b8-113fada2a49a-kube-api-access-l9989\") pod \"ingress-canary-gx8nh\" (UID: \"f345c916-a0a1-4610-90b8-113fada2a49a\") " pod="openshift-ingress-canary/ingress-canary-gx8nh" Jul 17 18:10:21.425182 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.425122 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/852a630b-6cf7-4355-ae0b-49347eb3c4e1-metrics-tls\") pod \"dns-default-8jm6x\" (UID: \"852a630b-6cf7-4355-ae0b-49347eb3c4e1\") " pod="openshift-dns/dns-default-8jm6x" Jul 17 18:10:21.425291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.425179 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm7v4\" (UniqueName: \"kubernetes.io/projected/852a630b-6cf7-4355-ae0b-49347eb3c4e1-kube-api-access-xm7v4\") pod \"dns-default-8jm6x\" (UID: \"852a630b-6cf7-4355-ae0b-49347eb3c4e1\") " pod="openshift-dns/dns-default-8jm6x" Jul 17 18:10:21.425291 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:21.425235 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 18:10:21.425385 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:21.425312 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/852a630b-6cf7-4355-ae0b-49347eb3c4e1-metrics-tls podName:852a630b-6cf7-4355-ae0b-49347eb3c4e1 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:21.925292054 +0000 UTC m=+37.198903174 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/852a630b-6cf7-4355-ae0b-49347eb3c4e1-metrics-tls") pod "dns-default-8jm6x" (UID: "852a630b-6cf7-4355-ae0b-49347eb3c4e1") : secret "dns-default-metrics-tls" not found Jul 17 18:10:21.425385 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.425235 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtm6m\" (UniqueName: \"kubernetes.io/projected/86296674-d8de-4f65-9729-3dc6cbf134a2-kube-api-access-qtm6m\") pod \"network-check-source-7bc5b6bf85-9bn2j\" (UID: \"86296674-d8de-4f65-9729-3dc6cbf134a2\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-9bn2j" Jul 17 18:10:21.425485 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.425411 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/852a630b-6cf7-4355-ae0b-49347eb3c4e1-config-volume\") pod \"dns-default-8jm6x\" (UID: \"852a630b-6cf7-4355-ae0b-49347eb3c4e1\") " pod="openshift-dns/dns-default-8jm6x" Jul 17 18:10:21.425485 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.425443 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/852a630b-6cf7-4355-ae0b-49347eb3c4e1-tmp-dir\") pod \"dns-default-8jm6x\" (UID: \"852a630b-6cf7-4355-ae0b-49347eb3c4e1\") " pod="openshift-dns/dns-default-8jm6x" Jul 17 18:10:21.425808 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.425788 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/852a630b-6cf7-4355-ae0b-49347eb3c4e1-tmp-dir\") pod \"dns-default-8jm6x\" (UID: \"852a630b-6cf7-4355-ae0b-49347eb3c4e1\") " pod="openshift-dns/dns-default-8jm6x" Jul 17 18:10:21.425967 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.425950 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/852a630b-6cf7-4355-ae0b-49347eb3c4e1-config-volume\") pod \"dns-default-8jm6x\" (UID: \"852a630b-6cf7-4355-ae0b-49347eb3c4e1\") " pod="openshift-dns/dns-default-8jm6x" Jul 17 18:10:21.426678 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.426663 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-jxfz9" Jul 17 18:10:21.427626 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.427602 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f345c916-a0a1-4610-90b8-113fada2a49a-cert\") pod \"ingress-canary-gx8nh\" (UID: \"f345c916-a0a1-4610-90b8-113fada2a49a\") " pod="openshift-ingress-canary/ingress-canary-gx8nh" Jul 17 18:10:21.433635 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.433611 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9989\" (UniqueName: \"kubernetes.io/projected/f345c916-a0a1-4610-90b8-113fada2a49a-kube-api-access-l9989\") pod \"ingress-canary-gx8nh\" (UID: \"f345c916-a0a1-4610-90b8-113fada2a49a\") " pod="openshift-ingress-canary/ingress-canary-gx8nh" Jul 17 18:10:21.433741 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.433719 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtm6m\" (UniqueName: \"kubernetes.io/projected/86296674-d8de-4f65-9729-3dc6cbf134a2-kube-api-access-qtm6m\") pod \"network-check-source-7bc5b6bf85-9bn2j\" (UID: \"86296674-d8de-4f65-9729-3dc6cbf134a2\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-9bn2j" Jul 17 18:10:21.433798 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.433780 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm7v4\" (UniqueName: \"kubernetes.io/projected/852a630b-6cf7-4355-ae0b-49347eb3c4e1-kube-api-access-xm7v4\") pod \"dns-default-8jm6x\" (UID: \"852a630b-6cf7-4355-ae0b-49347eb3c4e1\") " pod="openshift-dns/dns-default-8jm6x" Jul 17 18:10:21.449903 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.449879 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-nwqlr" Jul 17 18:10:21.465735 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.465716 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-75v7p" Jul 17 18:10:21.467848 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.467827 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hghkd" Jul 17 18:10:21.490446 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.490428 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-9bn2j" Jul 17 18:10:21.496105 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.496088 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gx8nh" Jul 17 18:10:21.829830 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.829796 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-metrics-certs\") pod \"router-default-6b45f6d8d8-rp2wb\" (UID: \"ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27\") " pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" Jul 17 18:10:21.829971 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.829870 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a24dfc7c-8415-4449-908f-4376cf8c694c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-rsbql\" (UID: \"a24dfc7c-8415-4449-908f-4376cf8c694c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-rsbql" Jul 17 18:10:21.829971 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.829931 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-registry-tls\") pod \"image-registry-6598fb4596-t7r2p\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:10:21.829971 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:21.829935 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 18:10:21.829971 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.829960 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f102d994-82b5-4785-ac0e-04453f06bab6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-6g7gt\" (UID: \"f102d994-82b5-4785-ac0e-04453f06bab6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6g7gt" Jul 17 18:10:21.830187 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:21.830021 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-metrics-certs podName:ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:22.830000051 +0000 UTC m=+38.103611187 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-metrics-certs") pod "router-default-6b45f6d8d8-rp2wb" (UID: "ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27") : secret "router-metrics-certs-default" not found Jul 17 18:10:21.830187 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:21.830038 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 18:10:21.830187 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.830045 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-service-ca-bundle\") pod \"router-default-6b45f6d8d8-rp2wb\" (UID: \"ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27\") " pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" Jul 17 18:10:21.830187 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:21.830066 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 18:10:21.830187 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:21.830090 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a24dfc7c-8415-4449-908f-4376cf8c694c-cluster-monitoring-operator-tls podName:a24dfc7c-8415-4449-908f-4376cf8c694c nodeName:}" failed. No retries permitted until 2026-07-17 18:10:22.830072283 +0000 UTC m=+38.103683415 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a24dfc7c-8415-4449-908f-4376cf8c694c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-rsbql" (UID: "a24dfc7c-8415-4449-908f-4376cf8c694c") : secret "cluster-monitoring-operator-tls" not found Jul 17 18:10:21.830187 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:21.830109 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f102d994-82b5-4785-ac0e-04453f06bab6-samples-operator-tls podName:f102d994-82b5-4785-ac0e-04453f06bab6 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:22.830099371 +0000 UTC m=+38.103710493 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f102d994-82b5-4785-ac0e-04453f06bab6-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-6g7gt" (UID: "f102d994-82b5-4785-ac0e-04453f06bab6") : secret "samples-operator-tls" not found Jul 17 18:10:21.830187 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:21.830144 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 18:10:21.830187 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:21.830154 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6598fb4596-t7r2p: secret "image-registry-tls" not found Jul 17 18:10:21.830187 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:21.830159 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-service-ca-bundle podName:ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:22.830147137 +0000 UTC m=+38.103758258 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-service-ca-bundle") pod "router-default-6b45f6d8d8-rp2wb" (UID: "ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27") : configmap references non-existent config key: service-ca.crt Jul 17 18:10:21.830187 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:21.830186 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-registry-tls podName:3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:22.830172962 +0000 UTC m=+38.103784085 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-registry-tls") pod "image-registry-6598fb4596-t7r2p" (UID: "3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6") : secret "image-registry-tls" not found Jul 17 18:10:21.930703 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:21.930679 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/852a630b-6cf7-4355-ae0b-49347eb3c4e1-metrics-tls\") pod \"dns-default-8jm6x\" (UID: \"852a630b-6cf7-4355-ae0b-49347eb3c4e1\") " pod="openshift-dns/dns-default-8jm6x" Jul 17 18:10:21.930842 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:21.930816 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 18:10:21.930910 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:21.930877 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/852a630b-6cf7-4355-ae0b-49347eb3c4e1-metrics-tls podName:852a630b-6cf7-4355-ae0b-49347eb3c4e1 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:22.930864076 +0000 UTC m=+38.204475196 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/852a630b-6cf7-4355-ae0b-49347eb3c4e1-metrics-tls") pod "dns-default-8jm6x" (UID: "852a630b-6cf7-4355-ae0b-49347eb3c4e1") : secret "dns-default-metrics-tls" not found Jul 17 18:10:22.044838 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:22.044811 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-4qhqv"] Jul 17 18:10:22.048060 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:22.048039 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4qhqv" Jul 17 18:10:22.049971 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:22.049952 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 17 18:10:22.050099 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:22.049955 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-w59br\"" Jul 17 18:10:22.050099 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:22.049953 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 17 18:10:22.054639 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:22.054618 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-4qhqv"] Jul 17 18:10:22.131852 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:22.131787 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b52e56d1-173f-4c0b-b1ce-23904145a410-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-4qhqv\" (UID: \"b52e56d1-173f-4c0b-b1ce-23904145a410\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4qhqv" Jul 17 18:10:22.131852 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:22.131820 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b52e56d1-173f-4c0b-b1ce-23904145a410-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4qhqv\" (UID: \"b52e56d1-173f-4c0b-b1ce-23904145a410\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4qhqv" Jul 17 18:10:22.219794 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:22.219764 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:22.232852 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:22.232830 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b52e56d1-173f-4c0b-b1ce-23904145a410-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-4qhqv\" (UID: \"b52e56d1-173f-4c0b-b1ce-23904145a410\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4qhqv" Jul 17 18:10:22.233029 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:22.232861 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b52e56d1-173f-4c0b-b1ce-23904145a410-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4qhqv\" (UID: \"b52e56d1-173f-4c0b-b1ce-23904145a410\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4qhqv" Jul 17 18:10:22.233088 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:22.233030 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 17 18:10:22.233134 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:22.233093 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b52e56d1-173f-4c0b-b1ce-23904145a410-networking-console-plugin-cert podName:b52e56d1-173f-4c0b-b1ce-23904145a410 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:22.733075209 +0000 UTC m=+38.006686343 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b52e56d1-173f-4c0b-b1ce-23904145a410-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-4qhqv" (UID: "b52e56d1-173f-4c0b-b1ce-23904145a410") : secret "networking-console-plugin-cert" not found Jul 17 18:10:22.233511 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:22.233488 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b52e56d1-173f-4c0b-b1ce-23904145a410-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-4qhqv\" (UID: \"b52e56d1-173f-4c0b-b1ce-23904145a410\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4qhqv" Jul 17 18:10:22.314701 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:22.314672 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:22.373027 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:22.372995 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:22.737733 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:22.737703 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b52e56d1-173f-4c0b-b1ce-23904145a410-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4qhqv\" (UID: \"b52e56d1-173f-4c0b-b1ce-23904145a410\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4qhqv" Jul 17 18:10:22.737902 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:22.737881 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 17 18:10:22.737971 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:22.737960 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b52e56d1-173f-4c0b-b1ce-23904145a410-networking-console-plugin-cert podName:b52e56d1-173f-4c0b-b1ce-23904145a410 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:23.737940001 +0000 UTC m=+39.011551134 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b52e56d1-173f-4c0b-b1ce-23904145a410-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-4qhqv" (UID: "b52e56d1-173f-4c0b-b1ce-23904145a410") : secret "networking-console-plugin-cert" not found Jul 17 18:10:22.838992 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:22.838948 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-registry-tls\") pod \"image-registry-6598fb4596-t7r2p\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:10:22.839156 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:22.839012 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f102d994-82b5-4785-ac0e-04453f06bab6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-6g7gt\" (UID: \"f102d994-82b5-4785-ac0e-04453f06bab6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6g7gt" Jul 17 18:10:22.839156 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:22.839051 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-service-ca-bundle\") pod \"router-default-6b45f6d8d8-rp2wb\" (UID: \"ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27\") " pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" Jul 17 18:10:22.839156 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:22.839103 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 18:10:22.839156 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:22.839124 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6598fb4596-t7r2p: secret "image-registry-tls" not found Jul 17 18:10:22.839156 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:22.839131 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-metrics-certs\") pod \"router-default-6b45f6d8d8-rp2wb\" (UID: \"ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27\") " pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" Jul 17 18:10:22.839384 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:22.839164 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 18:10:22.839384 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:22.839184 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-registry-tls podName:3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:24.839164651 +0000 UTC m=+40.112775783 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-registry-tls") pod "image-registry-6598fb4596-t7r2p" (UID: "3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6") : secret "image-registry-tls" not found Jul 17 18:10:22.839384 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:22.839227 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 18:10:22.839384 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:22.839228 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f102d994-82b5-4785-ac0e-04453f06bab6-samples-operator-tls podName:f102d994-82b5-4785-ac0e-04453f06bab6 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:24.839210336 +0000 UTC m=+40.112821470 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f102d994-82b5-4785-ac0e-04453f06bab6-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-6g7gt" (UID: "f102d994-82b5-4785-ac0e-04453f06bab6") : secret "samples-operator-tls" not found Jul 17 18:10:22.839384 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:22.839285 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a24dfc7c-8415-4449-908f-4376cf8c694c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-rsbql\" (UID: \"a24dfc7c-8415-4449-908f-4376cf8c694c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-rsbql" Jul 17 18:10:22.839384 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:22.839306 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-service-ca-bundle podName:ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:24.839293913 +0000 UTC m=+40.112905035 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-service-ca-bundle") pod "router-default-6b45f6d8d8-rp2wb" (UID: "ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27") : configmap references non-existent config key: service-ca.crt Jul 17 18:10:22.839384 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:22.839335 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-metrics-certs podName:ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:24.83932515 +0000 UTC m=+40.112936287 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-metrics-certs") pod "router-default-6b45f6d8d8-rp2wb" (UID: "ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27") : secret "router-metrics-certs-default" not found Jul 17 18:10:22.839384 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:22.839349 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 18:10:22.839384 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:22.839385 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a24dfc7c-8415-4449-908f-4376cf8c694c-cluster-monitoring-operator-tls podName:a24dfc7c-8415-4449-908f-4376cf8c694c nodeName:}" failed. No retries permitted until 2026-07-17 18:10:24.839371521 +0000 UTC m=+40.112982646 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a24dfc7c-8415-4449-908f-4376cf8c694c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-rsbql" (UID: "a24dfc7c-8415-4449-908f-4376cf8c694c") : secret "cluster-monitoring-operator-tls" not found Jul 17 18:10:22.941064 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:22.940849 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/852a630b-6cf7-4355-ae0b-49347eb3c4e1-metrics-tls\") pod \"dns-default-8jm6x\" (UID: \"852a630b-6cf7-4355-ae0b-49347eb3c4e1\") " pod="openshift-dns/dns-default-8jm6x" Jul 17 18:10:22.941285 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:22.941256 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 18:10:22.941373 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:22.941338 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/852a630b-6cf7-4355-ae0b-49347eb3c4e1-metrics-tls podName:852a630b-6cf7-4355-ae0b-49347eb3c4e1 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:24.941317321 +0000 UTC m=+40.214928445 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/852a630b-6cf7-4355-ae0b-49347eb3c4e1-metrics-tls") pod "dns-default-8jm6x" (UID: "852a630b-6cf7-4355-ae0b-49347eb3c4e1") : secret "dns-default-metrics-tls" not found Jul 17 18:10:23.126891 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:23.125026 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-nwqlr"] Jul 17 18:10:23.129512 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:10:23.129458 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6017e7d_5ed2_4d7d_ba64_ba9ce933828f.slice/crio-83a2ebf9db3917d8f35d8e2e771ab1d48dd9ede13d3c471b1e7c87217768613e WatchSource:0}: Error finding container 83a2ebf9db3917d8f35d8e2e771ab1d48dd9ede13d3c471b1e7c87217768613e: Status 404 returned error can't find the container with id 83a2ebf9db3917d8f35d8e2e771ab1d48dd9ede13d3c471b1e7c87217768613e Jul 17 18:10:23.134495 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:10:23.134463 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d37e971_7201_4f9b_a44c_e79ba57d5baa.slice/crio-861eba7323460c82a05184f7bd48b710783566311a126e1a0e90fe589c384d04 WatchSource:0}: Error finding container 861eba7323460c82a05184f7bd48b710783566311a126e1a0e90fe589c384d04: Status 404 returned error can't find the container with id 861eba7323460c82a05184f7bd48b710783566311a126e1a0e90fe589c384d04 Jul 17 18:10:23.136020 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:23.135601 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-l8njm"] Jul 17 18:10:23.138653 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:23.138009 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-jxfz9"] Jul 17 18:10:23.164118 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:23.164030 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gx8nh"] Jul 17 18:10:23.172673 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:23.172616 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hghkd"] Jul 17 18:10:23.185312 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:23.185284 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-9bn2j"] Jul 17 18:10:23.187036 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:23.187013 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-75v7p"] Jul 17 18:10:23.191543 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:10:23.191514 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod490303ef_c958_4260_84ee_1852150aae55.slice/crio-ec78a60cb9e2983c9983bd68237acb8d96467d4a35d5ab9088a552d916d804b4 WatchSource:0}: Error finding container ec78a60cb9e2983c9983bd68237acb8d96467d4a35d5ab9088a552d916d804b4: Status 404 returned error can't find the container with id ec78a60cb9e2983c9983bd68237acb8d96467d4a35d5ab9088a552d916d804b4 Jul 17 18:10:23.191948 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:10:23.191787 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86296674_d8de_4f65_9729_3dc6cbf134a2.slice/crio-ec3c89d3f46c95ac267ca4f195b752d79e1b364e471839ee85e8b51f4a43c2a8 WatchSource:0}: Error finding container ec3c89d3f46c95ac267ca4f195b752d79e1b364e471839ee85e8b51f4a43c2a8: Status 404 returned error can't find the container with id ec3c89d3f46c95ac267ca4f195b752d79e1b364e471839ee85e8b51f4a43c2a8 Jul 17 18:10:23.192417 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:10:23.192394 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52639dcf_cedf_46de_a944_316eac2db0a8.slice/crio-03f8f9db2fb4e2f2c0ff3b417f2d76502923ecb8f7799236bcdf3fb05b6b5978 WatchSource:0}: Error finding container 03f8f9db2fb4e2f2c0ff3b417f2d76502923ecb8f7799236bcdf3fb05b6b5978: Status 404 returned error can't find the container with id 03f8f9db2fb4e2f2c0ff3b417f2d76502923ecb8f7799236bcdf3fb05b6b5978 Jul 17 18:10:23.193400 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:10:23.193293 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf345c916_a0a1_4610_90b8_113fada2a49a.slice/crio-78c4facd4158a9fe25109163877b0d7d5d4ffffccf1f25c058b0700710ecf03d WatchSource:0}: Error finding container 78c4facd4158a9fe25109163877b0d7d5d4ffffccf1f25c058b0700710ecf03d: Status 404 returned error can't find the container with id 78c4facd4158a9fe25109163877b0d7d5d4ffffccf1f25c058b0700710ecf03d Jul 17 18:10:23.337346 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:23.337156 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-l8njm" event={"ID":"0d37e971-7201-4f9b-a44c-e79ba57d5baa","Type":"ContainerStarted","Data":"861eba7323460c82a05184f7bd48b710783566311a126e1a0e90fe589c384d04"} Jul 17 18:10:23.338076 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:23.338055 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-jxfz9" event={"ID":"e82b2034-7625-41a9-a5f0-cec5b7605b5c","Type":"ContainerStarted","Data":"6a3bea458a7b47b28ea7b4b2fe4abcade4b0e576c18b1a16bcad90775b66f746"} Jul 17 18:10:23.340576 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:23.340555 2576 generic.go:356] "Generic (PLEG): container finished" podID="b5ff5649-c98d-4586-a8b2-27e68c67fdca" containerID="656b1e105a11cf56f47da75ab4e597b98cd28410547da2af8247abaac88e7c2c" exitCode=0 Jul 17 18:10:23.340657 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:23.340619 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zb24" event={"ID":"b5ff5649-c98d-4586-a8b2-27e68c67fdca","Type":"ContainerDied","Data":"656b1e105a11cf56f47da75ab4e597b98cd28410547da2af8247abaac88e7c2c"} Jul 17 18:10:23.341702 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:23.341677 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-75v7p" event={"ID":"52639dcf-cedf-46de-a944-316eac2db0a8","Type":"ContainerStarted","Data":"03f8f9db2fb4e2f2c0ff3b417f2d76502923ecb8f7799236bcdf3fb05b6b5978"} Jul 17 18:10:23.342698 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:23.342674 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-nwqlr" event={"ID":"c6017e7d-5ed2-4d7d-ba64-ba9ce933828f","Type":"ContainerStarted","Data":"83a2ebf9db3917d8f35d8e2e771ab1d48dd9ede13d3c471b1e7c87217768613e"} Jul 17 18:10:23.343827 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:23.343806 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gx8nh" event={"ID":"f345c916-a0a1-4610-90b8-113fada2a49a","Type":"ContainerStarted","Data":"78c4facd4158a9fe25109163877b0d7d5d4ffffccf1f25c058b0700710ecf03d"} Jul 17 18:10:23.345057 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:23.345039 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hghkd" event={"ID":"490303ef-c958-4260-84ee-1852150aae55","Type":"ContainerStarted","Data":"ec78a60cb9e2983c9983bd68237acb8d96467d4a35d5ab9088a552d916d804b4"} Jul 17 18:10:23.346047 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:23.346019 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-9bn2j" event={"ID":"86296674-d8de-4f65-9729-3dc6cbf134a2","Type":"ContainerStarted","Data":"ec3c89d3f46c95ac267ca4f195b752d79e1b364e471839ee85e8b51f4a43c2a8"} Jul 17 18:10:23.747842 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:23.747706 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b52e56d1-173f-4c0b-b1ce-23904145a410-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4qhqv\" (UID: \"b52e56d1-173f-4c0b-b1ce-23904145a410\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4qhqv" Jul 17 18:10:23.748003 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:23.747875 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 17 18:10:23.748003 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:23.747953 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b52e56d1-173f-4c0b-b1ce-23904145a410-networking-console-plugin-cert podName:b52e56d1-173f-4c0b-b1ce-23904145a410 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:25.747931791 +0000 UTC m=+41.021542918 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b52e56d1-173f-4c0b-b1ce-23904145a410-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-4qhqv" (UID: "b52e56d1-173f-4c0b-b1ce-23904145a410") : secret "networking-console-plugin-cert" not found Jul 17 18:10:24.358553 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:24.357607 2576 generic.go:356] "Generic (PLEG): container finished" podID="b5ff5649-c98d-4586-a8b2-27e68c67fdca" containerID="161a6ee86930f477e29ca81212d7fc8028769ae9787c650291d655e4ca0b778e" exitCode=0 Jul 17 18:10:24.358553 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:24.357667 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zb24" event={"ID":"b5ff5649-c98d-4586-a8b2-27e68c67fdca","Type":"ContainerDied","Data":"161a6ee86930f477e29ca81212d7fc8028769ae9787c650291d655e4ca0b778e"} Jul 17 18:10:24.438017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:24.437913 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:24.496904 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:24.496828 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:24.857866 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:24.857831 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a24dfc7c-8415-4449-908f-4376cf8c694c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-rsbql\" (UID: \"a24dfc7c-8415-4449-908f-4376cf8c694c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-rsbql" Jul 17 18:10:24.858047 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:24.857930 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-registry-tls\") pod \"image-registry-6598fb4596-t7r2p\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:10:24.858047 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:24.857965 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f102d994-82b5-4785-ac0e-04453f06bab6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-6g7gt\" (UID: \"f102d994-82b5-4785-ac0e-04453f06bab6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6g7gt" Jul 17 18:10:24.858047 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:24.858004 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 18:10:24.858047 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:24.858018 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-service-ca-bundle\") pod \"router-default-6b45f6d8d8-rp2wb\" (UID: \"ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27\") " pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" Jul 17 18:10:24.858259 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:24.858091 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-metrics-certs\") pod \"router-default-6b45f6d8d8-rp2wb\" (UID: \"ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27\") " pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" Jul 17 18:10:24.858259 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:24.858222 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 18:10:24.858347 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:24.858275 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-metrics-certs podName:ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:28.8582573 +0000 UTC m=+44.131868436 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-metrics-certs") pod "router-default-6b45f6d8d8-rp2wb" (UID: "ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27") : secret "router-metrics-certs-default" not found Jul 17 18:10:24.858402 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:24.858344 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 18:10:24.858402 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:24.858357 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6598fb4596-t7r2p: secret "image-registry-tls" not found Jul 17 18:10:24.858402 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:24.858393 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-registry-tls podName:3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:28.858380939 +0000 UTC m=+44.131992079 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-registry-tls") pod "image-registry-6598fb4596-t7r2p" (UID: "3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6") : secret "image-registry-tls" not found Jul 17 18:10:24.858543 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:24.858433 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a24dfc7c-8415-4449-908f-4376cf8c694c-cluster-monitoring-operator-tls podName:a24dfc7c-8415-4449-908f-4376cf8c694c nodeName:}" failed. No retries permitted until 2026-07-17 18:10:28.858423815 +0000 UTC m=+44.132034938 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a24dfc7c-8415-4449-908f-4376cf8c694c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-rsbql" (UID: "a24dfc7c-8415-4449-908f-4376cf8c694c") : secret "cluster-monitoring-operator-tls" not found Jul 17 18:10:24.858543 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:24.858513 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-service-ca-bundle podName:ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:28.85849545 +0000 UTC m=+44.132106576 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-service-ca-bundle") pod "router-default-6b45f6d8d8-rp2wb" (UID: "ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27") : configmap references non-existent config key: service-ca.crt Jul 17 18:10:24.858654 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:24.858551 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 18:10:24.858654 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:24.858594 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f102d994-82b5-4785-ac0e-04453f06bab6-samples-operator-tls podName:f102d994-82b5-4785-ac0e-04453f06bab6 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:28.858582627 +0000 UTC m=+44.132193752 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f102d994-82b5-4785-ac0e-04453f06bab6-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-6g7gt" (UID: "f102d994-82b5-4785-ac0e-04453f06bab6") : secret "samples-operator-tls" not found Jul 17 18:10:24.959477 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:24.959327 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/852a630b-6cf7-4355-ae0b-49347eb3c4e1-metrics-tls\") pod \"dns-default-8jm6x\" (UID: \"852a630b-6cf7-4355-ae0b-49347eb3c4e1\") " pod="openshift-dns/dns-default-8jm6x" Jul 17 18:10:24.959641 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:24.959487 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 18:10:24.959641 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:24.959557 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/852a630b-6cf7-4355-ae0b-49347eb3c4e1-metrics-tls podName:852a630b-6cf7-4355-ae0b-49347eb3c4e1 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:28.959536076 +0000 UTC m=+44.233147202 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/852a630b-6cf7-4355-ae0b-49347eb3c4e1-metrics-tls") pod "dns-default-8jm6x" (UID: "852a630b-6cf7-4355-ae0b-49347eb3c4e1") : secret "dns-default-metrics-tls" not found Jul 17 18:10:25.367143 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:25.367073 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4zb24" event={"ID":"b5ff5649-c98d-4586-a8b2-27e68c67fdca","Type":"ContainerStarted","Data":"43effe9fbe32c5292e44647892edc379abf5ce2032a6caf8712e999a7dcf564b"} Jul 17 18:10:25.514555 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:25.514426 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:25.575993 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:25.575893 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:25.636039 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:25.636009 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:25.767403 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:25.767319 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b52e56d1-173f-4c0b-b1ce-23904145a410-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4qhqv\" (UID: \"b52e56d1-173f-4c0b-b1ce-23904145a410\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4qhqv" Jul 17 18:10:25.767547 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:25.767476 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 17 18:10:25.767547 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:25.767544 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b52e56d1-173f-4c0b-b1ce-23904145a410-networking-console-plugin-cert podName:b52e56d1-173f-4c0b-b1ce-23904145a410 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:29.767523335 +0000 UTC m=+45.041134460 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b52e56d1-173f-4c0b-b1ce-23904145a410-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-4qhqv" (UID: "b52e56d1-173f-4c0b-b1ce-23904145a410") : secret "networking-console-plugin-cert" not found Jul 17 18:10:28.460054 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:28.460008 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:28.519177 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:28.519143 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:28.898514 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:28.898470 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-metrics-certs\") pod \"router-default-6b45f6d8d8-rp2wb\" (UID: \"ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27\") " pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" Jul 17 18:10:28.898720 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:28.898557 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a24dfc7c-8415-4449-908f-4376cf8c694c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-rsbql\" (UID: \"a24dfc7c-8415-4449-908f-4376cf8c694c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-rsbql" Jul 17 18:10:28.898720 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:28.898599 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 18:10:28.898720 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:28.898652 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-registry-tls\") pod \"image-registry-6598fb4596-t7r2p\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:10:28.898720 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:28.898687 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-metrics-certs podName:ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:36.898663771 +0000 UTC m=+52.172274893 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-metrics-certs") pod "router-default-6b45f6d8d8-rp2wb" (UID: "ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27") : secret "router-metrics-certs-default" not found Jul 17 18:10:28.898920 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:28.898726 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 18:10:28.898920 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:28.898734 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f102d994-82b5-4785-ac0e-04453f06bab6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-6g7gt\" (UID: \"f102d994-82b5-4785-ac0e-04453f06bab6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6g7gt" Jul 17 18:10:28.898920 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:28.898735 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 18:10:28.898920 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:28.898786 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a24dfc7c-8415-4449-908f-4376cf8c694c-cluster-monitoring-operator-tls podName:a24dfc7c-8415-4449-908f-4376cf8c694c nodeName:}" failed. No retries permitted until 2026-07-17 18:10:36.898769607 +0000 UTC m=+52.172380727 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a24dfc7c-8415-4449-908f-4376cf8c694c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-rsbql" (UID: "a24dfc7c-8415-4449-908f-4376cf8c694c") : secret "cluster-monitoring-operator-tls" not found Jul 17 18:10:28.898920 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:28.898796 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6598fb4596-t7r2p: secret "image-registry-tls" not found Jul 17 18:10:28.898920 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:28.898839 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-service-ca-bundle podName:ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:36.898828203 +0000 UTC m=+52.172439324 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-service-ca-bundle") pod "router-default-6b45f6d8d8-rp2wb" (UID: "ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27") : configmap references non-existent config key: service-ca.crt Jul 17 18:10:28.898920 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:28.898773 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-service-ca-bundle\") pod \"router-default-6b45f6d8d8-rp2wb\" (UID: \"ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27\") " pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" Jul 17 18:10:28.898920 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:28.898852 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 18:10:28.898920 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:28.898873 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-registry-tls podName:3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:36.898856434 +0000 UTC m=+52.172467591 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-registry-tls") pod "image-registry-6598fb4596-t7r2p" (UID: "3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6") : secret "image-registry-tls" not found Jul 17 18:10:28.898920 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:28.898900 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f102d994-82b5-4785-ac0e-04453f06bab6-samples-operator-tls podName:f102d994-82b5-4785-ac0e-04453f06bab6 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:36.898892487 +0000 UTC m=+52.172503607 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f102d994-82b5-4785-ac0e-04453f06bab6-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-6g7gt" (UID: "f102d994-82b5-4785-ac0e-04453f06bab6") : secret "samples-operator-tls" not found Jul 17 18:10:29.000113 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:29.000089 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/852a630b-6cf7-4355-ae0b-49347eb3c4e1-metrics-tls\") pod \"dns-default-8jm6x\" (UID: \"852a630b-6cf7-4355-ae0b-49347eb3c4e1\") " pod="openshift-dns/dns-default-8jm6x" Jul 17 18:10:29.000223 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:29.000191 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 18:10:29.000258 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:29.000226 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/852a630b-6cf7-4355-ae0b-49347eb3c4e1-metrics-tls podName:852a630b-6cf7-4355-ae0b-49347eb3c4e1 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:37.000217218 +0000 UTC m=+52.273828349 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/852a630b-6cf7-4355-ae0b-49347eb3c4e1-metrics-tls") pod "dns-default-8jm6x" (UID: "852a630b-6cf7-4355-ae0b-49347eb3c4e1") : secret "dns-default-metrics-tls" not found Jul 17 18:10:29.806358 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:29.806317 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b52e56d1-173f-4c0b-b1ce-23904145a410-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4qhqv\" (UID: \"b52e56d1-173f-4c0b-b1ce-23904145a410\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4qhqv" Jul 17 18:10:29.806776 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:29.806480 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 17 18:10:29.806776 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:29.806567 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b52e56d1-173f-4c0b-b1ce-23904145a410-networking-console-plugin-cert podName:b52e56d1-173f-4c0b-b1ce-23904145a410 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:37.806545752 +0000 UTC m=+53.080156882 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b52e56d1-173f-4c0b-b1ce-23904145a410-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-4qhqv" (UID: "b52e56d1-173f-4c0b-b1ce-23904145a410") : secret "networking-console-plugin-cert" not found Jul 17 18:10:29.919557 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:29.919520 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:29.976805 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:29.976774 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:30.567304 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:30.567278 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:30.624200 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:30.624178 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:31.391356 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:31.391322 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gx8nh" event={"ID":"f345c916-a0a1-4610-90b8-113fada2a49a","Type":"ContainerStarted","Data":"9e2c98c0364a39483503f97a11d2dc3a54abe5d6085797ba0bf119b0e719d931"} Jul 17 18:10:31.392868 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:31.392841 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hghkd" event={"ID":"490303ef-c958-4260-84ee-1852150aae55","Type":"ContainerStarted","Data":"94d721757082fbf40b043370818876bdcfe1840be41dbe2e9e55eec0392545ab"} Jul 17 18:10:31.395040 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:31.394965 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-9bn2j" event={"ID":"86296674-d8de-4f65-9729-3dc6cbf134a2","Type":"ContainerStarted","Data":"ee44bac477479490c4a4b49d9d10fb38936ab1fbfe0e75a875cad1e7bb6c67cd"} Jul 17 18:10:31.396917 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:31.396889 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-l8njm" event={"ID":"0d37e971-7201-4f9b-a44c-e79ba57d5baa","Type":"ContainerStarted","Data":"bb1a857ea78c9b0031a9976953bf66086d739fade9b0a9cf74b0bf72715a01b3"} Jul 17 18:10:31.401845 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:31.401822 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-jxfz9" event={"ID":"e82b2034-7625-41a9-a5f0-cec5b7605b5c","Type":"ContainerStarted","Data":"314a66b930159d018b7f9808b3c689d40d7cd0ccc426341d53cc74a2384b2fbe"} Jul 17 18:10:31.403670 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:31.403639 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-75v7p" event={"ID":"52639dcf-cedf-46de-a944-316eac2db0a8","Type":"ContainerStarted","Data":"27c007eb9d10b15d4489aed16c10045abcdb91ac8d0622c074379738fdcb27d8"} Jul 17 18:10:31.405610 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:31.405590 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nwqlr_c6017e7d-5ed2-4d7d-ba64-ba9ce933828f/console-operator/0.log" Jul 17 18:10:31.405706 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:31.405626 2576 generic.go:356] "Generic (PLEG): container finished" podID="c6017e7d-5ed2-4d7d-ba64-ba9ce933828f" containerID="545c1a0b4dd59f3ffb788417d271d3d4a2b7b9241612d77ef97165bef1eaaee6" exitCode=255 Jul 17 18:10:31.405706 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:31.405664 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-nwqlr" event={"ID":"c6017e7d-5ed2-4d7d-ba64-ba9ce933828f","Type":"ContainerDied","Data":"545c1a0b4dd59f3ffb788417d271d3d4a2b7b9241612d77ef97165bef1eaaee6"} Jul 17 18:10:31.405891 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:31.405854 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4zb24" podStartSLOduration=21.929196683 podStartE2EDuration="45.405836844s" totalImagesPullingTime="23.476640161s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:09:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:10:25.393477307 +0000 UTC m=+40.667088463" watchObservedRunningTime="2026-07-17 18:10:31.405836844 +0000 UTC m=+46.679447987" Jul 17 18:10:31.405988 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:31.405959 2576 scope.go:117] "RemoveContainer" containerID="545c1a0b4dd59f3ffb788417d271d3d4a2b7b9241612d77ef97165bef1eaaee6" Jul 17 18:10:31.406786 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:31.406567 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gx8nh" podStartSLOduration=2.954791032 podStartE2EDuration="10.406558286s" totalImagesPullingTime="7.451767254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:10:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:10:31.405050783 +0000 UTC m=+46.678661925" watchObservedRunningTime="2026-07-17 18:10:31.406558286 +0000 UTC m=+46.680169410" Jul 17 18:10:31.423565 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:31.423461 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-l8njm" podStartSLOduration=21.01950582 podStartE2EDuration="28.423446126s" totalImagesPullingTime="7.403940306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:10:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:10:31.421341521 +0000 UTC m=+46.694952663" watchObservedRunningTime="2026-07-17 18:10:31.423446126 +0000 UTC m=+46.697057261" Jul 17 18:10:31.450213 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:31.450146 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-nwqlr" Jul 17 18:10:31.450329 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:31.450262 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-nwqlr" Jul 17 18:10:31.453316 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:31.453258 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hghkd" podStartSLOduration=20.999372216 podStartE2EDuration="28.453246957s" totalImagesPullingTime="7.453874741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:10:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:10:31.452713454 +0000 UTC m=+46.726324596" watchObservedRunningTime="2026-07-17 18:10:31.453246957 +0000 UTC m=+46.726858099" Jul 17 18:10:31.453685 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:31.453656 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-jxfz9" podStartSLOduration=20.951948428 podStartE2EDuration="28.453646895s" totalImagesPullingTime="7.501698467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:10:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:10:31.438316792 +0000 UTC m=+46.711927934" watchObservedRunningTime="2026-07-17 18:10:31.453646895 +0000 UTC m=+46.727258037" Jul 17 18:10:31.473023 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:31.472921 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-75v7p" podStartSLOduration=21.020916582 podStartE2EDuration="28.472911126s" totalImagesPullingTime="7.451994544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:10:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:10:31.472761378 +0000 UTC m=+46.746372514" watchObservedRunningTime="2026-07-17 18:10:31.472911126 +0000 UTC m=+46.746522266" Jul 17 18:10:31.486447 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:31.486412 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-9bn2j" podStartSLOduration=21.024445346 podStartE2EDuration="28.486400268s" totalImagesPullingTime="7.461954922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:10:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:10:31.485655245 +0000 UTC m=+46.759266388" watchObservedRunningTime="2026-07-17 18:10:31.486400268 +0000 UTC m=+46.760011409" Jul 17 18:10:31.507275 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:31.507254 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:31.608751 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:31.608705 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:31.953536 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:31.953463 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:32.051778 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:32.051754 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:32.109988 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:32.109950 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:32.410507 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:32.410486 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nwqlr_c6017e7d-5ed2-4d7d-ba64-ba9ce933828f/console-operator/1.log" Jul 17 18:10:32.410936 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:32.410917 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nwqlr_c6017e7d-5ed2-4d7d-ba64-ba9ce933828f/console-operator/0.log" Jul 17 18:10:32.411011 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:32.410962 2576 generic.go:356] "Generic (PLEG): container finished" podID="c6017e7d-5ed2-4d7d-ba64-ba9ce933828f" containerID="85e50f53eca6d83b2434ef995dba39273cc05502fc44e0d3ab24be6da800d847" exitCode=255 Jul 17 18:10:32.411092 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:32.411068 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-nwqlr" event={"ID":"c6017e7d-5ed2-4d7d-ba64-ba9ce933828f","Type":"ContainerDied","Data":"85e50f53eca6d83b2434ef995dba39273cc05502fc44e0d3ab24be6da800d847"} Jul 17 18:10:32.411141 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:32.411124 2576 scope.go:117] "RemoveContainer" containerID="545c1a0b4dd59f3ffb788417d271d3d4a2b7b9241612d77ef97165bef1eaaee6" Jul 17 18:10:32.411276 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:32.411255 2576 scope.go:117] "RemoveContainer" containerID="85e50f53eca6d83b2434ef995dba39273cc05502fc44e0d3ab24be6da800d847" Jul 17 18:10:32.411459 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:32.411436 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-nwqlr_openshift-console-operator(c6017e7d-5ed2-4d7d-ba64-ba9ce933828f)\"" pod="openshift-console-operator/console-operator-565b7b569d-nwqlr" podUID="c6017e7d-5ed2-4d7d-ba64-ba9ce933828f" Jul 17 18:10:32.475759 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:32.475736 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:32.621857 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:32.621826 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:32.642046 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:32.642020 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-27qbd"] Jul 17 18:10:32.667205 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:32.667158 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-27qbd" Jul 17 18:10:32.670300 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:32.670281 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 17 18:10:32.670529 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:32.670514 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-85j6j\"" Jul 17 18:10:32.671472 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:32.671448 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 17 18:10:32.699402 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:32.699380 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-27qbd"] Jul 17 18:10:32.730820 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:32.730797 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:32.733937 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:32.733914 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69ee051d-625f-4724-abcb-49fa56dd3983-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-27qbd\" (UID: \"69ee051d-625f-4724-abcb-49fa56dd3983\") " pod="openshift-insights/insights-runtime-extractor-27qbd" Jul 17 18:10:32.734053 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:32.733948 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69ee051d-625f-4724-abcb-49fa56dd3983-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-27qbd\" (UID: \"69ee051d-625f-4724-abcb-49fa56dd3983\") " pod="openshift-insights/insights-runtime-extractor-27qbd" Jul 17 18:10:32.734053 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:32.734007 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/69ee051d-625f-4724-abcb-49fa56dd3983-data-volume\") pod \"insights-runtime-extractor-27qbd\" (UID: \"69ee051d-625f-4724-abcb-49fa56dd3983\") " pod="openshift-insights/insights-runtime-extractor-27qbd" Jul 17 18:10:32.734168 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:32.734136 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/69ee051d-625f-4724-abcb-49fa56dd3983-crio-socket\") pod \"insights-runtime-extractor-27qbd\" (UID: \"69ee051d-625f-4724-abcb-49fa56dd3983\") " pod="openshift-insights/insights-runtime-extractor-27qbd" Jul 17 18:10:32.734221 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:32.734186 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2d6l\" (UniqueName: \"kubernetes.io/projected/69ee051d-625f-4724-abcb-49fa56dd3983-kube-api-access-b2d6l\") pod \"insights-runtime-extractor-27qbd\" (UID: \"69ee051d-625f-4724-abcb-49fa56dd3983\") " pod="openshift-insights/insights-runtime-extractor-27qbd" Jul 17 18:10:32.835458 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:32.835432 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69ee051d-625f-4724-abcb-49fa56dd3983-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-27qbd\" (UID: \"69ee051d-625f-4724-abcb-49fa56dd3983\") " pod="openshift-insights/insights-runtime-extractor-27qbd" Jul 17 18:10:32.835561 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:32.835517 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69ee051d-625f-4724-abcb-49fa56dd3983-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-27qbd\" (UID: \"69ee051d-625f-4724-abcb-49fa56dd3983\") " pod="openshift-insights/insights-runtime-extractor-27qbd" Jul 17 18:10:32.835627 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:32.835588 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/69ee051d-625f-4724-abcb-49fa56dd3983-data-volume\") pod \"insights-runtime-extractor-27qbd\" (UID: \"69ee051d-625f-4724-abcb-49fa56dd3983\") " pod="openshift-insights/insights-runtime-extractor-27qbd" Jul 17 18:10:32.835627 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:32.835528 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 18:10:32.835718 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:32.835665 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69ee051d-625f-4724-abcb-49fa56dd3983-insights-runtime-extractor-tls podName:69ee051d-625f-4724-abcb-49fa56dd3983 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:33.335652859 +0000 UTC m=+48.609263979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/69ee051d-625f-4724-abcb-49fa56dd3983-insights-runtime-extractor-tls") pod "insights-runtime-extractor-27qbd" (UID: "69ee051d-625f-4724-abcb-49fa56dd3983") : secret "insights-runtime-extractor-tls" not found Jul 17 18:10:32.835718 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:32.835695 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/69ee051d-625f-4724-abcb-49fa56dd3983-crio-socket\") pod \"insights-runtime-extractor-27qbd\" (UID: \"69ee051d-625f-4724-abcb-49fa56dd3983\") " pod="openshift-insights/insights-runtime-extractor-27qbd" Jul 17 18:10:32.835813 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:32.835735 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2d6l\" (UniqueName: \"kubernetes.io/projected/69ee051d-625f-4724-abcb-49fa56dd3983-kube-api-access-b2d6l\") pod \"insights-runtime-extractor-27qbd\" (UID: \"69ee051d-625f-4724-abcb-49fa56dd3983\") " pod="openshift-insights/insights-runtime-extractor-27qbd" Jul 17 18:10:32.835813 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:32.835553 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 18:10:32.835922 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:32.835855 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69ee051d-625f-4724-abcb-49fa56dd3983-kube-rbac-proxy-cm podName:69ee051d-625f-4724-abcb-49fa56dd3983 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:33.335838377 +0000 UTC m=+48.609449497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/69ee051d-625f-4724-abcb-49fa56dd3983-kube-rbac-proxy-cm") pod "insights-runtime-extractor-27qbd" (UID: "69ee051d-625f-4724-abcb-49fa56dd3983") : configmap "kube-rbac-proxy" not found Jul 17 18:10:32.835922 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:32.835898 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/69ee051d-625f-4724-abcb-49fa56dd3983-crio-socket\") pod \"insights-runtime-extractor-27qbd\" (UID: \"69ee051d-625f-4724-abcb-49fa56dd3983\") " pod="openshift-insights/insights-runtime-extractor-27qbd" Jul 17 18:10:32.836092 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:32.836045 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/69ee051d-625f-4724-abcb-49fa56dd3983-data-volume\") pod \"insights-runtime-extractor-27qbd\" (UID: \"69ee051d-625f-4724-abcb-49fa56dd3983\") " pod="openshift-insights/insights-runtime-extractor-27qbd" Jul 17 18:10:32.844694 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:32.844674 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2d6l\" (UniqueName: \"kubernetes.io/projected/69ee051d-625f-4724-abcb-49fa56dd3983-kube-api-access-b2d6l\") pod \"insights-runtime-extractor-27qbd\" (UID: \"69ee051d-625f-4724-abcb-49fa56dd3983\") " pod="openshift-insights/insights-runtime-extractor-27qbd" Jul 17 18:10:33.126327 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:33.126296 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:33.226657 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:33.226631 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:33.294257 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:33.294233 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:33.339802 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:33.339779 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69ee051d-625f-4724-abcb-49fa56dd3983-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-27qbd\" (UID: \"69ee051d-625f-4724-abcb-49fa56dd3983\") " pod="openshift-insights/insights-runtime-extractor-27qbd" Jul 17 18:10:33.339906 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:33.339814 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69ee051d-625f-4724-abcb-49fa56dd3983-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-27qbd\" (UID: \"69ee051d-625f-4724-abcb-49fa56dd3983\") " pod="openshift-insights/insights-runtime-extractor-27qbd" Jul 17 18:10:33.339948 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:33.339930 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 18:10:33.339994 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:33.339930 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 18:10:33.340040 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:33.340010 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69ee051d-625f-4724-abcb-49fa56dd3983-insights-runtime-extractor-tls podName:69ee051d-625f-4724-abcb-49fa56dd3983 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:34.339991861 +0000 UTC m=+49.613602995 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/69ee051d-625f-4724-abcb-49fa56dd3983-insights-runtime-extractor-tls") pod "insights-runtime-extractor-27qbd" (UID: "69ee051d-625f-4724-abcb-49fa56dd3983") : secret "insights-runtime-extractor-tls" not found Jul 17 18:10:33.340081 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:33.340047 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69ee051d-625f-4724-abcb-49fa56dd3983-kube-rbac-proxy-cm podName:69ee051d-625f-4724-abcb-49fa56dd3983 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:34.340031034 +0000 UTC m=+49.613642155 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/69ee051d-625f-4724-abcb-49fa56dd3983-kube-rbac-proxy-cm") pod "insights-runtime-extractor-27qbd" (UID: "69ee051d-625f-4724-abcb-49fa56dd3983") : configmap "kube-rbac-proxy" not found Jul 17 18:10:33.415496 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:33.415448 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nwqlr_c6017e7d-5ed2-4d7d-ba64-ba9ce933828f/console-operator/1.log" Jul 17 18:10:33.415794 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:33.415729 2576 scope.go:117] "RemoveContainer" containerID="85e50f53eca6d83b2434ef995dba39273cc05502fc44e0d3ab24be6da800d847" Jul 17 18:10:33.415871 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:33.415853 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-nwqlr_openshift-console-operator(c6017e7d-5ed2-4d7d-ba64-ba9ce933828f)\"" pod="openshift-console-operator/console-operator-565b7b569d-nwqlr" podUID="c6017e7d-5ed2-4d7d-ba64-ba9ce933828f" Jul 17 18:10:33.758908 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:33.758822 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:33.869942 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:33.869919 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:33.969760 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:33.969721 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:34.179047 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:34.179007 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:34.280913 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:34.280877 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:34.349450 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:34.349421 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69ee051d-625f-4724-abcb-49fa56dd3983-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-27qbd\" (UID: \"69ee051d-625f-4724-abcb-49fa56dd3983\") " pod="openshift-insights/insights-runtime-extractor-27qbd" Jul 17 18:10:34.349588 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:34.349460 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69ee051d-625f-4724-abcb-49fa56dd3983-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-27qbd\" (UID: \"69ee051d-625f-4724-abcb-49fa56dd3983\") " pod="openshift-insights/insights-runtime-extractor-27qbd" Jul 17 18:10:34.349644 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:34.349632 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 18:10:34.349697 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:34.349685 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 18:10:34.349737 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:34.349691 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69ee051d-625f-4724-abcb-49fa56dd3983-insights-runtime-extractor-tls podName:69ee051d-625f-4724-abcb-49fa56dd3983 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:36.34967378 +0000 UTC m=+51.623284916 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/69ee051d-625f-4724-abcb-49fa56dd3983-insights-runtime-extractor-tls") pod "insights-runtime-extractor-27qbd" (UID: "69ee051d-625f-4724-abcb-49fa56dd3983") : secret "insights-runtime-extractor-tls" not found Jul 17 18:10:34.349737 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:34.349730 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69ee051d-625f-4724-abcb-49fa56dd3983-kube-rbac-proxy-cm podName:69ee051d-625f-4724-abcb-49fa56dd3983 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:36.349720328 +0000 UTC m=+51.623331454 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/69ee051d-625f-4724-abcb-49fa56dd3983-kube-rbac-proxy-cm") pod "insights-runtime-extractor-27qbd" (UID: "69ee051d-625f-4724-abcb-49fa56dd3983") : configmap "kube-rbac-proxy" not found Jul 17 18:10:35.381537 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:35.381512 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5hrpr_d74aab62-4360-4e21-9d51-57f2a63da3c4/dns-node-resolver/0.log" Jul 17 18:10:35.454658 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:35.454629 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:35.557431 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:35.557384 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:36.081904 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:36.081872 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:36.357831 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:36.357741 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:36.365958 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:36.365933 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69ee051d-625f-4724-abcb-49fa56dd3983-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-27qbd\" (UID: \"69ee051d-625f-4724-abcb-49fa56dd3983\") " pod="openshift-insights/insights-runtime-extractor-27qbd" Jul 17 18:10:36.366064 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:36.365971 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69ee051d-625f-4724-abcb-49fa56dd3983-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-27qbd\" (UID: \"69ee051d-625f-4724-abcb-49fa56dd3983\") " pod="openshift-insights/insights-runtime-extractor-27qbd" Jul 17 18:10:36.366103 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:36.366072 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 18:10:36.366140 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:36.366133 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69ee051d-625f-4724-abcb-49fa56dd3983-insights-runtime-extractor-tls podName:69ee051d-625f-4724-abcb-49fa56dd3983 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:40.366119143 +0000 UTC m=+55.639730264 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/69ee051d-625f-4724-abcb-49fa56dd3983-insights-runtime-extractor-tls") pod "insights-runtime-extractor-27qbd" (UID: "69ee051d-625f-4724-abcb-49fa56dd3983") : secret "insights-runtime-extractor-tls" not found Jul 17 18:10:36.366525 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:36.366510 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69ee051d-625f-4724-abcb-49fa56dd3983-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-27qbd\" (UID: \"69ee051d-625f-4724-abcb-49fa56dd3983\") " pod="openshift-insights/insights-runtime-extractor-27qbd" Jul 17 18:10:36.387119 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:36.387096 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hpwk9_780d0c42-753a-4fd5-96d3-8a6fd8177494/node-ca/0.log" Jul 17 18:10:36.971999 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:36.971949 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a24dfc7c-8415-4449-908f-4376cf8c694c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-rsbql\" (UID: \"a24dfc7c-8415-4449-908f-4376cf8c694c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-rsbql" Jul 17 18:10:36.972166 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:36.972045 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-registry-tls\") pod \"image-registry-6598fb4596-t7r2p\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:10:36.972166 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:36.972070 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f102d994-82b5-4785-ac0e-04453f06bab6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-6g7gt\" (UID: \"f102d994-82b5-4785-ac0e-04453f06bab6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6g7gt" Jul 17 18:10:36.972166 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:36.972089 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 18:10:36.972166 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:36.972161 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a24dfc7c-8415-4449-908f-4376cf8c694c-cluster-monitoring-operator-tls podName:a24dfc7c-8415-4449-908f-4376cf8c694c nodeName:}" failed. No retries permitted until 2026-07-17 18:10:52.972142205 +0000 UTC m=+68.245753333 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a24dfc7c-8415-4449-908f-4376cf8c694c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-rsbql" (UID: "a24dfc7c-8415-4449-908f-4376cf8c694c") : secret "cluster-monitoring-operator-tls" not found Jul 17 18:10:36.972166 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:36.972160 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 18:10:36.972431 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:36.972177 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6598fb4596-t7r2p: secret "image-registry-tls" not found Jul 17 18:10:36.972431 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:36.972094 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-service-ca-bundle\") pod \"router-default-6b45f6d8d8-rp2wb\" (UID: \"ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27\") " pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" Jul 17 18:10:36.972431 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:36.972195 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 18:10:36.972431 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:36.972179 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-service-ca-bundle podName:ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:52.972168016 +0000 UTC m=+68.245779136 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-service-ca-bundle") pod "router-default-6b45f6d8d8-rp2wb" (UID: "ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27") : configmap references non-existent config key: service-ca.crt Jul 17 18:10:36.972431 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:36.972255 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-registry-tls podName:3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:52.972241751 +0000 UTC m=+68.245852875 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-registry-tls") pod "image-registry-6598fb4596-t7r2p" (UID: "3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6") : secret "image-registry-tls" not found Jul 17 18:10:36.972431 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:36.972274 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f102d994-82b5-4785-ac0e-04453f06bab6-samples-operator-tls podName:f102d994-82b5-4785-ac0e-04453f06bab6 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:52.972264818 +0000 UTC m=+68.245875942 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f102d994-82b5-4785-ac0e-04453f06bab6-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-6g7gt" (UID: "f102d994-82b5-4785-ac0e-04453f06bab6") : secret "samples-operator-tls" not found Jul 17 18:10:36.972431 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:36.972373 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-metrics-certs\") pod \"router-default-6b45f6d8d8-rp2wb\" (UID: \"ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27\") " pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" Jul 17 18:10:36.972648 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:36.972475 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 18:10:36.972648 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:36.972517 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-metrics-certs podName:ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:52.972505432 +0000 UTC m=+68.246116555 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-metrics-certs") pod "router-default-6b45f6d8d8-rp2wb" (UID: "ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27") : secret "router-metrics-certs-default" not found Jul 17 18:10:36.983816 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:36.983794 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gx8nh_f345c916-a0a1-4610-90b8-113fada2a49a/serve-healthcheck-canary/0.log" Jul 17 18:10:37.073059 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:37.073029 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/852a630b-6cf7-4355-ae0b-49347eb3c4e1-metrics-tls\") pod \"dns-default-8jm6x\" (UID: \"852a630b-6cf7-4355-ae0b-49347eb3c4e1\") " pod="openshift-dns/dns-default-8jm6x" Jul 17 18:10:37.073212 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:37.073132 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 18:10:37.073212 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:37.073181 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/852a630b-6cf7-4355-ae0b-49347eb3c4e1-metrics-tls podName:852a630b-6cf7-4355-ae0b-49347eb3c4e1 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:53.073168047 +0000 UTC m=+68.346779167 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/852a630b-6cf7-4355-ae0b-49347eb3c4e1-metrics-tls") pod "dns-default-8jm6x" (UID: "852a630b-6cf7-4355-ae0b-49347eb3c4e1") : secret "dns-default-metrics-tls" not found Jul 17 18:10:37.879381 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:37.879350 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b52e56d1-173f-4c0b-b1ce-23904145a410-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4qhqv\" (UID: \"b52e56d1-173f-4c0b-b1ce-23904145a410\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4qhqv" Jul 17 18:10:37.879768 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:37.879506 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 17 18:10:37.879768 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:37.879585 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b52e56d1-173f-4c0b-b1ce-23904145a410-networking-console-plugin-cert podName:b52e56d1-173f-4c0b-b1ce-23904145a410 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:53.879567677 +0000 UTC m=+69.153178811 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b52e56d1-173f-4c0b-b1ce-23904145a410-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-4qhqv" (UID: "b52e56d1-173f-4c0b-b1ce-23904145a410") : secret "networking-console-plugin-cert" not found Jul 17 18:10:37.983682 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:37.983643 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-hghkd_490303ef-c958-4260-84ee-1852150aae55/kube-storage-version-migrator-operator/0.log" Jul 17 18:10:39.327777 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:39.327741 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:40.297625 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:40.297595 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:40.399801 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:40.399751 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69ee051d-625f-4724-abcb-49fa56dd3983-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-27qbd\" (UID: \"69ee051d-625f-4724-abcb-49fa56dd3983\") " pod="openshift-insights/insights-runtime-extractor-27qbd" Jul 17 18:10:40.400285 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:40.399892 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 18:10:40.400285 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:40.400005 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69ee051d-625f-4724-abcb-49fa56dd3983-insights-runtime-extractor-tls podName:69ee051d-625f-4724-abcb-49fa56dd3983 nodeName:}" failed. No retries permitted until 2026-07-17 18:10:48.399959942 +0000 UTC m=+63.673571080 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/69ee051d-625f-4724-abcb-49fa56dd3983-insights-runtime-extractor-tls") pod "insights-runtime-extractor-27qbd" (UID: "69ee051d-625f-4724-abcb-49fa56dd3983") : secret "insights-runtime-extractor-tls" not found Jul 17 18:10:40.426381 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:40.426352 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:40.527913 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:40.527865 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:40.629165 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:40.629078 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:40.727710 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:40.727685 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:40.980121 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:40.980046 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:41.450619 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:41.450592 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-nwqlr" Jul 17 18:10:41.451026 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:41.450641 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-nwqlr" Jul 17 18:10:41.451026 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:41.450942 2576 scope.go:117] "RemoveContainer" containerID="85e50f53eca6d83b2434ef995dba39273cc05502fc44e0d3ab24be6da800d847" Jul 17 18:10:41.451110 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:10:41.451090 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-nwqlr_openshift-console-operator(c6017e7d-5ed2-4d7d-ba64-ba9ce933828f)\"" pod="openshift-console-operator/console-operator-565b7b569d-nwqlr" podUID="c6017e7d-5ed2-4d7d-ba64-ba9ce933828f" Jul 17 18:10:41.974151 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:41.974122 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:42.382411 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:42.382381 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:42.598953 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:42.598916 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:42.780436 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:42.780356 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:42.833774 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:42.833748 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:42.977835 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:42.977804 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:43.692089 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:43.692055 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:43.792731 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:43.792689 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:43.983672 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:43.983581 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:44.378851 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:44.378808 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:44.579691 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:44.579663 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:44.680499 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:44.680415 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:44.780556 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:44.780526 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:45.175070 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:45.175039 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:45.802017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:45.801963 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:46.186550 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:46.186480 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:46.330905 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:46.330886 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6pqqj" Jul 17 18:10:46.372744 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:46.372723 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:46.638290 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:46.638257 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:46.774864 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:46.774842 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:47.380273 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:47.380254 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:47.482575 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:47.482555 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:47.583146 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:47.583122 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:47.684628 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:47.684546 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:47.974895 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:47.974829 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:48.467444 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:48.467423 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69ee051d-625f-4724-abcb-49fa56dd3983-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-27qbd\" (UID: \"69ee051d-625f-4724-abcb-49fa56dd3983\") " pod="openshift-insights/insights-runtime-extractor-27qbd" Jul 17 18:10:48.469512 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:48.469490 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69ee051d-625f-4724-abcb-49fa56dd3983-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-27qbd\" (UID: \"69ee051d-625f-4724-abcb-49fa56dd3983\") " pod="openshift-insights/insights-runtime-extractor-27qbd" Jul 17 18:10:48.571246 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:48.571218 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:48.577822 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:48.577804 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-85j6j\"" Jul 17 18:10:48.586326 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:48.586311 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-27qbd" Jul 17 18:10:48.703578 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:48.703551 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-27qbd"] Jul 17 18:10:48.706232 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:10:48.706207 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69ee051d_625f_4724_abcb_49fa56dd3983.slice/crio-7cc7d6775110890e7f1df68a65476ed22afae86e51890c95fe8a93122a7dce9a WatchSource:0}: Error finding container 7cc7d6775110890e7f1df68a65476ed22afae86e51890c95fe8a93122a7dce9a: Status 404 returned error can't find the container with id 7cc7d6775110890e7f1df68a65476ed22afae86e51890c95fe8a93122a7dce9a Jul 17 18:10:49.000583 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:49.000563 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:49.377198 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:49.377124 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:49.463782 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:49.463749 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-27qbd" event={"ID":"69ee051d-625f-4724-abcb-49fa56dd3983","Type":"ContainerStarted","Data":"7cc7d6775110890e7f1df68a65476ed22afae86e51890c95fe8a93122a7dce9a"} Jul 17 18:10:49.597016 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:49.596969 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:50.178216 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:50.178182 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:50.379174 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:50.379141 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:50.581607 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:50.581574 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:50.890127 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:50.890050 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31390317-6109-491f-8d6a-6530a57f25c2-metrics-certs\") pod \"network-metrics-daemon-fgr6m\" (UID: \"31390317-6109-491f-8d6a-6530a57f25c2\") " pod="openshift-multus/network-metrics-daemon-fgr6m" Jul 17 18:10:50.892430 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:50.892411 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 18:10:50.903295 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:50.903272 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31390317-6109-491f-8d6a-6530a57f25c2-metrics-certs\") pod \"network-metrics-daemon-fgr6m\" (UID: \"31390317-6109-491f-8d6a-6530a57f25c2\") " pod="openshift-multus/network-metrics-daemon-fgr6m" Jul 17 18:10:50.923618 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:50.923594 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nj845\"" Jul 17 18:10:50.932412 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:50.932390 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fgr6m" Jul 17 18:10:50.985464 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:50.985443 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:50.991866 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:50.991838 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0e11cff-8760-45ef-80a5-d966038cf469-original-pull-secret\") pod \"global-pull-secret-syncer-9sg94\" (UID: \"a0e11cff-8760-45ef-80a5-d966038cf469\") " pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:10:50.994659 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:50.994641 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 18:10:51.004445 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:51.004425 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0e11cff-8760-45ef-80a5-d966038cf469-original-pull-secret\") pod \"global-pull-secret-syncer-9sg94\" (UID: \"a0e11cff-8760-45ef-80a5-d966038cf469\") " pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:10:51.093099 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:51.093064 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmw9c\" (UniqueName: \"kubernetes.io/projected/bb8f1a9f-2737-4a45-8507-997facd5c5fb-kube-api-access-kmw9c\") pod \"network-check-target-srkxv\" (UID: \"bb8f1a9f-2737-4a45-8507-997facd5c5fb\") " pod="openshift-network-diagnostics/network-check-target-srkxv" Jul 17 18:10:51.095684 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:51.095652 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmw9c\" (UniqueName: \"kubernetes.io/projected/bb8f1a9f-2737-4a45-8507-997facd5c5fb-kube-api-access-kmw9c\") pod \"network-check-target-srkxv\" (UID: \"bb8f1a9f-2737-4a45-8507-997facd5c5fb\") " pod="openshift-network-diagnostics/network-check-target-srkxv" Jul 17 18:10:51.210157 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:51.210085 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sg94" Jul 17 18:10:51.219564 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:51.219539 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-47jdr\"" Jul 17 18:10:51.228161 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:51.228033 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srkxv" Jul 17 18:10:53.011379 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.011329 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-registry-tls\") pod \"image-registry-6598fb4596-t7r2p\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:10:53.011797 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.011391 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f102d994-82b5-4785-ac0e-04453f06bab6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-6g7gt\" (UID: \"f102d994-82b5-4785-ac0e-04453f06bab6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6g7gt" Jul 17 18:10:53.011797 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.011427 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-service-ca-bundle\") pod \"router-default-6b45f6d8d8-rp2wb\" (UID: \"ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27\") " pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" Jul 17 18:10:53.011797 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.011476 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-metrics-certs\") pod \"router-default-6b45f6d8d8-rp2wb\" (UID: \"ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27\") " pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" Jul 17 18:10:53.011797 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.011520 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a24dfc7c-8415-4449-908f-4376cf8c694c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-rsbql\" (UID: \"a24dfc7c-8415-4449-908f-4376cf8c694c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-rsbql" Jul 17 18:10:53.012209 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.012184 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-service-ca-bundle\") pod \"router-default-6b45f6d8d8-rp2wb\" (UID: \"ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27\") " pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" Jul 17 18:10:53.014277 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.014251 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-registry-tls\") pod \"image-registry-6598fb4596-t7r2p\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:10:53.014378 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.014330 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27-metrics-certs\") pod \"router-default-6b45f6d8d8-rp2wb\" (UID: \"ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27\") " pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" Jul 17 18:10:53.014378 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.014358 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a24dfc7c-8415-4449-908f-4376cf8c694c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-rsbql\" (UID: \"a24dfc7c-8415-4449-908f-4376cf8c694c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-rsbql" Jul 17 18:10:53.014458 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.014413 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f102d994-82b5-4785-ac0e-04453f06bab6-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-6g7gt\" (UID: \"f102d994-82b5-4785-ac0e-04453f06bab6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6g7gt" Jul 17 18:10:53.112492 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.112459 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/852a630b-6cf7-4355-ae0b-49347eb3c4e1-metrics-tls\") pod \"dns-default-8jm6x\" (UID: \"852a630b-6cf7-4355-ae0b-49347eb3c4e1\") " pod="openshift-dns/dns-default-8jm6x" Jul 17 18:10:53.114929 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.114897 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/852a630b-6cf7-4355-ae0b-49347eb3c4e1-metrics-tls\") pod \"dns-default-8jm6x\" (UID: \"852a630b-6cf7-4355-ae0b-49347eb3c4e1\") " pod="openshift-dns/dns-default-8jm6x" Jul 17 18:10:53.181203 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.181182 2576 scope.go:117] "RemoveContainer" containerID="85e50f53eca6d83b2434ef995dba39273cc05502fc44e0d3ab24be6da800d847" Jul 17 18:10:53.235088 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.235063 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ksssl\"" Jul 17 18:10:53.243700 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.243674 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:10:53.244603 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.244585 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qr485\"" Jul 17 18:10:53.251969 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.251954 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-rsbql" Jul 17 18:10:53.277444 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.277396 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5wfbr\"" Jul 17 18:10:53.284430 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.284416 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vl9w9\"" Jul 17 18:10:53.285580 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.285568 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6g7gt" Jul 17 18:10:53.293802 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.293790 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" Jul 17 18:10:53.304508 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.304494 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vkv2q\"" Jul 17 18:10:53.314047 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.314031 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8jm6x" Jul 17 18:10:53.491641 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.491532 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nwqlr_c6017e7d-5ed2-4d7d-ba64-ba9ce933828f/console-operator/1.log" Jul 17 18:10:53.537995 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.537856 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-srkxv"] Jul 17 18:10:53.544937 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:10:53.544891 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb8f1a9f_2737_4a45_8507_997facd5c5fb.slice/crio-8ccf9bdee0b7e566a09084f5149efb632063a8dcb9651c5a4f00006aa172c0d4 WatchSource:0}: Error finding container 8ccf9bdee0b7e566a09084f5149efb632063a8dcb9651c5a4f00006aa172c0d4: Status 404 returned error can't find the container with id 8ccf9bdee0b7e566a09084f5149efb632063a8dcb9651c5a4f00006aa172c0d4 Jul 17 18:10:53.578065 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.578044 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6598fb4596-t7r2p"] Jul 17 18:10:53.653699 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.653679 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8jm6x"] Jul 17 18:10:53.741190 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:10:53.741162 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dd7bab3_cf0a_42f3_a5e0_bcc0c0dc5dd6.slice/crio-37a626111dc1627d6da10396324197e5f43aaf209c55fa7c240963be5e4361db WatchSource:0}: Error finding container 37a626111dc1627d6da10396324197e5f43aaf209c55fa7c240963be5e4361db: Status 404 returned error can't find the container with id 37a626111dc1627d6da10396324197e5f43aaf209c55fa7c240963be5e4361db Jul 17 18:10:53.741956 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:10:53.741933 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod852a630b_6cf7_4355_ae0b_49347eb3c4e1.slice/crio-ee79ff7841fdd7f7661b16a207649f955dbc99630fef4fd4341984902411c99d WatchSource:0}: Error finding container ee79ff7841fdd7f7661b16a207649f955dbc99630fef4fd4341984902411c99d: Status 404 returned error can't find the container with id ee79ff7841fdd7f7661b16a207649f955dbc99630fef4fd4341984902411c99d Jul 17 18:10:53.796127 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.796103 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-rsbql"] Jul 17 18:10:53.798616 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.798553 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6g7gt"] Jul 17 18:10:53.798714 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:10:53.798665 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda24dfc7c_8415_4449_908f_4376cf8c694c.slice/crio-35dd261a724e97acae0fa2cd461500f6bc4c01575ab600fcee1f1d001985fe9a WatchSource:0}: Error finding container 35dd261a724e97acae0fa2cd461500f6bc4c01575ab600fcee1f1d001985fe9a: Status 404 returned error can't find the container with id 35dd261a724e97acae0fa2cd461500f6bc4c01575ab600fcee1f1d001985fe9a Jul 17 18:10:53.803577 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.803209 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b45f6d8d8-rp2wb"] Jul 17 18:10:53.805645 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:10:53.805619 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea07b754_ab4b_4f27_bdb4_d7ac4f0bce27.slice/crio-bb73dcd5d5548317089dd5bf15b2c2481c711454c33a07142d8541c5ed7b8797 WatchSource:0}: Error finding container bb73dcd5d5548317089dd5bf15b2c2481c711454c33a07142d8541c5ed7b8797: Status 404 returned error can't find the container with id bb73dcd5d5548317089dd5bf15b2c2481c711454c33a07142d8541c5ed7b8797 Jul 17 18:10:53.834366 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.834330 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9sg94"] Jul 17 18:10:53.837241 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.837059 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fgr6m"] Jul 17 18:10:53.842012 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:10:53.841951 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31390317_6109_491f_8d6a_6530a57f25c2.slice/crio-a75d9fc1c0c332ed5f7c882ca0a9da71d0a267bafbda86738e66194ad82c0583 WatchSource:0}: Error finding container a75d9fc1c0c332ed5f7c882ca0a9da71d0a267bafbda86738e66194ad82c0583: Status 404 returned error can't find the container with id a75d9fc1c0c332ed5f7c882ca0a9da71d0a267bafbda86738e66194ad82c0583 Jul 17 18:10:53.842522 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:10:53.842489 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0e11cff_8760_45ef_80a5_d966038cf469.slice/crio-711d9da023f6de079a2812f2c5c4e90dce8faf3e1d5220855d7b437583a1954c WatchSource:0}: Error finding container 711d9da023f6de079a2812f2c5c4e90dce8faf3e1d5220855d7b437583a1954c: Status 404 returned error can't find the container with id 711d9da023f6de079a2812f2c5c4e90dce8faf3e1d5220855d7b437583a1954c Jul 17 18:10:53.924556 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.924448 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b52e56d1-173f-4c0b-b1ce-23904145a410-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4qhqv\" (UID: \"b52e56d1-173f-4c0b-b1ce-23904145a410\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4qhqv" Jul 17 18:10:53.926902 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:53.926881 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b52e56d1-173f-4c0b-b1ce-23904145a410-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-4qhqv\" (UID: \"b52e56d1-173f-4c0b-b1ce-23904145a410\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4qhqv" Jul 17 18:10:54.132795 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.132694 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:54.161273 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.161237 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-w59br\"" Jul 17 18:10:54.169732 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.169705 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4qhqv" Jul 17 18:10:54.235480 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.235453 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:54.305098 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.305068 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:54.341657 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.341553 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-4qhqv"] Jul 17 18:10:54.345186 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:10:54.345156 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb52e56d1_173f_4c0b_b1ce_23904145a410.slice/crio-23e2a2cf1b6cacd36d2a2123d269d0f4574ccc260b2dc08f5d55f856d224582b WatchSource:0}: Error finding container 23e2a2cf1b6cacd36d2a2123d269d0f4574ccc260b2dc08f5d55f856d224582b: Status 404 returned error can't find the container with id 23e2a2cf1b6cacd36d2a2123d269d0f4574ccc260b2dc08f5d55f856d224582b Jul 17 18:10:54.425936 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.425828 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:54.500773 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.500745 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nwqlr_c6017e7d-5ed2-4d7d-ba64-ba9ce933828f/console-operator/1.log" Jul 17 18:10:54.500926 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.500832 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-nwqlr" event={"ID":"c6017e7d-5ed2-4d7d-ba64-ba9ce933828f","Type":"ContainerStarted","Data":"2bf46527fcb6ef484c87bd074ed69e5a1554fc70dea919c16c13b5016774a648"} Jul 17 18:10:54.505015 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.501781 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-nwqlr" Jul 17 18:10:54.509140 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.509107 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-27qbd" event={"ID":"69ee051d-625f-4724-abcb-49fa56dd3983","Type":"ContainerStarted","Data":"8b208237a0ee9a91f3f579df63742842b438fa470d41de9b727296df1888097b"} Jul 17 18:10:54.509455 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.509433 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-nwqlr" Jul 17 18:10:54.512027 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.512002 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8jm6x" event={"ID":"852a630b-6cf7-4355-ae0b-49347eb3c4e1","Type":"ContainerStarted","Data":"ee79ff7841fdd7f7661b16a207649f955dbc99630fef4fd4341984902411c99d"} Jul 17 18:10:54.514384 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.514363 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" event={"ID":"ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27","Type":"ContainerStarted","Data":"32b8fe1ed2efbcd61fca2cfc4e4a6fbe214562480466997d9f2ddc417d6063a3"} Jul 17 18:10:54.514523 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.514507 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" event={"ID":"ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27","Type":"ContainerStarted","Data":"bb73dcd5d5548317089dd5bf15b2c2481c711454c33a07142d8541c5ed7b8797"} Jul 17 18:10:54.519640 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.518692 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" event={"ID":"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6","Type":"ContainerStarted","Data":"4d6875d34141a8e0ea3284801ef1708de25db9c4c4a26503be337fc5567903a8"} Jul 17 18:10:54.519640 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.518732 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" event={"ID":"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6","Type":"ContainerStarted","Data":"37a626111dc1627d6da10396324197e5f43aaf209c55fa7c240963be5e4361db"} Jul 17 18:10:54.520628 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.519848 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:10:54.521295 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.521247 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-nwqlr" podStartSLOduration=44.005851762 podStartE2EDuration="51.52123187s" totalImagesPullingTime="7.515380108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:10:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:10:54.519894712 +0000 UTC m=+69.793505856" watchObservedRunningTime="2026-07-17 18:10:54.52123187 +0000 UTC m=+69.794843014" Jul 17 18:10:54.525345 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.525288 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-rsbql" event={"ID":"a24dfc7c-8415-4449-908f-4376cf8c694c","Type":"ContainerStarted","Data":"35dd261a724e97acae0fa2cd461500f6bc4c01575ab600fcee1f1d001985fe9a"} Jul 17 18:10:54.527413 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.527349 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9sg94" event={"ID":"a0e11cff-8760-45ef-80a5-d966038cf469","Type":"ContainerStarted","Data":"711d9da023f6de079a2812f2c5c4e90dce8faf3e1d5220855d7b437583a1954c"} Jul 17 18:10:54.530589 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.530537 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fgr6m" event={"ID":"31390317-6109-491f-8d6a-6530a57f25c2","Type":"ContainerStarted","Data":"a75d9fc1c0c332ed5f7c882ca0a9da71d0a267bafbda86738e66194ad82c0583"} Jul 17 18:10:54.533187 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.532866 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-srkxv" event={"ID":"bb8f1a9f-2737-4a45-8507-997facd5c5fb","Type":"ContainerStarted","Data":"e6d234002648ce2798fc8e5357ef5ea28126f4c17f803b7325c7d0be7a4726f7"} Jul 17 18:10:54.533187 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.532901 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-srkxv" event={"ID":"bb8f1a9f-2737-4a45-8507-997facd5c5fb","Type":"ContainerStarted","Data":"8ccf9bdee0b7e566a09084f5149efb632063a8dcb9651c5a4f00006aa172c0d4"} Jul 17 18:10:54.533358 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.533341 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-srkxv" Jul 17 18:10:54.534743 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.534684 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4qhqv" event={"ID":"b52e56d1-173f-4c0b-b1ce-23904145a410","Type":"ContainerStarted","Data":"23e2a2cf1b6cacd36d2a2123d269d0f4574ccc260b2dc08f5d55f856d224582b"} Jul 17 18:10:54.535751 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.535699 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6g7gt" event={"ID":"f102d994-82b5-4785-ac0e-04453f06bab6","Type":"ContainerStarted","Data":"4b623ff9cbf136d1e8758b46ed9b3c350e057997db14b0999478f554a51d5be5"} Jul 17 18:10:54.541752 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.541707 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" podStartSLOduration=68.54169315 podStartE2EDuration="1m8.54169315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:09:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:10:54.541164076 +0000 UTC m=+69.814775232" watchObservedRunningTime="2026-07-17 18:10:54.54169315 +0000 UTC m=+69.815304295" Jul 17 18:10:54.579912 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.579854 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" podStartSLOduration=51.579833278 podStartE2EDuration="51.579833278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:10:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:10:54.579198965 +0000 UTC m=+69.852810107" watchObservedRunningTime="2026-07-17 18:10:54.579833278 +0000 UTC m=+69.853444421" Jul 17 18:10:54.594805 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.594559 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-srkxv" podStartSLOduration=68.594547933 podStartE2EDuration="1m8.594547933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:09:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:10:54.594095195 +0000 UTC m=+69.867706337" watchObservedRunningTime="2026-07-17 18:10:54.594547933 +0000 UTC m=+69.868159077" Jul 17 18:10:54.597320 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.597289 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:54.651424 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.651368 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:54.801730 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.801667 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:54.997092 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:54.997015 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:55.051542 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:55.051457 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:55.294706 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:55.294612 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" Jul 17 18:10:55.297568 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:55.297388 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" Jul 17 18:10:55.550209 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:55.549058 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" Jul 17 18:10:55.550371 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:55.550254 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6b45f6d8d8-rp2wb" Jul 17 18:10:56.006152 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:56.006034 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:56.068435 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:56.068372 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:56.208287 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:56.208203 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:56.553088 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:56.553053 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fgr6m" event={"ID":"31390317-6109-491f-8d6a-6530a57f25c2","Type":"ContainerStarted","Data":"a7d6d3de2d33944bcf117c612665ca0ef1f0d177e523b6e41e8d21ec04d5156b"} Jul 17 18:10:57.209458 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:57.209425 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:57.323110 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:57.323039 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:10:57.428133 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:10:57.428099 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:01.553478 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:01.553415 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:01.574513 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:01.574460 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4qhqv" event={"ID":"b52e56d1-173f-4c0b-b1ce-23904145a410","Type":"ContainerStarted","Data":"368ed14278696c3aab678916dca0c7b8c97844e03db057b15a1abf4f9269604b"} Jul 17 18:11:01.576591 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:01.576564 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6g7gt" event={"ID":"f102d994-82b5-4785-ac0e-04453f06bab6","Type":"ContainerStarted","Data":"7b7776761be9fbc08a0fddc5af041e745f68dcbae1e20533ec98cb5f24388539"} Jul 17 18:11:01.576686 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:01.576620 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6g7gt" event={"ID":"f102d994-82b5-4785-ac0e-04453f06bab6","Type":"ContainerStarted","Data":"2bf9773a2bb3670c8961783d25aa8489cd6e7b71c5d8b96f7ad6fd8444db5d8d"} Jul 17 18:11:01.578839 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:01.578805 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-27qbd" event={"ID":"69ee051d-625f-4724-abcb-49fa56dd3983","Type":"ContainerStarted","Data":"8abe77d599193080a43371c1567e860f31244c680092536532819a3f1a61a2ae"} Jul 17 18:11:01.580608 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:01.580583 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8jm6x" event={"ID":"852a630b-6cf7-4355-ae0b-49347eb3c4e1","Type":"ContainerStarted","Data":"fca5f963544e20752689aa6e8f7a4ac57b19998c4821c260e1f613a15e607c46"} Jul 17 18:11:01.580706 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:01.580632 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8jm6x" event={"ID":"852a630b-6cf7-4355-ae0b-49347eb3c4e1","Type":"ContainerStarted","Data":"6d73818e638d8ed4a4bde40a0f31488bd8ed84d9366519c53945ed346ea64fe6"} Jul 17 18:11:01.580706 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:01.580677 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8jm6x" Jul 17 18:11:01.582151 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:01.582129 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-rsbql" event={"ID":"a24dfc7c-8415-4449-908f-4376cf8c694c","Type":"ContainerStarted","Data":"0e2afa05c96169f78fa366d2a01404ae8c7e28724f50400c175ad7b1e79f6891"} Jul 17 18:11:01.583940 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:01.583916 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9sg94" event={"ID":"a0e11cff-8760-45ef-80a5-d966038cf469","Type":"ContainerStarted","Data":"30869d664892eaae4d64ae45fc85ff6a4f6410d65c1e8f4873dd9a4c03d62ca4"} Jul 17 18:11:01.590350 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:01.590328 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fgr6m" event={"ID":"31390317-6109-491f-8d6a-6530a57f25c2","Type":"ContainerStarted","Data":"c201fc319a7ab4781c4f740f81d08fa6fa498b7c8b20e765c56a0e0daadd1c23"} Jul 17 18:11:01.609134 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:01.609074 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-4qhqv" podStartSLOduration=32.910687753 podStartE2EDuration="39.609058567s" totalImagesPullingTime="6.698370814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:10:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:11:01.590027718 +0000 UTC m=+76.863638861" watchObservedRunningTime="2026-07-17 18:11:01.609058567 +0000 UTC m=+76.882669687" Jul 17 18:11:01.624070 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:01.624036 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-rsbql" podStartSLOduration=51.341616774 podStartE2EDuration="58.624014782s" totalImagesPullingTime="7.282398008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:10:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:11:01.623617061 +0000 UTC m=+76.897228203" watchObservedRunningTime="2026-07-17 18:11:01.624014782 +0000 UTC m=+76.897625923" Jul 17 18:11:01.624555 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:01.624528 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9sg94" podStartSLOduration=68.37281171 podStartE2EDuration="1m15.624522154s" totalImagesPullingTime="7.251710444s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:09:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:11:01.609839723 +0000 UTC m=+76.883450866" watchObservedRunningTime="2026-07-17 18:11:01.624522154 +0000 UTC m=+76.898133292" Jul 17 18:11:01.633932 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:01.633913 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:01.645957 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:01.645922 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8jm6x" podStartSLOduration=33.364485048 podStartE2EDuration="40.645902355s" totalImagesPullingTime="7.281417307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:10:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:11:01.645230232 +0000 UTC m=+76.918841375" watchObservedRunningTime="2026-07-17 18:11:01.645902355 +0000 UTC m=+76.919513504" Jul 17 18:11:01.664445 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:01.664410 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fgr6m" podStartSLOduration=73.920062951 podStartE2EDuration="1m15.66439944s" totalImagesPullingTime="1.744336489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:09:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:11:01.663536885 +0000 UTC m=+76.937148028" watchObservedRunningTime="2026-07-17 18:11:01.66439944 +0000 UTC m=+76.938010582" Jul 17 18:11:01.712487 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:01.712457 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:01.779799 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:01.779777 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:01.845500 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:01.845450 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:01.946163 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:01.946141 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:02.120846 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:02.120795 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:02.263502 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:02.263476 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:02.362826 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:02.362792 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:02.473266 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:02.473196 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:02.526142 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:02.526115 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:02.613505 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:02.613454 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-6g7gt" podStartSLOduration=52.404980703 podStartE2EDuration="59.61343963s" totalImagesPullingTime="7.208458927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:10:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:11:02.612297841 +0000 UTC m=+77.885908980" watchObservedRunningTime="2026-07-17 18:11:02.61343963 +0000 UTC m=+77.887050771" Jul 17 18:11:04.628948 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:04.628917 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:04.682429 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:04.682383 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:05.817069 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:05.817040 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:05.866803 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:05.866779 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:06.614517 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:06.614489 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-27qbd" event={"ID":"69ee051d-625f-4724-abcb-49fa56dd3983","Type":"ContainerStarted","Data":"0211fe431fb73beb55c3c5a1d9d4825f623dc9273655ba9235568e659eb2d284"} Jul 17 18:11:06.631265 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:06.631216 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-27qbd" podStartSLOduration=18.094226373 podStartE2EDuration="34.631203479s" totalImagesPullingTime="16.536977106s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:10:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:11:06.630419308 +0000 UTC m=+81.904030449" watchObservedRunningTime="2026-07-17 18:11:06.631203479 +0000 UTC m=+81.904814642" Jul 17 18:11:07.289956 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:07.289871 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:07.390272 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:07.390246 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:08.364378 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:08.364350 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:08.466745 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:08.466718 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:09.024593 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.024562 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54c6bfdd65-bqp2k"] Jul 17 18:11:09.027347 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.027329 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54c6bfdd65-bqp2k" Jul 17 18:11:09.029231 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.029215 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 17 18:11:09.029428 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.029416 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 17 18:11:09.029937 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.029925 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wrbhg\"" Jul 17 18:11:09.030012 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.029945 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 17 18:11:09.030128 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.030113 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 17 18:11:09.030182 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.030170 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 17 18:11:09.030236 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.030181 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 17 18:11:09.030236 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.030198 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 17 18:11:09.038937 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.038913 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 17 18:11:09.041544 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.041523 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54c6bfdd65-bqp2k"] Jul 17 18:11:09.148027 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.148005 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-console-serving-cert\") pod \"console-54c6bfdd65-bqp2k\" (UID: \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\") " pod="openshift-console/console-54c6bfdd65-bqp2k" Jul 17 18:11:09.148137 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.148036 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-service-ca\") pod \"console-54c6bfdd65-bqp2k\" (UID: \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\") " pod="openshift-console/console-54c6bfdd65-bqp2k" Jul 17 18:11:09.148137 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.148055 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j52nx\" (UniqueName: \"kubernetes.io/projected/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-kube-api-access-j52nx\") pod \"console-54c6bfdd65-bqp2k\" (UID: \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\") " pod="openshift-console/console-54c6bfdd65-bqp2k" Jul 17 18:11:09.148137 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.148091 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-console-oauth-config\") pod \"console-54c6bfdd65-bqp2k\" (UID: \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\") " pod="openshift-console/console-54c6bfdd65-bqp2k" Jul 17 18:11:09.148252 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.148134 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-oauth-serving-cert\") pod \"console-54c6bfdd65-bqp2k\" (UID: \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\") " pod="openshift-console/console-54c6bfdd65-bqp2k" Jul 17 18:11:09.148252 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.148207 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-console-config\") pod \"console-54c6bfdd65-bqp2k\" (UID: \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\") " pod="openshift-console/console-54c6bfdd65-bqp2k" Jul 17 18:11:09.148252 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.148236 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-trusted-ca-bundle\") pod \"console-54c6bfdd65-bqp2k\" (UID: \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\") " pod="openshift-console/console-54c6bfdd65-bqp2k" Jul 17 18:11:09.248564 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.248540 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-console-config\") pod \"console-54c6bfdd65-bqp2k\" (UID: \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\") " pod="openshift-console/console-54c6bfdd65-bqp2k" Jul 17 18:11:09.248661 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.248569 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-trusted-ca-bundle\") pod \"console-54c6bfdd65-bqp2k\" (UID: \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\") " pod="openshift-console/console-54c6bfdd65-bqp2k" Jul 17 18:11:09.248661 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.248603 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-console-serving-cert\") pod \"console-54c6bfdd65-bqp2k\" (UID: \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\") " pod="openshift-console/console-54c6bfdd65-bqp2k" Jul 17 18:11:09.248661 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.248629 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-service-ca\") pod \"console-54c6bfdd65-bqp2k\" (UID: \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\") " pod="openshift-console/console-54c6bfdd65-bqp2k" Jul 17 18:11:09.248661 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.248653 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j52nx\" (UniqueName: \"kubernetes.io/projected/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-kube-api-access-j52nx\") pod \"console-54c6bfdd65-bqp2k\" (UID: \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\") " pod="openshift-console/console-54c6bfdd65-bqp2k" Jul 17 18:11:09.248904 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.248690 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-console-oauth-config\") pod \"console-54c6bfdd65-bqp2k\" (UID: \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\") " pod="openshift-console/console-54c6bfdd65-bqp2k" Jul 17 18:11:09.248904 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.248712 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-oauth-serving-cert\") pod \"console-54c6bfdd65-bqp2k\" (UID: \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\") " pod="openshift-console/console-54c6bfdd65-bqp2k" Jul 17 18:11:09.249400 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.249370 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-console-config\") pod \"console-54c6bfdd65-bqp2k\" (UID: \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\") " pod="openshift-console/console-54c6bfdd65-bqp2k" Jul 17 18:11:09.249520 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.249372 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-service-ca\") pod \"console-54c6bfdd65-bqp2k\" (UID: \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\") " pod="openshift-console/console-54c6bfdd65-bqp2k" Jul 17 18:11:09.249520 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.249477 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-trusted-ca-bundle\") pod \"console-54c6bfdd65-bqp2k\" (UID: \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\") " pod="openshift-console/console-54c6bfdd65-bqp2k" Jul 17 18:11:09.249520 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.249511 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-oauth-serving-cert\") pod \"console-54c6bfdd65-bqp2k\" (UID: \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\") " pod="openshift-console/console-54c6bfdd65-bqp2k" Jul 17 18:11:09.251149 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.251131 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-console-oauth-config\") pod \"console-54c6bfdd65-bqp2k\" (UID: \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\") " pod="openshift-console/console-54c6bfdd65-bqp2k" Jul 17 18:11:09.251264 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.251243 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-console-serving-cert\") pod \"console-54c6bfdd65-bqp2k\" (UID: \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\") " pod="openshift-console/console-54c6bfdd65-bqp2k" Jul 17 18:11:09.256386 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.256362 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j52nx\" (UniqueName: \"kubernetes.io/projected/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-kube-api-access-j52nx\") pod \"console-54c6bfdd65-bqp2k\" (UID: \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\") " pod="openshift-console/console-54c6bfdd65-bqp2k" Jul 17 18:11:09.342128 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.342106 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54c6bfdd65-bqp2k" Jul 17 18:11:09.440148 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.440104 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:09.469619 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.469595 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54c6bfdd65-bqp2k"] Jul 17 18:11:09.472603 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:11:09.472560 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b8f65ac_b3d8_4cf4_b0ba_f61b5c30953c.slice/crio-25dc930af55a0d02f9e8114ce0990c56dca5417eb98777b4d7bf3ed5ecd392b6 WatchSource:0}: Error finding container 25dc930af55a0d02f9e8114ce0990c56dca5417eb98777b4d7bf3ed5ecd392b6: Status 404 returned error can't find the container with id 25dc930af55a0d02f9e8114ce0990c56dca5417eb98777b4d7bf3ed5ecd392b6 Jul 17 18:11:09.625473 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.625418 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54c6bfdd65-bqp2k" event={"ID":"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c","Type":"ContainerStarted","Data":"25dc930af55a0d02f9e8114ce0990c56dca5417eb98777b4d7bf3ed5ecd392b6"} Jul 17 18:11:09.657581 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.657554 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:09.755570 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:09.755549 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:10.013034 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:10.012954 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:10.109795 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:10.109765 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:10.210800 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:10.210776 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:10.788913 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:10.788881 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:10.859133 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:10.859107 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:11.024803 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:11.024778 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:11.126856 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:11.126792 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:11.598034 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:11.598005 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8jm6x" Jul 17 18:11:12.639012 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:12.638962 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54c6bfdd65-bqp2k" event={"ID":"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c","Type":"ContainerStarted","Data":"6daaa2062a6cab4606c5f48d4df512ca8674f52506ef469e41116c0b31e30b0c"} Jul 17 18:11:12.654108 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:12.654065 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54c6bfdd65-bqp2k" podStartSLOduration=1.060382821 podStartE2EDuration="3.654046273s" totalImagesPullingTime="2.593663452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:11:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:11:12.653036691 +0000 UTC m=+87.926647832" watchObservedRunningTime="2026-07-17 18:11:12.654046273 +0000 UTC m=+87.927657416" Jul 17 18:11:13.702211 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:13.702178 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:13.804685 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:13.804657 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:16.557080 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:16.557058 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:11:16.822000 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:16.821908 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:16.886181 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:16.886157 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:18.236446 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:18.236412 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:18.293757 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:18.293730 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:19.235512 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:19.235478 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6598fb4596-t7r2p"] Jul 17 18:11:19.314125 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:19.314095 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:19.343173 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:19.343143 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54c6bfdd65-bqp2k" Jul 17 18:11:19.343298 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:19.343193 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54c6bfdd65-bqp2k" Jul 17 18:11:19.347610 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:19.347595 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54c6bfdd65-bqp2k" Jul 17 18:11:19.409744 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:19.409721 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:19.667404 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:19.667381 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54c6bfdd65-bqp2k" Jul 17 18:11:19.816539 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:19.816512 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:19.917862 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:19.917797 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:20.017852 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:20.017829 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:20.417192 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:20.417169 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:20.473455 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:20.473433 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:20.719125 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:20.719074 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:20.819606 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:20.819588 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:21.916810 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:21.916776 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:22.159853 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.159824 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:22.230695 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.230633 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-7964f"] Jul 17 18:11:22.235052 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.235034 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-r96rb"] Jul 17 18:11:22.235167 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.235148 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-7964f" Jul 17 18:11:22.237779 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.237756 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 17 18:11:22.237888 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.237756 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 17 18:11:22.237888 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.237762 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 17 18:11:22.237888 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.237759 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-r2r59\"" Jul 17 18:11:22.237888 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.237836 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 17 18:11:22.238242 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.238227 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r96rb" Jul 17 18:11:22.240173 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.240153 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 17 18:11:22.240276 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.240179 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 17 18:11:22.240331 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.240275 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-r66sj\"" Jul 17 18:11:22.240519 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.240503 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 17 18:11:22.248202 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.248185 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-7964f"] Jul 17 18:11:22.274416 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.274395 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:22.333953 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.333927 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/87fe467f-2f60-4f80-b5df-3d062652bb55-node-exporter-accelerators-collector-config\") pod \"node-exporter-r96rb\" (UID: \"87fe467f-2f60-4f80-b5df-3d062652bb55\") " pod="openshift-monitoring/node-exporter-r96rb" Jul 17 18:11:22.334074 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.333962 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/87fe467f-2f60-4f80-b5df-3d062652bb55-node-exporter-textfile\") pod \"node-exporter-r96rb\" (UID: \"87fe467f-2f60-4f80-b5df-3d062652bb55\") " pod="openshift-monitoring/node-exporter-r96rb" Jul 17 18:11:22.334074 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.334016 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/87fe467f-2f60-4f80-b5df-3d062652bb55-node-exporter-wtmp\") pod \"node-exporter-r96rb\" (UID: \"87fe467f-2f60-4f80-b5df-3d062652bb55\") " pod="openshift-monitoring/node-exporter-r96rb" Jul 17 18:11:22.334074 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.334058 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87fe467f-2f60-4f80-b5df-3d062652bb55-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r96rb\" (UID: \"87fe467f-2f60-4f80-b5df-3d062652bb55\") " pod="openshift-monitoring/node-exporter-r96rb" Jul 17 18:11:22.334180 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.334082 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d878t\" (UniqueName: \"kubernetes.io/projected/87fe467f-2f60-4f80-b5df-3d062652bb55-kube-api-access-d878t\") pod \"node-exporter-r96rb\" (UID: \"87fe467f-2f60-4f80-b5df-3d062652bb55\") " pod="openshift-monitoring/node-exporter-r96rb" Jul 17 18:11:22.334180 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.334100 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/87fe467f-2f60-4f80-b5df-3d062652bb55-node-exporter-tls\") pod \"node-exporter-r96rb\" (UID: \"87fe467f-2f60-4f80-b5df-3d062652bb55\") " pod="openshift-monitoring/node-exporter-r96rb" Jul 17 18:11:22.334180 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.334121 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9q46\" (UniqueName: \"kubernetes.io/projected/3c8f09f8-88c0-45aa-8574-e746b1fa4749-kube-api-access-s9q46\") pod \"kube-state-metrics-56c5594674-7964f\" (UID: \"3c8f09f8-88c0-45aa-8574-e746b1fa4749\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7964f" Jul 17 18:11:22.334180 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.334140 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87fe467f-2f60-4f80-b5df-3d062652bb55-metrics-client-ca\") pod \"node-exporter-r96rb\" (UID: \"87fe467f-2f60-4f80-b5df-3d062652bb55\") " pod="openshift-monitoring/node-exporter-r96rb" Jul 17 18:11:22.334180 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.334174 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/87fe467f-2f60-4f80-b5df-3d062652bb55-root\") pod \"node-exporter-r96rb\" (UID: \"87fe467f-2f60-4f80-b5df-3d062652bb55\") " pod="openshift-monitoring/node-exporter-r96rb" Jul 17 18:11:22.334350 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.334189 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3c8f09f8-88c0-45aa-8574-e746b1fa4749-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-7964f\" (UID: \"3c8f09f8-88c0-45aa-8574-e746b1fa4749\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7964f" Jul 17 18:11:22.334350 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.334223 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87fe467f-2f60-4f80-b5df-3d062652bb55-sys\") pod \"node-exporter-r96rb\" (UID: \"87fe467f-2f60-4f80-b5df-3d062652bb55\") " pod="openshift-monitoring/node-exporter-r96rb" Jul 17 18:11:22.334350 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.334237 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c8f09f8-88c0-45aa-8574-e746b1fa4749-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-7964f\" (UID: \"3c8f09f8-88c0-45aa-8574-e746b1fa4749\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7964f" Jul 17 18:11:22.334350 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.334265 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3c8f09f8-88c0-45aa-8574-e746b1fa4749-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-7964f\" (UID: \"3c8f09f8-88c0-45aa-8574-e746b1fa4749\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7964f" Jul 17 18:11:22.334350 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.334286 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c8f09f8-88c0-45aa-8574-e746b1fa4749-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-7964f\" (UID: \"3c8f09f8-88c0-45aa-8574-e746b1fa4749\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7964f" Jul 17 18:11:22.334350 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.334302 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c8f09f8-88c0-45aa-8574-e746b1fa4749-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-7964f\" (UID: \"3c8f09f8-88c0-45aa-8574-e746b1fa4749\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7964f" Jul 17 18:11:22.374447 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.374428 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:22.434969 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.434947 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/87fe467f-2f60-4f80-b5df-3d062652bb55-node-exporter-textfile\") pod \"node-exporter-r96rb\" (UID: \"87fe467f-2f60-4f80-b5df-3d062652bb55\") " pod="openshift-monitoring/node-exporter-r96rb" Jul 17 18:11:22.435085 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.434997 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/87fe467f-2f60-4f80-b5df-3d062652bb55-node-exporter-wtmp\") pod \"node-exporter-r96rb\" (UID: \"87fe467f-2f60-4f80-b5df-3d062652bb55\") " pod="openshift-monitoring/node-exporter-r96rb" Jul 17 18:11:22.435085 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.435018 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87fe467f-2f60-4f80-b5df-3d062652bb55-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r96rb\" (UID: \"87fe467f-2f60-4f80-b5df-3d062652bb55\") " pod="openshift-monitoring/node-exporter-r96rb" Jul 17 18:11:22.435085 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.435041 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d878t\" (UniqueName: \"kubernetes.io/projected/87fe467f-2f60-4f80-b5df-3d062652bb55-kube-api-access-d878t\") pod \"node-exporter-r96rb\" (UID: \"87fe467f-2f60-4f80-b5df-3d062652bb55\") " pod="openshift-monitoring/node-exporter-r96rb" Jul 17 18:11:22.435085 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.435066 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/87fe467f-2f60-4f80-b5df-3d062652bb55-node-exporter-tls\") pod \"node-exporter-r96rb\" (UID: \"87fe467f-2f60-4f80-b5df-3d062652bb55\") " pod="openshift-monitoring/node-exporter-r96rb" Jul 17 18:11:22.435289 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.435094 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9q46\" (UniqueName: \"kubernetes.io/projected/3c8f09f8-88c0-45aa-8574-e746b1fa4749-kube-api-access-s9q46\") pod \"kube-state-metrics-56c5594674-7964f\" (UID: \"3c8f09f8-88c0-45aa-8574-e746b1fa4749\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7964f" Jul 17 18:11:22.435289 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.435118 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87fe467f-2f60-4f80-b5df-3d062652bb55-metrics-client-ca\") pod \"node-exporter-r96rb\" (UID: \"87fe467f-2f60-4f80-b5df-3d062652bb55\") " pod="openshift-monitoring/node-exporter-r96rb" Jul 17 18:11:22.435289 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.435147 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/87fe467f-2f60-4f80-b5df-3d062652bb55-node-exporter-wtmp\") pod \"node-exporter-r96rb\" (UID: \"87fe467f-2f60-4f80-b5df-3d062652bb55\") " pod="openshift-monitoring/node-exporter-r96rb" Jul 17 18:11:22.435289 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.435147 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/87fe467f-2f60-4f80-b5df-3d062652bb55-root\") pod \"node-exporter-r96rb\" (UID: \"87fe467f-2f60-4f80-b5df-3d062652bb55\") " pod="openshift-monitoring/node-exporter-r96rb" Jul 17 18:11:22.435289 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.435184 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3c8f09f8-88c0-45aa-8574-e746b1fa4749-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-7964f\" (UID: \"3c8f09f8-88c0-45aa-8574-e746b1fa4749\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7964f" Jul 17 18:11:22.435289 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.435217 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87fe467f-2f60-4f80-b5df-3d062652bb55-sys\") pod \"node-exporter-r96rb\" (UID: \"87fe467f-2f60-4f80-b5df-3d062652bb55\") " pod="openshift-monitoring/node-exporter-r96rb" Jul 17 18:11:22.435289 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.435240 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c8f09f8-88c0-45aa-8574-e746b1fa4749-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-7964f\" (UID: \"3c8f09f8-88c0-45aa-8574-e746b1fa4749\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7964f" Jul 17 18:11:22.435289 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.435268 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3c8f09f8-88c0-45aa-8574-e746b1fa4749-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-7964f\" (UID: \"3c8f09f8-88c0-45aa-8574-e746b1fa4749\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7964f" Jul 17 18:11:22.435289 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:11:22.435243 2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 17 18:11:22.435289 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.435187 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/87fe467f-2f60-4f80-b5df-3d062652bb55-root\") pod \"node-exporter-r96rb\" (UID: \"87fe467f-2f60-4f80-b5df-3d062652bb55\") " pod="openshift-monitoring/node-exporter-r96rb" Jul 17 18:11:22.435732 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:11:22.435325 2576 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 17 18:11:22.435732 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:11:22.435350 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87fe467f-2f60-4f80-b5df-3d062652bb55-node-exporter-tls podName:87fe467f-2f60-4f80-b5df-3d062652bb55 nodeName:}" failed. No retries permitted until 2026-07-17 18:11:22.935330816 +0000 UTC m=+98.208941943 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/87fe467f-2f60-4f80-b5df-3d062652bb55-node-exporter-tls") pod "node-exporter-r96rb" (UID: "87fe467f-2f60-4f80-b5df-3d062652bb55") : secret "node-exporter-tls" not found Jul 17 18:11:22.435732 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.435273 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87fe467f-2f60-4f80-b5df-3d062652bb55-sys\") pod \"node-exporter-r96rb\" (UID: \"87fe467f-2f60-4f80-b5df-3d062652bb55\") " pod="openshift-monitoring/node-exporter-r96rb" Jul 17 18:11:22.435732 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:11:22.435380 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c8f09f8-88c0-45aa-8574-e746b1fa4749-kube-state-metrics-tls podName:3c8f09f8-88c0-45aa-8574-e746b1fa4749 nodeName:}" failed. No retries permitted until 2026-07-17 18:11:22.935364789 +0000 UTC m=+98.208975909 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/3c8f09f8-88c0-45aa-8574-e746b1fa4749-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-7964f" (UID: "3c8f09f8-88c0-45aa-8574-e746b1fa4749") : secret "kube-state-metrics-tls" not found Jul 17 18:11:22.435732 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.435320 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/87fe467f-2f60-4f80-b5df-3d062652bb55-node-exporter-textfile\") pod \"node-exporter-r96rb\" (UID: \"87fe467f-2f60-4f80-b5df-3d062652bb55\") " pod="openshift-monitoring/node-exporter-r96rb" Jul 17 18:11:22.435732 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.435400 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c8f09f8-88c0-45aa-8574-e746b1fa4749-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-7964f\" (UID: \"3c8f09f8-88c0-45aa-8574-e746b1fa4749\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7964f" Jul 17 18:11:22.435732 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.435430 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c8f09f8-88c0-45aa-8574-e746b1fa4749-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-7964f\" (UID: \"3c8f09f8-88c0-45aa-8574-e746b1fa4749\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7964f" Jul 17 18:11:22.435732 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.435483 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/87fe467f-2f60-4f80-b5df-3d062652bb55-node-exporter-accelerators-collector-config\") pod \"node-exporter-r96rb\" (UID: \"87fe467f-2f60-4f80-b5df-3d062652bb55\") " pod="openshift-monitoring/node-exporter-r96rb" Jul 17 18:11:22.435732 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.435575 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3c8f09f8-88c0-45aa-8574-e746b1fa4749-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-7964f\" (UID: \"3c8f09f8-88c0-45aa-8574-e746b1fa4749\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7964f" Jul 17 18:11:22.436209 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.435806 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87fe467f-2f60-4f80-b5df-3d062652bb55-metrics-client-ca\") pod \"node-exporter-r96rb\" (UID: \"87fe467f-2f60-4f80-b5df-3d062652bb55\") " pod="openshift-monitoring/node-exporter-r96rb" Jul 17 18:11:22.436209 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.435992 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3c8f09f8-88c0-45aa-8574-e746b1fa4749-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-7964f\" (UID: \"3c8f09f8-88c0-45aa-8574-e746b1fa4749\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7964f" Jul 17 18:11:22.436209 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.435992 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/87fe467f-2f60-4f80-b5df-3d062652bb55-node-exporter-accelerators-collector-config\") pod \"node-exporter-r96rb\" (UID: \"87fe467f-2f60-4f80-b5df-3d062652bb55\") " pod="openshift-monitoring/node-exporter-r96rb" Jul 17 18:11:22.436209 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.436135 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c8f09f8-88c0-45aa-8574-e746b1fa4749-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-7964f\" (UID: \"3c8f09f8-88c0-45aa-8574-e746b1fa4749\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7964f" Jul 17 18:11:22.437577 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.437555 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87fe467f-2f60-4f80-b5df-3d062652bb55-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r96rb\" (UID: \"87fe467f-2f60-4f80-b5df-3d062652bb55\") " pod="openshift-monitoring/node-exporter-r96rb" Jul 17 18:11:22.437734 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.437716 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c8f09f8-88c0-45aa-8574-e746b1fa4749-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-7964f\" (UID: \"3c8f09f8-88c0-45aa-8574-e746b1fa4749\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7964f" Jul 17 18:11:22.442664 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.442645 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9q46\" (UniqueName: \"kubernetes.io/projected/3c8f09f8-88c0-45aa-8574-e746b1fa4749-kube-api-access-s9q46\") pod \"kube-state-metrics-56c5594674-7964f\" (UID: \"3c8f09f8-88c0-45aa-8574-e746b1fa4749\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7964f" Jul 17 18:11:22.442738 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.442685 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d878t\" (UniqueName: \"kubernetes.io/projected/87fe467f-2f60-4f80-b5df-3d062652bb55-kube-api-access-d878t\") pod \"node-exporter-r96rb\" (UID: \"87fe467f-2f60-4f80-b5df-3d062652bb55\") " pod="openshift-monitoring/node-exporter-r96rb" Jul 17 18:11:22.532201 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.532148 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:22.629359 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.629328 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:22.827972 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.827945 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:22.939630 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.939608 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/87fe467f-2f60-4f80-b5df-3d062652bb55-node-exporter-tls\") pod \"node-exporter-r96rb\" (UID: \"87fe467f-2f60-4f80-b5df-3d062652bb55\") " pod="openshift-monitoring/node-exporter-r96rb" Jul 17 18:11:22.939998 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.939659 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c8f09f8-88c0-45aa-8574-e746b1fa4749-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-7964f\" (UID: \"3c8f09f8-88c0-45aa-8574-e746b1fa4749\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7964f" Jul 17 18:11:22.942041 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.942022 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/87fe467f-2f60-4f80-b5df-3d062652bb55-node-exporter-tls\") pod \"node-exporter-r96rb\" (UID: \"87fe467f-2f60-4f80-b5df-3d062652bb55\") " pod="openshift-monitoring/node-exporter-r96rb" Jul 17 18:11:22.942117 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.942098 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c8f09f8-88c0-45aa-8574-e746b1fa4749-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-7964f\" (UID: \"3c8f09f8-88c0-45aa-8574-e746b1fa4749\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7964f" Jul 17 18:11:22.991141 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:22.991118 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:23.145887 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.145840 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-7964f" Jul 17 18:11:23.155115 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.155090 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r96rb" Jul 17 18:11:23.188625 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.188603 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:23.218588 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:11:23.218567 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87fe467f_2f60_4f80_b5df_3d062652bb55.slice/crio-49810fcfaaae7ccebff0c2a0d9c884962cdbb1211f165899e34b8c8bf6f1945a WatchSource:0}: Error finding container 49810fcfaaae7ccebff0c2a0d9c884962cdbb1211f165899e34b8c8bf6f1945a: Status 404 returned error can't find the container with id 49810fcfaaae7ccebff0c2a0d9c884962cdbb1211f165899e34b8c8bf6f1945a Jul 17 18:11:23.279318 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.279293 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:23.283312 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.283271 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 18:11:23.299505 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.299298 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.301604 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.301540 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 17 18:11:23.302288 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.302215 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 18:11:23.303321 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.303113 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 17 18:11:23.303321 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.303291 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 17 18:11:23.303935 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.303502 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 17 18:11:23.303935 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.303582 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wdnjn\"" Jul 17 18:11:23.303935 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.303758 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 17 18:11:23.303935 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.303814 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 17 18:11:23.304195 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.304043 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 17 18:11:23.304422 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.304243 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 17 18:11:23.304826 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.304704 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 17 18:11:23.340042 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.338443 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-7964f"] Jul 17 18:11:23.341329 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:11:23.341298 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c8f09f8_88c0_45aa_8574_e746b1fa4749.slice/crio-5723097f9df4a90e0aab44020417ffa7975ddbf3d653c185ab3afdc22d607999 WatchSource:0}: Error finding container 5723097f9df4a90e0aab44020417ffa7975ddbf3d653c185ab3afdc22d607999: Status 404 returned error can't find the container with id 5723097f9df4a90e0aab44020417ffa7975ddbf3d653c185ab3afdc22d607999 Jul 17 18:11:23.342934 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.342914 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.343041 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.342944 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.343041 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.343019 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-web-config\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.343155 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.343065 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/842abb31-4d3f-4616-9901-3c4e690c45cd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.343155 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.343085 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/842abb31-4d3f-4616-9901-3c4e690c45cd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.343155 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.343116 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/842abb31-4d3f-4616-9901-3c4e690c45cd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.343155 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.343135 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.343417 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.343202 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxltr\" (UniqueName: \"kubernetes.io/projected/842abb31-4d3f-4616-9901-3c4e690c45cd-kube-api-access-kxltr\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.343417 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.343243 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-config-volume\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.343417 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.343265 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/842abb31-4d3f-4616-9901-3c4e690c45cd-config-out\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.343417 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.343291 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.343417 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.343324 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/842abb31-4d3f-4616-9901-3c4e690c45cd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.343417 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.343397 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.444778 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.444714 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxltr\" (UniqueName: \"kubernetes.io/projected/842abb31-4d3f-4616-9901-3c4e690c45cd-kube-api-access-kxltr\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.444778 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.444743 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-config-volume\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.444778 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.444762 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/842abb31-4d3f-4616-9901-3c4e690c45cd-config-out\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.445026 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.444783 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.445026 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.444826 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/842abb31-4d3f-4616-9901-3c4e690c45cd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.445026 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.444850 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.445026 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.444885 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.445026 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.444917 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.445026 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.444998 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-web-config\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.445026 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:11:23.445001 2576 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 17 18:11:23.445371 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.445040 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/842abb31-4d3f-4616-9901-3c4e690c45cd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.445371 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:11:23.445063 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-secret-alertmanager-main-tls podName:842abb31-4d3f-4616-9901-3c4e690c45cd nodeName:}" failed. No retries permitted until 2026-07-17 18:11:23.945045272 +0000 UTC m=+99.218656392 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "842abb31-4d3f-4616-9901-3c4e690c45cd") : secret "alertmanager-main-tls" not found Jul 17 18:11:23.445371 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.445094 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/842abb31-4d3f-4616-9901-3c4e690c45cd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.445371 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.445132 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/842abb31-4d3f-4616-9901-3c4e690c45cd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.445371 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.445166 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.445371 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.445261 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/842abb31-4d3f-4616-9901-3c4e690c45cd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.445672 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:11:23.445442 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/842abb31-4d3f-4616-9901-3c4e690c45cd-alertmanager-trusted-ca-bundle podName:842abb31-4d3f-4616-9901-3c4e690c45cd nodeName:}" failed. No retries permitted until 2026-07-17 18:11:23.945422871 +0000 UTC m=+99.219033995 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/842abb31-4d3f-4616-9901-3c4e690c45cd-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "842abb31-4d3f-4616-9901-3c4e690c45cd") : configmap references non-existent config key: ca-bundle.crt Jul 17 18:11:23.446517 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.445915 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/842abb31-4d3f-4616-9901-3c4e690c45cd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.448238 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.448195 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-config-volume\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.448845 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.448820 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.449275 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.449258 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.449371 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.449351 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/842abb31-4d3f-4616-9901-3c4e690c45cd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.450023 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.449669 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-web-config\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.450023 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.449769 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.450023 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.450017 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.450218 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.450196 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/842abb31-4d3f-4616-9901-3c4e690c45cd-config-out\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.454392 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.454368 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxltr\" (UniqueName: \"kubernetes.io/projected/842abb31-4d3f-4616-9901-3c4e690c45cd-kube-api-access-kxltr\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.679315 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.679287 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r96rb" event={"ID":"87fe467f-2f60-4f80-b5df-3d062652bb55","Type":"ContainerStarted","Data":"49810fcfaaae7ccebff0c2a0d9c884962cdbb1211f165899e34b8c8bf6f1945a"} Jul 17 18:11:23.680552 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.680525 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-7964f" event={"ID":"3c8f09f8-88c0-45aa-8574-e746b1fa4749","Type":"ContainerStarted","Data":"5723097f9df4a90e0aab44020417ffa7975ddbf3d653c185ab3afdc22d607999"} Jul 17 18:11:23.710171 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.710118 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:23.810137 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.810095 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:23.949526 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.949493 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/842abb31-4d3f-4616-9901-3c4e690c45cd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.949992 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.949558 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.950602 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.950576 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/842abb31-4d3f-4616-9901-3c4e690c45cd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:23.952291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:23.952267 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:24.095823 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:24.095778 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:24.213349 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:24.213306 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:11:24.453493 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:24.453392 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 18:11:24.599714 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:11:24.599688 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod842abb31_4d3f_4616_9901_3c4e690c45cd.slice/crio-5881eb7f2e715f871c33c47d0bb2b2d748633617c2846ab562d24780975dab69 WatchSource:0}: Error finding container 5881eb7f2e715f871c33c47d0bb2b2d748633617c2846ab562d24780975dab69: Status 404 returned error can't find the container with id 5881eb7f2e715f871c33c47d0bb2b2d748633617c2846ab562d24780975dab69 Jul 17 18:11:24.685540 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:24.685511 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"842abb31-4d3f-4616-9901-3c4e690c45cd","Type":"ContainerStarted","Data":"5881eb7f2e715f871c33c47d0bb2b2d748633617c2846ab562d24780975dab69"} Jul 17 18:11:25.099552 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:25.099526 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:25.197453 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:25.197425 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:25.300102 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:25.300073 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:25.355423 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:25.355395 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:25.692522 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:25.692485 2576 generic.go:356] "Generic (PLEG): container finished" podID="87fe467f-2f60-4f80-b5df-3d062652bb55" containerID="0dbde9d0c0a984656392158d474d5d2ac0baf66c310aa176c576b9ae5befb6fd" exitCode=0 Jul 17 18:11:25.692694 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:25.692548 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r96rb" event={"ID":"87fe467f-2f60-4f80-b5df-3d062652bb55","Type":"ContainerDied","Data":"0dbde9d0c0a984656392158d474d5d2ac0baf66c310aa176c576b9ae5befb6fd"} Jul 17 18:11:25.695139 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:25.695115 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-7964f" event={"ID":"3c8f09f8-88c0-45aa-8574-e746b1fa4749","Type":"ContainerStarted","Data":"e4776338da3d57602dd72d339b927cc5d7b35642590a46b948be3af70e1ffcc1"} Jul 17 18:11:25.695257 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:25.695166 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-7964f" event={"ID":"3c8f09f8-88c0-45aa-8574-e746b1fa4749","Type":"ContainerStarted","Data":"704662459d606070468b4e211b40d74a3a12a2954c54069f3550a355a25c5284"} Jul 17 18:11:25.695257 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:25.695200 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-7964f" event={"ID":"3c8f09f8-88c0-45aa-8574-e746b1fa4749","Type":"ContainerStarted","Data":"717265584a4b5820fd107a168b859d4f7d82ae595e8ac511980b7d36765b6fb1"} Jul 17 18:11:25.729469 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:25.729421 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-7964f" podStartSLOduration=1.805723144 podStartE2EDuration="3.729405409s" totalImagesPullingTime="1.923682265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:11:25.727252022 +0000 UTC m=+101.000863164" watchObservedRunningTime="2026-07-17 18:11:25.729405409 +0000 UTC m=+101.003016550" Jul 17 18:11:26.555942 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:26.555920 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-srkxv" Jul 17 18:11:26.701046 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:26.700960 2576 generic.go:356] "Generic (PLEG): container finished" podID="842abb31-4d3f-4616-9901-3c4e690c45cd" containerID="7d52e78cb8ffbe822a3b7cb2c2d94e2322a8a0f23f529875076bdc86022fd5cd" exitCode=0 Jul 17 18:11:26.701046 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:26.701016 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"842abb31-4d3f-4616-9901-3c4e690c45cd","Type":"ContainerDied","Data":"7d52e78cb8ffbe822a3b7cb2c2d94e2322a8a0f23f529875076bdc86022fd5cd"} Jul 17 18:11:26.703315 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:26.703293 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r96rb" event={"ID":"87fe467f-2f60-4f80-b5df-3d062652bb55","Type":"ContainerStarted","Data":"1e9cc5e92149c573bfdd32511cded7b36bafe1c5c13117d30d0140fa96033ebd"} Jul 17 18:11:26.703404 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:26.703343 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r96rb" event={"ID":"87fe467f-2f60-4f80-b5df-3d062652bb55","Type":"ContainerStarted","Data":"add5cc51f47cc9eb68961f6e9029cc3630f1756c236f49cf7ee73bf12c9eab9a"} Jul 17 18:11:26.743711 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:26.743670 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-r96rb" podStartSLOduration=2.9226728079999997 podStartE2EDuration="4.743658406s" totalImagesPullingTime="1.739132268s" totalInitContainerRuntime="81.85333ms" isStatefulPod=true podCreationTimestamp="2026-07-17 18:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:11:26.742505884 +0000 UTC m=+102.016117037" watchObservedRunningTime="2026-07-17 18:11:26.743658406 +0000 UTC m=+102.017269548" Jul 17 18:11:26.958586 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:26.958509 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57f8989b49-p5zmn"] Jul 17 18:11:26.964643 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:26.964621 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57f8989b49-p5zmn" Jul 17 18:11:26.965939 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:26.965914 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:26.975828 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:26.975806 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57f8989b49-p5zmn"] Jul 17 18:11:26.976143 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:26.976122 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trjn5\" (UniqueName: \"kubernetes.io/projected/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-kube-api-access-trjn5\") pod \"console-57f8989b49-p5zmn\" (UID: \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\") " pod="openshift-console/console-57f8989b49-p5zmn" Jul 17 18:11:26.976217 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:26.976154 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-console-config\") pod \"console-57f8989b49-p5zmn\" (UID: \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\") " pod="openshift-console/console-57f8989b49-p5zmn" Jul 17 18:11:26.976217 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:26.976179 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-trusted-ca-bundle\") pod \"console-57f8989b49-p5zmn\" (UID: \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\") " pod="openshift-console/console-57f8989b49-p5zmn" Jul 17 18:11:26.976217 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:26.976209 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-console-oauth-config\") pod \"console-57f8989b49-p5zmn\" (UID: \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\") " pod="openshift-console/console-57f8989b49-p5zmn" Jul 17 18:11:26.976389 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:26.976231 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-service-ca\") pod \"console-57f8989b49-p5zmn\" (UID: \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\") " pod="openshift-console/console-57f8989b49-p5zmn" Jul 17 18:11:26.976389 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:26.976267 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-console-serving-cert\") pod \"console-57f8989b49-p5zmn\" (UID: \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\") " pod="openshift-console/console-57f8989b49-p5zmn" Jul 17 18:11:26.976389 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:26.976372 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-oauth-serving-cert\") pod \"console-57f8989b49-p5zmn\" (UID: \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\") " pod="openshift-console/console-57f8989b49-p5zmn" Jul 17 18:11:27.051341 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:27.051315 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:27.077584 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:27.077561 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-console-oauth-config\") pod \"console-57f8989b49-p5zmn\" (UID: \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\") " pod="openshift-console/console-57f8989b49-p5zmn" Jul 17 18:11:27.077679 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:27.077589 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-service-ca\") pod \"console-57f8989b49-p5zmn\" (UID: \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\") " pod="openshift-console/console-57f8989b49-p5zmn" Jul 17 18:11:27.077679 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:27.077610 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-console-serving-cert\") pod \"console-57f8989b49-p5zmn\" (UID: \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\") " pod="openshift-console/console-57f8989b49-p5zmn" Jul 17 18:11:27.077827 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:27.077804 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-oauth-serving-cert\") pod \"console-57f8989b49-p5zmn\" (UID: \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\") " pod="openshift-console/console-57f8989b49-p5zmn" Jul 17 18:11:27.077876 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:27.077856 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trjn5\" (UniqueName: \"kubernetes.io/projected/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-kube-api-access-trjn5\") pod \"console-57f8989b49-p5zmn\" (UID: \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\") " pod="openshift-console/console-57f8989b49-p5zmn" Jul 17 18:11:27.077927 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:27.077883 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-console-config\") pod \"console-57f8989b49-p5zmn\" (UID: \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\") " pod="openshift-console/console-57f8989b49-p5zmn" Jul 17 18:11:27.077927 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:27.077910 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-trusted-ca-bundle\") pod \"console-57f8989b49-p5zmn\" (UID: \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\") " pod="openshift-console/console-57f8989b49-p5zmn" Jul 17 18:11:27.078418 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:27.078394 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-service-ca\") pod \"console-57f8989b49-p5zmn\" (UID: \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\") " pod="openshift-console/console-57f8989b49-p5zmn" Jul 17 18:11:27.078620 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:27.078597 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-oauth-serving-cert\") pod \"console-57f8989b49-p5zmn\" (UID: \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\") " pod="openshift-console/console-57f8989b49-p5zmn" Jul 17 18:11:27.078715 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:27.078638 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-console-config\") pod \"console-57f8989b49-p5zmn\" (UID: \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\") " pod="openshift-console/console-57f8989b49-p5zmn" Jul 17 18:11:27.078775 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:27.078739 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-trusted-ca-bundle\") pod \"console-57f8989b49-p5zmn\" (UID: \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\") " pod="openshift-console/console-57f8989b49-p5zmn" Jul 17 18:11:27.080189 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:27.080173 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-console-oauth-config\") pod \"console-57f8989b49-p5zmn\" (UID: \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\") " pod="openshift-console/console-57f8989b49-p5zmn" Jul 17 18:11:27.080265 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:27.080196 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-console-serving-cert\") pod \"console-57f8989b49-p5zmn\" (UID: \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\") " pod="openshift-console/console-57f8989b49-p5zmn" Jul 17 18:11:27.084622 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:27.084601 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trjn5\" (UniqueName: \"kubernetes.io/projected/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-kube-api-access-trjn5\") pod \"console-57f8989b49-p5zmn\" (UID: \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\") " pod="openshift-console/console-57f8989b49-p5zmn" Jul 17 18:11:27.152015 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:27.151994 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:27.205600 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:27.205581 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:27.277714 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:27.277617 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57f8989b49-p5zmn" Jul 17 18:11:27.421477 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:27.421368 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57f8989b49-p5zmn"] Jul 17 18:11:27.423665 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:11:27.423635 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb32ccce9_2ce2_4bb9_8019_7a18e1dd7479.slice/crio-9b9b052ddeaddefbd94cfb3f70c4d13899b09f51a91d35bfa771c3acf9c295b0 WatchSource:0}: Error finding container 9b9b052ddeaddefbd94cfb3f70c4d13899b09f51a91d35bfa771c3acf9c295b0: Status 404 returned error can't find the container with id 9b9b052ddeaddefbd94cfb3f70c4d13899b09f51a91d35bfa771c3acf9c295b0 Jul 17 18:11:27.709723 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:27.709692 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57f8989b49-p5zmn" event={"ID":"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479","Type":"ContainerStarted","Data":"5fe70753e7c9a56778b98f8a0e54261c3cb0c03b184f0cd57445df5a03697085"} Jul 17 18:11:27.710151 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:27.709742 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57f8989b49-p5zmn" event={"ID":"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479","Type":"ContainerStarted","Data":"9b9b052ddeaddefbd94cfb3f70c4d13899b09f51a91d35bfa771c3acf9c295b0"} Jul 17 18:11:28.359899 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.359874 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:28.365215 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.365166 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57f8989b49-p5zmn" podStartSLOduration=2.365148693 podStartE2EDuration="2.365148693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:11:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:11:27.72463861 +0000 UTC m=+102.998249753" watchObservedRunningTime="2026-07-17 18:11:28.365148693 +0000 UTC m=+103.638759836" Jul 17 18:11:28.367210 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.367188 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 17 18:11:28.372252 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.372236 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.374463 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.374424 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 17 18:11:28.374586 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.374494 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 17 18:11:28.375026 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.374969 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 17 18:11:28.375156 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.375140 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 17 18:11:28.375263 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.375222 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 17 18:11:28.375468 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.375450 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 17 18:11:28.375571 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.375536 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 17 18:11:28.375641 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.375575 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5i98p068o26r0\"" Jul 17 18:11:28.375641 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.375599 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 17 18:11:28.375641 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.375619 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 17 18:11:28.375762 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.375687 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 17 18:11:28.376205 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.376188 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8x4hz\"" Jul 17 18:11:28.376383 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.376366 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 17 18:11:28.376700 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.376566 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 17 18:11:28.376700 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.376580 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 17 18:11:28.376700 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.376616 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 17 18:11:28.377792 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.377773 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 17 18:11:28.388162 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.388138 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 17 18:11:28.389996 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.389931 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.390094 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.390016 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.390094 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.390047 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.390203 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.390102 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.390203 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.390125 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/736537c8-84ed-4e0b-8110-cbc34fa49128-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.390203 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.390175 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.390353 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.390238 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.390353 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.390274 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.390353 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.390297 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.390353 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.390317 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.390353 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.390341 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.390575 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.390406 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-web-config\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.390575 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.390427 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/736537c8-84ed-4e0b-8110-cbc34fa49128-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.390575 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.390466 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.390575 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.390486 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.390575 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.390526 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.390575 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.390552 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/736537c8-84ed-4e0b-8110-cbc34fa49128-config-out\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.390848 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.390579 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.390848 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.390603 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-config\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.390848 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.390622 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8lrg\" (UniqueName: \"kubernetes.io/projected/736537c8-84ed-4e0b-8110-cbc34fa49128-kube-api-access-m8lrg\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.491360 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.491331 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.491507 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.491369 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.491507 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.491390 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.491507 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.491422 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.491677 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.491538 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/736537c8-84ed-4e0b-8110-cbc34fa49128-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.491677 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.491593 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.491677 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.491634 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.491677 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.491662 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.491864 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.491688 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.491864 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.491712 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.491864 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.491739 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.491864 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.491784 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-web-config\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.491864 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.491810 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/736537c8-84ed-4e0b-8110-cbc34fa49128-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.491864 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.491849 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.492173 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.491874 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.492173 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.491926 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.492173 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.491957 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/736537c8-84ed-4e0b-8110-cbc34fa49128-config-out\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.492173 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.492012 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.492173 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.492012 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/736537c8-84ed-4e0b-8110-cbc34fa49128-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.492173 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.492041 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-config\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.492173 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.492087 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8lrg\" (UniqueName: \"kubernetes.io/projected/736537c8-84ed-4e0b-8110-cbc34fa49128-kube-api-access-m8lrg\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.492496 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.492336 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.492658 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:11:28.492638 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-prometheus-trusted-ca-bundle podName:736537c8-84ed-4e0b-8110-cbc34fa49128 nodeName:}" failed. No retries permitted until 2026-07-17 18:11:28.99261414 +0000 UTC m=+104.266225277 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-prometheus-trusted-ca-bundle") pod "prometheus-k8s-0" (UID: "736537c8-84ed-4e0b-8110-cbc34fa49128") : configmap references non-existent config key: ca-bundle.crt Jul 17 18:11:28.495801 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.494712 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.495801 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.495154 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.495801 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.495483 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.495801 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.495606 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.496231 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.496206 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.496771 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.496743 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.496858 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.496815 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.498106 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.498072 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/736537c8-84ed-4e0b-8110-cbc34fa49128-config-out\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.498204 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.498157 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/736537c8-84ed-4e0b-8110-cbc34fa49128-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.499347 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.498498 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.499347 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.498597 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-config\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.499347 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.498906 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.499347 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.499082 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-web-config\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.499347 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.499313 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.500082 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.500060 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.500464 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.500439 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.501767 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.501686 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8lrg\" (UniqueName: \"kubernetes.io/projected/736537c8-84ed-4e0b-8110-cbc34fa49128-kube-api-access-m8lrg\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.716779 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.716703 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"842abb31-4d3f-4616-9901-3c4e690c45cd","Type":"ContainerStarted","Data":"9c75162486b88e855f3027907d9dd4c638b31af9f07d2fd7f8ca77df4fb2bf1d"} Jul 17 18:11:28.716779 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.716766 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"842abb31-4d3f-4616-9901-3c4e690c45cd","Type":"ContainerStarted","Data":"fc7e209d176dc1a0c4553f4c527d0100d3c48a404b9aab6f7011b8cf97204c50"} Jul 17 18:11:28.717171 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.716793 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"842abb31-4d3f-4616-9901-3c4e690c45cd","Type":"ContainerStarted","Data":"5ef1a32e5499706fee31e1a7cf9e552c7cc5944d76cc34c7b1e077b79befdf79"} Jul 17 18:11:28.717171 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.716820 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"842abb31-4d3f-4616-9901-3c4e690c45cd","Type":"ContainerStarted","Data":"1398f645c78a2906bf002f2394e2c5998b06cf5a746b791c1548c1e869dde5ba"} Jul 17 18:11:28.717171 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.716843 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"842abb31-4d3f-4616-9901-3c4e690c45cd","Type":"ContainerStarted","Data":"5e9cb2d1d62b821c0ef1970600621e0d42665303bb1a2a87c6a1f7dcf6a3467e"} Jul 17 18:11:28.996961 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.996890 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:28.997850 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:28.997833 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:29.284914 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:29.284886 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:29.415896 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:29.415867 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 17 18:11:29.418836 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:11:29.418804 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod736537c8_84ed_4e0b_8110_cbc34fa49128.slice/crio-e62c6de94723ddaf9c9c7ff2f075b86321a58b8712c4abf7813a326883fa6495 WatchSource:0}: Error finding container e62c6de94723ddaf9c9c7ff2f075b86321a58b8712c4abf7813a326883fa6495: Status 404 returned error can't find the container with id e62c6de94723ddaf9c9c7ff2f075b86321a58b8712c4abf7813a326883fa6495 Jul 17 18:11:29.722166 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:29.722135 2576 generic.go:356] "Generic (PLEG): container finished" podID="736537c8-84ed-4e0b-8110-cbc34fa49128" containerID="ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870" exitCode=0 Jul 17 18:11:29.722490 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:29.722188 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"736537c8-84ed-4e0b-8110-cbc34fa49128","Type":"ContainerDied","Data":"ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870"} Jul 17 18:11:29.722490 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:29.722254 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"736537c8-84ed-4e0b-8110-cbc34fa49128","Type":"ContainerStarted","Data":"e62c6de94723ddaf9c9c7ff2f075b86321a58b8712c4abf7813a326883fa6495"} Jul 17 18:11:29.725707 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:29.725683 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"842abb31-4d3f-4616-9901-3c4e690c45cd","Type":"ContainerStarted","Data":"3e7efca445b6ece8e90bec95f81e6fc828c06fdb6089983147e219ba334d995e"} Jul 17 18:11:29.747548 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:29.747524 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:29.772831 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:29.772763 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.326454414 podStartE2EDuration="6.772750936s" totalImagesPullingTime="3.424043057s" totalInitContainerRuntime="22.253465ms" isStatefulPod=false podCreationTimestamp="2026-07-17 18:11:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:11:29.770453297 +0000 UTC m=+105.044064440" watchObservedRunningTime="2026-07-17 18:11:29.772750936 +0000 UTC m=+105.046362077" Jul 17 18:11:29.845334 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:29.845297 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:32.476544 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:32.476506 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:32.535447 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:32.535417 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:33.744128 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:33.744051 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"736537c8-84ed-4e0b-8110-cbc34fa49128","Type":"ContainerStarted","Data":"c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b"} Jul 17 18:11:33.744128 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:33.744117 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"736537c8-84ed-4e0b-8110-cbc34fa49128","Type":"ContainerStarted","Data":"674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb"} Jul 17 18:11:35.300013 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:35.299963 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57f8989b49-p5zmn"] Jul 17 18:11:35.490453 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:35.490417 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:35.589531 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:35.589445 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:36.110272 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:36.110109 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:36.161492 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:36.161466 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:36.758485 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:36.758461 2576 generic.go:356] "Generic (PLEG): container finished" podID="490303ef-c958-4260-84ee-1852150aae55" containerID="94d721757082fbf40b043370818876bdcfe1840be41dbe2e9e55eec0392545ab" exitCode=0 Jul 17 18:11:36.758820 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:36.758533 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hghkd" event={"ID":"490303ef-c958-4260-84ee-1852150aae55","Type":"ContainerDied","Data":"94d721757082fbf40b043370818876bdcfe1840be41dbe2e9e55eec0392545ab"} Jul 17 18:11:36.758868 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:36.758832 2576 scope.go:117] "RemoveContainer" containerID="94d721757082fbf40b043370818876bdcfe1840be41dbe2e9e55eec0392545ab" Jul 17 18:11:36.762206 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:36.762189 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"736537c8-84ed-4e0b-8110-cbc34fa49128","Type":"ContainerStarted","Data":"15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098"} Jul 17 18:11:36.762289 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:36.762235 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"736537c8-84ed-4e0b-8110-cbc34fa49128","Type":"ContainerStarted","Data":"d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9"} Jul 17 18:11:36.762289 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:36.762260 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"736537c8-84ed-4e0b-8110-cbc34fa49128","Type":"ContainerStarted","Data":"931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e"} Jul 17 18:11:36.762289 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:36.762282 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"736537c8-84ed-4e0b-8110-cbc34fa49128","Type":"ContainerStarted","Data":"dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5"} Jul 17 18:11:36.803801 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:36.803749 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.03491269 podStartE2EDuration="8.803730767s" totalImagesPullingTime="5.750122142s" totalInitContainerRuntime="18.695935ms" isStatefulPod=false podCreationTimestamp="2026-07-17 18:11:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:11:36.802333366 +0000 UTC m=+112.075944510" watchObservedRunningTime="2026-07-17 18:11:36.803730767 +0000 UTC m=+112.077341910" Jul 17 18:11:37.278000 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:37.277960 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57f8989b49-p5zmn" Jul 17 18:11:37.768017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:37.767969 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hghkd" event={"ID":"490303ef-c958-4260-84ee-1852150aae55","Type":"ContainerStarted","Data":"eea03876a850b0199768d7d95c1c35d7a01b4adc8f396fb405ce08b6635acf7e"} Jul 17 18:11:37.769433 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:37.769410 2576 generic.go:356] "Generic (PLEG): container finished" podID="52639dcf-cedf-46de-a944-316eac2db0a8" containerID="27c007eb9d10b15d4489aed16c10045abcdb91ac8d0622c074379738fdcb27d8" exitCode=0 Jul 17 18:11:37.769538 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:37.769484 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-75v7p" event={"ID":"52639dcf-cedf-46de-a944-316eac2db0a8","Type":"ContainerDied","Data":"27c007eb9d10b15d4489aed16c10045abcdb91ac8d0622c074379738fdcb27d8"} Jul 17 18:11:37.770042 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:37.770025 2576 scope.go:117] "RemoveContainer" containerID="27c007eb9d10b15d4489aed16c10045abcdb91ac8d0622c074379738fdcb27d8" Jul 17 18:11:38.775615 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:38.775583 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-75v7p" event={"ID":"52639dcf-cedf-46de-a944-316eac2db0a8","Type":"ContainerStarted","Data":"236656e905091e8547a6d145ee55c05e6f63c0a101a73dbd0ea097dd7a279aae"} Jul 17 18:11:39.285381 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:39.285350 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:11:41.788645 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:41.788622 2576 generic.go:356] "Generic (PLEG): container finished" podID="e82b2034-7625-41a9-a5f0-cec5b7605b5c" containerID="314a66b930159d018b7f9808b3c689d40d7cd0ccc426341d53cc74a2384b2fbe" exitCode=0 Jul 17 18:11:41.789160 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:41.788692 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-jxfz9" event={"ID":"e82b2034-7625-41a9-a5f0-cec5b7605b5c","Type":"ContainerDied","Data":"314a66b930159d018b7f9808b3c689d40d7cd0ccc426341d53cc74a2384b2fbe"} Jul 17 18:11:41.789160 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:41.789039 2576 scope.go:117] "RemoveContainer" containerID="314a66b930159d018b7f9808b3c689d40d7cd0ccc426341d53cc74a2384b2fbe" Jul 17 18:11:42.794640 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:42.794606 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-jxfz9" event={"ID":"e82b2034-7625-41a9-a5f0-cec5b7605b5c","Type":"ContainerStarted","Data":"8f3abacc1f3210c9ea0e63b566f8e4d1beb8aedcc161752d751e47418c21d45b"} Jul 17 18:11:44.254664 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.254627 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" podUID="3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6" containerName="registry" containerID="cri-o://4d6875d34141a8e0ea3284801ef1708de25db9c4c4a26503be337fc5567903a8" gracePeriod=30 Jul 17 18:11:44.491755 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.491734 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:11:44.629743 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.629718 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-image-registry-private-configuration\") pod \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " Jul 17 18:11:44.629861 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.629753 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8vbs\" (UniqueName: \"kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-kube-api-access-t8vbs\") pod \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " Jul 17 18:11:44.629861 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.629779 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-installation-pull-secrets\") pod \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " Jul 17 18:11:44.629861 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.629802 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-bound-sa-token\") pod \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " Jul 17 18:11:44.630017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.629913 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-registry-certificates\") pod \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " Jul 17 18:11:44.630017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.629954 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-trusted-ca\") pod \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " Jul 17 18:11:44.630126 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.630022 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-ca-trust-extracted\") pod \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " Jul 17 18:11:44.630126 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.630044 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-registry-tls\") pod \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\" (UID: \"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6\") " Jul 17 18:11:44.630453 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.630387 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6" (UID: "3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:11:44.630714 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.630690 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6" (UID: "3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:11:44.632392 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.632365 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6" (UID: "3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:11:44.632498 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.632416 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6" (UID: "3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:11:44.632498 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.632460 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6" (UID: "3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:11:44.632590 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.632487 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6" (UID: "3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:11:44.632590 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.632537 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-kube-api-access-t8vbs" (OuterVolumeSpecName: "kube-api-access-t8vbs") pod "3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6" (UID: "3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6"). InnerVolumeSpecName "kube-api-access-t8vbs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:11:44.640702 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.640678 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6" (UID: "3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:11:44.730972 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.730950 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-image-registry-private-configuration\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:11:44.731065 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.730972 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8vbs\" (UniqueName: \"kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-kube-api-access-t8vbs\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:11:44.731065 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.731019 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-installation-pull-secrets\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:11:44.731065 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.731029 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-bound-sa-token\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:11:44.731065 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.731038 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-registry-certificates\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:11:44.731065 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.731046 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-trusted-ca\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:11:44.731065 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.731054 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-ca-trust-extracted\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:11:44.731240 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.731061 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6-registry-tls\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:11:44.803841 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.803815 2576 generic.go:356] "Generic (PLEG): container finished" podID="3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6" containerID="4d6875d34141a8e0ea3284801ef1708de25db9c4c4a26503be337fc5567903a8" exitCode=0 Jul 17 18:11:44.803933 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.803860 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" Jul 17 18:11:44.803933 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.803907 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" event={"ID":"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6","Type":"ContainerDied","Data":"4d6875d34141a8e0ea3284801ef1708de25db9c4c4a26503be337fc5567903a8"} Jul 17 18:11:44.804074 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.803969 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6598fb4596-t7r2p" event={"ID":"3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6","Type":"ContainerDied","Data":"37a626111dc1627d6da10396324197e5f43aaf209c55fa7c240963be5e4361db"} Jul 17 18:11:44.804074 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.804012 2576 scope.go:117] "RemoveContainer" containerID="4d6875d34141a8e0ea3284801ef1708de25db9c4c4a26503be337fc5567903a8" Jul 17 18:11:44.813815 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.813797 2576 scope.go:117] "RemoveContainer" containerID="4d6875d34141a8e0ea3284801ef1708de25db9c4c4a26503be337fc5567903a8" Jul 17 18:11:44.814301 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:11:44.814281 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d6875d34141a8e0ea3284801ef1708de25db9c4c4a26503be337fc5567903a8\": container with ID starting with 4d6875d34141a8e0ea3284801ef1708de25db9c4c4a26503be337fc5567903a8 not found: ID does not exist" containerID="4d6875d34141a8e0ea3284801ef1708de25db9c4c4a26503be337fc5567903a8" Jul 17 18:11:44.814367 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.814308 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d6875d34141a8e0ea3284801ef1708de25db9c4c4a26503be337fc5567903a8"} err="failed to get container status \"4d6875d34141a8e0ea3284801ef1708de25db9c4c4a26503be337fc5567903a8\": rpc error: code = NotFound desc = could not find container \"4d6875d34141a8e0ea3284801ef1708de25db9c4c4a26503be337fc5567903a8\": container with ID starting with 4d6875d34141a8e0ea3284801ef1708de25db9c4c4a26503be337fc5567903a8 not found: ID does not exist" Jul 17 18:11:44.823340 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.823316 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6598fb4596-t7r2p"] Jul 17 18:11:44.828030 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:44.828013 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6598fb4596-t7r2p"] Jul 17 18:11:45.185289 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:45.185248 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6" path="/var/lib/kubelet/pods/3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6/volumes" Jul 17 18:11:45.213994 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:45.213952 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:46.518525 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:46.518497 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54c6bfdd65-bqp2k"] Jul 17 18:11:46.626122 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:46.626037 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:46.767495 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:46.767468 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:46.832310 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:46.832288 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:47.471198 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:47.471128 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:47.571484 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:47.571453 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:11:58.244123 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:11:58.244089 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:12:00.323401 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:00.323365 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-57f8989b49-p5zmn" podUID="b32ccce9-2ce2-4bb9-8019-7a18e1dd7479" containerName="console" containerID="cri-o://5fe70753e7c9a56778b98f8a0e54261c3cb0c03b184f0cd57445df5a03697085" gracePeriod=15 Jul 17 18:12:00.568623 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:00.568602 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57f8989b49-p5zmn" Jul 17 18:12:00.660758 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:00.660703 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-console-oauth-config\") pod \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\" (UID: \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\") " Jul 17 18:12:00.660871 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:00.660764 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-service-ca\") pod \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\" (UID: \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\") " Jul 17 18:12:00.660871 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:00.660794 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-trusted-ca-bundle\") pod \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\" (UID: \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\") " Jul 17 18:12:00.660871 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:00.660811 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-console-serving-cert\") pod \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\" (UID: \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\") " Jul 17 18:12:00.660871 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:00.660840 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trjn5\" (UniqueName: \"kubernetes.io/projected/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-kube-api-access-trjn5\") pod \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\" (UID: \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\") " Jul 17 18:12:00.660871 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:00.660861 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-console-config\") pod \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\" (UID: \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\") " Jul 17 18:12:00.661146 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:00.660878 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-oauth-serving-cert\") pod \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\" (UID: \"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479\") " Jul 17 18:12:00.661287 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:00.661254 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-service-ca" (OuterVolumeSpecName: "service-ca") pod "b32ccce9-2ce2-4bb9-8019-7a18e1dd7479" (UID: "b32ccce9-2ce2-4bb9-8019-7a18e1dd7479"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:12:00.661392 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:00.661325 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b32ccce9-2ce2-4bb9-8019-7a18e1dd7479" (UID: "b32ccce9-2ce2-4bb9-8019-7a18e1dd7479"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:12:00.661392 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:00.661334 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-console-config" (OuterVolumeSpecName: "console-config") pod "b32ccce9-2ce2-4bb9-8019-7a18e1dd7479" (UID: "b32ccce9-2ce2-4bb9-8019-7a18e1dd7479"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:12:00.661392 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:00.661366 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b32ccce9-2ce2-4bb9-8019-7a18e1dd7479" (UID: "b32ccce9-2ce2-4bb9-8019-7a18e1dd7479"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:12:00.662865 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:00.662844 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b32ccce9-2ce2-4bb9-8019-7a18e1dd7479" (UID: "b32ccce9-2ce2-4bb9-8019-7a18e1dd7479"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:12:00.663022 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:00.662963 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b32ccce9-2ce2-4bb9-8019-7a18e1dd7479" (UID: "b32ccce9-2ce2-4bb9-8019-7a18e1dd7479"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:12:00.663129 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:00.663106 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-kube-api-access-trjn5" (OuterVolumeSpecName: "kube-api-access-trjn5") pod "b32ccce9-2ce2-4bb9-8019-7a18e1dd7479" (UID: "b32ccce9-2ce2-4bb9-8019-7a18e1dd7479"). InnerVolumeSpecName "kube-api-access-trjn5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:12:00.761765 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:00.761743 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-console-oauth-config\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:00.761765 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:00.761763 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-service-ca\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:00.761876 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:00.761773 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-trusted-ca-bundle\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:00.761876 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:00.761781 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-console-serving-cert\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:00.761876 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:00.761789 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trjn5\" (UniqueName: \"kubernetes.io/projected/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-kube-api-access-trjn5\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:00.761876 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:00.761797 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-console-config\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:00.761876 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:00.761805 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479-oauth-serving-cert\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:00.868533 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:00.868508 2576 generic.go:356] "Generic (PLEG): container finished" podID="b32ccce9-2ce2-4bb9-8019-7a18e1dd7479" containerID="5fe70753e7c9a56778b98f8a0e54261c3cb0c03b184f0cd57445df5a03697085" exitCode=0 Jul 17 18:12:00.868610 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:00.868554 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57f8989b49-p5zmn" Jul 17 18:12:00.868610 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:00.868567 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57f8989b49-p5zmn" event={"ID":"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479","Type":"ContainerDied","Data":"5fe70753e7c9a56778b98f8a0e54261c3cb0c03b184f0cd57445df5a03697085"} Jul 17 18:12:00.868610 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:00.868604 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57f8989b49-p5zmn" event={"ID":"b32ccce9-2ce2-4bb9-8019-7a18e1dd7479","Type":"ContainerDied","Data":"9b9b052ddeaddefbd94cfb3f70c4d13899b09f51a91d35bfa771c3acf9c295b0"} Jul 17 18:12:00.868706 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:00.868622 2576 scope.go:117] "RemoveContainer" containerID="5fe70753e7c9a56778b98f8a0e54261c3cb0c03b184f0cd57445df5a03697085" Jul 17 18:12:00.879545 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:00.879529 2576 scope.go:117] "RemoveContainer" containerID="5fe70753e7c9a56778b98f8a0e54261c3cb0c03b184f0cd57445df5a03697085" Jul 17 18:12:00.879785 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:12:00.879765 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fe70753e7c9a56778b98f8a0e54261c3cb0c03b184f0cd57445df5a03697085\": container with ID starting with 5fe70753e7c9a56778b98f8a0e54261c3cb0c03b184f0cd57445df5a03697085 not found: ID does not exist" containerID="5fe70753e7c9a56778b98f8a0e54261c3cb0c03b184f0cd57445df5a03697085" Jul 17 18:12:00.879838 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:00.879794 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fe70753e7c9a56778b98f8a0e54261c3cb0c03b184f0cd57445df5a03697085"} err="failed to get container status \"5fe70753e7c9a56778b98f8a0e54261c3cb0c03b184f0cd57445df5a03697085\": rpc error: code = NotFound desc = could not find container \"5fe70753e7c9a56778b98f8a0e54261c3cb0c03b184f0cd57445df5a03697085\": container with ID starting with 5fe70753e7c9a56778b98f8a0e54261c3cb0c03b184f0cd57445df5a03697085 not found: ID does not exist" Jul 17 18:12:00.890848 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:00.890824 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57f8989b49-p5zmn"] Jul 17 18:12:00.901654 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:00.901632 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57f8989b49-p5zmn"] Jul 17 18:12:01.185314 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:01.185282 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b32ccce9-2ce2-4bb9-8019-7a18e1dd7479" path="/var/lib/kubelet/pods/b32ccce9-2ce2-4bb9-8019-7a18e1dd7479/volumes" Jul 17 18:12:11.540970 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:11.540905 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-54c6bfdd65-bqp2k" podUID="0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c" containerName="console" containerID="cri-o://6daaa2062a6cab4606c5f48d4df512ca8674f52506ef469e41116c0b31e30b0c" gracePeriod=15 Jul 17 18:12:11.781395 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:11.781368 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54c6bfdd65-bqp2k" Jul 17 18:12:11.914006 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:11.913899 2576 generic.go:356] "Generic (PLEG): container finished" podID="0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c" containerID="6daaa2062a6cab4606c5f48d4df512ca8674f52506ef469e41116c0b31e30b0c" exitCode=0 Jul 17 18:12:11.914006 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:11.913940 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54c6bfdd65-bqp2k" Jul 17 18:12:11.914197 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:11.914012 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54c6bfdd65-bqp2k" event={"ID":"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c","Type":"ContainerDied","Data":"6daaa2062a6cab4606c5f48d4df512ca8674f52506ef469e41116c0b31e30b0c"} Jul 17 18:12:11.914197 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:11.914063 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54c6bfdd65-bqp2k" event={"ID":"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c","Type":"ContainerDied","Data":"25dc930af55a0d02f9e8114ce0990c56dca5417eb98777b4d7bf3ed5ecd392b6"} Jul 17 18:12:11.914197 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:11.914096 2576 scope.go:117] "RemoveContainer" containerID="6daaa2062a6cab4606c5f48d4df512ca8674f52506ef469e41116c0b31e30b0c" Jul 17 18:12:11.921786 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:11.921772 2576 scope.go:117] "RemoveContainer" containerID="6daaa2062a6cab4606c5f48d4df512ca8674f52506ef469e41116c0b31e30b0c" Jul 17 18:12:11.922039 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:12:11.922023 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6daaa2062a6cab4606c5f48d4df512ca8674f52506ef469e41116c0b31e30b0c\": container with ID starting with 6daaa2062a6cab4606c5f48d4df512ca8674f52506ef469e41116c0b31e30b0c not found: ID does not exist" containerID="6daaa2062a6cab4606c5f48d4df512ca8674f52506ef469e41116c0b31e30b0c" Jul 17 18:12:11.922083 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:11.922047 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6daaa2062a6cab4606c5f48d4df512ca8674f52506ef469e41116c0b31e30b0c"} err="failed to get container status \"6daaa2062a6cab4606c5f48d4df512ca8674f52506ef469e41116c0b31e30b0c\": rpc error: code = NotFound desc = could not find container \"6daaa2062a6cab4606c5f48d4df512ca8674f52506ef469e41116c0b31e30b0c\": container with ID starting with 6daaa2062a6cab4606c5f48d4df512ca8674f52506ef469e41116c0b31e30b0c not found: ID does not exist" Jul 17 18:12:11.943327 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:11.943303 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-trusted-ca-bundle\") pod \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\" (UID: \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\") " Jul 17 18:12:11.943424 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:11.943333 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-console-config\") pod \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\" (UID: \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\") " Jul 17 18:12:11.943424 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:11.943372 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-oauth-serving-cert\") pod \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\" (UID: \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\") " Jul 17 18:12:11.943424 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:11.943388 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j52nx\" (UniqueName: \"kubernetes.io/projected/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-kube-api-access-j52nx\") pod \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\" (UID: \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\") " Jul 17 18:12:11.943554 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:11.943432 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-console-serving-cert\") pod \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\" (UID: \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\") " Jul 17 18:12:11.943554 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:11.943477 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-service-ca\") pod \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\" (UID: \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\") " Jul 17 18:12:11.943554 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:11.943515 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-console-oauth-config\") pod \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\" (UID: \"0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c\") " Jul 17 18:12:11.943735 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:11.943706 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c" (UID: "0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:12:11.943735 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:11.943713 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c" (UID: "0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:12:11.943937 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:11.943825 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-console-config" (OuterVolumeSpecName: "console-config") pod "0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c" (UID: "0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:12:11.944014 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:11.943966 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-service-ca" (OuterVolumeSpecName: "service-ca") pod "0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c" (UID: "0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:12:11.945458 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:11.945435 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-kube-api-access-j52nx" (OuterVolumeSpecName: "kube-api-access-j52nx") pod "0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c" (UID: "0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c"). InnerVolumeSpecName "kube-api-access-j52nx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:12:11.945565 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:11.945524 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c" (UID: "0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:12:11.945565 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:11.945538 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c" (UID: "0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:12:12.044399 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:12.044369 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-trusted-ca-bundle\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:12.044399 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:12.044397 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-console-config\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:12.044399 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:12.044406 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-oauth-serving-cert\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:12.044545 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:12.044415 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j52nx\" (UniqueName: \"kubernetes.io/projected/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-kube-api-access-j52nx\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:12.044545 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:12.044423 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-console-serving-cert\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:12.044545 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:12.044432 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-service-ca\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:12.044545 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:12.044440 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c-console-oauth-config\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:12.233862 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:12.233837 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54c6bfdd65-bqp2k"] Jul 17 18:12:12.239499 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:12.239480 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54c6bfdd65-bqp2k"] Jul 17 18:12:13.185055 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:13.185025 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c" path="/var/lib/kubelet/pods/0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c/volumes" Jul 17 18:12:29.285111 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:29.285076 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:29.299727 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:29.299706 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:29.998322 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:29.998299 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:38.236259 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:38.236180 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:12:38.289295 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:38.289269 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:12:42.502565 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:42.502528 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 18:12:42.502971 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:42.502816 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="842abb31-4d3f-4616-9901-3c4e690c45cd" containerName="alertmanager" containerID="cri-o://5e9cb2d1d62b821c0ef1970600621e0d42665303bb1a2a87c6a1f7dcf6a3467e" gracePeriod=120 Jul 17 18:12:42.502971 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:42.502910 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="842abb31-4d3f-4616-9901-3c4e690c45cd" containerName="kube-rbac-proxy-web" containerID="cri-o://5ef1a32e5499706fee31e1a7cf9e552c7cc5944d76cc34c7b1e077b79befdf79" gracePeriod=120 Jul 17 18:12:42.502971 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:42.502935 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="842abb31-4d3f-4616-9901-3c4e690c45cd" containerName="config-reloader" containerID="cri-o://1398f645c78a2906bf002f2394e2c5998b06cf5a746b791c1548c1e869dde5ba" gracePeriod=120 Jul 17 18:12:42.503181 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:42.502966 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="842abb31-4d3f-4616-9901-3c4e690c45cd" containerName="kube-rbac-proxy" containerID="cri-o://fc7e209d176dc1a0c4553f4c527d0100d3c48a404b9aab6f7011b8cf97204c50" gracePeriod=120 Jul 17 18:12:42.503181 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:42.502948 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="842abb31-4d3f-4616-9901-3c4e690c45cd" containerName="prom-label-proxy" containerID="cri-o://3e7efca445b6ece8e90bec95f81e6fc828c06fdb6089983147e219ba334d995e" gracePeriod=120 Jul 17 18:12:42.503181 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:42.502906 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="842abb31-4d3f-4616-9901-3c4e690c45cd" containerName="kube-rbac-proxy-metric" containerID="cri-o://9c75162486b88e855f3027907d9dd4c638b31af9f07d2fd7f8ca77df4fb2bf1d" gracePeriod=120 Jul 17 18:12:43.038169 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.038142 2576 generic.go:356] "Generic (PLEG): container finished" podID="842abb31-4d3f-4616-9901-3c4e690c45cd" containerID="3e7efca445b6ece8e90bec95f81e6fc828c06fdb6089983147e219ba334d995e" exitCode=0 Jul 17 18:12:43.038169 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.038166 2576 generic.go:356] "Generic (PLEG): container finished" podID="842abb31-4d3f-4616-9901-3c4e690c45cd" containerID="fc7e209d176dc1a0c4553f4c527d0100d3c48a404b9aab6f7011b8cf97204c50" exitCode=0 Jul 17 18:12:43.038169 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.038172 2576 generic.go:356] "Generic (PLEG): container finished" podID="842abb31-4d3f-4616-9901-3c4e690c45cd" containerID="1398f645c78a2906bf002f2394e2c5998b06cf5a746b791c1548c1e869dde5ba" exitCode=0 Jul 17 18:12:43.038340 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.038177 2576 generic.go:356] "Generic (PLEG): container finished" podID="842abb31-4d3f-4616-9901-3c4e690c45cd" containerID="5e9cb2d1d62b821c0ef1970600621e0d42665303bb1a2a87c6a1f7dcf6a3467e" exitCode=0 Jul 17 18:12:43.038340 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.038217 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"842abb31-4d3f-4616-9901-3c4e690c45cd","Type":"ContainerDied","Data":"3e7efca445b6ece8e90bec95f81e6fc828c06fdb6089983147e219ba334d995e"} Jul 17 18:12:43.038340 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.038275 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"842abb31-4d3f-4616-9901-3c4e690c45cd","Type":"ContainerDied","Data":"fc7e209d176dc1a0c4553f4c527d0100d3c48a404b9aab6f7011b8cf97204c50"} Jul 17 18:12:43.038340 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.038300 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"842abb31-4d3f-4616-9901-3c4e690c45cd","Type":"ContainerDied","Data":"1398f645c78a2906bf002f2394e2c5998b06cf5a746b791c1548c1e869dde5ba"} Jul 17 18:12:43.038340 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.038326 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"842abb31-4d3f-4616-9901-3c4e690c45cd","Type":"ContainerDied","Data":"5e9cb2d1d62b821c0ef1970600621e0d42665303bb1a2a87c6a1f7dcf6a3467e"} Jul 17 18:12:43.742041 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.742019 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:12:43.766235 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.766217 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-config-volume\") pod \"842abb31-4d3f-4616-9901-3c4e690c45cd\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " Jul 17 18:12:43.766338 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.766254 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"842abb31-4d3f-4616-9901-3c4e690c45cd\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " Jul 17 18:12:43.766338 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.766279 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-secret-alertmanager-kube-rbac-proxy\") pod \"842abb31-4d3f-4616-9901-3c4e690c45cd\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " Jul 17 18:12:43.766338 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.766303 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxltr\" (UniqueName: \"kubernetes.io/projected/842abb31-4d3f-4616-9901-3c4e690c45cd-kube-api-access-kxltr\") pod \"842abb31-4d3f-4616-9901-3c4e690c45cd\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " Jul 17 18:12:43.766511 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.766428 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/842abb31-4d3f-4616-9901-3c4e690c45cd-config-out\") pod \"842abb31-4d3f-4616-9901-3c4e690c45cd\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " Jul 17 18:12:43.766559 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.766478 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-secret-alertmanager-kube-rbac-proxy-web\") pod \"842abb31-4d3f-4616-9901-3c4e690c45cd\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " Jul 17 18:12:43.766656 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.766621 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/842abb31-4d3f-4616-9901-3c4e690c45cd-alertmanager-main-db\") pod \"842abb31-4d3f-4616-9901-3c4e690c45cd\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " Jul 17 18:12:43.766772 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.766670 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-web-config\") pod \"842abb31-4d3f-4616-9901-3c4e690c45cd\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " Jul 17 18:12:43.766772 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.766725 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/842abb31-4d3f-4616-9901-3c4e690c45cd-tls-assets\") pod \"842abb31-4d3f-4616-9901-3c4e690c45cd\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " Jul 17 18:12:43.766884 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.766773 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-cluster-tls-config\") pod \"842abb31-4d3f-4616-9901-3c4e690c45cd\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " Jul 17 18:12:43.766884 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.766798 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-secret-alertmanager-main-tls\") pod \"842abb31-4d3f-4616-9901-3c4e690c45cd\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " Jul 17 18:12:43.766884 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.766845 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/842abb31-4d3f-4616-9901-3c4e690c45cd-metrics-client-ca\") pod \"842abb31-4d3f-4616-9901-3c4e690c45cd\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " Jul 17 18:12:43.766884 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.766873 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/842abb31-4d3f-4616-9901-3c4e690c45cd-alertmanager-trusted-ca-bundle\") pod \"842abb31-4d3f-4616-9901-3c4e690c45cd\" (UID: \"842abb31-4d3f-4616-9901-3c4e690c45cd\") " Jul 17 18:12:43.771054 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.767475 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/842abb31-4d3f-4616-9901-3c4e690c45cd-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "842abb31-4d3f-4616-9901-3c4e690c45cd" (UID: "842abb31-4d3f-4616-9901-3c4e690c45cd"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:12:43.771054 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.768859 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-config-volume" (OuterVolumeSpecName: "config-volume") pod "842abb31-4d3f-4616-9901-3c4e690c45cd" (UID: "842abb31-4d3f-4616-9901-3c4e690c45cd"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:12:43.771054 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.769138 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/842abb31-4d3f-4616-9901-3c4e690c45cd-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "842abb31-4d3f-4616-9901-3c4e690c45cd" (UID: "842abb31-4d3f-4616-9901-3c4e690c45cd"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:12:43.771054 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.769343 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "842abb31-4d3f-4616-9901-3c4e690c45cd" (UID: "842abb31-4d3f-4616-9901-3c4e690c45cd"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:12:43.771054 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.769694 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/842abb31-4d3f-4616-9901-3c4e690c45cd-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "842abb31-4d3f-4616-9901-3c4e690c45cd" (UID: "842abb31-4d3f-4616-9901-3c4e690c45cd"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:12:43.771054 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.770537 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/842abb31-4d3f-4616-9901-3c4e690c45cd-config-out" (OuterVolumeSpecName: "config-out") pod "842abb31-4d3f-4616-9901-3c4e690c45cd" (UID: "842abb31-4d3f-4616-9901-3c4e690c45cd"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:12:43.771054 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.770938 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "842abb31-4d3f-4616-9901-3c4e690c45cd" (UID: "842abb31-4d3f-4616-9901-3c4e690c45cd"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:12:43.771537 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.771517 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/842abb31-4d3f-4616-9901-3c4e690c45cd-kube-api-access-kxltr" (OuterVolumeSpecName: "kube-api-access-kxltr") pod "842abb31-4d3f-4616-9901-3c4e690c45cd" (UID: "842abb31-4d3f-4616-9901-3c4e690c45cd"). InnerVolumeSpecName "kube-api-access-kxltr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:12:43.772679 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.771918 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "842abb31-4d3f-4616-9901-3c4e690c45cd" (UID: "842abb31-4d3f-4616-9901-3c4e690c45cd"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:12:43.773016 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.772959 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "842abb31-4d3f-4616-9901-3c4e690c45cd" (UID: "842abb31-4d3f-4616-9901-3c4e690c45cd"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:12:43.773143 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.773122 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/842abb31-4d3f-4616-9901-3c4e690c45cd-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "842abb31-4d3f-4616-9901-3c4e690c45cd" (UID: "842abb31-4d3f-4616-9901-3c4e690c45cd"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:12:43.777686 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.777644 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "842abb31-4d3f-4616-9901-3c4e690c45cd" (UID: "842abb31-4d3f-4616-9901-3c4e690c45cd"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:12:43.784686 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.784666 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-web-config" (OuterVolumeSpecName: "web-config") pod "842abb31-4d3f-4616-9901-3c4e690c45cd" (UID: "842abb31-4d3f-4616-9901-3c4e690c45cd"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:12:43.868352 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.868296 2576 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-cluster-tls-config\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:43.868352 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.868319 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-secret-alertmanager-main-tls\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:43.868352 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.868329 2576 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/842abb31-4d3f-4616-9901-3c4e690c45cd-metrics-client-ca\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:43.868352 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.868338 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/842abb31-4d3f-4616-9901-3c4e690c45cd-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:43.868352 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.868347 2576 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-config-volume\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:43.868660 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.868356 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:43.868660 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.868365 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:43.868660 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.868373 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxltr\" (UniqueName: \"kubernetes.io/projected/842abb31-4d3f-4616-9901-3c4e690c45cd-kube-api-access-kxltr\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:43.868660 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.868383 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/842abb31-4d3f-4616-9901-3c4e690c45cd-config-out\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:43.868660 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.868391 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:43.868660 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.868399 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/842abb31-4d3f-4616-9901-3c4e690c45cd-alertmanager-main-db\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:43.868660 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.868407 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/842abb31-4d3f-4616-9901-3c4e690c45cd-web-config\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:43.868660 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:43.868414 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/842abb31-4d3f-4616-9901-3c4e690c45cd-tls-assets\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:44.045265 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.045237 2576 generic.go:356] "Generic (PLEG): container finished" podID="842abb31-4d3f-4616-9901-3c4e690c45cd" containerID="9c75162486b88e855f3027907d9dd4c638b31af9f07d2fd7f8ca77df4fb2bf1d" exitCode=0 Jul 17 18:12:44.045265 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.045264 2576 generic.go:356] "Generic (PLEG): container finished" podID="842abb31-4d3f-4616-9901-3c4e690c45cd" containerID="5ef1a32e5499706fee31e1a7cf9e552c7cc5944d76cc34c7b1e077b79befdf79" exitCode=0 Jul 17 18:12:44.045420 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.045284 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"842abb31-4d3f-4616-9901-3c4e690c45cd","Type":"ContainerDied","Data":"9c75162486b88e855f3027907d9dd4c638b31af9f07d2fd7f8ca77df4fb2bf1d"} Jul 17 18:12:44.045420 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.045313 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 17 18:12:44.045420 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.045340 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"842abb31-4d3f-4616-9901-3c4e690c45cd","Type":"ContainerDied","Data":"5ef1a32e5499706fee31e1a7cf9e552c7cc5944d76cc34c7b1e077b79befdf79"} Jul 17 18:12:44.045420 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.045367 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"842abb31-4d3f-4616-9901-3c4e690c45cd","Type":"ContainerDied","Data":"5881eb7f2e715f871c33c47d0bb2b2d748633617c2846ab562d24780975dab69"} Jul 17 18:12:44.045420 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.045404 2576 scope.go:117] "RemoveContainer" containerID="3e7efca445b6ece8e90bec95f81e6fc828c06fdb6089983147e219ba334d995e" Jul 17 18:12:44.055307 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.054873 2576 scope.go:117] "RemoveContainer" containerID="9c75162486b88e855f3027907d9dd4c638b31af9f07d2fd7f8ca77df4fb2bf1d" Jul 17 18:12:44.062966 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.062948 2576 scope.go:117] "RemoveContainer" containerID="fc7e209d176dc1a0c4553f4c527d0100d3c48a404b9aab6f7011b8cf97204c50" Jul 17 18:12:44.070933 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.070908 2576 scope.go:117] "RemoveContainer" containerID="5ef1a32e5499706fee31e1a7cf9e552c7cc5944d76cc34c7b1e077b79befdf79" Jul 17 18:12:44.072757 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.072738 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 18:12:44.078562 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.078542 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 17 18:12:44.079583 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.079566 2576 scope.go:117] "RemoveContainer" containerID="1398f645c78a2906bf002f2394e2c5998b06cf5a746b791c1548c1e869dde5ba" Jul 17 18:12:44.086769 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.086752 2576 scope.go:117] "RemoveContainer" containerID="5e9cb2d1d62b821c0ef1970600621e0d42665303bb1a2a87c6a1f7dcf6a3467e" Jul 17 18:12:44.093767 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.093752 2576 scope.go:117] "RemoveContainer" containerID="7d52e78cb8ffbe822a3b7cb2c2d94e2322a8a0f23f529875076bdc86022fd5cd" Jul 17 18:12:44.102143 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.102128 2576 scope.go:117] "RemoveContainer" containerID="3e7efca445b6ece8e90bec95f81e6fc828c06fdb6089983147e219ba334d995e" Jul 17 18:12:44.102388 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:12:44.102367 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e7efca445b6ece8e90bec95f81e6fc828c06fdb6089983147e219ba334d995e\": container with ID starting with 3e7efca445b6ece8e90bec95f81e6fc828c06fdb6089983147e219ba334d995e not found: ID does not exist" containerID="3e7efca445b6ece8e90bec95f81e6fc828c06fdb6089983147e219ba334d995e" Jul 17 18:12:44.102448 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.102410 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e7efca445b6ece8e90bec95f81e6fc828c06fdb6089983147e219ba334d995e"} err="failed to get container status \"3e7efca445b6ece8e90bec95f81e6fc828c06fdb6089983147e219ba334d995e\": rpc error: code = NotFound desc = could not find container \"3e7efca445b6ece8e90bec95f81e6fc828c06fdb6089983147e219ba334d995e\": container with ID starting with 3e7efca445b6ece8e90bec95f81e6fc828c06fdb6089983147e219ba334d995e not found: ID does not exist" Jul 17 18:12:44.102448 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.102435 2576 scope.go:117] "RemoveContainer" containerID="9c75162486b88e855f3027907d9dd4c638b31af9f07d2fd7f8ca77df4fb2bf1d" Jul 17 18:12:44.102701 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:12:44.102683 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c75162486b88e855f3027907d9dd4c638b31af9f07d2fd7f8ca77df4fb2bf1d\": container with ID starting with 9c75162486b88e855f3027907d9dd4c638b31af9f07d2fd7f8ca77df4fb2bf1d not found: ID does not exist" containerID="9c75162486b88e855f3027907d9dd4c638b31af9f07d2fd7f8ca77df4fb2bf1d" Jul 17 18:12:44.102750 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.102707 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c75162486b88e855f3027907d9dd4c638b31af9f07d2fd7f8ca77df4fb2bf1d"} err="failed to get container status \"9c75162486b88e855f3027907d9dd4c638b31af9f07d2fd7f8ca77df4fb2bf1d\": rpc error: code = NotFound desc = could not find container \"9c75162486b88e855f3027907d9dd4c638b31af9f07d2fd7f8ca77df4fb2bf1d\": container with ID starting with 9c75162486b88e855f3027907d9dd4c638b31af9f07d2fd7f8ca77df4fb2bf1d not found: ID does not exist" Jul 17 18:12:44.102750 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.102723 2576 scope.go:117] "RemoveContainer" containerID="fc7e209d176dc1a0c4553f4c527d0100d3c48a404b9aab6f7011b8cf97204c50" Jul 17 18:12:44.102952 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:12:44.102936 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc7e209d176dc1a0c4553f4c527d0100d3c48a404b9aab6f7011b8cf97204c50\": container with ID starting with fc7e209d176dc1a0c4553f4c527d0100d3c48a404b9aab6f7011b8cf97204c50 not found: ID does not exist" containerID="fc7e209d176dc1a0c4553f4c527d0100d3c48a404b9aab6f7011b8cf97204c50" Jul 17 18:12:44.103015 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.102957 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc7e209d176dc1a0c4553f4c527d0100d3c48a404b9aab6f7011b8cf97204c50"} err="failed to get container status \"fc7e209d176dc1a0c4553f4c527d0100d3c48a404b9aab6f7011b8cf97204c50\": rpc error: code = NotFound desc = could not find container \"fc7e209d176dc1a0c4553f4c527d0100d3c48a404b9aab6f7011b8cf97204c50\": container with ID starting with fc7e209d176dc1a0c4553f4c527d0100d3c48a404b9aab6f7011b8cf97204c50 not found: ID does not exist" Jul 17 18:12:44.103015 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.102971 2576 scope.go:117] "RemoveContainer" containerID="5ef1a32e5499706fee31e1a7cf9e552c7cc5944d76cc34c7b1e077b79befdf79" Jul 17 18:12:44.103236 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:12:44.103191 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ef1a32e5499706fee31e1a7cf9e552c7cc5944d76cc34c7b1e077b79befdf79\": container with ID starting with 5ef1a32e5499706fee31e1a7cf9e552c7cc5944d76cc34c7b1e077b79befdf79 not found: ID does not exist" containerID="5ef1a32e5499706fee31e1a7cf9e552c7cc5944d76cc34c7b1e077b79befdf79" Jul 17 18:12:44.103270 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.103245 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ef1a32e5499706fee31e1a7cf9e552c7cc5944d76cc34c7b1e077b79befdf79"} err="failed to get container status \"5ef1a32e5499706fee31e1a7cf9e552c7cc5944d76cc34c7b1e077b79befdf79\": rpc error: code = NotFound desc = could not find container \"5ef1a32e5499706fee31e1a7cf9e552c7cc5944d76cc34c7b1e077b79befdf79\": container with ID starting with 5ef1a32e5499706fee31e1a7cf9e552c7cc5944d76cc34c7b1e077b79befdf79 not found: ID does not exist" Jul 17 18:12:44.103270 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.103266 2576 scope.go:117] "RemoveContainer" containerID="1398f645c78a2906bf002f2394e2c5998b06cf5a746b791c1548c1e869dde5ba" Jul 17 18:12:44.103465 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:12:44.103451 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1398f645c78a2906bf002f2394e2c5998b06cf5a746b791c1548c1e869dde5ba\": container with ID starting with 1398f645c78a2906bf002f2394e2c5998b06cf5a746b791c1548c1e869dde5ba not found: ID does not exist" containerID="1398f645c78a2906bf002f2394e2c5998b06cf5a746b791c1548c1e869dde5ba" Jul 17 18:12:44.103501 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.103467 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1398f645c78a2906bf002f2394e2c5998b06cf5a746b791c1548c1e869dde5ba"} err="failed to get container status \"1398f645c78a2906bf002f2394e2c5998b06cf5a746b791c1548c1e869dde5ba\": rpc error: code = NotFound desc = could not find container \"1398f645c78a2906bf002f2394e2c5998b06cf5a746b791c1548c1e869dde5ba\": container with ID starting with 1398f645c78a2906bf002f2394e2c5998b06cf5a746b791c1548c1e869dde5ba not found: ID does not exist" Jul 17 18:12:44.103501 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.103478 2576 scope.go:117] "RemoveContainer" containerID="5e9cb2d1d62b821c0ef1970600621e0d42665303bb1a2a87c6a1f7dcf6a3467e" Jul 17 18:12:44.103692 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:12:44.103675 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e9cb2d1d62b821c0ef1970600621e0d42665303bb1a2a87c6a1f7dcf6a3467e\": container with ID starting with 5e9cb2d1d62b821c0ef1970600621e0d42665303bb1a2a87c6a1f7dcf6a3467e not found: ID does not exist" containerID="5e9cb2d1d62b821c0ef1970600621e0d42665303bb1a2a87c6a1f7dcf6a3467e" Jul 17 18:12:44.103733 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.103697 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e9cb2d1d62b821c0ef1970600621e0d42665303bb1a2a87c6a1f7dcf6a3467e"} err="failed to get container status \"5e9cb2d1d62b821c0ef1970600621e0d42665303bb1a2a87c6a1f7dcf6a3467e\": rpc error: code = NotFound desc = could not find container \"5e9cb2d1d62b821c0ef1970600621e0d42665303bb1a2a87c6a1f7dcf6a3467e\": container with ID starting with 5e9cb2d1d62b821c0ef1970600621e0d42665303bb1a2a87c6a1f7dcf6a3467e not found: ID does not exist" Jul 17 18:12:44.103733 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.103711 2576 scope.go:117] "RemoveContainer" containerID="7d52e78cb8ffbe822a3b7cb2c2d94e2322a8a0f23f529875076bdc86022fd5cd" Jul 17 18:12:44.103924 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:12:44.103909 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d52e78cb8ffbe822a3b7cb2c2d94e2322a8a0f23f529875076bdc86022fd5cd\": container with ID starting with 7d52e78cb8ffbe822a3b7cb2c2d94e2322a8a0f23f529875076bdc86022fd5cd not found: ID does not exist" containerID="7d52e78cb8ffbe822a3b7cb2c2d94e2322a8a0f23f529875076bdc86022fd5cd" Jul 17 18:12:44.103994 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.103925 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d52e78cb8ffbe822a3b7cb2c2d94e2322a8a0f23f529875076bdc86022fd5cd"} err="failed to get container status \"7d52e78cb8ffbe822a3b7cb2c2d94e2322a8a0f23f529875076bdc86022fd5cd\": rpc error: code = NotFound desc = could not find container \"7d52e78cb8ffbe822a3b7cb2c2d94e2322a8a0f23f529875076bdc86022fd5cd\": container with ID starting with 7d52e78cb8ffbe822a3b7cb2c2d94e2322a8a0f23f529875076bdc86022fd5cd not found: ID does not exist" Jul 17 18:12:44.103994 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.103936 2576 scope.go:117] "RemoveContainer" containerID="3e7efca445b6ece8e90bec95f81e6fc828c06fdb6089983147e219ba334d995e" Jul 17 18:12:44.104146 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.104128 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e7efca445b6ece8e90bec95f81e6fc828c06fdb6089983147e219ba334d995e"} err="failed to get container status \"3e7efca445b6ece8e90bec95f81e6fc828c06fdb6089983147e219ba334d995e\": rpc error: code = NotFound desc = could not find container \"3e7efca445b6ece8e90bec95f81e6fc828c06fdb6089983147e219ba334d995e\": container with ID starting with 3e7efca445b6ece8e90bec95f81e6fc828c06fdb6089983147e219ba334d995e not found: ID does not exist" Jul 17 18:12:44.104186 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.104148 2576 scope.go:117] "RemoveContainer" containerID="9c75162486b88e855f3027907d9dd4c638b31af9f07d2fd7f8ca77df4fb2bf1d" Jul 17 18:12:44.104334 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.104318 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c75162486b88e855f3027907d9dd4c638b31af9f07d2fd7f8ca77df4fb2bf1d"} err="failed to get container status \"9c75162486b88e855f3027907d9dd4c638b31af9f07d2fd7f8ca77df4fb2bf1d\": rpc error: code = NotFound desc = could not find container \"9c75162486b88e855f3027907d9dd4c638b31af9f07d2fd7f8ca77df4fb2bf1d\": container with ID starting with 9c75162486b88e855f3027907d9dd4c638b31af9f07d2fd7f8ca77df4fb2bf1d not found: ID does not exist" Jul 17 18:12:44.104374 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.104335 2576 scope.go:117] "RemoveContainer" containerID="fc7e209d176dc1a0c4553f4c527d0100d3c48a404b9aab6f7011b8cf97204c50" Jul 17 18:12:44.104521 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.104505 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc7e209d176dc1a0c4553f4c527d0100d3c48a404b9aab6f7011b8cf97204c50"} err="failed to get container status \"fc7e209d176dc1a0c4553f4c527d0100d3c48a404b9aab6f7011b8cf97204c50\": rpc error: code = NotFound desc = could not find container \"fc7e209d176dc1a0c4553f4c527d0100d3c48a404b9aab6f7011b8cf97204c50\": container with ID starting with fc7e209d176dc1a0c4553f4c527d0100d3c48a404b9aab6f7011b8cf97204c50 not found: ID does not exist" Jul 17 18:12:44.104560 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.104521 2576 scope.go:117] "RemoveContainer" containerID="5ef1a32e5499706fee31e1a7cf9e552c7cc5944d76cc34c7b1e077b79befdf79" Jul 17 18:12:44.104717 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.104702 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ef1a32e5499706fee31e1a7cf9e552c7cc5944d76cc34c7b1e077b79befdf79"} err="failed to get container status \"5ef1a32e5499706fee31e1a7cf9e552c7cc5944d76cc34c7b1e077b79befdf79\": rpc error: code = NotFound desc = could not find container \"5ef1a32e5499706fee31e1a7cf9e552c7cc5944d76cc34c7b1e077b79befdf79\": container with ID starting with 5ef1a32e5499706fee31e1a7cf9e552c7cc5944d76cc34c7b1e077b79befdf79 not found: ID does not exist" Jul 17 18:12:44.104768 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.104717 2576 scope.go:117] "RemoveContainer" containerID="1398f645c78a2906bf002f2394e2c5998b06cf5a746b791c1548c1e869dde5ba" Jul 17 18:12:44.104917 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.104902 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1398f645c78a2906bf002f2394e2c5998b06cf5a746b791c1548c1e869dde5ba"} err="failed to get container status \"1398f645c78a2906bf002f2394e2c5998b06cf5a746b791c1548c1e869dde5ba\": rpc error: code = NotFound desc = could not find container \"1398f645c78a2906bf002f2394e2c5998b06cf5a746b791c1548c1e869dde5ba\": container with ID starting with 1398f645c78a2906bf002f2394e2c5998b06cf5a746b791c1548c1e869dde5ba not found: ID does not exist" Jul 17 18:12:44.104962 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.104918 2576 scope.go:117] "RemoveContainer" containerID="5e9cb2d1d62b821c0ef1970600621e0d42665303bb1a2a87c6a1f7dcf6a3467e" Jul 17 18:12:44.105138 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.105121 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e9cb2d1d62b821c0ef1970600621e0d42665303bb1a2a87c6a1f7dcf6a3467e"} err="failed to get container status \"5e9cb2d1d62b821c0ef1970600621e0d42665303bb1a2a87c6a1f7dcf6a3467e\": rpc error: code = NotFound desc = could not find container \"5e9cb2d1d62b821c0ef1970600621e0d42665303bb1a2a87c6a1f7dcf6a3467e\": container with ID starting with 5e9cb2d1d62b821c0ef1970600621e0d42665303bb1a2a87c6a1f7dcf6a3467e not found: ID does not exist" Jul 17 18:12:44.105185 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.105140 2576 scope.go:117] "RemoveContainer" containerID="7d52e78cb8ffbe822a3b7cb2c2d94e2322a8a0f23f529875076bdc86022fd5cd" Jul 17 18:12:44.105325 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.105306 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d52e78cb8ffbe822a3b7cb2c2d94e2322a8a0f23f529875076bdc86022fd5cd"} err="failed to get container status \"7d52e78cb8ffbe822a3b7cb2c2d94e2322a8a0f23f529875076bdc86022fd5cd\": rpc error: code = NotFound desc = could not find container \"7d52e78cb8ffbe822a3b7cb2c2d94e2322a8a0f23f529875076bdc86022fd5cd\": container with ID starting with 7d52e78cb8ffbe822a3b7cb2c2d94e2322a8a0f23f529875076bdc86022fd5cd not found: ID does not exist" Jul 17 18:12:44.421817 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:44.421780 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:12:45.184796 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:45.184773 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="842abb31-4d3f-4616-9901-3c4e690c45cd" path="/var/lib/kubelet/pods/842abb31-4d3f-4616-9901-3c4e690c45cd/volumes" Jul 17 18:12:46.724328 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.724300 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 17 18:12:46.724792 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.724552 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="736537c8-84ed-4e0b-8110-cbc34fa49128" containerName="prometheus" containerID="cri-o://674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb" gracePeriod=600 Jul 17 18:12:46.724792 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.724589 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="736537c8-84ed-4e0b-8110-cbc34fa49128" containerName="kube-rbac-proxy" containerID="cri-o://d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9" gracePeriod=600 Jul 17 18:12:46.724792 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.724606 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="736537c8-84ed-4e0b-8110-cbc34fa49128" containerName="thanos-sidecar" containerID="cri-o://dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5" gracePeriod=600 Jul 17 18:12:46.724792 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.724625 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="736537c8-84ed-4e0b-8110-cbc34fa49128" containerName="config-reloader" containerID="cri-o://c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b" gracePeriod=600 Jul 17 18:12:46.724792 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.724703 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="736537c8-84ed-4e0b-8110-cbc34fa49128" containerName="kube-rbac-proxy-web" containerID="cri-o://931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e" gracePeriod=600 Jul 17 18:12:46.724792 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.724729 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="736537c8-84ed-4e0b-8110-cbc34fa49128" containerName="kube-rbac-proxy-thanos" containerID="cri-o://15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098" gracePeriod=600 Jul 17 18:12:46.956829 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.956805 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:46.987999 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.987938 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-prometheus-k8s-rulefiles-2\") pod \"736537c8-84ed-4e0b-8110-cbc34fa49128\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " Jul 17 18:12:46.987999 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.987967 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8lrg\" (UniqueName: \"kubernetes.io/projected/736537c8-84ed-4e0b-8110-cbc34fa49128-kube-api-access-m8lrg\") pod \"736537c8-84ed-4e0b-8110-cbc34fa49128\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " Jul 17 18:12:46.987999 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.987996 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-kube-rbac-proxy\") pod \"736537c8-84ed-4e0b-8110-cbc34fa49128\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " Jul 17 18:12:46.988262 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.988015 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/736537c8-84ed-4e0b-8110-cbc34fa49128-config-out\") pod \"736537c8-84ed-4e0b-8110-cbc34fa49128\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " Jul 17 18:12:46.988262 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.988038 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-configmap-metrics-client-ca\") pod \"736537c8-84ed-4e0b-8110-cbc34fa49128\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " Jul 17 18:12:46.988262 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.988060 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-configmap-kubelet-serving-ca-bundle\") pod \"736537c8-84ed-4e0b-8110-cbc34fa49128\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " Jul 17 18:12:46.988262 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.988087 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-config\") pod \"736537c8-84ed-4e0b-8110-cbc34fa49128\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " Jul 17 18:12:46.988262 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.988114 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-grpc-tls\") pod \"736537c8-84ed-4e0b-8110-cbc34fa49128\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " Jul 17 18:12:46.988262 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.988142 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-configmap-serving-certs-ca-bundle\") pod \"736537c8-84ed-4e0b-8110-cbc34fa49128\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " Jul 17 18:12:46.988262 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.988181 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-thanos-prometheus-http-client-file\") pod \"736537c8-84ed-4e0b-8110-cbc34fa49128\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " Jul 17 18:12:46.988262 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.988215 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-prometheus-k8s-tls\") pod \"736537c8-84ed-4e0b-8110-cbc34fa49128\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " Jul 17 18:12:46.988262 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.988242 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/736537c8-84ed-4e0b-8110-cbc34fa49128-prometheus-k8s-db\") pod \"736537c8-84ed-4e0b-8110-cbc34fa49128\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " Jul 17 18:12:46.988710 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.988284 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-web-config\") pod \"736537c8-84ed-4e0b-8110-cbc34fa49128\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " Jul 17 18:12:46.988710 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.988323 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/736537c8-84ed-4e0b-8110-cbc34fa49128-tls-assets\") pod \"736537c8-84ed-4e0b-8110-cbc34fa49128\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " Jul 17 18:12:46.988710 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.988318 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "736537c8-84ed-4e0b-8110-cbc34fa49128" (UID: "736537c8-84ed-4e0b-8110-cbc34fa49128"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:12:46.988710 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.988374 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"736537c8-84ed-4e0b-8110-cbc34fa49128\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " Jul 17 18:12:46.988710 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.988406 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-prometheus-k8s-rulefiles-0\") pod \"736537c8-84ed-4e0b-8110-cbc34fa49128\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " Jul 17 18:12:46.988710 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.988443 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-prometheus-k8s-rulefiles-1\") pod \"736537c8-84ed-4e0b-8110-cbc34fa49128\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " Jul 17 18:12:46.988710 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.988494 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"736537c8-84ed-4e0b-8110-cbc34fa49128\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " Jul 17 18:12:46.988710 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.988523 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-prometheus-trusted-ca-bundle\") pod \"736537c8-84ed-4e0b-8110-cbc34fa49128\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " Jul 17 18:12:46.988710 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.988546 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-metrics-client-certs\") pod \"736537c8-84ed-4e0b-8110-cbc34fa49128\" (UID: \"736537c8-84ed-4e0b-8110-cbc34fa49128\") " Jul 17 18:12:46.988710 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.988666 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "736537c8-84ed-4e0b-8110-cbc34fa49128" (UID: "736537c8-84ed-4e0b-8110-cbc34fa49128"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:12:46.989210 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.988821 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:46.989210 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.988842 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:46.989318 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.989219 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "736537c8-84ed-4e0b-8110-cbc34fa49128" (UID: "736537c8-84ed-4e0b-8110-cbc34fa49128"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:12:46.989593 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.989565 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "736537c8-84ed-4e0b-8110-cbc34fa49128" (UID: "736537c8-84ed-4e0b-8110-cbc34fa49128"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:12:46.990966 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.990341 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "736537c8-84ed-4e0b-8110-cbc34fa49128" (UID: "736537c8-84ed-4e0b-8110-cbc34fa49128"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:12:46.990966 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.990690 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "736537c8-84ed-4e0b-8110-cbc34fa49128" (UID: "736537c8-84ed-4e0b-8110-cbc34fa49128"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:12:46.993410 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.992023 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "736537c8-84ed-4e0b-8110-cbc34fa49128" (UID: "736537c8-84ed-4e0b-8110-cbc34fa49128"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:12:46.993410 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.992174 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "736537c8-84ed-4e0b-8110-cbc34fa49128" (UID: "736537c8-84ed-4e0b-8110-cbc34fa49128"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:12:46.993410 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.992233 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/736537c8-84ed-4e0b-8110-cbc34fa49128-config-out" (OuterVolumeSpecName: "config-out") pod "736537c8-84ed-4e0b-8110-cbc34fa49128" (UID: "736537c8-84ed-4e0b-8110-cbc34fa49128"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:12:46.993410 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.992276 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "736537c8-84ed-4e0b-8110-cbc34fa49128" (UID: "736537c8-84ed-4e0b-8110-cbc34fa49128"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:12:46.993410 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.992319 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "736537c8-84ed-4e0b-8110-cbc34fa49128" (UID: "736537c8-84ed-4e0b-8110-cbc34fa49128"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:12:46.993410 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.993257 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/736537c8-84ed-4e0b-8110-cbc34fa49128-kube-api-access-m8lrg" (OuterVolumeSpecName: "kube-api-access-m8lrg") pod "736537c8-84ed-4e0b-8110-cbc34fa49128" (UID: "736537c8-84ed-4e0b-8110-cbc34fa49128"). InnerVolumeSpecName "kube-api-access-m8lrg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:12:46.993410 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.993342 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "736537c8-84ed-4e0b-8110-cbc34fa49128" (UID: "736537c8-84ed-4e0b-8110-cbc34fa49128"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:12:46.993410 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.993354 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "736537c8-84ed-4e0b-8110-cbc34fa49128" (UID: "736537c8-84ed-4e0b-8110-cbc34fa49128"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:12:46.993818 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.993504 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "736537c8-84ed-4e0b-8110-cbc34fa49128" (UID: "736537c8-84ed-4e0b-8110-cbc34fa49128"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:12:46.993877 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.993814 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-config" (OuterVolumeSpecName: "config") pod "736537c8-84ed-4e0b-8110-cbc34fa49128" (UID: "736537c8-84ed-4e0b-8110-cbc34fa49128"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:12:46.994572 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.994545 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/736537c8-84ed-4e0b-8110-cbc34fa49128-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "736537c8-84ed-4e0b-8110-cbc34fa49128" (UID: "736537c8-84ed-4e0b-8110-cbc34fa49128"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:12:46.994672 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.994637 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/736537c8-84ed-4e0b-8110-cbc34fa49128-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "736537c8-84ed-4e0b-8110-cbc34fa49128" (UID: "736537c8-84ed-4e0b-8110-cbc34fa49128"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:12:46.994853 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:46.994824 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "736537c8-84ed-4e0b-8110-cbc34fa49128" (UID: "736537c8-84ed-4e0b-8110-cbc34fa49128"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:12:47.005947 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.005920 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-web-config" (OuterVolumeSpecName: "web-config") pod "736537c8-84ed-4e0b-8110-cbc34fa49128" (UID: "736537c8-84ed-4e0b-8110-cbc34fa49128"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:12:47.059433 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.059410 2576 generic.go:356] "Generic (PLEG): container finished" podID="736537c8-84ed-4e0b-8110-cbc34fa49128" containerID="15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098" exitCode=0 Jul 17 18:12:47.059433 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.059429 2576 generic.go:356] "Generic (PLEG): container finished" podID="736537c8-84ed-4e0b-8110-cbc34fa49128" containerID="d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9" exitCode=0 Jul 17 18:12:47.059433 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.059435 2576 generic.go:356] "Generic (PLEG): container finished" podID="736537c8-84ed-4e0b-8110-cbc34fa49128" containerID="931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e" exitCode=0 Jul 17 18:12:47.059594 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.059440 2576 generic.go:356] "Generic (PLEG): container finished" podID="736537c8-84ed-4e0b-8110-cbc34fa49128" containerID="dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5" exitCode=0 Jul 17 18:12:47.059594 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.059445 2576 generic.go:356] "Generic (PLEG): container finished" podID="736537c8-84ed-4e0b-8110-cbc34fa49128" containerID="c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b" exitCode=0 Jul 17 18:12:47.059594 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.059451 2576 generic.go:356] "Generic (PLEG): container finished" podID="736537c8-84ed-4e0b-8110-cbc34fa49128" containerID="674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb" exitCode=0 Jul 17 18:12:47.059594 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.059480 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.059594 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.059491 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"736537c8-84ed-4e0b-8110-cbc34fa49128","Type":"ContainerDied","Data":"15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098"} Jul 17 18:12:47.059594 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.059556 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"736537c8-84ed-4e0b-8110-cbc34fa49128","Type":"ContainerDied","Data":"d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9"} Jul 17 18:12:47.059594 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.059587 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"736537c8-84ed-4e0b-8110-cbc34fa49128","Type":"ContainerDied","Data":"931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e"} Jul 17 18:12:47.059883 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.059611 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"736537c8-84ed-4e0b-8110-cbc34fa49128","Type":"ContainerDied","Data":"dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5"} Jul 17 18:12:47.059883 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.059636 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"736537c8-84ed-4e0b-8110-cbc34fa49128","Type":"ContainerDied","Data":"c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b"} Jul 17 18:12:47.059883 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.059641 2576 scope.go:117] "RemoveContainer" containerID="15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098" Jul 17 18:12:47.059883 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.059659 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"736537c8-84ed-4e0b-8110-cbc34fa49128","Type":"ContainerDied","Data":"674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb"} Jul 17 18:12:47.059883 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.059682 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"736537c8-84ed-4e0b-8110-cbc34fa49128","Type":"ContainerDied","Data":"e62c6de94723ddaf9c9c7ff2f075b86321a58b8712c4abf7813a326883fa6495"} Jul 17 18:12:47.071771 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.071753 2576 scope.go:117] "RemoveContainer" containerID="d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9" Jul 17 18:12:47.078345 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.078329 2576 scope.go:117] "RemoveContainer" containerID="931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e" Jul 17 18:12:47.084300 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.084280 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 17 18:12:47.085347 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.085328 2576 scope.go:117] "RemoveContainer" containerID="dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5" Jul 17 18:12:47.088435 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.088413 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 17 18:12:47.090152 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.090129 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-configmap-metrics-client-ca\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:47.090152 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.090151 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:47.090288 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.090161 2576 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-config\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:47.090288 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.090169 2576 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-grpc-tls\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:47.090288 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.090179 2576 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:47.090288 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.090187 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:47.090288 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.090195 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/736537c8-84ed-4e0b-8110-cbc34fa49128-prometheus-k8s-db\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:47.090288 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.090220 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-web-config\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:47.090288 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.090229 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/736537c8-84ed-4e0b-8110-cbc34fa49128-tls-assets\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:47.090288 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.090237 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:47.090288 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.090245 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:47.090288 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.090253 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:47.090288 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.090261 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:47.090288 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.090269 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736537c8-84ed-4e0b-8110-cbc34fa49128-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:47.090288 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.090278 2576 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-metrics-client-certs\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:47.090288 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.090286 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8lrg\" (UniqueName: \"kubernetes.io/projected/736537c8-84ed-4e0b-8110-cbc34fa49128-kube-api-access-m8lrg\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:47.090288 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.090294 2576 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/736537c8-84ed-4e0b-8110-cbc34fa49128-secret-kube-rbac-proxy\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:47.091060 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.090302 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/736537c8-84ed-4e0b-8110-cbc34fa49128-config-out\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:12:47.092119 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.092105 2576 scope.go:117] "RemoveContainer" containerID="c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b" Jul 17 18:12:47.098486 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.098471 2576 scope.go:117] "RemoveContainer" containerID="674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb" Jul 17 18:12:47.104968 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.104954 2576 scope.go:117] "RemoveContainer" containerID="ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870" Jul 17 18:12:47.111150 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.111131 2576 scope.go:117] "RemoveContainer" containerID="15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098" Jul 17 18:12:47.111409 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:12:47.111393 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098\": container with ID starting with 15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098 not found: ID does not exist" containerID="15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098" Jul 17 18:12:47.111463 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.111418 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098"} err="failed to get container status \"15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098\": rpc error: code = NotFound desc = could not find container \"15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098\": container with ID starting with 15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098 not found: ID does not exist" Jul 17 18:12:47.111463 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.111435 2576 scope.go:117] "RemoveContainer" containerID="d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9" Jul 17 18:12:47.111644 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:12:47.111629 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9\": container with ID starting with d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9 not found: ID does not exist" containerID="d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9" Jul 17 18:12:47.111685 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.111647 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9"} err="failed to get container status \"d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9\": rpc error: code = NotFound desc = could not find container \"d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9\": container with ID starting with d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9 not found: ID does not exist" Jul 17 18:12:47.111685 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.111658 2576 scope.go:117] "RemoveContainer" containerID="931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e" Jul 17 18:12:47.111890 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:12:47.111872 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e\": container with ID starting with 931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e not found: ID does not exist" containerID="931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e" Jul 17 18:12:47.111936 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.111894 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e"} err="failed to get container status \"931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e\": rpc error: code = NotFound desc = could not find container \"931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e\": container with ID starting with 931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e not found: ID does not exist" Jul 17 18:12:47.111936 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.111909 2576 scope.go:117] "RemoveContainer" containerID="dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5" Jul 17 18:12:47.112157 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:12:47.112141 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5\": container with ID starting with dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5 not found: ID does not exist" containerID="dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5" Jul 17 18:12:47.112216 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.112160 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5"} err="failed to get container status \"dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5\": rpc error: code = NotFound desc = could not find container \"dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5\": container with ID starting with dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5 not found: ID does not exist" Jul 17 18:12:47.112216 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.112172 2576 scope.go:117] "RemoveContainer" containerID="c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b" Jul 17 18:12:47.112399 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:12:47.112386 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b\": container with ID starting with c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b not found: ID does not exist" containerID="c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b" Jul 17 18:12:47.112434 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.112402 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b"} err="failed to get container status \"c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b\": rpc error: code = NotFound desc = could not find container \"c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b\": container with ID starting with c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b not found: ID does not exist" Jul 17 18:12:47.112434 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.112413 2576 scope.go:117] "RemoveContainer" containerID="674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb" Jul 17 18:12:47.112614 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:12:47.112600 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb\": container with ID starting with 674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb not found: ID does not exist" containerID="674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb" Jul 17 18:12:47.112646 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.112618 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb"} err="failed to get container status \"674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb\": rpc error: code = NotFound desc = could not find container \"674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb\": container with ID starting with 674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb not found: ID does not exist" Jul 17 18:12:47.112646 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.112630 2576 scope.go:117] "RemoveContainer" containerID="ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870" Jul 17 18:12:47.112823 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:12:47.112807 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870\": container with ID starting with ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870 not found: ID does not exist" containerID="ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870" Jul 17 18:12:47.112863 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.112828 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870"} err="failed to get container status \"ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870\": rpc error: code = NotFound desc = could not find container \"ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870\": container with ID starting with ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870 not found: ID does not exist" Jul 17 18:12:47.112863 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.112843 2576 scope.go:117] "RemoveContainer" containerID="15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098" Jul 17 18:12:47.113156 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.113141 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098"} err="failed to get container status \"15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098\": rpc error: code = NotFound desc = could not find container \"15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098\": container with ID starting with 15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098 not found: ID does not exist" Jul 17 18:12:47.113208 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.113156 2576 scope.go:117] "RemoveContainer" containerID="d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9" Jul 17 18:12:47.113342 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.113326 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9"} err="failed to get container status \"d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9\": rpc error: code = NotFound desc = could not find container \"d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9\": container with ID starting with d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9 not found: ID does not exist" Jul 17 18:12:47.113375 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.113343 2576 scope.go:117] "RemoveContainer" containerID="931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e" Jul 17 18:12:47.113546 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.113529 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e"} err="failed to get container status \"931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e\": rpc error: code = NotFound desc = could not find container \"931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e\": container with ID starting with 931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e not found: ID does not exist" Jul 17 18:12:47.113588 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.113547 2576 scope.go:117] "RemoveContainer" containerID="dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5" Jul 17 18:12:47.113766 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.113750 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5"} err="failed to get container status \"dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5\": rpc error: code = NotFound desc = could not find container \"dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5\": container with ID starting with dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5 not found: ID does not exist" Jul 17 18:12:47.113810 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.113767 2576 scope.go:117] "RemoveContainer" containerID="c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b" Jul 17 18:12:47.113962 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.113943 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b"} err="failed to get container status \"c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b\": rpc error: code = NotFound desc = could not find container \"c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b\": container with ID starting with c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b not found: ID does not exist" Jul 17 18:12:47.114030 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.113963 2576 scope.go:117] "RemoveContainer" containerID="674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb" Jul 17 18:12:47.114206 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.114189 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb"} err="failed to get container status \"674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb\": rpc error: code = NotFound desc = could not find container \"674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb\": container with ID starting with 674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb not found: ID does not exist" Jul 17 18:12:47.114259 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.114208 2576 scope.go:117] "RemoveContainer" containerID="ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870" Jul 17 18:12:47.114459 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.114433 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870"} err="failed to get container status \"ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870\": rpc error: code = NotFound desc = could not find container \"ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870\": container with ID starting with ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870 not found: ID does not exist" Jul 17 18:12:47.114606 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.114460 2576 scope.go:117] "RemoveContainer" containerID="15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098" Jul 17 18:12:47.114844 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.114789 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098"} err="failed to get container status \"15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098\": rpc error: code = NotFound desc = could not find container \"15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098\": container with ID starting with 15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098 not found: ID does not exist" Jul 17 18:12:47.114844 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.114820 2576 scope.go:117] "RemoveContainer" containerID="d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9" Jul 17 18:12:47.115241 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.115128 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9"} err="failed to get container status \"d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9\": rpc error: code = NotFound desc = could not find container \"d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9\": container with ID starting with d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9 not found: ID does not exist" Jul 17 18:12:47.115241 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.115168 2576 scope.go:117] "RemoveContainer" containerID="931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e" Jul 17 18:12:47.115484 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.115454 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e"} err="failed to get container status \"931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e\": rpc error: code = NotFound desc = could not find container \"931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e\": container with ID starting with 931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e not found: ID does not exist" Jul 17 18:12:47.115536 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.115486 2576 scope.go:117] "RemoveContainer" containerID="dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5" Jul 17 18:12:47.115755 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.115737 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5"} err="failed to get container status \"dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5\": rpc error: code = NotFound desc = could not find container \"dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5\": container with ID starting with dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5 not found: ID does not exist" Jul 17 18:12:47.115800 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.115757 2576 scope.go:117] "RemoveContainer" containerID="c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b" Jul 17 18:12:47.116038 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.115969 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b"} err="failed to get container status \"c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b\": rpc error: code = NotFound desc = could not find container \"c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b\": container with ID starting with c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b not found: ID does not exist" Jul 17 18:12:47.116038 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.116010 2576 scope.go:117] "RemoveContainer" containerID="674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb" Jul 17 18:12:47.116253 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.116237 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb"} err="failed to get container status \"674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb\": rpc error: code = NotFound desc = could not find container \"674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb\": container with ID starting with 674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb not found: ID does not exist" Jul 17 18:12:47.116303 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.116253 2576 scope.go:117] "RemoveContainer" containerID="ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870" Jul 17 18:12:47.116446 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.116431 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870"} err="failed to get container status \"ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870\": rpc error: code = NotFound desc = could not find container \"ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870\": container with ID starting with ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870 not found: ID does not exist" Jul 17 18:12:47.116487 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.116445 2576 scope.go:117] "RemoveContainer" containerID="15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098" Jul 17 18:12:47.116520 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.116494 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 17 18:12:47.116655 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.116638 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098"} err="failed to get container status \"15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098\": rpc error: code = NotFound desc = could not find container \"15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098\": container with ID starting with 15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098 not found: ID does not exist" Jul 17 18:12:47.116697 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.116655 2576 scope.go:117] "RemoveContainer" containerID="d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9" Jul 17 18:12:47.116838 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.116824 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9"} err="failed to get container status \"d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9\": rpc error: code = NotFound desc = could not find container \"d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9\": container with ID starting with d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9 not found: ID does not exist" Jul 17 18:12:47.116838 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.116833 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="736537c8-84ed-4e0b-8110-cbc34fa49128" containerName="kube-rbac-proxy-web" Jul 17 18:12:47.116909 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.116839 2576 scope.go:117] "RemoveContainer" containerID="931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e" Jul 17 18:12:47.116909 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.116846 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="736537c8-84ed-4e0b-8110-cbc34fa49128" containerName="kube-rbac-proxy-web" Jul 17 18:12:47.116909 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.116858 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="842abb31-4d3f-4616-9901-3c4e690c45cd" containerName="kube-rbac-proxy-metric" Jul 17 18:12:47.116909 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.116863 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="842abb31-4d3f-4616-9901-3c4e690c45cd" containerName="kube-rbac-proxy-metric" Jul 17 18:12:47.116909 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.116869 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="736537c8-84ed-4e0b-8110-cbc34fa49128" containerName="kube-rbac-proxy-thanos" Jul 17 18:12:47.116909 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.116874 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="736537c8-84ed-4e0b-8110-cbc34fa49128" containerName="kube-rbac-proxy-thanos" Jul 17 18:12:47.116909 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.116880 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6" containerName="registry" Jul 17 18:12:47.116909 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.116885 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6" containerName="registry" Jul 17 18:12:47.116909 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.116891 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="736537c8-84ed-4e0b-8110-cbc34fa49128" containerName="config-reloader" Jul 17 18:12:47.116909 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.116897 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="736537c8-84ed-4e0b-8110-cbc34fa49128" containerName="config-reloader" Jul 17 18:12:47.116909 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.116903 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="736537c8-84ed-4e0b-8110-cbc34fa49128" containerName="prometheus" Jul 17 18:12:47.116909 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.116908 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="736537c8-84ed-4e0b-8110-cbc34fa49128" containerName="prometheus" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.116916 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="736537c8-84ed-4e0b-8110-cbc34fa49128" containerName="thanos-sidecar" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.116922 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="736537c8-84ed-4e0b-8110-cbc34fa49128" containerName="thanos-sidecar" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.116938 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="842abb31-4d3f-4616-9901-3c4e690c45cd" containerName="config-reloader" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.116947 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="842abb31-4d3f-4616-9901-3c4e690c45cd" containerName="config-reloader" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.116956 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="842abb31-4d3f-4616-9901-3c4e690c45cd" containerName="kube-rbac-proxy-web" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.116963 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="842abb31-4d3f-4616-9901-3c4e690c45cd" containerName="kube-rbac-proxy-web" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.116989 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c" containerName="console" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.116998 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c" containerName="console" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117004 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="842abb31-4d3f-4616-9901-3c4e690c45cd" containerName="init-config-reloader" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117009 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="842abb31-4d3f-4616-9901-3c4e690c45cd" containerName="init-config-reloader" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117015 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b32ccce9-2ce2-4bb9-8019-7a18e1dd7479" containerName="console" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117023 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b32ccce9-2ce2-4bb9-8019-7a18e1dd7479" containerName="console" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117032 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="842abb31-4d3f-4616-9901-3c4e690c45cd" containerName="alertmanager" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117037 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="842abb31-4d3f-4616-9901-3c4e690c45cd" containerName="alertmanager" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117043 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="842abb31-4d3f-4616-9901-3c4e690c45cd" containerName="prom-label-proxy" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117048 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="842abb31-4d3f-4616-9901-3c4e690c45cd" containerName="prom-label-proxy" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117054 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="736537c8-84ed-4e0b-8110-cbc34fa49128" containerName="kube-rbac-proxy" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117064 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="736537c8-84ed-4e0b-8110-cbc34fa49128" containerName="kube-rbac-proxy" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117050 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e"} err="failed to get container status \"931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e\": rpc error: code = NotFound desc = could not find container \"931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e\": container with ID starting with 931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e not found: ID does not exist" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117073 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="842abb31-4d3f-4616-9901-3c4e690c45cd" containerName="kube-rbac-proxy" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117078 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="842abb31-4d3f-4616-9901-3c4e690c45cd" containerName="kube-rbac-proxy" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117079 2576 scope.go:117] "RemoveContainer" containerID="dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117084 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="736537c8-84ed-4e0b-8110-cbc34fa49128" containerName="init-config-reloader" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117089 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="736537c8-84ed-4e0b-8110-cbc34fa49128" containerName="init-config-reloader" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117138 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="736537c8-84ed-4e0b-8110-cbc34fa49128" containerName="config-reloader" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117149 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="736537c8-84ed-4e0b-8110-cbc34fa49128" containerName="prometheus" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117159 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b32ccce9-2ce2-4bb9-8019-7a18e1dd7479" containerName="console" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117169 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="842abb31-4d3f-4616-9901-3c4e690c45cd" containerName="kube-rbac-proxy-metric" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117177 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="736537c8-84ed-4e0b-8110-cbc34fa49128" containerName="thanos-sidecar" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117185 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="842abb31-4d3f-4616-9901-3c4e690c45cd" containerName="prom-label-proxy" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117193 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="842abb31-4d3f-4616-9901-3c4e690c45cd" containerName="kube-rbac-proxy-web" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117200 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="736537c8-84ed-4e0b-8110-cbc34fa49128" containerName="kube-rbac-proxy" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117208 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="842abb31-4d3f-4616-9901-3c4e690c45cd" containerName="config-reloader" Jul 17 18:12:47.117291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117216 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="736537c8-84ed-4e0b-8110-cbc34fa49128" containerName="kube-rbac-proxy-web" Jul 17 18:12:47.118422 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117223 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="736537c8-84ed-4e0b-8110-cbc34fa49128" containerName="kube-rbac-proxy-thanos" Jul 17 18:12:47.118422 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117233 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="842abb31-4d3f-4616-9901-3c4e690c45cd" containerName="kube-rbac-proxy" Jul 17 18:12:47.118422 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117241 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="842abb31-4d3f-4616-9901-3c4e690c45cd" containerName="alertmanager" Jul 17 18:12:47.118422 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117248 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b8f65ac-b3d8-4cf4-b0ba-f61b5c30953c" containerName="console" Jul 17 18:12:47.118422 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117256 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dd7bab3-cf0a-42f3-a5e0-bcc0c0dc5dd6" containerName="registry" Jul 17 18:12:47.118422 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117279 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5"} err="failed to get container status \"dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5\": rpc error: code = NotFound desc = could not find container \"dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5\": container with ID starting with dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5 not found: ID does not exist" Jul 17 18:12:47.118422 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117294 2576 scope.go:117] "RemoveContainer" containerID="c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b" Jul 17 18:12:47.118422 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117512 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b"} err="failed to get container status \"c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b\": rpc error: code = NotFound desc = could not find container \"c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b\": container with ID starting with c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b not found: ID does not exist" Jul 17 18:12:47.118422 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117524 2576 scope.go:117] "RemoveContainer" containerID="674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb" Jul 17 18:12:47.118422 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117722 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb"} err="failed to get container status \"674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb\": rpc error: code = NotFound desc = could not find container \"674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb\": container with ID starting with 674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb not found: ID does not exist" Jul 17 18:12:47.118422 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117738 2576 scope.go:117] "RemoveContainer" containerID="ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870" Jul 17 18:12:47.118422 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117932 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870"} err="failed to get container status \"ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870\": rpc error: code = NotFound desc = could not find container \"ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870\": container with ID starting with ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870 not found: ID does not exist" Jul 17 18:12:47.118422 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.117945 2576 scope.go:117] "RemoveContainer" containerID="15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098" Jul 17 18:12:47.118422 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.118138 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098"} err="failed to get container status \"15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098\": rpc error: code = NotFound desc = could not find container \"15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098\": container with ID starting with 15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098 not found: ID does not exist" Jul 17 18:12:47.118422 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.118150 2576 scope.go:117] "RemoveContainer" containerID="d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9" Jul 17 18:12:47.118422 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.118327 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9"} err="failed to get container status \"d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9\": rpc error: code = NotFound desc = could not find container \"d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9\": container with ID starting with d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9 not found: ID does not exist" Jul 17 18:12:47.118422 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.118343 2576 scope.go:117] "RemoveContainer" containerID="931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e" Jul 17 18:12:47.118887 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.118548 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e"} err="failed to get container status \"931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e\": rpc error: code = NotFound desc = could not find container \"931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e\": container with ID starting with 931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e not found: ID does not exist" Jul 17 18:12:47.118887 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.118562 2576 scope.go:117] "RemoveContainer" containerID="dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5" Jul 17 18:12:47.118887 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.118751 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5"} err="failed to get container status \"dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5\": rpc error: code = NotFound desc = could not find container \"dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5\": container with ID starting with dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5 not found: ID does not exist" Jul 17 18:12:47.118887 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.118766 2576 scope.go:117] "RemoveContainer" containerID="c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b" Jul 17 18:12:47.119018 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.118927 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b"} err="failed to get container status \"c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b\": rpc error: code = NotFound desc = could not find container \"c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b\": container with ID starting with c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b not found: ID does not exist" Jul 17 18:12:47.119018 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.118939 2576 scope.go:117] "RemoveContainer" containerID="674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb" Jul 17 18:12:47.119125 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.119110 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb"} err="failed to get container status \"674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb\": rpc error: code = NotFound desc = could not find container \"674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb\": container with ID starting with 674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb not found: ID does not exist" Jul 17 18:12:47.119161 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.119124 2576 scope.go:117] "RemoveContainer" containerID="ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870" Jul 17 18:12:47.119295 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.119278 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870"} err="failed to get container status \"ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870\": rpc error: code = NotFound desc = could not find container \"ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870\": container with ID starting with ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870 not found: ID does not exist" Jul 17 18:12:47.119331 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.119296 2576 scope.go:117] "RemoveContainer" containerID="15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098" Jul 17 18:12:47.119480 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.119461 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098"} err="failed to get container status \"15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098\": rpc error: code = NotFound desc = could not find container \"15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098\": container with ID starting with 15cc18184cb117a494267e7d875bea4f6d0c45bbdcc9c52fa22f74171f4d1098 not found: ID does not exist" Jul 17 18:12:47.119544 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.119480 2576 scope.go:117] "RemoveContainer" containerID="d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9" Jul 17 18:12:47.119675 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.119660 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9"} err="failed to get container status \"d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9\": rpc error: code = NotFound desc = could not find container \"d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9\": container with ID starting with d6360cf4b80c65f0c687dfd6aa3dfa3c008805d4bd386290bed8c4974d4dd8c9 not found: ID does not exist" Jul 17 18:12:47.119725 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.119677 2576 scope.go:117] "RemoveContainer" containerID="931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e" Jul 17 18:12:47.119849 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.119835 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e"} err="failed to get container status \"931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e\": rpc error: code = NotFound desc = could not find container \"931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e\": container with ID starting with 931c735c3ed057ebfd7f7b479ed1d9d2668d4dc7432bb0ed669e87748efa7d8e not found: ID does not exist" Jul 17 18:12:47.119889 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.119848 2576 scope.go:117] "RemoveContainer" containerID="dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5" Jul 17 18:12:47.120064 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.120047 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5"} err="failed to get container status \"dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5\": rpc error: code = NotFound desc = could not find container \"dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5\": container with ID starting with dc614fd049ba47e040d6efd8be9a5d40c5d1b52b6ce95093d1aefbd27dabcfc5 not found: ID does not exist" Jul 17 18:12:47.120114 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.120066 2576 scope.go:117] "RemoveContainer" containerID="c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b" Jul 17 18:12:47.120239 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.120222 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b"} err="failed to get container status \"c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b\": rpc error: code = NotFound desc = could not find container \"c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b\": container with ID starting with c4ea00be9fd60f3cef8298382b7992d99a713f5bb22b38e7c9a6ebf4e6fc234b not found: ID does not exist" Jul 17 18:12:47.120278 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.120239 2576 scope.go:117] "RemoveContainer" containerID="674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb" Jul 17 18:12:47.120387 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.120370 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb"} err="failed to get container status \"674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb\": rpc error: code = NotFound desc = could not find container \"674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb\": container with ID starting with 674c48e4c74ad447cd4a55ca6a51164db226a991a1e8027084e029a8ca48d2bb not found: ID does not exist" Jul 17 18:12:47.120438 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.120388 2576 scope.go:117] "RemoveContainer" containerID="ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870" Jul 17 18:12:47.120550 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.120535 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870"} err="failed to get container status \"ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870\": rpc error: code = NotFound desc = could not find container \"ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870\": container with ID starting with ce91d0610ce1feb629a50e3263a806637ecef84b67255e41c31a8740af2a7870 not found: ID does not exist" Jul 17 18:12:47.122411 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.122394 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.124599 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.124582 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5i98p068o26r0\"" Jul 17 18:12:47.124683 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.124649 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 17 18:12:47.124683 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.124662 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 17 18:12:47.124858 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.124840 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 17 18:12:47.124916 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.124905 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 17 18:12:47.124990 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.124949 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 17 18:12:47.124990 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.124955 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 17 18:12:47.125529 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.125512 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 17 18:12:47.125674 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.125654 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 17 18:12:47.125762 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.125696 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 17 18:12:47.125821 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.125797 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 17 18:12:47.125909 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.125878 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 17 18:12:47.126042 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.125911 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 17 18:12:47.126042 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.125968 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8x4hz\"" Jul 17 18:12:47.126466 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.126448 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 17 18:12:47.129106 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.129088 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 17 18:12:47.130593 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.130577 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 17 18:12:47.136720 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.136702 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 17 18:12:47.184737 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.184713 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="736537c8-84ed-4e0b-8110-cbc34fa49128" path="/var/lib/kubelet/pods/736537c8-84ed-4e0b-8110-cbc34fa49128/volumes" Jul 17 18:12:47.191209 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.191191 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.191276 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.191220 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.191276 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.191236 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.191276 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.191256 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.191375 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.191321 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.191375 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.191345 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.191432 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.191377 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.191432 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.191411 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-config\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.191432 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.191428 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.191556 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.191459 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.191556 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.191489 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-config-out\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.191556 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.191509 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.191556 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.191530 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.191556 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.191548 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.191697 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.191573 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.191697 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.191598 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.191697 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.191619 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-web-config\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.191697 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.191647 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.191697 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.191662 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxk24\" (UniqueName: \"kubernetes.io/projected/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-kube-api-access-wxk24\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.191697 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.191690 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.292654 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.292635 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-config\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.292730 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.292664 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.292730 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.292681 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.292730 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.292696 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-config-out\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.292730 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.292717 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.292902 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.292741 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.292902 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.292765 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.292902 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.292790 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.292902 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.292813 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.292902 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.292835 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-web-config\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.292902 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.292866 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.292902 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.292888 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxk24\" (UniqueName: \"kubernetes.io/projected/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-kube-api-access-wxk24\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.293256 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.292912 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.293256 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.292949 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.293256 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.292970 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.293256 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.293019 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.293256 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.293044 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.293256 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.293079 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.293256 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.293101 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.294054 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.293644 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.294054 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.293711 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.294199 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.294096 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.294311 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.294287 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.294374 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.294294 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.294374 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.294351 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.294826 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.294801 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.295443 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.295389 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.295645 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.295615 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-config-out\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.296233 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.296161 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.297017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.296995 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-config\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.297097 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.297055 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.297761 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.297334 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.297761 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.297459 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.297761 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.297733 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.297908 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.297733 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.297908 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.297798 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.298087 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.298073 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.298169 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.298150 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.298552 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.298535 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-web-config\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.300271 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.300256 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxk24\" (UniqueName: \"kubernetes.io/projected/a24ad2e1-8e7f-4726-b9ce-e81ef3173381-kube-api-access-wxk24\") pod \"prometheus-k8s-0\" (UID: \"a24ad2e1-8e7f-4726-b9ce-e81ef3173381\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.431482 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.431464 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:47.565936 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:47.565863 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 17 18:12:47.568895 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:12:47.568872 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda24ad2e1_8e7f_4726_b9ce_e81ef3173381.slice/crio-aecc7f07efa8fef253d97a8e47f1a0aef7f1af9c86cd649763643798a9ded407 WatchSource:0}: Error finding container aecc7f07efa8fef253d97a8e47f1a0aef7f1af9c86cd649763643798a9ded407: Status 404 returned error can't find the container with id aecc7f07efa8fef253d97a8e47f1a0aef7f1af9c86cd649763643798a9ded407 Jul 17 18:12:48.064281 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:48.064252 2576 generic.go:356] "Generic (PLEG): container finished" podID="a24ad2e1-8e7f-4726-b9ce-e81ef3173381" containerID="6f98ee57952c534c25d688d93e2fa64b2c7d82e0f8d618ec6b6e5ed6dfc9f31f" exitCode=0 Jul 17 18:12:48.064656 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:48.064341 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a24ad2e1-8e7f-4726-b9ce-e81ef3173381","Type":"ContainerDied","Data":"6f98ee57952c534c25d688d93e2fa64b2c7d82e0f8d618ec6b6e5ed6dfc9f31f"} Jul 17 18:12:48.064656 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:48.064420 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a24ad2e1-8e7f-4726-b9ce-e81ef3173381","Type":"ContainerStarted","Data":"aecc7f07efa8fef253d97a8e47f1a0aef7f1af9c86cd649763643798a9ded407"} Jul 17 18:12:49.072712 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:49.072680 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a24ad2e1-8e7f-4726-b9ce-e81ef3173381","Type":"ContainerStarted","Data":"6cdf41ef1480804afc645b8365fcc9fc39ec33b84412950c88ee7afbfbdb92fa"} Jul 17 18:12:49.073062 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:49.072756 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a24ad2e1-8e7f-4726-b9ce-e81ef3173381","Type":"ContainerStarted","Data":"32c73e63ce9b2a8825310a4cd2a07a9bec7ce16d167a3b3ae99ecb8fae11c5ac"} Jul 17 18:12:49.073062 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:49.072796 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a24ad2e1-8e7f-4726-b9ce-e81ef3173381","Type":"ContainerStarted","Data":"5cc6680d87aa1b6baf57c26aabdd535229ad6b9f87a43d6e731cdd0c6dbaab6f"} Jul 17 18:12:49.073062 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:49.072832 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a24ad2e1-8e7f-4726-b9ce-e81ef3173381","Type":"ContainerStarted","Data":"2d7bbb93833a746c2fcc8a808120b95038adab7292981ff3d3c9cdf3c46dbd5b"} Jul 17 18:12:49.073062 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:49.072870 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a24ad2e1-8e7f-4726-b9ce-e81ef3173381","Type":"ContainerStarted","Data":"1f6fa6ed6f6e5ee627f993fb38f2e9ad878285530ed8f4e7bf8defb1cab510a0"} Jul 17 18:12:49.073062 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:49.072903 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a24ad2e1-8e7f-4726-b9ce-e81ef3173381","Type":"ContainerStarted","Data":"875f2883006133b90c8222d3bfc6723bfd4e7ec236b4cd6edc66399bf6f9bef8"} Jul 17 18:12:49.098986 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:49.098918 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.082316849 podStartE2EDuration="2.098901447s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.584598ms" isStatefulPod=false podCreationTimestamp="2026-07-17 18:12:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:12:49.097660461 +0000 UTC m=+184.371271603" watchObservedRunningTime="2026-07-17 18:12:49.098901447 +0000 UTC m=+184.372512590" Jul 17 18:12:50.266658 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:50.266628 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:12:50.367706 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:50.367686 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:12:52.432373 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:52.432344 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:12:54.885925 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:54.885886 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:12:54.986422 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:54.986395 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:12:55.039379 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:12:55.039335 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:13:02.477512 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:13:02.477455 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:13:02.577966 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:13:02.577936 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:13:12.761176 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:13:12.761136 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:13:12.834401 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:13:12.834371 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:13:15.863323 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:13:15.863296 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:13:42.924101 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:13:42.924055 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:13:43.022763 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:13:43.022733 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:13:47.432551 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:13:47.432522 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:13:47.447151 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:13:47.447125 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:13:48.297960 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:13:48.297930 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 17 18:14:09.626452 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:09.626359 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:14:10.430952 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:10.430919 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:14:13.247087 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:13.247058 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:14:13.347418 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:13.347392 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:14:14.550429 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:14.550385 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:14:14.721062 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:14.721037 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:14:14.831238 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:14.831175 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:14:17.068128 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:17.068095 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:14:17.256880 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:17.256853 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:14:20.081468 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:20.081440 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:14:20.180680 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:20.180659 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:14:21.538884 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:21.538840 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:14:21.595112 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:21.595079 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:14:24.846948 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:24.846915 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:14:26.039776 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:26.039733 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:14:26.104556 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:26.104532 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:14:31.916259 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:31.916228 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:14:32.175820 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:32.175761 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:14:34.459832 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:34.459805 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:14:45.037904 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:45.037876 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nwqlr_c6017e7d-5ed2-4d7d-ba64-ba9ce933828f/console-operator/1.log" Jul 17 18:14:45.043675 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:45.043657 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6pqqj_a67c7573-deca-4960-b69f-5ad3bda075a8/ovn-acl-logging/0.log" Jul 17 18:14:45.043811 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:45.043777 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nwqlr_c6017e7d-5ed2-4d7d-ba64-ba9ce933828f/console-operator/1.log" Jul 17 18:14:45.047862 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:45.047847 2576 kubelet.go:1648] "Image garbage collection succeeded" Jul 17 18:14:45.049506 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:45.049491 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6pqqj_a67c7573-deca-4960-b69f-5ad3bda075a8/ovn-acl-logging/0.log" Jul 17 18:14:47.283704 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:47.283661 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:14:47.388554 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:47.388516 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:14:48.237380 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:48.237348 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:14:48.843015 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:48.842961 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7cf59f64f5-jzwm8"] Jul 17 18:14:48.846308 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:48.846287 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7cf59f64f5-jzwm8" Jul 17 18:14:48.850532 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:48.850514 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 17 18:14:48.851950 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:48.851925 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 17 18:14:48.852093 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:48.852075 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 17 18:14:48.852166 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:48.852118 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-wn5nw\"" Jul 17 18:14:48.852223 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:48.852204 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 17 18:14:48.852695 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:48.852459 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 17 18:14:48.865829 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:48.865811 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7cf59f64f5-jzwm8"] Jul 17 18:14:48.917068 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:48.917047 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4553dba1-6212-4374-bb08-abde863e0940-manager-config\") pod \"lws-controller-manager-7cf59f64f5-jzwm8\" (UID: \"4553dba1-6212-4374-bb08-abde863e0940\") " pod="openshift-lws-operator/lws-controller-manager-7cf59f64f5-jzwm8" Jul 17 18:14:48.917161 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:48.917084 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpjq5\" (UniqueName: \"kubernetes.io/projected/4553dba1-6212-4374-bb08-abde863e0940-kube-api-access-xpjq5\") pod \"lws-controller-manager-7cf59f64f5-jzwm8\" (UID: \"4553dba1-6212-4374-bb08-abde863e0940\") " pod="openshift-lws-operator/lws-controller-manager-7cf59f64f5-jzwm8" Jul 17 18:14:48.917161 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:48.917118 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4553dba1-6212-4374-bb08-abde863e0940-cert\") pod \"lws-controller-manager-7cf59f64f5-jzwm8\" (UID: \"4553dba1-6212-4374-bb08-abde863e0940\") " pod="openshift-lws-operator/lws-controller-manager-7cf59f64f5-jzwm8" Jul 17 18:14:48.917239 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:48.917182 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4553dba1-6212-4374-bb08-abde863e0940-metrics-cert\") pod \"lws-controller-manager-7cf59f64f5-jzwm8\" (UID: \"4553dba1-6212-4374-bb08-abde863e0940\") " pod="openshift-lws-operator/lws-controller-manager-7cf59f64f5-jzwm8" Jul 17 18:14:49.018071 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.018045 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4553dba1-6212-4374-bb08-abde863e0940-manager-config\") pod \"lws-controller-manager-7cf59f64f5-jzwm8\" (UID: \"4553dba1-6212-4374-bb08-abde863e0940\") " pod="openshift-lws-operator/lws-controller-manager-7cf59f64f5-jzwm8" Jul 17 18:14:49.018167 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.018094 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpjq5\" (UniqueName: \"kubernetes.io/projected/4553dba1-6212-4374-bb08-abde863e0940-kube-api-access-xpjq5\") pod \"lws-controller-manager-7cf59f64f5-jzwm8\" (UID: \"4553dba1-6212-4374-bb08-abde863e0940\") " pod="openshift-lws-operator/lws-controller-manager-7cf59f64f5-jzwm8" Jul 17 18:14:49.018167 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.018147 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4553dba1-6212-4374-bb08-abde863e0940-cert\") pod \"lws-controller-manager-7cf59f64f5-jzwm8\" (UID: \"4553dba1-6212-4374-bb08-abde863e0940\") " pod="openshift-lws-operator/lws-controller-manager-7cf59f64f5-jzwm8" Jul 17 18:14:49.018240 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.018183 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4553dba1-6212-4374-bb08-abde863e0940-metrics-cert\") pod \"lws-controller-manager-7cf59f64f5-jzwm8\" (UID: \"4553dba1-6212-4374-bb08-abde863e0940\") " pod="openshift-lws-operator/lws-controller-manager-7cf59f64f5-jzwm8" Jul 17 18:14:49.018775 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.018747 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4553dba1-6212-4374-bb08-abde863e0940-manager-config\") pod \"lws-controller-manager-7cf59f64f5-jzwm8\" (UID: \"4553dba1-6212-4374-bb08-abde863e0940\") " pod="openshift-lws-operator/lws-controller-manager-7cf59f64f5-jzwm8" Jul 17 18:14:49.020489 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.020462 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4553dba1-6212-4374-bb08-abde863e0940-metrics-cert\") pod \"lws-controller-manager-7cf59f64f5-jzwm8\" (UID: \"4553dba1-6212-4374-bb08-abde863e0940\") " pod="openshift-lws-operator/lws-controller-manager-7cf59f64f5-jzwm8" Jul 17 18:14:49.020489 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.020483 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4553dba1-6212-4374-bb08-abde863e0940-cert\") pod \"lws-controller-manager-7cf59f64f5-jzwm8\" (UID: \"4553dba1-6212-4374-bb08-abde863e0940\") " pod="openshift-lws-operator/lws-controller-manager-7cf59f64f5-jzwm8" Jul 17 18:14:49.034079 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.034059 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpjq5\" (UniqueName: \"kubernetes.io/projected/4553dba1-6212-4374-bb08-abde863e0940-kube-api-access-xpjq5\") pod \"lws-controller-manager-7cf59f64f5-jzwm8\" (UID: \"4553dba1-6212-4374-bb08-abde863e0940\") " pod="openshift-lws-operator/lws-controller-manager-7cf59f64f5-jzwm8" Jul 17 18:14:49.155754 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.155696 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7cf59f64f5-jzwm8" Jul 17 18:14:49.279250 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.279228 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7cf59f64f5-jzwm8"] Jul 17 18:14:49.281261 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:14:49.281234 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4553dba1_6212_4374_bb08_abde863e0940.slice/crio-8770defed74aafddc04bad1d805593407aa37cce1f8d1fee5e986b7403427a8f WatchSource:0}: Error finding container 8770defed74aafddc04bad1d805593407aa37cce1f8d1fee5e986b7403427a8f: Status 404 returned error can't find the container with id 8770defed74aafddc04bad1d805593407aa37cce1f8d1fee5e986b7403427a8f Jul 17 18:14:49.283084 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.283069 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 18:14:49.509162 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.509080 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7cf59f64f5-jzwm8" event={"ID":"4553dba1-6212-4374-bb08-abde863e0940","Type":"ContainerStarted","Data":"8770defed74aafddc04bad1d805593407aa37cce1f8d1fee5e986b7403427a8f"} Jul 17 18:14:49.565737 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.565708 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9846c54f8-nvnp7"] Jul 17 18:14:49.570097 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.570077 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9846c54f8-nvnp7" Jul 17 18:14:49.572323 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.572298 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 17 18:14:49.572456 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.572368 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-z9sgw\"" Jul 17 18:14:49.572456 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.572439 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 17 18:14:49.572753 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.572734 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 17 18:14:49.572810 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.572781 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 17 18:14:49.585301 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.585278 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9846c54f8-nvnp7"] Jul 17 18:14:49.623158 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.623133 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/41b0f71f-e1bb-4030-861c-bb5dd52fa752-manifests\") pod \"opendatahub-operator-controller-manager-9846c54f8-nvnp7\" (UID: \"41b0f71f-e1bb-4030-861c-bb5dd52fa752\") " pod="opendatahub/opendatahub-operator-controller-manager-9846c54f8-nvnp7" Jul 17 18:14:49.623282 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.623169 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpjrf\" (UniqueName: \"kubernetes.io/projected/41b0f71f-e1bb-4030-861c-bb5dd52fa752-kube-api-access-cpjrf\") pod \"opendatahub-operator-controller-manager-9846c54f8-nvnp7\" (UID: \"41b0f71f-e1bb-4030-861c-bb5dd52fa752\") " pod="opendatahub/opendatahub-operator-controller-manager-9846c54f8-nvnp7" Jul 17 18:14:49.623282 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.623204 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/41b0f71f-e1bb-4030-861c-bb5dd52fa752-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9846c54f8-nvnp7\" (UID: \"41b0f71f-e1bb-4030-861c-bb5dd52fa752\") " pod="opendatahub/opendatahub-operator-controller-manager-9846c54f8-nvnp7" Jul 17 18:14:49.623282 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.623224 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41b0f71f-e1bb-4030-861c-bb5dd52fa752-tmp\") pod \"opendatahub-operator-controller-manager-9846c54f8-nvnp7\" (UID: \"41b0f71f-e1bb-4030-861c-bb5dd52fa752\") " pod="opendatahub/opendatahub-operator-controller-manager-9846c54f8-nvnp7" Jul 17 18:14:49.623282 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.623247 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41b0f71f-e1bb-4030-861c-bb5dd52fa752-webhook-cert\") pod \"opendatahub-operator-controller-manager-9846c54f8-nvnp7\" (UID: \"41b0f71f-e1bb-4030-861c-bb5dd52fa752\") " pod="opendatahub/opendatahub-operator-controller-manager-9846c54f8-nvnp7" Jul 17 18:14:49.724419 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.724396 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/41b0f71f-e1bb-4030-861c-bb5dd52fa752-manifests\") pod \"opendatahub-operator-controller-manager-9846c54f8-nvnp7\" (UID: \"41b0f71f-e1bb-4030-861c-bb5dd52fa752\") " pod="opendatahub/opendatahub-operator-controller-manager-9846c54f8-nvnp7" Jul 17 18:14:49.724557 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.724429 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpjrf\" (UniqueName: \"kubernetes.io/projected/41b0f71f-e1bb-4030-861c-bb5dd52fa752-kube-api-access-cpjrf\") pod \"opendatahub-operator-controller-manager-9846c54f8-nvnp7\" (UID: \"41b0f71f-e1bb-4030-861c-bb5dd52fa752\") " pod="opendatahub/opendatahub-operator-controller-manager-9846c54f8-nvnp7" Jul 17 18:14:49.724557 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.724451 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/41b0f71f-e1bb-4030-861c-bb5dd52fa752-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9846c54f8-nvnp7\" (UID: \"41b0f71f-e1bb-4030-861c-bb5dd52fa752\") " pod="opendatahub/opendatahub-operator-controller-manager-9846c54f8-nvnp7" Jul 17 18:14:49.724557 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.724469 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41b0f71f-e1bb-4030-861c-bb5dd52fa752-tmp\") pod \"opendatahub-operator-controller-manager-9846c54f8-nvnp7\" (UID: \"41b0f71f-e1bb-4030-861c-bb5dd52fa752\") " pod="opendatahub/opendatahub-operator-controller-manager-9846c54f8-nvnp7" Jul 17 18:14:49.724557 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.724488 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41b0f71f-e1bb-4030-861c-bb5dd52fa752-webhook-cert\") pod \"opendatahub-operator-controller-manager-9846c54f8-nvnp7\" (UID: \"41b0f71f-e1bb-4030-861c-bb5dd52fa752\") " pod="opendatahub/opendatahub-operator-controller-manager-9846c54f8-nvnp7" Jul 17 18:14:49.724845 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.724824 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/41b0f71f-e1bb-4030-861c-bb5dd52fa752-manifests\") pod \"opendatahub-operator-controller-manager-9846c54f8-nvnp7\" (UID: \"41b0f71f-e1bb-4030-861c-bb5dd52fa752\") " pod="opendatahub/opendatahub-operator-controller-manager-9846c54f8-nvnp7" Jul 17 18:14:49.726724 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.726700 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41b0f71f-e1bb-4030-861c-bb5dd52fa752-tmp\") pod \"opendatahub-operator-controller-manager-9846c54f8-nvnp7\" (UID: \"41b0f71f-e1bb-4030-861c-bb5dd52fa752\") " pod="opendatahub/opendatahub-operator-controller-manager-9846c54f8-nvnp7" Jul 17 18:14:49.726927 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.726907 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41b0f71f-e1bb-4030-861c-bb5dd52fa752-webhook-cert\") pod \"opendatahub-operator-controller-manager-9846c54f8-nvnp7\" (UID: \"41b0f71f-e1bb-4030-861c-bb5dd52fa752\") " pod="opendatahub/opendatahub-operator-controller-manager-9846c54f8-nvnp7" Jul 17 18:14:49.726969 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.726910 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/41b0f71f-e1bb-4030-861c-bb5dd52fa752-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9846c54f8-nvnp7\" (UID: \"41b0f71f-e1bb-4030-861c-bb5dd52fa752\") " pod="opendatahub/opendatahub-operator-controller-manager-9846c54f8-nvnp7" Jul 17 18:14:49.731511 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.731494 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpjrf\" (UniqueName: \"kubernetes.io/projected/41b0f71f-e1bb-4030-861c-bb5dd52fa752-kube-api-access-cpjrf\") pod \"opendatahub-operator-controller-manager-9846c54f8-nvnp7\" (UID: \"41b0f71f-e1bb-4030-861c-bb5dd52fa752\") " pod="opendatahub/opendatahub-operator-controller-manager-9846c54f8-nvnp7" Jul 17 18:14:49.882770 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:49.882751 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9846c54f8-nvnp7" Jul 17 18:14:50.007290 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:50.007270 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9846c54f8-nvnp7"] Jul 17 18:14:50.009422 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:14:50.009399 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41b0f71f_e1bb_4030_861c_bb5dd52fa752.slice/crio-4722ba7df18fc96faade377aebca3b5f4ba0722de3c508c3e366b7c4051954fb WatchSource:0}: Error finding container 4722ba7df18fc96faade377aebca3b5f4ba0722de3c508c3e366b7c4051954fb: Status 404 returned error can't find the container with id 4722ba7df18fc96faade377aebca3b5f4ba0722de3c508c3e366b7c4051954fb Jul 17 18:14:50.218994 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:50.218903 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:14:50.515791 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:50.515716 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9846c54f8-nvnp7" event={"ID":"41b0f71f-e1bb-4030-861c-bb5dd52fa752","Type":"ContainerStarted","Data":"4722ba7df18fc96faade377aebca3b5f4ba0722de3c508c3e366b7c4051954fb"} Jul 17 18:14:54.537517 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:54.537480 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9846c54f8-nvnp7" event={"ID":"41b0f71f-e1bb-4030-861c-bb5dd52fa752","Type":"ContainerStarted","Data":"b8646df5b8d23848370ceb1a041d60af7dff7f65db2b74fee9712a6f7137061f"} Jul 17 18:14:54.539030 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:54.539002 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7cf59f64f5-jzwm8" event={"ID":"4553dba1-6212-4374-bb08-abde863e0940","Type":"ContainerStarted","Data":"9f32a8e898d010666ee0f20bab0fe46f7915db6e3d855d8d81696c3fe88b0b64"} Jul 17 18:14:54.539165 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:54.539099 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7cf59f64f5-jzwm8" Jul 17 18:14:54.573292 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:54.573250 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7cf59f64f5-jzwm8" podStartSLOduration=2.366366635 podStartE2EDuration="6.573237444s" totalImagesPullingTime="4.206870809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:14:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:14:54.571925857 +0000 UTC m=+309.845537002" watchObservedRunningTime="2026-07-17 18:14:54.573237444 +0000 UTC m=+309.846848585" Jul 17 18:14:55.543581 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:55.543544 2576 generic.go:356] "Generic (PLEG): container finished" podID="41b0f71f-e1bb-4030-861c-bb5dd52fa752" containerID="b8646df5b8d23848370ceb1a041d60af7dff7f65db2b74fee9712a6f7137061f" exitCode=0 Jul 17 18:14:55.543951 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:55.543628 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9846c54f8-nvnp7" event={"ID":"41b0f71f-e1bb-4030-861c-bb5dd52fa752","Type":"ContainerDied","Data":"b8646df5b8d23848370ceb1a041d60af7dff7f65db2b74fee9712a6f7137061f"} Jul 17 18:14:56.549727 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:56.549698 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9846c54f8-nvnp7" event={"ID":"41b0f71f-e1bb-4030-861c-bb5dd52fa752","Type":"ContainerStarted","Data":"ff65ee8c25d0429bde6efef9ea8b4f9c876fe1c2b7d1c3171bcbd9e9ccbb2089"} Jul 17 18:14:56.550099 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:56.549910 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9846c54f8-nvnp7" Jul 17 18:14:56.571852 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:14:56.571809 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9846c54f8-nvnp7" podStartSLOduration=2.682816053 podStartE2EDuration="7.571796453s" totalImagesPullingTime="3.847174974s" totalInitContainerRuntime="1.041805426s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:14:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:14:56.569961882 +0000 UTC m=+311.843573025" watchObservedRunningTime="2026-07-17 18:14:56.571796453 +0000 UTC m=+311.845407592" Jul 17 18:15:00.141864 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:00.141831 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:15:00.204218 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:00.204193 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:15:00.602952 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:00.602929 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:15:00.703769 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:00.703745 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:15:05.546676 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:05.546642 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7cf59f64f5-jzwm8" Jul 17 18:15:07.556498 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:07.556467 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9846c54f8-nvnp7" Jul 17 18:15:09.186000 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:09.185962 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:15:09.288561 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:09.288536 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:15:09.571801 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:09.571773 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:15:09.825788 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:09.825722 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:15:09.990368 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:09.990325 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:15:10.126184 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:10.126129 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:15:10.225375 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:10.225352 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:15:10.374654 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:10.374631 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:15:10.642644 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:10.642612 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:15:10.924491 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:10.924395 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:15:11.120338 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:11.120309 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:15:11.195567 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:11.195477 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:15:12.044918 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:12.044892 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:15:17.555596 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:17.555557 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:15:17.654201 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:17.654174 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:15:18.273419 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.273389 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv"] Jul 17 18:15:18.276905 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.276888 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" Jul 17 18:15:18.278758 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.278739 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 17 18:15:18.278758 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.278748 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-n89fz\"" Jul 17 18:15:18.285797 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.285745 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv"] Jul 17 18:15:18.307138 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.307120 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:15:18.332809 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.332782 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d9fd590-4de6-4c58-8760-d79ad04eb1bd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p4wlv\" (UID: \"4d9fd590-4de6-4c58-8760-d79ad04eb1bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" Jul 17 18:15:18.332911 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.332823 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d9fd590-4de6-4c58-8760-d79ad04eb1bd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p4wlv\" (UID: \"4d9fd590-4de6-4c58-8760-d79ad04eb1bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" Jul 17 18:15:18.332911 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.332868 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d9fd590-4de6-4c58-8760-d79ad04eb1bd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p4wlv\" (UID: \"4d9fd590-4de6-4c58-8760-d79ad04eb1bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" Jul 17 18:15:18.332911 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.332904 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d9fd590-4de6-4c58-8760-d79ad04eb1bd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p4wlv\" (UID: \"4d9fd590-4de6-4c58-8760-d79ad04eb1bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" Jul 17 18:15:18.333091 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.333004 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d9fd590-4de6-4c58-8760-d79ad04eb1bd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p4wlv\" (UID: \"4d9fd590-4de6-4c58-8760-d79ad04eb1bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" Jul 17 18:15:18.333091 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.333055 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d9fd590-4de6-4c58-8760-d79ad04eb1bd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p4wlv\" (UID: \"4d9fd590-4de6-4c58-8760-d79ad04eb1bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" Jul 17 18:15:18.333193 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.333091 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d9fd590-4de6-4c58-8760-d79ad04eb1bd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p4wlv\" (UID: \"4d9fd590-4de6-4c58-8760-d79ad04eb1bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" Jul 17 18:15:18.333193 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.333124 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgxp8\" (UniqueName: \"kubernetes.io/projected/4d9fd590-4de6-4c58-8760-d79ad04eb1bd-kube-api-access-vgxp8\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p4wlv\" (UID: \"4d9fd590-4de6-4c58-8760-d79ad04eb1bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" Jul 17 18:15:18.333193 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.333175 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d9fd590-4de6-4c58-8760-d79ad04eb1bd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p4wlv\" (UID: \"4d9fd590-4de6-4c58-8760-d79ad04eb1bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" Jul 17 18:15:18.434028 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.434007 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d9fd590-4de6-4c58-8760-d79ad04eb1bd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p4wlv\" (UID: \"4d9fd590-4de6-4c58-8760-d79ad04eb1bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" Jul 17 18:15:18.434145 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.434044 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d9fd590-4de6-4c58-8760-d79ad04eb1bd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p4wlv\" (UID: \"4d9fd590-4de6-4c58-8760-d79ad04eb1bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" Jul 17 18:15:18.434145 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.434068 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d9fd590-4de6-4c58-8760-d79ad04eb1bd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p4wlv\" (UID: \"4d9fd590-4de6-4c58-8760-d79ad04eb1bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" Jul 17 18:15:18.434145 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.434088 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d9fd590-4de6-4c58-8760-d79ad04eb1bd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p4wlv\" (UID: \"4d9fd590-4de6-4c58-8760-d79ad04eb1bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" Jul 17 18:15:18.434145 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.434114 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d9fd590-4de6-4c58-8760-d79ad04eb1bd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p4wlv\" (UID: \"4d9fd590-4de6-4c58-8760-d79ad04eb1bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" Jul 17 18:15:18.434363 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.434146 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgxp8\" (UniqueName: \"kubernetes.io/projected/4d9fd590-4de6-4c58-8760-d79ad04eb1bd-kube-api-access-vgxp8\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p4wlv\" (UID: \"4d9fd590-4de6-4c58-8760-d79ad04eb1bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" Jul 17 18:15:18.434363 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.434189 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d9fd590-4de6-4c58-8760-d79ad04eb1bd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p4wlv\" (UID: \"4d9fd590-4de6-4c58-8760-d79ad04eb1bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" Jul 17 18:15:18.434363 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.434212 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d9fd590-4de6-4c58-8760-d79ad04eb1bd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p4wlv\" (UID: \"4d9fd590-4de6-4c58-8760-d79ad04eb1bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" Jul 17 18:15:18.434363 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.434237 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d9fd590-4de6-4c58-8760-d79ad04eb1bd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p4wlv\" (UID: \"4d9fd590-4de6-4c58-8760-d79ad04eb1bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" Jul 17 18:15:18.434550 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.434452 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d9fd590-4de6-4c58-8760-d79ad04eb1bd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p4wlv\" (UID: \"4d9fd590-4de6-4c58-8760-d79ad04eb1bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" Jul 17 18:15:18.434550 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.434499 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d9fd590-4de6-4c58-8760-d79ad04eb1bd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p4wlv\" (UID: \"4d9fd590-4de6-4c58-8760-d79ad04eb1bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" Jul 17 18:15:18.434619 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.434571 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d9fd590-4de6-4c58-8760-d79ad04eb1bd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p4wlv\" (UID: \"4d9fd590-4de6-4c58-8760-d79ad04eb1bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" Jul 17 18:15:18.434619 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.434607 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d9fd590-4de6-4c58-8760-d79ad04eb1bd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p4wlv\" (UID: \"4d9fd590-4de6-4c58-8760-d79ad04eb1bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" Jul 17 18:15:18.435002 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.434962 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d9fd590-4de6-4c58-8760-d79ad04eb1bd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p4wlv\" (UID: \"4d9fd590-4de6-4c58-8760-d79ad04eb1bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" Jul 17 18:15:18.436466 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.436442 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d9fd590-4de6-4c58-8760-d79ad04eb1bd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p4wlv\" (UID: \"4d9fd590-4de6-4c58-8760-d79ad04eb1bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" Jul 17 18:15:18.436596 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.436581 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d9fd590-4de6-4c58-8760-d79ad04eb1bd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p4wlv\" (UID: \"4d9fd590-4de6-4c58-8760-d79ad04eb1bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" Jul 17 18:15:18.451650 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.451628 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d9fd590-4de6-4c58-8760-d79ad04eb1bd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p4wlv\" (UID: \"4d9fd590-4de6-4c58-8760-d79ad04eb1bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" Jul 17 18:15:18.451730 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.451634 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgxp8\" (UniqueName: \"kubernetes.io/projected/4d9fd590-4de6-4c58-8760-d79ad04eb1bd-kube-api-access-vgxp8\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p4wlv\" (UID: \"4d9fd590-4de6-4c58-8760-d79ad04eb1bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" Jul 17 18:15:18.588167 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.588140 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" Jul 17 18:15:18.621408 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.621381 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:15:18.665516 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.665489 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r6ggj"] Jul 17 18:15:18.669572 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.669237 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r6ggj" Jul 17 18:15:18.672574 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.671745 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-rhvf4\"" Jul 17 18:15:18.672574 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.672072 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 17 18:15:18.672574 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.672285 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 17 18:15:18.672574 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.672446 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 17 18:15:18.680776 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.680745 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r6ggj"] Jul 17 18:15:18.727969 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.727808 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv"] Jul 17 18:15:18.729101 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:15:18.729059 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d9fd590_4de6_4c58_8760_d79ad04eb1bd.slice/crio-7c7ddb3ba2ea9abfdfc3b6e56e1a31906aa00aaa9201a0f8ca2a6a6e70078298 WatchSource:0}: Error finding container 7c7ddb3ba2ea9abfdfc3b6e56e1a31906aa00aaa9201a0f8ca2a6a6e70078298: Status 404 returned error can't find the container with id 7c7ddb3ba2ea9abfdfc3b6e56e1a31906aa00aaa9201a0f8ca2a6a6e70078298 Jul 17 18:15:18.737249 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.737226 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/abd1833e-41a6-467c-a21a-b75466997983-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-r6ggj\" (UID: \"abd1833e-41a6-467c-a21a-b75466997983\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r6ggj" Jul 17 18:15:18.737363 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.737263 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf7jq\" (UniqueName: \"kubernetes.io/projected/abd1833e-41a6-467c-a21a-b75466997983-kube-api-access-nf7jq\") pod \"istiod-openshift-gateway-94bb8fbfd-r6ggj\" (UID: \"abd1833e-41a6-467c-a21a-b75466997983\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r6ggj" Jul 17 18:15:18.737363 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.737351 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/abd1833e-41a6-467c-a21a-b75466997983-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-r6ggj\" (UID: \"abd1833e-41a6-467c-a21a-b75466997983\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r6ggj" Jul 17 18:15:18.737448 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.737410 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/abd1833e-41a6-467c-a21a-b75466997983-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-r6ggj\" (UID: \"abd1833e-41a6-467c-a21a-b75466997983\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r6ggj" Jul 17 18:15:18.737448 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.737442 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/abd1833e-41a6-467c-a21a-b75466997983-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-r6ggj\" (UID: \"abd1833e-41a6-467c-a21a-b75466997983\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r6ggj" Jul 17 18:15:18.737521 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.737464 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/abd1833e-41a6-467c-a21a-b75466997983-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-r6ggj\" (UID: \"abd1833e-41a6-467c-a21a-b75466997983\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r6ggj" Jul 17 18:15:18.737521 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.737486 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abd1833e-41a6-467c-a21a-b75466997983-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-r6ggj\" (UID: \"abd1833e-41a6-467c-a21a-b75466997983\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r6ggj" Jul 17 18:15:18.802160 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.802133 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:15:18.838680 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.838621 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/abd1833e-41a6-467c-a21a-b75466997983-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-r6ggj\" (UID: \"abd1833e-41a6-467c-a21a-b75466997983\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r6ggj" Jul 17 18:15:18.838680 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.838651 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/abd1833e-41a6-467c-a21a-b75466997983-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-r6ggj\" (UID: \"abd1833e-41a6-467c-a21a-b75466997983\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r6ggj" Jul 17 18:15:18.838680 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.838669 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/abd1833e-41a6-467c-a21a-b75466997983-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-r6ggj\" (UID: \"abd1833e-41a6-467c-a21a-b75466997983\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r6ggj" Jul 17 18:15:18.838895 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.838685 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/abd1833e-41a6-467c-a21a-b75466997983-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-r6ggj\" (UID: \"abd1833e-41a6-467c-a21a-b75466997983\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r6ggj" Jul 17 18:15:18.838895 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.838706 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abd1833e-41a6-467c-a21a-b75466997983-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-r6ggj\" (UID: \"abd1833e-41a6-467c-a21a-b75466997983\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r6ggj" Jul 17 18:15:18.838895 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.838740 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/abd1833e-41a6-467c-a21a-b75466997983-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-r6ggj\" (UID: \"abd1833e-41a6-467c-a21a-b75466997983\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r6ggj" Jul 17 18:15:18.838895 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.838757 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf7jq\" (UniqueName: \"kubernetes.io/projected/abd1833e-41a6-467c-a21a-b75466997983-kube-api-access-nf7jq\") pod \"istiod-openshift-gateway-94bb8fbfd-r6ggj\" (UID: \"abd1833e-41a6-467c-a21a-b75466997983\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r6ggj" Jul 17 18:15:18.839482 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.839462 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/abd1833e-41a6-467c-a21a-b75466997983-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-r6ggj\" (UID: \"abd1833e-41a6-467c-a21a-b75466997983\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r6ggj" Jul 17 18:15:18.840771 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.840746 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/abd1833e-41a6-467c-a21a-b75466997983-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-r6ggj\" (UID: \"abd1833e-41a6-467c-a21a-b75466997983\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r6ggj" Jul 17 18:15:18.841008 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.840967 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/abd1833e-41a6-467c-a21a-b75466997983-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-r6ggj\" (UID: \"abd1833e-41a6-467c-a21a-b75466997983\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r6ggj" Jul 17 18:15:18.841157 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.841143 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/abd1833e-41a6-467c-a21a-b75466997983-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-r6ggj\" (UID: \"abd1833e-41a6-467c-a21a-b75466997983\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r6ggj" Jul 17 18:15:18.841215 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.841199 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/abd1833e-41a6-467c-a21a-b75466997983-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-r6ggj\" (UID: \"abd1833e-41a6-467c-a21a-b75466997983\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r6ggj" Jul 17 18:15:18.851717 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.851694 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abd1833e-41a6-467c-a21a-b75466997983-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-r6ggj\" (UID: \"abd1833e-41a6-467c-a21a-b75466997983\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r6ggj" Jul 17 18:15:18.853057 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.853035 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf7jq\" (UniqueName: \"kubernetes.io/projected/abd1833e-41a6-467c-a21a-b75466997983-kube-api-access-nf7jq\") pod \"istiod-openshift-gateway-94bb8fbfd-r6ggj\" (UID: \"abd1833e-41a6-467c-a21a-b75466997983\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r6ggj" Jul 17 18:15:18.982893 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:18.982868 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r6ggj" Jul 17 18:15:19.108555 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:19.108526 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r6ggj"] Jul 17 18:15:19.110467 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:15:19.110440 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabd1833e_41a6_467c_a21a_b75466997983.slice/crio-41bde9988d83f433d02076f25a3cf4a543a1f9f4a75f7644f158ba5186894f76 WatchSource:0}: Error finding container 41bde9988d83f433d02076f25a3cf4a543a1f9f4a75f7644f158ba5186894f76: Status 404 returned error can't find the container with id 41bde9988d83f433d02076f25a3cf4a543a1f9f4a75f7644f158ba5186894f76 Jul 17 18:15:19.656584 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:19.656418 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r6ggj" event={"ID":"abd1833e-41a6-467c-a21a-b75466997983","Type":"ContainerStarted","Data":"41bde9988d83f433d02076f25a3cf4a543a1f9f4a75f7644f158ba5186894f76"} Jul 17 18:15:19.658039 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:19.657991 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" event={"ID":"4d9fd590-4de6-4c58-8760-d79ad04eb1bd","Type":"ContainerStarted","Data":"7c7ddb3ba2ea9abfdfc3b6e56e1a31906aa00aaa9201a0f8ca2a6a6e70078298"} Jul 17 18:15:21.282814 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:21.282765 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:15:21.460159 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:21.460130 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:15:21.716539 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:21.716506 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:15:21.831026 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:21.830955 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:15:22.404785 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:22.404749 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:15:22.405079 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:22.404824 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:15:22.405079 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:22.404869 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:15:22.405371 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:22.405338 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:15:22.405411 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:22.405400 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:15:22.675552 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:22.675440 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r6ggj" event={"ID":"abd1833e-41a6-467c-a21a-b75466997983","Type":"ContainerStarted","Data":"655bd1697c0e17403c4ed1b7906a1e73911610f95e33c8c7e4ae7924309d6e2c"} Jul 17 18:15:22.675552 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:22.675525 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r6ggj" Jul 17 18:15:22.677369 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:22.677316 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" event={"ID":"4d9fd590-4de6-4c58-8760-d79ad04eb1bd","Type":"ContainerStarted","Data":"e7ee2097e355b83f8298bfeeea7426f465e08d734f623302beb02a63c6638407"} Jul 17 18:15:22.766256 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:22.766200 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" podStartSLOduration=1.092601196 podStartE2EDuration="4.766183098s" totalImagesPullingTime="3.673581902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:15:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:15:22.76486817 +0000 UTC m=+338.038479312" watchObservedRunningTime="2026-07-17 18:15:22.766183098 +0000 UTC m=+338.039794241" Jul 17 18:15:22.767673 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:22.767644 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r6ggj" podStartSLOduration=1.475087886 podStartE2EDuration="4.767636794s" totalImagesPullingTime="3.292548908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:15:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:15:22.72483004 +0000 UTC m=+337.998441181" watchObservedRunningTime="2026-07-17 18:15:22.767636794 +0000 UTC m=+338.041247936" Jul 17 18:15:23.200488 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:23.200460 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:15:23.300220 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:23.300192 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:15:23.589286 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:23.589254 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" Jul 17 18:15:23.594022 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:23.594001 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" Jul 17 18:15:23.681992 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:23.681945 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" Jul 17 18:15:23.682817 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:23.682797 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p4wlv" Jul 17 18:15:23.683411 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:15:23.683394 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-r6ggj" Jul 17 18:16:10.738787 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:16:10.738756 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:16:10.839755 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:16:10.839721 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:16:10.941264 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:16:10.941238 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:16:39.736037 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:16:39.736007 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:16:43.188995 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:16:43.188957 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:16:45.084832 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:16:45.084806 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:16:45.554184 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:16:45.554154 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:16:45.840913 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:16:45.840841 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:16:46.116225 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:16:46.116158 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:16:48.157206 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:16:48.157150 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:16:50.005939 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:16:50.005910 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:16:50.151385 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:16:50.151356 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:16:50.364928 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:16:50.364887 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:16:50.484440 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:16:50.484415 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:16:52.364839 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:16:52.364811 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:16:54.371618 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:16:54.371590 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:16:54.466183 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:16:54.466158 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:16:55.519696 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:16:55.519669 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:16:55.976300 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:16:55.976274 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:17:01.015164 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:01.015135 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:17:01.125234 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:01.125202 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:17:01.251905 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:01.251874 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:17:03.793994 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:03.793954 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:17:03.904754 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:03.904717 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:17:04.643612 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:04.643582 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:17:04.817319 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:04.817292 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:17:04.986614 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:04.986550 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:17:07.210187 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:07.210120 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:17:07.515886 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:07.515821 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:17:11.872650 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:11.872622 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:17:12.064198 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:12.064171 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:17:16.076092 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:16.076063 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:17:16.203578 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:16.203553 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:17:16.327621 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:16.327534 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:17:27.159909 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:27.159878 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:17:27.261465 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:27.261425 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:17:28.367867 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:28.367838 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:17:28.447732 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:28.447709 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:17:31.333250 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:31.333221 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:17:31.431167 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:31.431138 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:17:35.633826 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:35.633757 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:17:35.773446 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:35.773423 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:17:38.849661 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:38.849630 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d"] Jul 17 18:17:38.852789 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:38.852772 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:38.855949 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:17:38.855921 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-default-gateway-openshift-default-56654dcf7-nbk6d\" is forbidden: User \"system:node:ip-10-0-132-68.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-132-68.ec2.internal' and this object" podUID="5b1c7635-d7ef-4616-9078-7a391c0adfde" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:38.855949 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:17:38.855925 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"maas-default-gateway-openshift-default-dockercfg-r58sp\" is forbidden: User \"system:node:ip-10-0-132-68.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-132-68.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-r58sp\"" type="*v1.Secret" Jul 17 18:17:38.887143 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:38.887122 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d"] Jul 17 18:17:38.919678 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:38.919658 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:17:38.962090 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:38.962068 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b1c7635-d7ef-4616-9078-7a391c0adfde-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-nbk6d\" (UID: \"5b1c7635-d7ef-4616-9078-7a391c0adfde\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:38.962213 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:38.962096 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b1c7635-d7ef-4616-9078-7a391c0adfde-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-nbk6d\" (UID: \"5b1c7635-d7ef-4616-9078-7a391c0adfde\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:38.962213 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:38.962132 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b1c7635-d7ef-4616-9078-7a391c0adfde-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-nbk6d\" (UID: \"5b1c7635-d7ef-4616-9078-7a391c0adfde\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:38.962213 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:38.962156 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b1c7635-d7ef-4616-9078-7a391c0adfde-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-nbk6d\" (UID: \"5b1c7635-d7ef-4616-9078-7a391c0adfde\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:38.962213 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:38.962179 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b1c7635-d7ef-4616-9078-7a391c0adfde-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-nbk6d\" (UID: \"5b1c7635-d7ef-4616-9078-7a391c0adfde\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:38.962213 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:38.962202 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8528l\" (UniqueName: \"kubernetes.io/projected/5b1c7635-d7ef-4616-9078-7a391c0adfde-kube-api-access-8528l\") pod \"maas-default-gateway-openshift-default-56654dcf7-nbk6d\" (UID: \"5b1c7635-d7ef-4616-9078-7a391c0adfde\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:38.962495 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:38.962224 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b1c7635-d7ef-4616-9078-7a391c0adfde-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-nbk6d\" (UID: \"5b1c7635-d7ef-4616-9078-7a391c0adfde\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:38.962495 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:38.962299 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b1c7635-d7ef-4616-9078-7a391c0adfde-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-nbk6d\" (UID: \"5b1c7635-d7ef-4616-9078-7a391c0adfde\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:38.962495 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:38.962346 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b1c7635-d7ef-4616-9078-7a391c0adfde-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-nbk6d\" (UID: \"5b1c7635-d7ef-4616-9078-7a391c0adfde\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:39.055883 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:39.055860 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:17:39.063011 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:39.062971 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b1c7635-d7ef-4616-9078-7a391c0adfde-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-nbk6d\" (UID: \"5b1c7635-d7ef-4616-9078-7a391c0adfde\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:39.063089 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:39.063020 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b1c7635-d7ef-4616-9078-7a391c0adfde-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-nbk6d\" (UID: \"5b1c7635-d7ef-4616-9078-7a391c0adfde\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:39.063089 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:39.063055 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b1c7635-d7ef-4616-9078-7a391c0adfde-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-nbk6d\" (UID: \"5b1c7635-d7ef-4616-9078-7a391c0adfde\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:39.063089 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:39.063071 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b1c7635-d7ef-4616-9078-7a391c0adfde-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-nbk6d\" (UID: \"5b1c7635-d7ef-4616-9078-7a391c0adfde\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:39.063229 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:39.063090 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b1c7635-d7ef-4616-9078-7a391c0adfde-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-nbk6d\" (UID: \"5b1c7635-d7ef-4616-9078-7a391c0adfde\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:39.063229 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:39.063114 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8528l\" (UniqueName: \"kubernetes.io/projected/5b1c7635-d7ef-4616-9078-7a391c0adfde-kube-api-access-8528l\") pod \"maas-default-gateway-openshift-default-56654dcf7-nbk6d\" (UID: \"5b1c7635-d7ef-4616-9078-7a391c0adfde\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:39.063326 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:39.063245 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b1c7635-d7ef-4616-9078-7a391c0adfde-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-nbk6d\" (UID: \"5b1c7635-d7ef-4616-9078-7a391c0adfde\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:39.063326 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:39.063294 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b1c7635-d7ef-4616-9078-7a391c0adfde-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-nbk6d\" (UID: \"5b1c7635-d7ef-4616-9078-7a391c0adfde\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:39.063426 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:39.063346 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b1c7635-d7ef-4616-9078-7a391c0adfde-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-nbk6d\" (UID: \"5b1c7635-d7ef-4616-9078-7a391c0adfde\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:39.063483 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:39.063424 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b1c7635-d7ef-4616-9078-7a391c0adfde-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-nbk6d\" (UID: \"5b1c7635-d7ef-4616-9078-7a391c0adfde\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:39.063539 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:39.063485 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b1c7635-d7ef-4616-9078-7a391c0adfde-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-nbk6d\" (UID: \"5b1c7635-d7ef-4616-9078-7a391c0adfde\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:39.063713 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:39.063672 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b1c7635-d7ef-4616-9078-7a391c0adfde-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-nbk6d\" (UID: \"5b1c7635-d7ef-4616-9078-7a391c0adfde\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:39.063713 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:39.063701 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b1c7635-d7ef-4616-9078-7a391c0adfde-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-nbk6d\" (UID: \"5b1c7635-d7ef-4616-9078-7a391c0adfde\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:39.063946 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:39.063927 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b1c7635-d7ef-4616-9078-7a391c0adfde-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-nbk6d\" (UID: \"5b1c7635-d7ef-4616-9078-7a391c0adfde\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:39.065146 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:39.065127 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b1c7635-d7ef-4616-9078-7a391c0adfde-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-nbk6d\" (UID: \"5b1c7635-d7ef-4616-9078-7a391c0adfde\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:39.065421 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:39.065404 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b1c7635-d7ef-4616-9078-7a391c0adfde-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-nbk6d\" (UID: \"5b1c7635-d7ef-4616-9078-7a391c0adfde\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:39.073170 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:39.073145 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b1c7635-d7ef-4616-9078-7a391c0adfde-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-nbk6d\" (UID: \"5b1c7635-d7ef-4616-9078-7a391c0adfde\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:39.073867 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:39.073849 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8528l\" (UniqueName: \"kubernetes.io/projected/5b1c7635-d7ef-4616-9078-7a391c0adfde-kube-api-access-8528l\") pod \"maas-default-gateway-openshift-default-56654dcf7-nbk6d\" (UID: \"5b1c7635-d7ef-4616-9078-7a391c0adfde\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:40.023863 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:40.023841 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-r58sp\"" Jul 17 18:17:40.032827 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:40.032805 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:40.181893 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:40.181871 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d"] Jul 17 18:17:40.186487 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:17:40.186455 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b1c7635_d7ef_4616_9078_7a391c0adfde.slice/crio-79d0522691c7f23fe6222b6a9073cb09efd3fae830a7b6172e81eba3bf4bf2b6 WatchSource:0}: Error finding container 79d0522691c7f23fe6222b6a9073cb09efd3fae830a7b6172e81eba3bf4bf2b6: Status 404 returned error can't find the container with id 79d0522691c7f23fe6222b6a9073cb09efd3fae830a7b6172e81eba3bf4bf2b6 Jul 17 18:17:40.188551 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:40.188520 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:17:40.188641 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:40.188585 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:17:40.188641 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:40.188616 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:17:40.240620 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:40.240597 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" event={"ID":"5b1c7635-d7ef-4616-9078-7a391c0adfde","Type":"ContainerStarted","Data":"79d0522691c7f23fe6222b6a9073cb09efd3fae830a7b6172e81eba3bf4bf2b6"} Jul 17 18:17:41.245424 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:41.245389 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" event={"ID":"5b1c7635-d7ef-4616-9078-7a391c0adfde","Type":"ContainerStarted","Data":"834ae0665c4f9b209e26cec26a4b4457cde3d63c16a0b05eae956d4a835298a9"} Jul 17 18:17:41.271755 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:41.271708 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" podStartSLOduration=3.271693253 podStartE2EDuration="3.271693253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:17:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:17:41.268706876 +0000 UTC m=+476.542318044" watchObservedRunningTime="2026-07-17 18:17:41.271693253 +0000 UTC m=+476.545304394" Jul 17 18:17:42.033686 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:42.033659 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:42.038180 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:42.038152 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:42.250265 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:42.250240 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:42.251186 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:42.251169 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:17:42.682048 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:42.682013 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:17:42.867140 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:42.867110 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:17:43.083579 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:43.083547 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:17:43.941475 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:43.941446 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:17:44.264266 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:17:44.261766 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:18:03.865146 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:03.865116 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:18:04.060683 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:04.060656 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:18:04.493143 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:04.493113 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:18:16.724048 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:16.724019 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:18:16.871613 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:16.871590 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:18:23.359652 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:23.359600 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:18:23.368515 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:23.368490 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55497d974c-wrg64"] Jul 17 18:18:23.371809 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:23.371793 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55497d974c-wrg64" Jul 17 18:18:23.373893 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:23.373873 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 17 18:18:23.374215 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:23.374197 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-k88r7\"" Jul 17 18:18:23.374215 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:23.374210 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 17 18:18:23.390700 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:23.390681 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55497d974c-wrg64"] Jul 17 18:18:23.479559 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:23.479534 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:18:23.506754 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:23.506717 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e40e6218-834a-4993-b634-427cebc8347d-webhook-cert\") pod \"maas-controller-55497d974c-wrg64\" (UID: \"e40e6218-834a-4993-b634-427cebc8347d\") " pod="opendatahub/maas-controller-55497d974c-wrg64" Jul 17 18:18:23.506876 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:23.506767 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx7fh\" (UniqueName: \"kubernetes.io/projected/e40e6218-834a-4993-b634-427cebc8347d-kube-api-access-wx7fh\") pod \"maas-controller-55497d974c-wrg64\" (UID: \"e40e6218-834a-4993-b634-427cebc8347d\") " pod="opendatahub/maas-controller-55497d974c-wrg64" Jul 17 18:18:23.582417 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:23.580398 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5f5fb87b96-28md9"] Jul 17 18:18:23.585263 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:23.585243 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f5fb87b96-28md9" Jul 17 18:18:23.595858 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:23.595829 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:18:23.607193 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:23.607171 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f5fb87b96-28md9"] Jul 17 18:18:23.607417 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:23.607397 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e40e6218-834a-4993-b634-427cebc8347d-webhook-cert\") pod \"maas-controller-55497d974c-wrg64\" (UID: \"e40e6218-834a-4993-b634-427cebc8347d\") " pod="opendatahub/maas-controller-55497d974c-wrg64" Jul 17 18:18:23.607489 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:23.607436 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx7fh\" (UniqueName: \"kubernetes.io/projected/e40e6218-834a-4993-b634-427cebc8347d-kube-api-access-wx7fh\") pod \"maas-controller-55497d974c-wrg64\" (UID: \"e40e6218-834a-4993-b634-427cebc8347d\") " pod="opendatahub/maas-controller-55497d974c-wrg64" Jul 17 18:18:23.610143 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:23.610084 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e40e6218-834a-4993-b634-427cebc8347d-webhook-cert\") pod \"maas-controller-55497d974c-wrg64\" (UID: \"e40e6218-834a-4993-b634-427cebc8347d\") " pod="opendatahub/maas-controller-55497d974c-wrg64" Jul 17 18:18:23.631017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:23.630997 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx7fh\" (UniqueName: \"kubernetes.io/projected/e40e6218-834a-4993-b634-427cebc8347d-kube-api-access-wx7fh\") pod \"maas-controller-55497d974c-wrg64\" (UID: \"e40e6218-834a-4993-b634-427cebc8347d\") " pod="opendatahub/maas-controller-55497d974c-wrg64" Jul 17 18:18:23.681998 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:23.681953 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55497d974c-wrg64" Jul 17 18:18:23.708012 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:23.707988 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl52f\" (UniqueName: \"kubernetes.io/projected/eba1e8e1-a58e-45c5-b13b-e6917c1c32a0-kube-api-access-fl52f\") pod \"maas-controller-5f5fb87b96-28md9\" (UID: \"eba1e8e1-a58e-45c5-b13b-e6917c1c32a0\") " pod="opendatahub/maas-controller-5f5fb87b96-28md9" Jul 17 18:18:23.708102 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:23.708036 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eba1e8e1-a58e-45c5-b13b-e6917c1c32a0-webhook-cert\") pod \"maas-controller-5f5fb87b96-28md9\" (UID: \"eba1e8e1-a58e-45c5-b13b-e6917c1c32a0\") " pod="opendatahub/maas-controller-5f5fb87b96-28md9" Jul 17 18:18:23.808437 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:23.808409 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eba1e8e1-a58e-45c5-b13b-e6917c1c32a0-webhook-cert\") pod \"maas-controller-5f5fb87b96-28md9\" (UID: \"eba1e8e1-a58e-45c5-b13b-e6917c1c32a0\") " pod="opendatahub/maas-controller-5f5fb87b96-28md9" Jul 17 18:18:23.808562 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:23.808495 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl52f\" (UniqueName: \"kubernetes.io/projected/eba1e8e1-a58e-45c5-b13b-e6917c1c32a0-kube-api-access-fl52f\") pod \"maas-controller-5f5fb87b96-28md9\" (UID: \"eba1e8e1-a58e-45c5-b13b-e6917c1c32a0\") " pod="opendatahub/maas-controller-5f5fb87b96-28md9" Jul 17 18:18:23.810674 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:23.810650 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eba1e8e1-a58e-45c5-b13b-e6917c1c32a0-webhook-cert\") pod \"maas-controller-5f5fb87b96-28md9\" (UID: \"eba1e8e1-a58e-45c5-b13b-e6917c1c32a0\") " pod="opendatahub/maas-controller-5f5fb87b96-28md9" Jul 17 18:18:23.816247 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:23.816224 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55497d974c-wrg64"] Jul 17 18:18:23.822567 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:18:23.822540 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode40e6218_834a_4993_b634_427cebc8347d.slice/crio-163aed559be87476e727e542baefde8e5cf5b985dbfaaa431e574e90ebbec0d6 WatchSource:0}: Error finding container 163aed559be87476e727e542baefde8e5cf5b985dbfaaa431e574e90ebbec0d6: Status 404 returned error can't find the container with id 163aed559be87476e727e542baefde8e5cf5b985dbfaaa431e574e90ebbec0d6 Jul 17 18:18:23.822821 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:23.822806 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl52f\" (UniqueName: \"kubernetes.io/projected/eba1e8e1-a58e-45c5-b13b-e6917c1c32a0-kube-api-access-fl52f\") pod \"maas-controller-5f5fb87b96-28md9\" (UID: \"eba1e8e1-a58e-45c5-b13b-e6917c1c32a0\") " pod="opendatahub/maas-controller-5f5fb87b96-28md9" Jul 17 18:18:23.895019 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:23.894942 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f5fb87b96-28md9" Jul 17 18:18:24.025021 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:24.024986 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f5fb87b96-28md9"] Jul 17 18:18:24.029667 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:18:24.029646 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeba1e8e1_a58e_45c5_b13b_e6917c1c32a0.slice/crio-1d00e1715bd7316888a6a5c85c469462fe176ab875ae0137d2e230537a50f2f0 WatchSource:0}: Error finding container 1d00e1715bd7316888a6a5c85c469462fe176ab875ae0137d2e230537a50f2f0: Status 404 returned error can't find the container with id 1d00e1715bd7316888a6a5c85c469462fe176ab875ae0137d2e230537a50f2f0 Jul 17 18:18:24.432940 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:24.432888 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55497d974c-wrg64" event={"ID":"e40e6218-834a-4993-b634-427cebc8347d","Type":"ContainerStarted","Data":"163aed559be87476e727e542baefde8e5cf5b985dbfaaa431e574e90ebbec0d6"} Jul 17 18:18:24.435191 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:24.435160 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f5fb87b96-28md9" event={"ID":"eba1e8e1-a58e-45c5-b13b-e6917c1c32a0","Type":"ContainerStarted","Data":"1d00e1715bd7316888a6a5c85c469462fe176ab875ae0137d2e230537a50f2f0"} Jul 17 18:18:25.728474 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:25.728430 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:18:26.707410 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:26.707326 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:18:26.888783 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:26.888758 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:18:27.450821 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:27.450788 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f5fb87b96-28md9" event={"ID":"eba1e8e1-a58e-45c5-b13b-e6917c1c32a0","Type":"ContainerStarted","Data":"94e481788681cd644d7919e9ed85502f0ee3ecccc3fcecc2b81193984b8e5b9f"} Jul 17 18:18:27.451030 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:27.450848 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5f5fb87b96-28md9" Jul 17 18:18:27.452248 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:27.452219 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55497d974c-wrg64" event={"ID":"e40e6218-834a-4993-b634-427cebc8347d","Type":"ContainerStarted","Data":"f511bba90dddd348645e34a4ff3f37692af5cbb9ebc06137fe03efe38f17cd35"} Jul 17 18:18:27.452374 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:27.452357 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55497d974c-wrg64" Jul 17 18:18:27.474855 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:27.474812 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5f5fb87b96-28md9" podStartSLOduration=2.06406918 podStartE2EDuration="4.474798504s" totalImagesPullingTime="2.410729324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:18:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:18:27.4738059 +0000 UTC m=+522.747417042" watchObservedRunningTime="2026-07-17 18:18:27.474798504 +0000 UTC m=+522.748409645" Jul 17 18:18:27.495956 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:27.495915 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55497d974c-wrg64" podStartSLOduration=1.884480412 podStartE2EDuration="4.495901799s" totalImagesPullingTime="2.611421387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:18:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:18:27.492683195 +0000 UTC m=+522.766294338" watchObservedRunningTime="2026-07-17 18:18:27.495901799 +0000 UTC m=+522.769512940" Jul 17 18:18:37.578377 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:37.578281 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:18:38.459239 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:38.459213 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5f5fb87b96-28md9" Jul 17 18:18:38.459554 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:38.459541 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55497d974c-wrg64" Jul 17 18:18:38.564396 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:38.564366 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55497d974c-wrg64"] Jul 17 18:18:38.564567 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:38.564545 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-55497d974c-wrg64" podUID="e40e6218-834a-4993-b634-427cebc8347d" containerName="manager" containerID="cri-o://f511bba90dddd348645e34a4ff3f37692af5cbb9ebc06137fe03efe38f17cd35" gracePeriod=30 Jul 17 18:18:38.800556 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:38.800531 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55497d974c-wrg64" Jul 17 18:18:38.820513 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:38.820486 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wx7fh\" (UniqueName: \"kubernetes.io/projected/e40e6218-834a-4993-b634-427cebc8347d-kube-api-access-wx7fh\") pod \"e40e6218-834a-4993-b634-427cebc8347d\" (UID: \"e40e6218-834a-4993-b634-427cebc8347d\") " Jul 17 18:18:38.820630 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:38.820571 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e40e6218-834a-4993-b634-427cebc8347d-webhook-cert\") pod \"e40e6218-834a-4993-b634-427cebc8347d\" (UID: \"e40e6218-834a-4993-b634-427cebc8347d\") " Jul 17 18:18:38.823249 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:38.823192 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e40e6218-834a-4993-b634-427cebc8347d-kube-api-access-wx7fh" (OuterVolumeSpecName: "kube-api-access-wx7fh") pod "e40e6218-834a-4993-b634-427cebc8347d" (UID: "e40e6218-834a-4993-b634-427cebc8347d"). InnerVolumeSpecName "kube-api-access-wx7fh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:18:38.823941 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:38.823680 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e40e6218-834a-4993-b634-427cebc8347d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e40e6218-834a-4993-b634-427cebc8347d" (UID: "e40e6218-834a-4993-b634-427cebc8347d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:18:38.921891 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:38.921874 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e40e6218-834a-4993-b634-427cebc8347d-webhook-cert\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:18:38.921891 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:38.921892 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wx7fh\" (UniqueName: \"kubernetes.io/projected/e40e6218-834a-4993-b634-427cebc8347d-kube-api-access-wx7fh\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:18:39.501372 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:39.501310 2576 generic.go:356] "Generic (PLEG): container finished" podID="e40e6218-834a-4993-b634-427cebc8347d" containerID="f511bba90dddd348645e34a4ff3f37692af5cbb9ebc06137fe03efe38f17cd35" exitCode=0 Jul 17 18:18:39.501372 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:39.501355 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55497d974c-wrg64" Jul 17 18:18:39.501512 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:39.501388 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55497d974c-wrg64" event={"ID":"e40e6218-834a-4993-b634-427cebc8347d","Type":"ContainerDied","Data":"f511bba90dddd348645e34a4ff3f37692af5cbb9ebc06137fe03efe38f17cd35"} Jul 17 18:18:39.501512 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:39.501434 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55497d974c-wrg64" event={"ID":"e40e6218-834a-4993-b634-427cebc8347d","Type":"ContainerDied","Data":"163aed559be87476e727e542baefde8e5cf5b985dbfaaa431e574e90ebbec0d6"} Jul 17 18:18:39.501512 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:39.501456 2576 scope.go:117] "RemoveContainer" containerID="f511bba90dddd348645e34a4ff3f37692af5cbb9ebc06137fe03efe38f17cd35" Jul 17 18:18:39.509471 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:39.509456 2576 scope.go:117] "RemoveContainer" containerID="f511bba90dddd348645e34a4ff3f37692af5cbb9ebc06137fe03efe38f17cd35" Jul 17 18:18:39.509751 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:18:39.509733 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f511bba90dddd348645e34a4ff3f37692af5cbb9ebc06137fe03efe38f17cd35\": container with ID starting with f511bba90dddd348645e34a4ff3f37692af5cbb9ebc06137fe03efe38f17cd35 not found: ID does not exist" containerID="f511bba90dddd348645e34a4ff3f37692af5cbb9ebc06137fe03efe38f17cd35" Jul 17 18:18:39.509812 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:39.509762 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f511bba90dddd348645e34a4ff3f37692af5cbb9ebc06137fe03efe38f17cd35"} err="failed to get container status \"f511bba90dddd348645e34a4ff3f37692af5cbb9ebc06137fe03efe38f17cd35\": rpc error: code = NotFound desc = could not find container \"f511bba90dddd348645e34a4ff3f37692af5cbb9ebc06137fe03efe38f17cd35\": container with ID starting with f511bba90dddd348645e34a4ff3f37692af5cbb9ebc06137fe03efe38f17cd35 not found: ID does not exist" Jul 17 18:18:39.521462 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:39.521443 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55497d974c-wrg64"] Jul 17 18:18:39.525948 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:39.525930 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-55497d974c-wrg64"] Jul 17 18:18:41.185854 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:41.185823 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e40e6218-834a-4993-b634-427cebc8347d" path="/var/lib/kubelet/pods/e40e6218-834a-4993-b634-427cebc8347d/volumes" Jul 17 18:18:41.280664 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:41.280634 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:18:41.385643 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:41.385618 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:18:58.761536 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:58.761503 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:18:58.861119 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:58.861095 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:18:59.279724 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:59.279696 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:18:59.312065 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:59.312039 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-59dfc85689-2gljp"] Jul 17 18:18:59.312352 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:59.312338 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e40e6218-834a-4993-b634-427cebc8347d" containerName="manager" Jul 17 18:18:59.312352 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:59.312353 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e40e6218-834a-4993-b634-427cebc8347d" containerName="manager" Jul 17 18:18:59.312431 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:59.312412 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e40e6218-834a-4993-b634-427cebc8347d" containerName="manager" Jul 17 18:18:59.317064 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:59.317045 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59dfc85689-2gljp" Jul 17 18:18:59.319226 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:59.319177 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 17 18:18:59.319226 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:59.319185 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 17 18:18:59.319226 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:59.319254 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 17 18:18:59.319801 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:59.319785 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-ksd6p\"" Jul 17 18:18:59.325137 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:59.325118 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59dfc85689-2gljp"] Jul 17 18:18:59.374835 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:59.374817 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c249a9d-20fb-4331-b7c3-21fd196631e4-maas-api-tls\") pod \"maas-api-59dfc85689-2gljp\" (UID: \"7c249a9d-20fb-4331-b7c3-21fd196631e4\") " pod="odh-ai-gateway-infra/maas-api-59dfc85689-2gljp" Jul 17 18:18:59.374932 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:59.374861 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtbd4\" (UniqueName: \"kubernetes.io/projected/7c249a9d-20fb-4331-b7c3-21fd196631e4-kube-api-access-gtbd4\") pod \"maas-api-59dfc85689-2gljp\" (UID: \"7c249a9d-20fb-4331-b7c3-21fd196631e4\") " pod="odh-ai-gateway-infra/maas-api-59dfc85689-2gljp" Jul 17 18:18:59.374932 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:59.374892 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c249a9d-20fb-4331-b7c3-21fd196631e4-openshift-service-ca\") pod \"maas-api-59dfc85689-2gljp\" (UID: \"7c249a9d-20fb-4331-b7c3-21fd196631e4\") " pod="odh-ai-gateway-infra/maas-api-59dfc85689-2gljp" Jul 17 18:18:59.475371 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:59.475353 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c249a9d-20fb-4331-b7c3-21fd196631e4-maas-api-tls\") pod \"maas-api-59dfc85689-2gljp\" (UID: \"7c249a9d-20fb-4331-b7c3-21fd196631e4\") " pod="odh-ai-gateway-infra/maas-api-59dfc85689-2gljp" Jul 17 18:18:59.475500 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:59.475418 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtbd4\" (UniqueName: \"kubernetes.io/projected/7c249a9d-20fb-4331-b7c3-21fd196631e4-kube-api-access-gtbd4\") pod \"maas-api-59dfc85689-2gljp\" (UID: \"7c249a9d-20fb-4331-b7c3-21fd196631e4\") " pod="odh-ai-gateway-infra/maas-api-59dfc85689-2gljp" Jul 17 18:18:59.475500 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:59.475466 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c249a9d-20fb-4331-b7c3-21fd196631e4-openshift-service-ca\") pod \"maas-api-59dfc85689-2gljp\" (UID: \"7c249a9d-20fb-4331-b7c3-21fd196631e4\") " pod="odh-ai-gateway-infra/maas-api-59dfc85689-2gljp" Jul 17 18:18:59.476053 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:59.476033 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c249a9d-20fb-4331-b7c3-21fd196631e4-openshift-service-ca\") pod \"maas-api-59dfc85689-2gljp\" (UID: \"7c249a9d-20fb-4331-b7c3-21fd196631e4\") " pod="odh-ai-gateway-infra/maas-api-59dfc85689-2gljp" Jul 17 18:18:59.477562 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:59.477547 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c249a9d-20fb-4331-b7c3-21fd196631e4-maas-api-tls\") pod \"maas-api-59dfc85689-2gljp\" (UID: \"7c249a9d-20fb-4331-b7c3-21fd196631e4\") " pod="odh-ai-gateway-infra/maas-api-59dfc85689-2gljp" Jul 17 18:18:59.486130 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:59.486110 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtbd4\" (UniqueName: \"kubernetes.io/projected/7c249a9d-20fb-4331-b7c3-21fd196631e4-kube-api-access-gtbd4\") pod \"maas-api-59dfc85689-2gljp\" (UID: \"7c249a9d-20fb-4331-b7c3-21fd196631e4\") " pod="odh-ai-gateway-infra/maas-api-59dfc85689-2gljp" Jul 17 18:18:59.499827 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:59.499794 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:18:59.628570 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:59.628549 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59dfc85689-2gljp" Jul 17 18:18:59.762047 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:59.762014 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59dfc85689-2gljp"] Jul 17 18:18:59.763218 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:18:59.763191 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c249a9d_20fb_4331_b7c3_21fd196631e4.slice/crio-85e622009be7575d33139ebdbe3bf1fdd51327833623b94a40f66dc1bb367274 WatchSource:0}: Error finding container 85e622009be7575d33139ebdbe3bf1fdd51327833623b94a40f66dc1bb367274: Status 404 returned error can't find the container with id 85e622009be7575d33139ebdbe3bf1fdd51327833623b94a40f66dc1bb367274 Jul 17 18:18:59.802705 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:59.802681 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:18:59.915806 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:59.915741 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-hb58j"] Jul 17 18:18:59.917743 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:59.917718 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:18:59.922267 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:59.922251 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-hb58j" Jul 17 18:18:59.924190 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:59.924171 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 17 18:18:59.924259 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:59.924227 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-785wp\"" Jul 17 18:18:59.929705 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:59.929686 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-hb58j"] Jul 17 18:18:59.980695 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:59.980671 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/949af1d4-703e-461d-bd64-e7656cb87a14-plugins-config-volume\") pod \"payload-processing-5bf47cd988-hb58j\" (UID: \"949af1d4-703e-461d-bd64-e7656cb87a14\") " pod="openshift-ingress/payload-processing-5bf47cd988-hb58j" Jul 17 18:18:59.980786 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:18:59.980700 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qsss\" (UniqueName: \"kubernetes.io/projected/949af1d4-703e-461d-bd64-e7656cb87a14-kube-api-access-8qsss\") pod \"payload-processing-5bf47cd988-hb58j\" (UID: \"949af1d4-703e-461d-bd64-e7656cb87a14\") " pod="openshift-ingress/payload-processing-5bf47cd988-hb58j" Jul 17 18:19:00.081485 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:00.081442 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/949af1d4-703e-461d-bd64-e7656cb87a14-plugins-config-volume\") pod \"payload-processing-5bf47cd988-hb58j\" (UID: \"949af1d4-703e-461d-bd64-e7656cb87a14\") " pod="openshift-ingress/payload-processing-5bf47cd988-hb58j" Jul 17 18:19:00.081679 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:00.081514 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qsss\" (UniqueName: \"kubernetes.io/projected/949af1d4-703e-461d-bd64-e7656cb87a14-kube-api-access-8qsss\") pod \"payload-processing-5bf47cd988-hb58j\" (UID: \"949af1d4-703e-461d-bd64-e7656cb87a14\") " pod="openshift-ingress/payload-processing-5bf47cd988-hb58j" Jul 17 18:19:00.082359 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:00.082332 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/949af1d4-703e-461d-bd64-e7656cb87a14-plugins-config-volume\") pod \"payload-processing-5bf47cd988-hb58j\" (UID: \"949af1d4-703e-461d-bd64-e7656cb87a14\") " pod="openshift-ingress/payload-processing-5bf47cd988-hb58j" Jul 17 18:19:00.090374 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:00.090348 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qsss\" (UniqueName: \"kubernetes.io/projected/949af1d4-703e-461d-bd64-e7656cb87a14-kube-api-access-8qsss\") pod \"payload-processing-5bf47cd988-hb58j\" (UID: \"949af1d4-703e-461d-bd64-e7656cb87a14\") " pod="openshift-ingress/payload-processing-5bf47cd988-hb58j" Jul 17 18:19:00.234409 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:00.234341 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-hb58j" Jul 17 18:19:00.415657 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:00.415632 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-hb58j"] Jul 17 18:19:00.417471 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:19:00.417447 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod949af1d4_703e_461d_bd64_e7656cb87a14.slice/crio-7df728f711a1276c9543f6754c49b06843dae04d4fc35e7c1573be09cc836586 WatchSource:0}: Error finding container 7df728f711a1276c9543f6754c49b06843dae04d4fc35e7c1573be09cc836586: Status 404 returned error can't find the container with id 7df728f711a1276c9543f6754c49b06843dae04d4fc35e7c1573be09cc836586 Jul 17 18:19:00.590791 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:00.590748 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59dfc85689-2gljp" event={"ID":"7c249a9d-20fb-4331-b7c3-21fd196631e4","Type":"ContainerStarted","Data":"85e622009be7575d33139ebdbe3bf1fdd51327833623b94a40f66dc1bb367274"} Jul 17 18:19:00.592481 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:00.592413 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-hb58j" event={"ID":"949af1d4-703e-461d-bd64-e7656cb87a14","Type":"ContainerStarted","Data":"7df728f711a1276c9543f6754c49b06843dae04d4fc35e7c1573be09cc836586"} Jul 17 18:19:02.473091 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:02.473052 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:19:02.529216 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:02.529175 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:19:02.605027 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:02.604966 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59dfc85689-2gljp" event={"ID":"7c249a9d-20fb-4331-b7c3-21fd196631e4","Type":"ContainerStarted","Data":"59cd841f8a3a0e8fc3ce77bf3b60cbb6d848870d7898f9fad98ff8b00facf748"} Jul 17 18:19:02.605205 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:02.605091 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-59dfc85689-2gljp" Jul 17 18:19:02.623417 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:02.623370 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-59dfc85689-2gljp" podStartSLOduration=1.631641663 podStartE2EDuration="3.623354343s" totalImagesPullingTime="1.99171268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:18:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:19:02.622537737 +0000 UTC m=+557.896148878" watchObservedRunningTime="2026-07-17 18:19:02.623354343 +0000 UTC m=+557.896965484" Jul 17 18:19:03.611008 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:03.610898 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-hb58j" event={"ID":"949af1d4-703e-461d-bd64-e7656cb87a14","Type":"ContainerStarted","Data":"1545e62818ba33d215dde0274884ae9e9d44ae8ca92c8ae5d151c8a24549fe71"} Jul 17 18:19:03.626950 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:03.626904 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-hb58j" podStartSLOduration=1.756673419 podStartE2EDuration="4.626888596s" totalImagesPullingTime="2.870215177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:18:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:19:03.625165335 +0000 UTC m=+558.898776477" watchObservedRunningTime="2026-07-17 18:19:03.626888596 +0000 UTC m=+558.900499737" Jul 17 18:19:04.615548 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:04.615526 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-hb58j" Jul 17 18:19:07.630504 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:07.630481 2576 generic.go:356] "Generic (PLEG): container finished" podID="5b1c7635-d7ef-4616-9078-7a391c0adfde" containerID="834ae0665c4f9b209e26cec26a4b4457cde3d63c16a0b05eae956d4a835298a9" exitCode=0 Jul 17 18:19:07.630867 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:07.630557 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" event={"ID":"5b1c7635-d7ef-4616-9078-7a391c0adfde","Type":"ContainerDied","Data":"834ae0665c4f9b209e26cec26a4b4457cde3d63c16a0b05eae956d4a835298a9"} Jul 17 18:19:07.630908 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:07.630872 2576 scope.go:117] "RemoveContainer" containerID="834ae0665c4f9b209e26cec26a4b4457cde3d63c16a0b05eae956d4a835298a9" Jul 17 18:19:07.631759 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:07.631736 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:19:07.631803 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:07.631796 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:19:07.631852 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:07.631841 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:19:08.616541 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:08.616516 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-59dfc85689-2gljp" Jul 17 18:19:08.643347 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:08.643311 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" event={"ID":"5b1c7635-d7ef-4616-9078-7a391c0adfde","Type":"ContainerStarted","Data":"ed0a5a778c4d6ede5585a325c959002281983493a6303416e3a7151a0cc59ec3"} Jul 17 18:19:09.035349 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:09.035255 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:19:09.035533 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:09.035433 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-nbk6d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body= Jul 17 18:19:09.035533 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:09.035490 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" podUID="5b1c7635-d7ef-4616-9078-7a391c0adfde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" Jul 17 18:19:10.034003 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:10.033951 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-nbk6d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body= Jul 17 18:19:10.034470 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:10.034036 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" podUID="5b1c7635-d7ef-4616-9078-7a391c0adfde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" Jul 17 18:19:10.372776 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:10.372748 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:19:10.457043 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:10.456970 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:19:11.033307 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:11.033268 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-nbk6d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body= Jul 17 18:19:11.033514 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:11.033337 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" podUID="5b1c7635-d7ef-4616-9078-7a391c0adfde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" Jul 17 18:19:12.033787 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:12.033752 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-nbk6d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body= Jul 17 18:19:12.034386 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:12.034356 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" podUID="5b1c7635-d7ef-4616-9078-7a391c0adfde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" Jul 17 18:19:12.250189 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:12.250160 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:19:13.037254 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:13.037229 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:19:13.038236 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:13.038218 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nbk6d" Jul 17 18:19:15.623206 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:15.623180 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-hb58j" Jul 17 18:19:17.529391 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:17.529351 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:19:22.274947 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:22.274910 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2jqzs"] Jul 17 18:19:22.278934 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:22.278912 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2jqzs" Jul 17 18:19:22.280823 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:22.280801 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 17 18:19:22.280964 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:22.280947 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 17 18:19:22.281530 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:22.281512 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 17 18:19:22.281593 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:22.281581 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-rp4s8\"" Jul 17 18:19:22.285184 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:22.285165 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2jqzs"] Jul 17 18:19:22.312911 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:22.312892 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:19:22.366412 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:22.366387 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c56edef8-0c3f-486a-970a-d5f86654a3d7-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2jqzs\" (UID: \"c56edef8-0c3f-486a-970a-d5f86654a3d7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2jqzs" Jul 17 18:19:22.366515 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:22.366417 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh295\" (UniqueName: \"kubernetes.io/projected/c56edef8-0c3f-486a-970a-d5f86654a3d7-kube-api-access-fh295\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2jqzs\" (UID: \"c56edef8-0c3f-486a-970a-d5f86654a3d7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2jqzs" Jul 17 18:19:22.366515 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:22.366455 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c56edef8-0c3f-486a-970a-d5f86654a3d7-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2jqzs\" (UID: \"c56edef8-0c3f-486a-970a-d5f86654a3d7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2jqzs" Jul 17 18:19:22.366595 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:22.366530 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c56edef8-0c3f-486a-970a-d5f86654a3d7-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2jqzs\" (UID: \"c56edef8-0c3f-486a-970a-d5f86654a3d7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2jqzs" Jul 17 18:19:22.366595 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:22.366559 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c56edef8-0c3f-486a-970a-d5f86654a3d7-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2jqzs\" (UID: \"c56edef8-0c3f-486a-970a-d5f86654a3d7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2jqzs" Jul 17 18:19:22.366595 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:22.366589 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c56edef8-0c3f-486a-970a-d5f86654a3d7-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2jqzs\" (UID: \"c56edef8-0c3f-486a-970a-d5f86654a3d7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2jqzs" Jul 17 18:19:22.467344 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:22.467308 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c56edef8-0c3f-486a-970a-d5f86654a3d7-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2jqzs\" (UID: \"c56edef8-0c3f-486a-970a-d5f86654a3d7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2jqzs" Jul 17 18:19:22.467344 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:22.467345 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh295\" (UniqueName: \"kubernetes.io/projected/c56edef8-0c3f-486a-970a-d5f86654a3d7-kube-api-access-fh295\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2jqzs\" (UID: \"c56edef8-0c3f-486a-970a-d5f86654a3d7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2jqzs" Jul 17 18:19:22.467502 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:22.467391 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c56edef8-0c3f-486a-970a-d5f86654a3d7-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2jqzs\" (UID: \"c56edef8-0c3f-486a-970a-d5f86654a3d7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2jqzs" Jul 17 18:19:22.467502 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:22.467436 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c56edef8-0c3f-486a-970a-d5f86654a3d7-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2jqzs\" (UID: \"c56edef8-0c3f-486a-970a-d5f86654a3d7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2jqzs" Jul 17 18:19:22.467502 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:22.467466 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c56edef8-0c3f-486a-970a-d5f86654a3d7-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2jqzs\" (UID: \"c56edef8-0c3f-486a-970a-d5f86654a3d7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2jqzs" Jul 17 18:19:22.467626 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:22.467501 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c56edef8-0c3f-486a-970a-d5f86654a3d7-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2jqzs\" (UID: \"c56edef8-0c3f-486a-970a-d5f86654a3d7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2jqzs" Jul 17 18:19:22.467785 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:22.467766 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c56edef8-0c3f-486a-970a-d5f86654a3d7-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2jqzs\" (UID: \"c56edef8-0c3f-486a-970a-d5f86654a3d7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2jqzs" Jul 17 18:19:22.467866 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:22.467839 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c56edef8-0c3f-486a-970a-d5f86654a3d7-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2jqzs\" (UID: \"c56edef8-0c3f-486a-970a-d5f86654a3d7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2jqzs" Jul 17 18:19:22.467951 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:22.467937 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c56edef8-0c3f-486a-970a-d5f86654a3d7-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2jqzs\" (UID: \"c56edef8-0c3f-486a-970a-d5f86654a3d7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2jqzs" Jul 17 18:19:22.469559 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:22.469539 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c56edef8-0c3f-486a-970a-d5f86654a3d7-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2jqzs\" (UID: \"c56edef8-0c3f-486a-970a-d5f86654a3d7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2jqzs" Jul 17 18:19:22.469791 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:22.469775 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c56edef8-0c3f-486a-970a-d5f86654a3d7-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2jqzs\" (UID: \"c56edef8-0c3f-486a-970a-d5f86654a3d7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2jqzs" Jul 17 18:19:22.475478 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:22.475452 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh295\" (UniqueName: \"kubernetes.io/projected/c56edef8-0c3f-486a-970a-d5f86654a3d7-kube-api-access-fh295\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2jqzs\" (UID: \"c56edef8-0c3f-486a-970a-d5f86654a3d7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2jqzs" Jul 17 18:19:22.591331 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:22.591300 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2jqzs" Jul 17 18:19:22.718798 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:22.718775 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2jqzs"] Jul 17 18:19:22.720424 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:19:22.720391 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc56edef8_0c3f_486a_970a_d5f86654a3d7.slice/crio-cb383dfe7c584b7eec452a80a5d2ec94e279959b43800549b388cfc9a7ba35f0 WatchSource:0}: Error finding container cb383dfe7c584b7eec452a80a5d2ec94e279959b43800549b388cfc9a7ba35f0: Status 404 returned error can't find the container with id cb383dfe7c584b7eec452a80a5d2ec94e279959b43800549b388cfc9a7ba35f0 Jul 17 18:19:23.714293 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:23.714266 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2jqzs" event={"ID":"c56edef8-0c3f-486a-970a-d5f86654a3d7","Type":"ContainerStarted","Data":"cb383dfe7c584b7eec452a80a5d2ec94e279959b43800549b388cfc9a7ba35f0"} Jul 17 18:19:24.720728 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:24.720695 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2jqzs" event={"ID":"c56edef8-0c3f-486a-970a-d5f86654a3d7","Type":"ContainerStarted","Data":"e3290ff38f99cf7b7a997ffd83291b0342ec7b0a5420767d900b4be1a5d51b5b"} Jul 17 18:19:24.736593 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:24.736546 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2jqzs" podStartSLOduration=1.765052397 podStartE2EDuration="2.736531723s" totalImagesPullingTime="971.479326ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:19:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:19:24.734792667 +0000 UTC m=+580.008403810" watchObservedRunningTime="2026-07-17 18:19:24.736531723 +0000 UTC m=+580.010142864" Jul 17 18:19:30.920960 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:30.920925 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:19:32.592051 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:32.592022 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2jqzs" Jul 17 18:19:32.592462 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:32.592065 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2jqzs" Jul 17 18:19:32.603904 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:32.603881 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2jqzs" Jul 17 18:19:32.765583 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:32.765557 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2jqzs" Jul 17 18:19:45.069506 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:45.069485 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nwqlr_c6017e7d-5ed2-4d7d-ba64-ba9ce933828f/console-operator/1.log" Jul 17 18:19:45.072905 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:45.072884 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nwqlr_c6017e7d-5ed2-4d7d-ba64-ba9ce933828f/console-operator/1.log" Jul 17 18:19:45.074732 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:45.074715 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6pqqj_a67c7573-deca-4960-b69f-5ad3bda075a8/ovn-acl-logging/0.log" Jul 17 18:19:45.078390 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:45.078375 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6pqqj_a67c7573-deca-4960-b69f-5ad3bda075a8/ovn-acl-logging/0.log" Jul 17 18:19:59.456897 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:19:59.456865 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:20:03.585026 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:03.584995 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2"] Jul 17 18:20:03.591659 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:03.591637 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2" Jul 17 18:20:03.593562 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:03.593540 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 17 18:20:03.597599 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:03.597576 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2"] Jul 17 18:20:03.616491 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:03.616474 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:20:03.680773 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:03.680750 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00d8ec73-2166-4b06-9cb2-5661e9793a75-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2\" (UID: \"00d8ec73-2166-4b06-9cb2-5661e9793a75\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2" Jul 17 18:20:03.680863 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:03.680798 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00d8ec73-2166-4b06-9cb2-5661e9793a75-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2\" (UID: \"00d8ec73-2166-4b06-9cb2-5661e9793a75\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2" Jul 17 18:20:03.680863 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:03.680824 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00d8ec73-2166-4b06-9cb2-5661e9793a75-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2\" (UID: \"00d8ec73-2166-4b06-9cb2-5661e9793a75\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2" Jul 17 18:20:03.680939 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:03.680860 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl6wv\" (UniqueName: \"kubernetes.io/projected/00d8ec73-2166-4b06-9cb2-5661e9793a75-kube-api-access-xl6wv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2\" (UID: \"00d8ec73-2166-4b06-9cb2-5661e9793a75\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2" Jul 17 18:20:03.680939 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:03.680904 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00d8ec73-2166-4b06-9cb2-5661e9793a75-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2\" (UID: \"00d8ec73-2166-4b06-9cb2-5661e9793a75\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2" Jul 17 18:20:03.680939 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:03.680922 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00d8ec73-2166-4b06-9cb2-5661e9793a75-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2\" (UID: \"00d8ec73-2166-4b06-9cb2-5661e9793a75\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2" Jul 17 18:20:03.782151 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:03.782124 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00d8ec73-2166-4b06-9cb2-5661e9793a75-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2\" (UID: \"00d8ec73-2166-4b06-9cb2-5661e9793a75\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2" Jul 17 18:20:03.782295 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:03.782164 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00d8ec73-2166-4b06-9cb2-5661e9793a75-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2\" (UID: \"00d8ec73-2166-4b06-9cb2-5661e9793a75\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2" Jul 17 18:20:03.782295 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:03.782217 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl6wv\" (UniqueName: \"kubernetes.io/projected/00d8ec73-2166-4b06-9cb2-5661e9793a75-kube-api-access-xl6wv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2\" (UID: \"00d8ec73-2166-4b06-9cb2-5661e9793a75\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2" Jul 17 18:20:03.782295 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:03.782263 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00d8ec73-2166-4b06-9cb2-5661e9793a75-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2\" (UID: \"00d8ec73-2166-4b06-9cb2-5661e9793a75\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2" Jul 17 18:20:03.782295 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:03.782282 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00d8ec73-2166-4b06-9cb2-5661e9793a75-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2\" (UID: \"00d8ec73-2166-4b06-9cb2-5661e9793a75\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2" Jul 17 18:20:03.782506 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:03.782330 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00d8ec73-2166-4b06-9cb2-5661e9793a75-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2\" (UID: \"00d8ec73-2166-4b06-9cb2-5661e9793a75\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2" Jul 17 18:20:03.782696 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:03.782647 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00d8ec73-2166-4b06-9cb2-5661e9793a75-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2\" (UID: \"00d8ec73-2166-4b06-9cb2-5661e9793a75\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2" Jul 17 18:20:03.782696 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:03.782658 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00d8ec73-2166-4b06-9cb2-5661e9793a75-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2\" (UID: \"00d8ec73-2166-4b06-9cb2-5661e9793a75\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2" Jul 17 18:20:03.782879 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:03.782851 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00d8ec73-2166-4b06-9cb2-5661e9793a75-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2\" (UID: \"00d8ec73-2166-4b06-9cb2-5661e9793a75\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2" Jul 17 18:20:03.784440 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:03.784419 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00d8ec73-2166-4b06-9cb2-5661e9793a75-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2\" (UID: \"00d8ec73-2166-4b06-9cb2-5661e9793a75\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2" Jul 17 18:20:03.784701 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:03.784685 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00d8ec73-2166-4b06-9cb2-5661e9793a75-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2\" (UID: \"00d8ec73-2166-4b06-9cb2-5661e9793a75\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2" Jul 17 18:20:03.790152 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:03.790124 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl6wv\" (UniqueName: \"kubernetes.io/projected/00d8ec73-2166-4b06-9cb2-5661e9793a75-kube-api-access-xl6wv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2\" (UID: \"00d8ec73-2166-4b06-9cb2-5661e9793a75\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2" Jul 17 18:20:03.903924 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:03.903845 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2" Jul 17 18:20:04.029571 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:04.029548 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2"] Jul 17 18:20:04.031315 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:20:04.031291 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00d8ec73_2166_4b06_9cb2_5661e9793a75.slice/crio-ac508a4a95a549b200ea5e0407044f077c9b3a4219ccf0b71433d432bf461adf WatchSource:0}: Error finding container ac508a4a95a549b200ea5e0407044f077c9b3a4219ccf0b71433d432bf461adf: Status 404 returned error can't find the container with id ac508a4a95a549b200ea5e0407044f077c9b3a4219ccf0b71433d432bf461adf Jul 17 18:20:04.032646 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:04.032627 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 18:20:04.890273 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:04.890243 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2" event={"ID":"00d8ec73-2166-4b06-9cb2-5661e9793a75","Type":"ContainerStarted","Data":"3dc8a6514ae913579465a1f1b5aef1c0d8498dbcb6fc9263a5dfa0db2132edc1"} Jul 17 18:20:04.890723 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:04.890291 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2" event={"ID":"00d8ec73-2166-4b06-9cb2-5661e9793a75","Type":"ContainerStarted","Data":"ac508a4a95a549b200ea5e0407044f077c9b3a4219ccf0b71433d432bf461adf"} Jul 17 18:20:04.910281 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:04.910238 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2" podStartSLOduration=1.69921809 podStartE2EDuration="1.910224933s" totalImagesPullingTime="211.006843ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:20:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:20:04.908365019 +0000 UTC m=+620.181976157" watchObservedRunningTime="2026-07-17 18:20:04.910224933 +0000 UTC m=+620.183836124" Jul 17 18:20:12.398360 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:12.398284 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:20:13.904301 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:13.904269 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2" Jul 17 18:20:13.904756 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:13.904336 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2" Jul 17 18:20:13.916171 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:13.916149 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2" Jul 17 18:20:13.942916 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:13.942896 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2" Jul 17 18:20:20.094990 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:20.094943 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:20:26.820004 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:26.819959 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:20:43.705266 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:20:43.705237 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:21:16.046138 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:21:16.046101 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:21:16.145329 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:21:16.145296 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:21:17.249678 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:21:17.249652 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:21:17.349896 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:21:17.349856 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:22:07.770028 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:22:07.769997 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f5fb87b96-28md9"] Jul 17 18:22:07.770563 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:22:07.770179 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5f5fb87b96-28md9" podUID="eba1e8e1-a58e-45c5-b13b-e6917c1c32a0" containerName="manager" containerID="cri-o://94e481788681cd644d7919e9ed85502f0ee3ecccc3fcecc2b81193984b8e5b9f" gracePeriod=30 Jul 17 18:22:08.011497 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:22:08.011475 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f5fb87b96-28md9" Jul 17 18:22:08.135056 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:22:08.135035 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eba1e8e1-a58e-45c5-b13b-e6917c1c32a0-webhook-cert\") pod \"eba1e8e1-a58e-45c5-b13b-e6917c1c32a0\" (UID: \"eba1e8e1-a58e-45c5-b13b-e6917c1c32a0\") " Jul 17 18:22:08.135182 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:22:08.135068 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fl52f\" (UniqueName: \"kubernetes.io/projected/eba1e8e1-a58e-45c5-b13b-e6917c1c32a0-kube-api-access-fl52f\") pod \"eba1e8e1-a58e-45c5-b13b-e6917c1c32a0\" (UID: \"eba1e8e1-a58e-45c5-b13b-e6917c1c32a0\") " Jul 17 18:22:08.137119 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:22:08.137085 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eba1e8e1-a58e-45c5-b13b-e6917c1c32a0-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "eba1e8e1-a58e-45c5-b13b-e6917c1c32a0" (UID: "eba1e8e1-a58e-45c5-b13b-e6917c1c32a0"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:22:08.137304 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:22:08.137274 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eba1e8e1-a58e-45c5-b13b-e6917c1c32a0-kube-api-access-fl52f" (OuterVolumeSpecName: "kube-api-access-fl52f") pod "eba1e8e1-a58e-45c5-b13b-e6917c1c32a0" (UID: "eba1e8e1-a58e-45c5-b13b-e6917c1c32a0"). InnerVolumeSpecName "kube-api-access-fl52f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:22:08.235841 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:22:08.235820 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eba1e8e1-a58e-45c5-b13b-e6917c1c32a0-webhook-cert\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:22:08.235926 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:22:08.235841 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fl52f\" (UniqueName: \"kubernetes.io/projected/eba1e8e1-a58e-45c5-b13b-e6917c1c32a0-kube-api-access-fl52f\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:22:08.433150 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:22:08.433073 2576 generic.go:356] "Generic (PLEG): container finished" podID="eba1e8e1-a58e-45c5-b13b-e6917c1c32a0" containerID="94e481788681cd644d7919e9ed85502f0ee3ecccc3fcecc2b81193984b8e5b9f" exitCode=0 Jul 17 18:22:08.433150 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:22:08.433124 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f5fb87b96-28md9" Jul 17 18:22:08.433323 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:22:08.433160 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f5fb87b96-28md9" event={"ID":"eba1e8e1-a58e-45c5-b13b-e6917c1c32a0","Type":"ContainerDied","Data":"94e481788681cd644d7919e9ed85502f0ee3ecccc3fcecc2b81193984b8e5b9f"} Jul 17 18:22:08.433323 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:22:08.433209 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f5fb87b96-28md9" event={"ID":"eba1e8e1-a58e-45c5-b13b-e6917c1c32a0","Type":"ContainerDied","Data":"1d00e1715bd7316888a6a5c85c469462fe176ab875ae0137d2e230537a50f2f0"} Jul 17 18:22:08.433323 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:22:08.433231 2576 scope.go:117] "RemoveContainer" containerID="94e481788681cd644d7919e9ed85502f0ee3ecccc3fcecc2b81193984b8e5b9f" Jul 17 18:22:08.441466 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:22:08.441451 2576 scope.go:117] "RemoveContainer" containerID="94e481788681cd644d7919e9ed85502f0ee3ecccc3fcecc2b81193984b8e5b9f" Jul 17 18:22:08.441695 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:22:08.441678 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94e481788681cd644d7919e9ed85502f0ee3ecccc3fcecc2b81193984b8e5b9f\": container with ID starting with 94e481788681cd644d7919e9ed85502f0ee3ecccc3fcecc2b81193984b8e5b9f not found: ID does not exist" containerID="94e481788681cd644d7919e9ed85502f0ee3ecccc3fcecc2b81193984b8e5b9f" Jul 17 18:22:08.441764 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:22:08.441700 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94e481788681cd644d7919e9ed85502f0ee3ecccc3fcecc2b81193984b8e5b9f"} err="failed to get container status \"94e481788681cd644d7919e9ed85502f0ee3ecccc3fcecc2b81193984b8e5b9f\": rpc error: code = NotFound desc = could not find container \"94e481788681cd644d7919e9ed85502f0ee3ecccc3fcecc2b81193984b8e5b9f\": container with ID starting with 94e481788681cd644d7919e9ed85502f0ee3ecccc3fcecc2b81193984b8e5b9f not found: ID does not exist" Jul 17 18:22:08.453185 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:22:08.453165 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f5fb87b96-28md9"] Jul 17 18:22:08.457967 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:22:08.457947 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5f5fb87b96-28md9"] Jul 17 18:22:09.185675 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:22:09.185647 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eba1e8e1-a58e-45c5-b13b-e6917c1c32a0" path="/var/lib/kubelet/pods/eba1e8e1-a58e-45c5-b13b-e6917c1c32a0/volumes" Jul 17 18:23:09.313481 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:09.313405 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5f5fb87b96-2cdmp"] Jul 17 18:23:09.313883 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:09.313749 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eba1e8e1-a58e-45c5-b13b-e6917c1c32a0" containerName="manager" Jul 17 18:23:09.313883 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:09.313759 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="eba1e8e1-a58e-45c5-b13b-e6917c1c32a0" containerName="manager" Jul 17 18:23:09.313883 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:09.313825 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="eba1e8e1-a58e-45c5-b13b-e6917c1c32a0" containerName="manager" Jul 17 18:23:09.318271 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:09.318253 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f5fb87b96-2cdmp" Jul 17 18:23:09.320563 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:09.320544 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-k88r7\"" Jul 17 18:23:09.321133 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:09.321116 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 17 18:23:09.321228 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:09.321151 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 17 18:23:09.326968 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:09.326947 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f5fb87b96-2cdmp"] Jul 17 18:23:09.413451 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:09.413432 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fb92af5a-17d4-4a53-be8c-8c7b0f5a5232-webhook-cert\") pod \"maas-controller-5f5fb87b96-2cdmp\" (UID: \"fb92af5a-17d4-4a53-be8c-8c7b0f5a5232\") " pod="opendatahub/maas-controller-5f5fb87b96-2cdmp" Jul 17 18:23:09.413553 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:09.413495 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svg5b\" (UniqueName: \"kubernetes.io/projected/fb92af5a-17d4-4a53-be8c-8c7b0f5a5232-kube-api-access-svg5b\") pod \"maas-controller-5f5fb87b96-2cdmp\" (UID: \"fb92af5a-17d4-4a53-be8c-8c7b0f5a5232\") " pod="opendatahub/maas-controller-5f5fb87b96-2cdmp" Jul 17 18:23:09.514516 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:09.514494 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svg5b\" (UniqueName: \"kubernetes.io/projected/fb92af5a-17d4-4a53-be8c-8c7b0f5a5232-kube-api-access-svg5b\") pod \"maas-controller-5f5fb87b96-2cdmp\" (UID: \"fb92af5a-17d4-4a53-be8c-8c7b0f5a5232\") " pod="opendatahub/maas-controller-5f5fb87b96-2cdmp" Jul 17 18:23:09.514611 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:09.514540 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fb92af5a-17d4-4a53-be8c-8c7b0f5a5232-webhook-cert\") pod \"maas-controller-5f5fb87b96-2cdmp\" (UID: \"fb92af5a-17d4-4a53-be8c-8c7b0f5a5232\") " pod="opendatahub/maas-controller-5f5fb87b96-2cdmp" Jul 17 18:23:09.516746 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:09.516729 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fb92af5a-17d4-4a53-be8c-8c7b0f5a5232-webhook-cert\") pod \"maas-controller-5f5fb87b96-2cdmp\" (UID: \"fb92af5a-17d4-4a53-be8c-8c7b0f5a5232\") " pod="opendatahub/maas-controller-5f5fb87b96-2cdmp" Jul 17 18:23:09.521867 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:09.521851 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svg5b\" (UniqueName: \"kubernetes.io/projected/fb92af5a-17d4-4a53-be8c-8c7b0f5a5232-kube-api-access-svg5b\") pod \"maas-controller-5f5fb87b96-2cdmp\" (UID: \"fb92af5a-17d4-4a53-be8c-8c7b0f5a5232\") " pod="opendatahub/maas-controller-5f5fb87b96-2cdmp" Jul 17 18:23:09.629023 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:09.628952 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f5fb87b96-2cdmp" Jul 17 18:23:09.757579 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:09.757431 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f5fb87b96-2cdmp"] Jul 17 18:23:09.760116 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:23:09.760090 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb92af5a_17d4_4a53_be8c_8c7b0f5a5232.slice/crio-45e5b485aab34411a5bd28ecdef86cccaf4f7889757a7d0a430ddaa040b60d5a WatchSource:0}: Error finding container 45e5b485aab34411a5bd28ecdef86cccaf4f7889757a7d0a430ddaa040b60d5a: Status 404 returned error can't find the container with id 45e5b485aab34411a5bd28ecdef86cccaf4f7889757a7d0a430ddaa040b60d5a Jul 17 18:23:10.701856 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:10.701821 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f5fb87b96-2cdmp" event={"ID":"fb92af5a-17d4-4a53-be8c-8c7b0f5a5232","Type":"ContainerStarted","Data":"2f8ddd3ec67a19f2343b9742f4b80fbdc131455ab16fe2e8e374693f842e4193"} Jul 17 18:23:10.702214 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:10.701885 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f5fb87b96-2cdmp" event={"ID":"fb92af5a-17d4-4a53-be8c-8c7b0f5a5232","Type":"ContainerStarted","Data":"45e5b485aab34411a5bd28ecdef86cccaf4f7889757a7d0a430ddaa040b60d5a"} Jul 17 18:23:10.702214 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:10.702018 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5f5fb87b96-2cdmp" Jul 17 18:23:10.719513 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:10.719469 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5f5fb87b96-2cdmp" podStartSLOduration=1.349165801 podStartE2EDuration="1.719447094s" totalImagesPullingTime="370.281293ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:23:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:23:10.71760697 +0000 UTC m=+805.991218124" watchObservedRunningTime="2026-07-17 18:23:10.719447094 +0000 UTC m=+805.993058274" Jul 17 18:23:21.709240 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:21.709211 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5f5fb87b96-2cdmp" Jul 17 18:23:26.287678 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:26.287602 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:23:26.369220 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:26.369190 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f5fb87b96-2cdmp"] Jul 17 18:23:26.369458 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:26.369433 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5f5fb87b96-2cdmp" podUID="fb92af5a-17d4-4a53-be8c-8c7b0f5a5232" containerName="manager" containerID="cri-o://2f8ddd3ec67a19f2343b9742f4b80fbdc131455ab16fe2e8e374693f842e4193" gracePeriod=30 Jul 17 18:23:26.609286 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:26.609265 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f5fb87b96-2cdmp" Jul 17 18:23:26.650320 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:26.650292 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svg5b\" (UniqueName: \"kubernetes.io/projected/fb92af5a-17d4-4a53-be8c-8c7b0f5a5232-kube-api-access-svg5b\") pod \"fb92af5a-17d4-4a53-be8c-8c7b0f5a5232\" (UID: \"fb92af5a-17d4-4a53-be8c-8c7b0f5a5232\") " Jul 17 18:23:26.650473 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:26.650393 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fb92af5a-17d4-4a53-be8c-8c7b0f5a5232-webhook-cert\") pod \"fb92af5a-17d4-4a53-be8c-8c7b0f5a5232\" (UID: \"fb92af5a-17d4-4a53-be8c-8c7b0f5a5232\") " Jul 17 18:23:26.652223 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:26.652184 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb92af5a-17d4-4a53-be8c-8c7b0f5a5232-kube-api-access-svg5b" (OuterVolumeSpecName: "kube-api-access-svg5b") pod "fb92af5a-17d4-4a53-be8c-8c7b0f5a5232" (UID: "fb92af5a-17d4-4a53-be8c-8c7b0f5a5232"). InnerVolumeSpecName "kube-api-access-svg5b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:23:26.652316 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:26.652218 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb92af5a-17d4-4a53-be8c-8c7b0f5a5232-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "fb92af5a-17d4-4a53-be8c-8c7b0f5a5232" (UID: "fb92af5a-17d4-4a53-be8c-8c7b0f5a5232"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:23:26.751192 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:26.751168 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fb92af5a-17d4-4a53-be8c-8c7b0f5a5232-webhook-cert\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:23:26.751192 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:26.751190 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svg5b\" (UniqueName: \"kubernetes.io/projected/fb92af5a-17d4-4a53-be8c-8c7b0f5a5232-kube-api-access-svg5b\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:23:26.775942 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:26.775914 2576 generic.go:356] "Generic (PLEG): container finished" podID="fb92af5a-17d4-4a53-be8c-8c7b0f5a5232" containerID="2f8ddd3ec67a19f2343b9742f4b80fbdc131455ab16fe2e8e374693f842e4193" exitCode=0 Jul 17 18:23:26.776060 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:26.775960 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f5fb87b96-2cdmp" Jul 17 18:23:26.776060 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:26.776004 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f5fb87b96-2cdmp" event={"ID":"fb92af5a-17d4-4a53-be8c-8c7b0f5a5232","Type":"ContainerDied","Data":"2f8ddd3ec67a19f2343b9742f4b80fbdc131455ab16fe2e8e374693f842e4193"} Jul 17 18:23:26.776177 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:26.776069 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f5fb87b96-2cdmp" event={"ID":"fb92af5a-17d4-4a53-be8c-8c7b0f5a5232","Type":"ContainerDied","Data":"45e5b485aab34411a5bd28ecdef86cccaf4f7889757a7d0a430ddaa040b60d5a"} Jul 17 18:23:26.776177 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:26.776100 2576 scope.go:117] "RemoveContainer" containerID="2f8ddd3ec67a19f2343b9742f4b80fbdc131455ab16fe2e8e374693f842e4193" Jul 17 18:23:26.784834 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:26.784816 2576 scope.go:117] "RemoveContainer" containerID="2f8ddd3ec67a19f2343b9742f4b80fbdc131455ab16fe2e8e374693f842e4193" Jul 17 18:23:26.785084 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:23:26.785066 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f8ddd3ec67a19f2343b9742f4b80fbdc131455ab16fe2e8e374693f842e4193\": container with ID starting with 2f8ddd3ec67a19f2343b9742f4b80fbdc131455ab16fe2e8e374693f842e4193 not found: ID does not exist" containerID="2f8ddd3ec67a19f2343b9742f4b80fbdc131455ab16fe2e8e374693f842e4193" Jul 17 18:23:26.785136 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:26.785094 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f8ddd3ec67a19f2343b9742f4b80fbdc131455ab16fe2e8e374693f842e4193"} err="failed to get container status \"2f8ddd3ec67a19f2343b9742f4b80fbdc131455ab16fe2e8e374693f842e4193\": rpc error: code = NotFound desc = could not find container \"2f8ddd3ec67a19f2343b9742f4b80fbdc131455ab16fe2e8e374693f842e4193\": container with ID starting with 2f8ddd3ec67a19f2343b9742f4b80fbdc131455ab16fe2e8e374693f842e4193 not found: ID does not exist" Jul 17 18:23:26.796630 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:26.796609 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f5fb87b96-2cdmp"] Jul 17 18:23:26.799952 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:26.799932 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5f5fb87b96-2cdmp"] Jul 17 18:23:27.186717 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:27.186693 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb92af5a-17d4-4a53-be8c-8c7b0f5a5232" path="/var/lib/kubelet/pods/fb92af5a-17d4-4a53-be8c-8c7b0f5a5232/volumes" Jul 17 18:23:27.519208 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:27.519132 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:23:27.624311 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:27.624280 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5f5fb87b96-glq24"] Jul 17 18:23:27.624683 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:27.624666 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb92af5a-17d4-4a53-be8c-8c7b0f5a5232" containerName="manager" Jul 17 18:23:27.624773 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:27.624685 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb92af5a-17d4-4a53-be8c-8c7b0f5a5232" containerName="manager" Jul 17 18:23:27.624826 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:27.624783 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb92af5a-17d4-4a53-be8c-8c7b0f5a5232" containerName="manager" Jul 17 18:23:27.629042 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:27.629020 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f5fb87b96-glq24" Jul 17 18:23:27.632003 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:27.631963 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 17 18:23:27.632100 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:27.632022 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-k88r7\"" Jul 17 18:23:27.632100 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:27.632022 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 17 18:23:27.638163 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:27.638138 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f5fb87b96-glq24"] Jul 17 18:23:27.658528 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:27.658507 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkzph\" (UniqueName: \"kubernetes.io/projected/9bd74a12-063b-4faf-b7cb-fe27b56554d3-kube-api-access-rkzph\") pod \"maas-controller-5f5fb87b96-glq24\" (UID: \"9bd74a12-063b-4faf-b7cb-fe27b56554d3\") " pod="opendatahub/maas-controller-5f5fb87b96-glq24" Jul 17 18:23:27.658631 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:27.658539 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9bd74a12-063b-4faf-b7cb-fe27b56554d3-webhook-cert\") pod \"maas-controller-5f5fb87b96-glq24\" (UID: \"9bd74a12-063b-4faf-b7cb-fe27b56554d3\") " pod="opendatahub/maas-controller-5f5fb87b96-glq24" Jul 17 18:23:27.759833 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:27.759809 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkzph\" (UniqueName: \"kubernetes.io/projected/9bd74a12-063b-4faf-b7cb-fe27b56554d3-kube-api-access-rkzph\") pod \"maas-controller-5f5fb87b96-glq24\" (UID: \"9bd74a12-063b-4faf-b7cb-fe27b56554d3\") " pod="opendatahub/maas-controller-5f5fb87b96-glq24" Jul 17 18:23:27.759922 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:27.759840 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9bd74a12-063b-4faf-b7cb-fe27b56554d3-webhook-cert\") pod \"maas-controller-5f5fb87b96-glq24\" (UID: \"9bd74a12-063b-4faf-b7cb-fe27b56554d3\") " pod="opendatahub/maas-controller-5f5fb87b96-glq24" Jul 17 18:23:27.762164 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:27.762145 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9bd74a12-063b-4faf-b7cb-fe27b56554d3-webhook-cert\") pod \"maas-controller-5f5fb87b96-glq24\" (UID: \"9bd74a12-063b-4faf-b7cb-fe27b56554d3\") " pod="opendatahub/maas-controller-5f5fb87b96-glq24" Jul 17 18:23:27.769245 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:27.769190 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkzph\" (UniqueName: \"kubernetes.io/projected/9bd74a12-063b-4faf-b7cb-fe27b56554d3-kube-api-access-rkzph\") pod \"maas-controller-5f5fb87b96-glq24\" (UID: \"9bd74a12-063b-4faf-b7cb-fe27b56554d3\") " pod="opendatahub/maas-controller-5f5fb87b96-glq24" Jul 17 18:23:27.940387 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:27.940360 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f5fb87b96-glq24" Jul 17 18:23:28.076747 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:28.076724 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f5fb87b96-glq24"] Jul 17 18:23:28.079072 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:23:28.079042 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bd74a12_063b_4faf_b7cb_fe27b56554d3.slice/crio-0a12a58982f643363dcc2a608668516ca2726aa454a94ad66ad912ad62c0ccb9 WatchSource:0}: Error finding container 0a12a58982f643363dcc2a608668516ca2726aa454a94ad66ad912ad62c0ccb9: Status 404 returned error can't find the container with id 0a12a58982f643363dcc2a608668516ca2726aa454a94ad66ad912ad62c0ccb9 Jul 17 18:23:28.787856 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:28.787776 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f5fb87b96-glq24" event={"ID":"9bd74a12-063b-4faf-b7cb-fe27b56554d3","Type":"ContainerStarted","Data":"48f99d15096f1b40c3d67a4f45a5ad1d16f585cce294114bbee67b7ac967e71d"} Jul 17 18:23:28.787856 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:28.787838 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f5fb87b96-glq24" event={"ID":"9bd74a12-063b-4faf-b7cb-fe27b56554d3","Type":"ContainerStarted","Data":"0a12a58982f643363dcc2a608668516ca2726aa454a94ad66ad912ad62c0ccb9"} Jul 17 18:23:28.788239 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:28.787867 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5f5fb87b96-glq24" Jul 17 18:23:28.807782 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:28.807712 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5f5fb87b96-glq24" podStartSLOduration=1.431920897 podStartE2EDuration="1.807697745s" totalImagesPullingTime="375.776848ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:23:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:23:28.805852092 +0000 UTC m=+824.079463232" watchObservedRunningTime="2026-07-17 18:23:28.807697745 +0000 UTC m=+824.081308886" Jul 17 18:23:39.794320 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:23:39.794290 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5f5fb87b96-glq24" Jul 17 18:24:10.672009 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:24:10.671965 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:24:10.767702 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:24:10.767680 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:24:10.900807 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:24:10.900789 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:24:17.563533 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:24:17.563481 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:24:17.632163 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:24:17.632133 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:24:17.729105 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:24:17.729077 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:24:17.826236 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:24:17.826172 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:24:17.945939 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:24:17.945911 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:24:23.849121 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:24:23.849089 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:24:23.954527 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:24:23.954502 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:24:45.098747 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:24:45.098713 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nwqlr_c6017e7d-5ed2-4d7d-ba64-ba9ce933828f/console-operator/1.log" Jul 17 18:24:45.099586 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:24:45.099564 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nwqlr_c6017e7d-5ed2-4d7d-ba64-ba9ce933828f/console-operator/1.log" Jul 17 18:24:45.104106 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:24:45.104084 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6pqqj_a67c7573-deca-4960-b69f-5ad3bda075a8/ovn-acl-logging/0.log" Jul 17 18:24:45.104530 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:24:45.104515 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6pqqj_a67c7573-deca-4960-b69f-5ad3bda075a8/ovn-acl-logging/0.log" Jul 17 18:25:05.605330 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:25:05.605303 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:25:06.907147 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:25:06.907091 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:28:51.757774 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:28:51.757742 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:29:12.507050 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:29:12.507017 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:29:45.126465 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:29:45.126441 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nwqlr_c6017e7d-5ed2-4d7d-ba64-ba9ce933828f/console-operator/1.log" Jul 17 18:29:45.127731 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:29:45.127708 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nwqlr_c6017e7d-5ed2-4d7d-ba64-ba9ce933828f/console-operator/1.log" Jul 17 18:29:45.131775 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:29:45.131756 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6pqqj_a67c7573-deca-4960-b69f-5ad3bda075a8/ovn-acl-logging/0.log" Jul 17 18:29:45.133072 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:29:45.133053 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6pqqj_a67c7573-deca-4960-b69f-5ad3bda075a8/ovn-acl-logging/0.log" Jul 17 18:30:14.125701 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:30:14.125661 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:30:54.796384 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:30:54.796352 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:30:54.853753 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:30:54.853727 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:34:45.155347 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:34:45.155316 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nwqlr_c6017e7d-5ed2-4d7d-ba64-ba9ce933828f/console-operator/1.log" Jul 17 18:34:45.157959 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:34:45.157512 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nwqlr_c6017e7d-5ed2-4d7d-ba64-ba9ce933828f/console-operator/1.log" Jul 17 18:34:45.160676 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:34:45.160657 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6pqqj_a67c7573-deca-4960-b69f-5ad3bda075a8/ovn-acl-logging/0.log" Jul 17 18:34:45.162900 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:34:45.162879 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6pqqj_a67c7573-deca-4960-b69f-5ad3bda075a8/ovn-acl-logging/0.log" Jul 17 18:35:26.866324 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:35:26.866227 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:35:41.860858 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:35:41.860826 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:35:49.462615 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:35:49.462578 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:35:57.665184 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:35:57.665150 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:36:02.761795 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:02.761763 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:36:05.775230 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:05.775203 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:36:05.876676 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:05.876648 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:36:06.286665 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:06.286636 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:36:12.002445 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.002411 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:36:12.082676 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.082649 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:36:12.227647 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.227615 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh"] Jul 17 18:36:12.231334 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.231315 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:12.234535 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.234509 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a8d2046a-openshift-default-dockercfg-4frtf\"" Jul 17 18:36:12.266252 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.266204 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh"] Jul 17 18:36:12.273233 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.273212 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtzzc\" (UniqueName: \"kubernetes.io/projected/100fdf56-1424-45f3-96d1-9631a12473a1-kube-api-access-xtzzc\") pod \"e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:12.273341 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.273243 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/100fdf56-1424-45f3-96d1-9631a12473a1-istio-podinfo\") pod \"e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:12.273341 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.273261 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/100fdf56-1424-45f3-96d1-9631a12473a1-istiod-ca-cert\") pod \"e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:12.273429 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.273410 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/100fdf56-1424-45f3-96d1-9631a12473a1-workload-socket\") pod \"e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:12.273471 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.273463 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/100fdf56-1424-45f3-96d1-9631a12473a1-istio-envoy\") pod \"e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:12.273595 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.273573 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/100fdf56-1424-45f3-96d1-9631a12473a1-istio-data\") pod \"e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:12.273660 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.273633 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/100fdf56-1424-45f3-96d1-9631a12473a1-credential-socket\") pod \"e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:12.273714 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.273665 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/100fdf56-1424-45f3-96d1-9631a12473a1-istio-token\") pod \"e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:12.273757 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.273737 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/100fdf56-1424-45f3-96d1-9631a12473a1-workload-certs\") pod \"e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:12.322921 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.322891 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:36:12.374246 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.374217 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtzzc\" (UniqueName: \"kubernetes.io/projected/100fdf56-1424-45f3-96d1-9631a12473a1-kube-api-access-xtzzc\") pod \"e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:12.374374 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.374257 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/100fdf56-1424-45f3-96d1-9631a12473a1-istio-podinfo\") pod \"e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:12.374374 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.374277 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/100fdf56-1424-45f3-96d1-9631a12473a1-istiod-ca-cert\") pod \"e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:12.374481 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.374389 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/100fdf56-1424-45f3-96d1-9631a12473a1-workload-socket\") pod \"e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:12.374481 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.374444 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/100fdf56-1424-45f3-96d1-9631a12473a1-istio-envoy\") pod \"e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:12.374587 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.374518 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/100fdf56-1424-45f3-96d1-9631a12473a1-istio-data\") pod \"e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:12.374587 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.374547 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/100fdf56-1424-45f3-96d1-9631a12473a1-credential-socket\") pod \"e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:12.374587 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.374575 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/100fdf56-1424-45f3-96d1-9631a12473a1-istio-token\") pod \"e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:12.374724 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.374643 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/100fdf56-1424-45f3-96d1-9631a12473a1-workload-certs\") pod \"e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:12.374786 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.374753 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/100fdf56-1424-45f3-96d1-9631a12473a1-workload-socket\") pod \"e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:12.374883 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.374862 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/100fdf56-1424-45f3-96d1-9631a12473a1-istio-data\") pod \"e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:12.375001 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.374961 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/100fdf56-1424-45f3-96d1-9631a12473a1-istiod-ca-cert\") pod \"e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:12.375118 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.375080 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/100fdf56-1424-45f3-96d1-9631a12473a1-workload-certs\") pod \"e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:12.375118 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.375107 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/100fdf56-1424-45f3-96d1-9631a12473a1-credential-socket\") pod \"e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:12.376602 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.376572 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/100fdf56-1424-45f3-96d1-9631a12473a1-istio-envoy\") pod \"e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:12.376746 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.376732 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/100fdf56-1424-45f3-96d1-9631a12473a1-istio-podinfo\") pod \"e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:12.383874 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.383853 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/100fdf56-1424-45f3-96d1-9631a12473a1-istio-token\") pod \"e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:12.384056 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.384034 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtzzc\" (UniqueName: \"kubernetes.io/projected/100fdf56-1424-45f3-96d1-9631a12473a1-kube-api-access-xtzzc\") pod \"e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:12.407611 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.407581 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:36:12.541581 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.541552 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:12.670826 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.670798 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh"] Jul 17 18:36:12.672969 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:36:12.672945 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod100fdf56_1424_45f3_96d1_9631a12473a1.slice/crio-1df1ce0bba183a7b4f21c2010fd7bd281d1816050f437cdeda8bd3c6ea927a92 WatchSource:0}: Error finding container 1df1ce0bba183a7b4f21c2010fd7bd281d1816050f437cdeda8bd3c6ea927a92: Status 404 returned error can't find the container with id 1df1ce0bba183a7b4f21c2010fd7bd281d1816050f437cdeda8bd3c6ea927a92 Jul 17 18:36:12.675109 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.675076 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:36:12.675198 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.675144 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:36:12.675198 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:12.675172 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:36:13.150414 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:13.150382 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" event={"ID":"100fdf56-1424-45f3-96d1-9631a12473a1","Type":"ContainerStarted","Data":"83c9e1c2e2e598017aacce51d9219873765fa5a66f95a5dd14811ab07378f5dd"} Jul 17 18:36:13.150787 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:13.150433 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" event={"ID":"100fdf56-1424-45f3-96d1-9631a12473a1","Type":"ContainerStarted","Data":"1df1ce0bba183a7b4f21c2010fd7bd281d1816050f437cdeda8bd3c6ea927a92"} Jul 17 18:36:13.170971 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:13.170921 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" podStartSLOduration=1.170905895 podStartE2EDuration="1.170905895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:36:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:36:13.169231159 +0000 UTC m=+1588.442842301" watchObservedRunningTime="2026-07-17 18:36:13.170905895 +0000 UTC m=+1588.444517037" Jul 17 18:36:13.415069 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:13.414990 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:36:13.500781 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:13.500750 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd"] Jul 17 18:36:13.504958 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:13.504937 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd" Jul 17 18:36:13.507292 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:13.507268 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-a8d2046a-serving-cert\"" Jul 17 18:36:13.507867 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:13.507841 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:36:13.513022 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:13.512998 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd"] Jul 17 18:36:13.542038 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:13.542011 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:13.547278 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:13.547256 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:13.588109 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:13.588086 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdxhq\" (UniqueName: \"kubernetes.io/projected/8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9-kube-api-access-tdxhq\") pod \"maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd\" (UID: \"8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd" Jul 17 18:36:13.588217 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:13.588144 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9-openshift-service-ca\") pod \"maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd\" (UID: \"8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd" Jul 17 18:36:13.588217 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:13.588173 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9-maas-api-tls\") pod \"maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd\" (UID: \"8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd" Jul 17 18:36:13.595844 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:13.595817 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:36:13.688669 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:13.688594 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9-openshift-service-ca\") pod \"maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd\" (UID: \"8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd" Jul 17 18:36:13.688669 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:13.688629 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9-maas-api-tls\") pod \"maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd\" (UID: \"8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd" Jul 17 18:36:13.688844 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:13.688689 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdxhq\" (UniqueName: \"kubernetes.io/projected/8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9-kube-api-access-tdxhq\") pod \"maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd\" (UID: \"8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd" Jul 17 18:36:13.688844 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:36:13.688778 2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-a8d2046a-serving-cert: secret "maas-api-e2e-ait-a8d2046a-serving-cert" not found Jul 17 18:36:13.688912 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:36:13.688850 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9-maas-api-tls podName:8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9 nodeName:}" failed. No retries permitted until 2026-07-17 18:36:14.188828856 +0000 UTC m=+1589.462439976 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9-maas-api-tls") pod "maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd" (UID: "8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9") : secret "maas-api-e2e-ait-a8d2046a-serving-cert" not found Jul 17 18:36:13.689342 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:13.689326 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9-openshift-service-ca\") pod \"maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd\" (UID: \"8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd" Jul 17 18:36:13.702115 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:13.702090 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdxhq\" (UniqueName: \"kubernetes.io/projected/8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9-kube-api-access-tdxhq\") pod \"maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd\" (UID: \"8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd" Jul 17 18:36:14.124299 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:14.124266 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:36:14.157504 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:14.157480 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:14.161806 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:14.161784 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:14.194189 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:14.194167 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9-maas-api-tls\") pod \"maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd\" (UID: \"8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd" Jul 17 18:36:14.196410 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:14.196391 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9-maas-api-tls\") pod \"maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd\" (UID: \"8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd" Jul 17 18:36:14.285298 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:14.285271 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:36:14.418929 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:14.418845 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd" Jul 17 18:36:14.552461 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:14.552426 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd"] Jul 17 18:36:14.553469 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:36:14.553432 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e36f7db_cd66_46a4_9fff_db9ddc8fb1a9.slice/crio-d77a5857a310064fa6c3a73cb614ba05cc4e9ff24d0811c3dac7b858dba4c09d WatchSource:0}: Error finding container d77a5857a310064fa6c3a73cb614ba05cc4e9ff24d0811c3dac7b858dba4c09d: Status 404 returned error can't find the container with id d77a5857a310064fa6c3a73cb614ba05cc4e9ff24d0811c3dac7b858dba4c09d Jul 17 18:36:14.555137 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:14.555114 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 18:36:15.162129 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:15.162102 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd" event={"ID":"8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9","Type":"ContainerStarted","Data":"d014daa3b80b0fddc2597fa30e6be75593d08866fdbfe3eefd3fd8539cb5b445"} Jul 17 18:36:15.162466 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:15.162153 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd" event={"ID":"8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9","Type":"ContainerStarted","Data":"d77a5857a310064fa6c3a73cb614ba05cc4e9ff24d0811c3dac7b858dba4c09d"} Jul 17 18:36:15.162466 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:15.162175 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd" Jul 17 18:36:15.184550 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:15.184503 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd" podStartSLOduration=1.728693024 podStartE2EDuration="2.184484926s" totalImagesPullingTime="455.791902ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:36:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:36:15.183819437 +0000 UTC m=+1590.457430578" watchObservedRunningTime="2026-07-17 18:36:15.184484926 +0000 UTC m=+1590.458096069" Jul 17 18:36:16.854575 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:16.854550 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:36:21.172353 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:21.172325 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd" Jul 17 18:36:26.222167 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:26.222104 2576 generic.go:356] "Generic (PLEG): container finished" podID="100fdf56-1424-45f3-96d1-9631a12473a1" containerID="83c9e1c2e2e598017aacce51d9219873765fa5a66f95a5dd14811ab07378f5dd" exitCode=0 Jul 17 18:36:26.222584 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:26.222169 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" event={"ID":"100fdf56-1424-45f3-96d1-9631a12473a1","Type":"ContainerDied","Data":"83c9e1c2e2e598017aacce51d9219873765fa5a66f95a5dd14811ab07378f5dd"} Jul 17 18:36:26.222660 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:26.222640 2576 scope.go:117] "RemoveContainer" containerID="83c9e1c2e2e598017aacce51d9219873765fa5a66f95a5dd14811ab07378f5dd" Jul 17 18:36:26.223669 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:26.223635 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:36:26.223765 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:26.223709 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:36:26.223765 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:26.223742 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:36:27.227553 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:27.227519 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" event={"ID":"100fdf56-1424-45f3-96d1-9631a12473a1","Type":"ContainerStarted","Data":"84c206362d5760716601976e765336c4efe84eb6850d631679cd4dcac5209c92"} Jul 17 18:36:27.542300 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:27.542211 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:27.543562 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:27.543522 2576 patch_prober.go:28] interesting pod/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 17 18:36:27.543684 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:27.543598 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" podUID="100fdf56-1424-45f3-96d1-9631a12473a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 17 18:36:28.542763 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:28.542324 2576 patch_prober.go:28] interesting pod/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 17 18:36:28.542763 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:28.542387 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" podUID="100fdf56-1424-45f3-96d1-9631a12473a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 17 18:36:29.157604 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:29.157576 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:29.542235 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:29.542202 2576 patch_prober.go:28] interesting pod/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 17 18:36:29.542531 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:29.542491 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" podUID="100fdf56-1424-45f3-96d1-9631a12473a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 17 18:36:30.542860 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:30.542818 2576 patch_prober.go:28] interesting pod/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 17 18:36:30.543360 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:30.542882 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" podUID="100fdf56-1424-45f3-96d1-9631a12473a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 17 18:36:31.546267 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:31.546235 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:31.547065 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:31.547045 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:36:55.491820 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:36:55.491789 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:37:06.658046 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:06.658011 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:37:28.971683 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:28.971650 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd"] Jul 17 18:37:28.972083 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:28.971903 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd" podUID="8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9" containerName="maas-api" containerID="cri-o://d014daa3b80b0fddc2597fa30e6be75593d08866fdbfe3eefd3fd8539cb5b445" gracePeriod=30 Jul 17 18:37:29.005714 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:29.005673 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:37:29.216240 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:29.216220 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd" Jul 17 18:37:29.319623 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:29.319597 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdxhq\" (UniqueName: \"kubernetes.io/projected/8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9-kube-api-access-tdxhq\") pod \"8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9\" (UID: \"8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9\") " Jul 17 18:37:29.319738 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:29.319638 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9-maas-api-tls\") pod \"8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9\" (UID: \"8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9\") " Jul 17 18:37:29.319738 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:29.319709 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9-openshift-service-ca\") pod \"8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9\" (UID: \"8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9\") " Jul 17 18:37:29.320085 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:29.320063 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9" (UID: "8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:37:29.321683 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:29.321653 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9-kube-api-access-tdxhq" (OuterVolumeSpecName: "kube-api-access-tdxhq") pod "8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9" (UID: "8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9"). InnerVolumeSpecName "kube-api-access-tdxhq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:37:29.321683 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:29.321654 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9" (UID: "8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 18:37:29.421109 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:29.421086 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdxhq\" (UniqueName: \"kubernetes.io/projected/8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9-kube-api-access-tdxhq\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:37:29.421109 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:29.421107 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9-maas-api-tls\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:37:29.421234 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:29.421118 2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9-openshift-service-ca\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:37:29.509633 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:29.509607 2576 generic.go:356] "Generic (PLEG): container finished" podID="8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9" containerID="d014daa3b80b0fddc2597fa30e6be75593d08866fdbfe3eefd3fd8539cb5b445" exitCode=0 Jul 17 18:37:29.509736 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:29.509650 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd" Jul 17 18:37:29.509736 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:29.509695 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd" event={"ID":"8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9","Type":"ContainerDied","Data":"d014daa3b80b0fddc2597fa30e6be75593d08866fdbfe3eefd3fd8539cb5b445"} Jul 17 18:37:29.509819 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:29.509742 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd" event={"ID":"8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9","Type":"ContainerDied","Data":"d77a5857a310064fa6c3a73cb614ba05cc4e9ff24d0811c3dac7b858dba4c09d"} Jul 17 18:37:29.509819 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:29.509768 2576 scope.go:117] "RemoveContainer" containerID="d014daa3b80b0fddc2597fa30e6be75593d08866fdbfe3eefd3fd8539cb5b445" Jul 17 18:37:29.518794 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:29.518777 2576 scope.go:117] "RemoveContainer" containerID="d014daa3b80b0fddc2597fa30e6be75593d08866fdbfe3eefd3fd8539cb5b445" Jul 17 18:37:29.519041 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:37:29.519024 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d014daa3b80b0fddc2597fa30e6be75593d08866fdbfe3eefd3fd8539cb5b445\": container with ID starting with d014daa3b80b0fddc2597fa30e6be75593d08866fdbfe3eefd3fd8539cb5b445 not found: ID does not exist" containerID="d014daa3b80b0fddc2597fa30e6be75593d08866fdbfe3eefd3fd8539cb5b445" Jul 17 18:37:29.519097 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:29.519049 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d014daa3b80b0fddc2597fa30e6be75593d08866fdbfe3eefd3fd8539cb5b445"} err="failed to get container status \"d014daa3b80b0fddc2597fa30e6be75593d08866fdbfe3eefd3fd8539cb5b445\": rpc error: code = NotFound desc = could not find container \"d014daa3b80b0fddc2597fa30e6be75593d08866fdbfe3eefd3fd8539cb5b445\": container with ID starting with d014daa3b80b0fddc2597fa30e6be75593d08866fdbfe3eefd3fd8539cb5b445 not found: ID does not exist" Jul 17 18:37:29.529778 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:29.529754 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd"] Jul 17 18:37:29.535810 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:29.535789 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a8d2046a-5fd9697488-dbkdd"] Jul 17 18:37:31.191229 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:31.185952 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9" path="/var/lib/kubelet/pods/8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9/volumes" Jul 17 18:37:33.603537 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:33.603503 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:37:39.302424 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:39.302379 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:37:39.405285 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:39.405256 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:37:43.789311 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:43.789281 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh"] Jul 17 18:37:43.789788 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:43.789491 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" podUID="100fdf56-1424-45f3-96d1-9631a12473a1" containerName="istio-proxy" containerID="cri-o://84c206362d5760716601976e765336c4efe84eb6850d631679cd4dcac5209c92" gracePeriod=30 Jul 17 18:37:43.914033 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:43.914000 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:37:44.229234 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.229161 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:37:44.331125 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.331100 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:37:44.443362 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.443343 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m"] Jul 17 18:37:44.443716 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.443704 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9" containerName="maas-api" Jul 17 18:37:44.443716 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.443717 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9" containerName="maas-api" Jul 17 18:37:44.443836 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.443790 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e36f7db-cd66-46a4-9fff-db9ddc8fb1a9" containerName="maas-api" Jul 17 18:37:44.448341 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.448324 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:37:44.454549 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.454519 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-d37232e3-gw-openshift-default-dockercfg-6pp7s\"" Jul 17 18:37:44.481008 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.480924 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m"] Jul 17 18:37:44.536160 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.536136 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7a2de1e-bb74-4df8-a958-f958880d5575-istio-envoy\") pod \"e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:37:44.536288 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.536183 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7a2de1e-bb74-4df8-a958-f958880d5575-istiod-ca-cert\") pod \"e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:37:44.536288 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.536257 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7a2de1e-bb74-4df8-a958-f958880d5575-credential-socket\") pod \"e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:37:44.536382 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.536298 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7a2de1e-bb74-4df8-a958-f958880d5575-istio-token\") pod \"e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:37:44.536382 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.536337 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7a2de1e-bb74-4df8-a958-f958880d5575-istio-podinfo\") pod \"e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:37:44.536460 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.536392 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7a2de1e-bb74-4df8-a958-f958880d5575-istio-data\") pod \"e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:37:44.536460 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.536414 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hqdm\" (UniqueName: \"kubernetes.io/projected/e7a2de1e-bb74-4df8-a958-f958880d5575-kube-api-access-6hqdm\") pod \"e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:37:44.536460 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.536440 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7a2de1e-bb74-4df8-a958-f958880d5575-workload-certs\") pod \"e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:37:44.536568 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.536479 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7a2de1e-bb74-4df8-a958-f958880d5575-workload-socket\") pod \"e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:37:44.548102 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.548074 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:37:44.637406 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.637375 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7a2de1e-bb74-4df8-a958-f958880d5575-istio-data\") pod \"e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:37:44.637406 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.637411 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hqdm\" (UniqueName: \"kubernetes.io/projected/e7a2de1e-bb74-4df8-a958-f958880d5575-kube-api-access-6hqdm\") pod \"e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:37:44.637691 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.637434 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7a2de1e-bb74-4df8-a958-f958880d5575-workload-certs\") pod \"e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:37:44.637691 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.637480 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7a2de1e-bb74-4df8-a958-f958880d5575-workload-socket\") pod \"e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:37:44.637691 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.637511 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7a2de1e-bb74-4df8-a958-f958880d5575-istio-envoy\") pod \"e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:37:44.637691 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.637560 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7a2de1e-bb74-4df8-a958-f958880d5575-istiod-ca-cert\") pod \"e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:37:44.637691 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.637627 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7a2de1e-bb74-4df8-a958-f958880d5575-credential-socket\") pod \"e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:37:44.637691 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.637652 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7a2de1e-bb74-4df8-a958-f958880d5575-istio-token\") pod \"e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:37:44.637691 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.637690 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7a2de1e-bb74-4df8-a958-f958880d5575-istio-podinfo\") pod \"e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:37:44.638088 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.637829 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7a2de1e-bb74-4df8-a958-f958880d5575-istio-data\") pod \"e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:37:44.638088 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.637882 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7a2de1e-bb74-4df8-a958-f958880d5575-workload-certs\") pod \"e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:37:44.638088 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.637935 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7a2de1e-bb74-4df8-a958-f958880d5575-workload-socket\") pod \"e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:37:44.638088 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.638078 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7a2de1e-bb74-4df8-a958-f958880d5575-credential-socket\") pod \"e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:37:44.638392 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.638371 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7a2de1e-bb74-4df8-a958-f958880d5575-istiod-ca-cert\") pod \"e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:37:44.639773 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.639757 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7a2de1e-bb74-4df8-a958-f958880d5575-istio-envoy\") pod \"e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:37:44.640170 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.640154 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7a2de1e-bb74-4df8-a958-f958880d5575-istio-podinfo\") pod \"e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:37:44.651241 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.651210 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hqdm\" (UniqueName: \"kubernetes.io/projected/e7a2de1e-bb74-4df8-a958-f958880d5575-kube-api-access-6hqdm\") pod \"e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:37:44.652077 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.652061 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7a2de1e-bb74-4df8-a958-f958880d5575-istio-token\") pod \"e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:37:44.758547 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.758491 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:37:44.890942 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.890920 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m"] Jul 17 18:37:44.893141 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:37:44.893117 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7a2de1e_bb74_4df8_a958_f958880d5575.slice/crio-5de3dd8f8cb65f17d919be134553d2c3fca60b521b09a46811442ec0cd95ccdb WatchSource:0}: Error finding container 5de3dd8f8cb65f17d919be134553d2c3fca60b521b09a46811442ec0cd95ccdb: Status 404 returned error can't find the container with id 5de3dd8f8cb65f17d919be134553d2c3fca60b521b09a46811442ec0cd95ccdb Jul 17 18:37:44.895137 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.895104 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:37:44.895220 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.895166 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:37:44.895220 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:44.895195 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:37:45.585360 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:45.585318 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" event={"ID":"e7a2de1e-bb74-4df8-a958-f958880d5575","Type":"ContainerStarted","Data":"4a87e95592428cf8dfea9c1764717255f2f2654a8f7c5c8613fccec5205003dc"} Jul 17 18:37:45.585517 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:45.585386 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" event={"ID":"e7a2de1e-bb74-4df8-a958-f958880d5575","Type":"ContainerStarted","Data":"5de3dd8f8cb65f17d919be134553d2c3fca60b521b09a46811442ec0cd95ccdb"} Jul 17 18:37:45.610172 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:45.610125 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" podStartSLOduration=1.6101116850000001 podStartE2EDuration="1.610111685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:37:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:37:45.60864894 +0000 UTC m=+1680.882260108" watchObservedRunningTime="2026-07-17 18:37:45.610111685 +0000 UTC m=+1680.883722827" Jul 17 18:37:45.759079 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:45.759049 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:37:45.764621 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:45.764598 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:37:45.840876 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:45.840801 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:37:46.033368 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:46.033327 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:37:46.168573 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:46.168502 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:37:46.504838 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:46.504761 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:37:46.549088 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:46.549055 2576 patch_prober.go:28] interesting pod/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 17 18:37:46.549252 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:46.549123 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" podUID="100fdf56-1424-45f3-96d1-9631a12473a1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 17 18:37:46.590446 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:46.590417 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:37:46.591231 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:46.591213 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:37:46.604667 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:46.604637 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:37:49.038660 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.038636 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:37:49.177406 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.177380 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/100fdf56-1424-45f3-96d1-9631a12473a1-credential-socket\") pod \"100fdf56-1424-45f3-96d1-9631a12473a1\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " Jul 17 18:37:49.177534 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.177413 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/100fdf56-1424-45f3-96d1-9631a12473a1-istio-podinfo\") pod \"100fdf56-1424-45f3-96d1-9631a12473a1\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " Jul 17 18:37:49.177534 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.177440 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/100fdf56-1424-45f3-96d1-9631a12473a1-workload-certs\") pod \"100fdf56-1424-45f3-96d1-9631a12473a1\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " Jul 17 18:37:49.177534 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.177495 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/100fdf56-1424-45f3-96d1-9631a12473a1-istio-data\") pod \"100fdf56-1424-45f3-96d1-9631a12473a1\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " Jul 17 18:37:49.177693 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.177539 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/100fdf56-1424-45f3-96d1-9631a12473a1-istiod-ca-cert\") pod \"100fdf56-1424-45f3-96d1-9631a12473a1\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " Jul 17 18:37:49.177693 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.177594 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtzzc\" (UniqueName: \"kubernetes.io/projected/100fdf56-1424-45f3-96d1-9631a12473a1-kube-api-access-xtzzc\") pod \"100fdf56-1424-45f3-96d1-9631a12473a1\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " Jul 17 18:37:49.177693 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.177623 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/100fdf56-1424-45f3-96d1-9631a12473a1-istio-token\") pod \"100fdf56-1424-45f3-96d1-9631a12473a1\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " Jul 17 18:37:49.177693 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.177665 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/100fdf56-1424-45f3-96d1-9631a12473a1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "100fdf56-1424-45f3-96d1-9631a12473a1" (UID: "100fdf56-1424-45f3-96d1-9631a12473a1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:37:49.177898 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.177771 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/100fdf56-1424-45f3-96d1-9631a12473a1-workload-socket\") pod \"100fdf56-1424-45f3-96d1-9631a12473a1\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " Jul 17 18:37:49.177898 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.177773 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/100fdf56-1424-45f3-96d1-9631a12473a1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "100fdf56-1424-45f3-96d1-9631a12473a1" (UID: "100fdf56-1424-45f3-96d1-9631a12473a1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:37:49.177898 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.177808 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/100fdf56-1424-45f3-96d1-9631a12473a1-istio-envoy\") pod \"100fdf56-1424-45f3-96d1-9631a12473a1\" (UID: \"100fdf56-1424-45f3-96d1-9631a12473a1\") " Jul 17 18:37:49.178067 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.177899 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/100fdf56-1424-45f3-96d1-9631a12473a1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "100fdf56-1424-45f3-96d1-9631a12473a1" (UID: "100fdf56-1424-45f3-96d1-9631a12473a1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:37:49.178067 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.177967 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/100fdf56-1424-45f3-96d1-9631a12473a1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "100fdf56-1424-45f3-96d1-9631a12473a1" (UID: "100fdf56-1424-45f3-96d1-9631a12473a1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:37:49.178228 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.178211 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/100fdf56-1424-45f3-96d1-9631a12473a1-credential-socket\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:37:49.178286 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.178232 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/100fdf56-1424-45f3-96d1-9631a12473a1-workload-certs\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:37:49.178286 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.178247 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/100fdf56-1424-45f3-96d1-9631a12473a1-istiod-ca-cert\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:37:49.178286 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.178259 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/100fdf56-1424-45f3-96d1-9631a12473a1-workload-socket\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:37:49.178286 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.178250 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/100fdf56-1424-45f3-96d1-9631a12473a1-istio-data" (OuterVolumeSpecName: "istio-data") pod "100fdf56-1424-45f3-96d1-9631a12473a1" (UID: "100fdf56-1424-45f3-96d1-9631a12473a1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:37:49.179706 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.179685 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/100fdf56-1424-45f3-96d1-9631a12473a1-istio-token" (OuterVolumeSpecName: "istio-token") pod "100fdf56-1424-45f3-96d1-9631a12473a1" (UID: "100fdf56-1424-45f3-96d1-9631a12473a1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:37:49.179793 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.179761 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/100fdf56-1424-45f3-96d1-9631a12473a1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "100fdf56-1424-45f3-96d1-9631a12473a1" (UID: "100fdf56-1424-45f3-96d1-9631a12473a1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:37:49.179880 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.179862 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/100fdf56-1424-45f3-96d1-9631a12473a1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "100fdf56-1424-45f3-96d1-9631a12473a1" (UID: "100fdf56-1424-45f3-96d1-9631a12473a1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 18:37:49.179997 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.179954 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/100fdf56-1424-45f3-96d1-9631a12473a1-kube-api-access-xtzzc" (OuterVolumeSpecName: "kube-api-access-xtzzc") pod "100fdf56-1424-45f3-96d1-9631a12473a1" (UID: "100fdf56-1424-45f3-96d1-9631a12473a1"). InnerVolumeSpecName "kube-api-access-xtzzc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:37:49.279239 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.279217 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/100fdf56-1424-45f3-96d1-9631a12473a1-istio-envoy\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:37:49.279239 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.279238 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/100fdf56-1424-45f3-96d1-9631a12473a1-istio-podinfo\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:37:49.279363 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.279246 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/100fdf56-1424-45f3-96d1-9631a12473a1-istio-data\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:37:49.279363 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.279255 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtzzc\" (UniqueName: \"kubernetes.io/projected/100fdf56-1424-45f3-96d1-9631a12473a1-kube-api-access-xtzzc\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:37:49.279363 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.279263 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/100fdf56-1424-45f3-96d1-9631a12473a1-istio-token\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:37:49.605805 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.605778 2576 generic.go:356] "Generic (PLEG): container finished" podID="100fdf56-1424-45f3-96d1-9631a12473a1" containerID="84c206362d5760716601976e765336c4efe84eb6850d631679cd4dcac5209c92" exitCode=0 Jul 17 18:37:49.606064 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.605841 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" Jul 17 18:37:49.606064 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.605858 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" event={"ID":"100fdf56-1424-45f3-96d1-9631a12473a1","Type":"ContainerDied","Data":"84c206362d5760716601976e765336c4efe84eb6850d631679cd4dcac5209c92"} Jul 17 18:37:49.606064 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.605932 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh" event={"ID":"100fdf56-1424-45f3-96d1-9631a12473a1","Type":"ContainerDied","Data":"1df1ce0bba183a7b4f21c2010fd7bd281d1816050f437cdeda8bd3c6ea927a92"} Jul 17 18:37:49.606064 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.605954 2576 scope.go:117] "RemoveContainer" containerID="84c206362d5760716601976e765336c4efe84eb6850d631679cd4dcac5209c92" Jul 17 18:37:49.614469 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.614451 2576 scope.go:117] "RemoveContainer" containerID="83c9e1c2e2e598017aacce51d9219873765fa5a66f95a5dd14811ab07378f5dd" Jul 17 18:37:49.621832 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.621812 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh"] Jul 17 18:37:49.623718 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.623703 2576 scope.go:117] "RemoveContainer" containerID="84c206362d5760716601976e765336c4efe84eb6850d631679cd4dcac5209c92" Jul 17 18:37:49.623961 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:37:49.623943 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84c206362d5760716601976e765336c4efe84eb6850d631679cd4dcac5209c92\": container with ID starting with 84c206362d5760716601976e765336c4efe84eb6850d631679cd4dcac5209c92 not found: ID does not exist" containerID="84c206362d5760716601976e765336c4efe84eb6850d631679cd4dcac5209c92" Jul 17 18:37:49.624035 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.623969 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84c206362d5760716601976e765336c4efe84eb6850d631679cd4dcac5209c92"} err="failed to get container status \"84c206362d5760716601976e765336c4efe84eb6850d631679cd4dcac5209c92\": rpc error: code = NotFound desc = could not find container \"84c206362d5760716601976e765336c4efe84eb6850d631679cd4dcac5209c92\": container with ID starting with 84c206362d5760716601976e765336c4efe84eb6850d631679cd4dcac5209c92 not found: ID does not exist" Jul 17 18:37:49.624035 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.624007 2576 scope.go:117] "RemoveContainer" containerID="83c9e1c2e2e598017aacce51d9219873765fa5a66f95a5dd14811ab07378f5dd" Jul 17 18:37:49.624236 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:37:49.624219 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83c9e1c2e2e598017aacce51d9219873765fa5a66f95a5dd14811ab07378f5dd\": container with ID starting with 83c9e1c2e2e598017aacce51d9219873765fa5a66f95a5dd14811ab07378f5dd not found: ID does not exist" containerID="83c9e1c2e2e598017aacce51d9219873765fa5a66f95a5dd14811ab07378f5dd" Jul 17 18:37:49.624309 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.624242 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83c9e1c2e2e598017aacce51d9219873765fa5a66f95a5dd14811ab07378f5dd"} err="failed to get container status \"83c9e1c2e2e598017aacce51d9219873765fa5a66f95a5dd14811ab07378f5dd\": rpc error: code = NotFound desc = could not find container \"83c9e1c2e2e598017aacce51d9219873765fa5a66f95a5dd14811ab07378f5dd\": container with ID starting with 83c9e1c2e2e598017aacce51d9219873765fa5a66f95a5dd14811ab07378f5dd not found: ID does not exist" Jul 17 18:37:49.626852 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:49.626833 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a8d2046a-openshift-default-5c8ff5687f-8sngh"] Jul 17 18:37:50.580156 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:50.580128 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:37:50.640926 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:50.640888 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:37:51.185793 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:51.185763 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="100fdf56-1424-45f3-96d1-9631a12473a1" path="/var/lib/kubelet/pods/100fdf56-1424-45f3-96d1-9631a12473a1/volumes" Jul 17 18:37:54.339279 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:37:54.339230 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:38:02.168419 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:02.167743 2576 patch_prober.go:28] interesting pod/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": read tcp 10.132.0.2:33650->10.132.0.41:15021: read: connection reset by peer" start-of-body= Jul 17 18:38:02.168419 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:02.167820 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" podUID="e7a2de1e-bb74-4df8-a958-f958880d5575" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": read tcp 10.132.0.2:33650->10.132.0.41:15021: read: connection reset by peer" Jul 17 18:38:02.675900 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:02.675876 2576 generic.go:356] "Generic (PLEG): container finished" podID="e7a2de1e-bb74-4df8-a958-f958880d5575" containerID="4a87e95592428cf8dfea9c1764717255f2f2654a8f7c5c8613fccec5205003dc" exitCode=0 Jul 17 18:38:02.676060 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:02.675916 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" event={"ID":"e7a2de1e-bb74-4df8-a958-f958880d5575","Type":"ContainerDied","Data":"4a87e95592428cf8dfea9c1764717255f2f2654a8f7c5c8613fccec5205003dc"} Jul 17 18:38:02.676257 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:02.676243 2576 scope.go:117] "RemoveContainer" containerID="4a87e95592428cf8dfea9c1764717255f2f2654a8f7c5c8613fccec5205003dc" Jul 17 18:38:02.677221 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:02.677188 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:38:02.677307 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:02.677277 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:38:02.677402 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:02.677316 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:38:03.682331 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:03.682294 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" event={"ID":"e7a2de1e-bb74-4df8-a958-f958880d5575","Type":"ContainerStarted","Data":"e7f9ab3d7c06f565c4da966f3cb52070f935233df0fe842f4b11d0256b8cb6ab"} Jul 17 18:38:03.758932 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:03.758899 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:38:03.759275 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:03.759248 2576 patch_prober.go:28] interesting pod/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 17 18:38:03.759407 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:03.759299 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" podUID="e7a2de1e-bb74-4df8-a958-f958880d5575" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 17 18:38:04.759880 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:04.759849 2576 patch_prober.go:28] interesting pod/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 17 18:38:04.760278 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:04.759898 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" podUID="e7a2de1e-bb74-4df8-a958-f958880d5575" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 17 18:38:05.759071 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:05.759039 2576 patch_prober.go:28] interesting pod/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 17 18:38:05.759248 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:05.759088 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" podUID="e7a2de1e-bb74-4df8-a958-f958880d5575" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 17 18:38:06.759273 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:06.759235 2576 patch_prober.go:28] interesting pod/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 17 18:38:06.759724 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:06.759314 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" podUID="e7a2de1e-bb74-4df8-a958-f958880d5575" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 17 18:38:07.762201 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:07.762134 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:38:07.762546 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:07.762503 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:38:07.763216 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:07.763196 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:38:31.191424 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:31.191394 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:38:50.325837 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:50.325804 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m"] Jul 17 18:38:50.326300 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:50.326030 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" podUID="e7a2de1e-bb74-4df8-a958-f958880d5575" containerName="istio-proxy" containerID="cri-o://e7f9ab3d7c06f565c4da966f3cb52070f935233df0fe842f4b11d0256b8cb6ab" gracePeriod=30 Jul 17 18:38:50.384301 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:50.384270 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:38:50.486247 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:50.486212 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:38:52.586235 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:52.586201 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:38:52.688829 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:52.688805 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:38:52.765943 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:52.765905 2576 patch_prober.go:28] interesting pod/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 17 18:38:52.766144 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:52.766006 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" podUID="e7a2de1e-bb74-4df8-a958-f958880d5575" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 17 18:38:55.576039 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.576017 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:38:55.712514 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.712487 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7a2de1e-bb74-4df8-a958-f958880d5575-istio-envoy\") pod \"e7a2de1e-bb74-4df8-a958-f958880d5575\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " Jul 17 18:38:55.712644 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.712522 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7a2de1e-bb74-4df8-a958-f958880d5575-credential-socket\") pod \"e7a2de1e-bb74-4df8-a958-f958880d5575\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " Jul 17 18:38:55.712644 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.712565 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7a2de1e-bb74-4df8-a958-f958880d5575-istio-data\") pod \"e7a2de1e-bb74-4df8-a958-f958880d5575\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " Jul 17 18:38:55.712644 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.712635 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7a2de1e-bb74-4df8-a958-f958880d5575-workload-certs\") pod \"e7a2de1e-bb74-4df8-a958-f958880d5575\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " Jul 17 18:38:55.712812 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.712664 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7a2de1e-bb74-4df8-a958-f958880d5575-istio-podinfo\") pod \"e7a2de1e-bb74-4df8-a958-f958880d5575\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " Jul 17 18:38:55.712812 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.712696 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7a2de1e-bb74-4df8-a958-f958880d5575-istio-token\") pod \"e7a2de1e-bb74-4df8-a958-f958880d5575\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " Jul 17 18:38:55.712812 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.712754 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7a2de1e-bb74-4df8-a958-f958880d5575-workload-socket\") pod \"e7a2de1e-bb74-4df8-a958-f958880d5575\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " Jul 17 18:38:55.712958 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.712884 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7a2de1e-bb74-4df8-a958-f958880d5575-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e7a2de1e-bb74-4df8-a958-f958880d5575" (UID: "e7a2de1e-bb74-4df8-a958-f958880d5575"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:38:55.713056 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.712959 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7a2de1e-bb74-4df8-a958-f958880d5575-istiod-ca-cert\") pod \"e7a2de1e-bb74-4df8-a958-f958880d5575\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " Jul 17 18:38:55.713056 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.713016 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hqdm\" (UniqueName: \"kubernetes.io/projected/e7a2de1e-bb74-4df8-a958-f958880d5575-kube-api-access-6hqdm\") pod \"e7a2de1e-bb74-4df8-a958-f958880d5575\" (UID: \"e7a2de1e-bb74-4df8-a958-f958880d5575\") " Jul 17 18:38:55.713056 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.713023 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7a2de1e-bb74-4df8-a958-f958880d5575-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e7a2de1e-bb74-4df8-a958-f958880d5575" (UID: "e7a2de1e-bb74-4df8-a958-f958880d5575"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:38:55.713375 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.713355 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7a2de1e-bb74-4df8-a958-f958880d5575-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e7a2de1e-bb74-4df8-a958-f958880d5575" (UID: "e7a2de1e-bb74-4df8-a958-f958880d5575"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:38:55.713587 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.713359 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7a2de1e-bb74-4df8-a958-f958880d5575-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e7a2de1e-bb74-4df8-a958-f958880d5575" (UID: "e7a2de1e-bb74-4df8-a958-f958880d5575"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:38:55.713661 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.713366 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7a2de1e-bb74-4df8-a958-f958880d5575-credential-socket\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:38:55.713749 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.713735 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7a2de1e-bb74-4df8-a958-f958880d5575-workload-certs\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:38:55.713825 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.713756 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7a2de1e-bb74-4df8-a958-f958880d5575-istio-data" (OuterVolumeSpecName: "istio-data") pod "e7a2de1e-bb74-4df8-a958-f958880d5575" (UID: "e7a2de1e-bb74-4df8-a958-f958880d5575"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:38:55.715397 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.715370 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7a2de1e-bb74-4df8-a958-f958880d5575-istio-token" (OuterVolumeSpecName: "istio-token") pod "e7a2de1e-bb74-4df8-a958-f958880d5575" (UID: "e7a2de1e-bb74-4df8-a958-f958880d5575"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:38:55.715569 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.715549 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7a2de1e-bb74-4df8-a958-f958880d5575-kube-api-access-6hqdm" (OuterVolumeSpecName: "kube-api-access-6hqdm") pod "e7a2de1e-bb74-4df8-a958-f958880d5575" (UID: "e7a2de1e-bb74-4df8-a958-f958880d5575"). InnerVolumeSpecName "kube-api-access-6hqdm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:38:55.715649 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.715633 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e7a2de1e-bb74-4df8-a958-f958880d5575-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e7a2de1e-bb74-4df8-a958-f958880d5575" (UID: "e7a2de1e-bb74-4df8-a958-f958880d5575"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 18:38:55.715754 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.715737 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7a2de1e-bb74-4df8-a958-f958880d5575-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e7a2de1e-bb74-4df8-a958-f958880d5575" (UID: "e7a2de1e-bb74-4df8-a958-f958880d5575"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:38:55.814455 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.814431 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7a2de1e-bb74-4df8-a958-f958880d5575-istio-podinfo\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:38:55.814455 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.814452 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7a2de1e-bb74-4df8-a958-f958880d5575-istio-token\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:38:55.814599 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.814466 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7a2de1e-bb74-4df8-a958-f958880d5575-workload-socket\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:38:55.814599 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.814502 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7a2de1e-bb74-4df8-a958-f958880d5575-istiod-ca-cert\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:38:55.814599 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.814516 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hqdm\" (UniqueName: \"kubernetes.io/projected/e7a2de1e-bb74-4df8-a958-f958880d5575-kube-api-access-6hqdm\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:38:55.814599 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.814529 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7a2de1e-bb74-4df8-a958-f958880d5575-istio-envoy\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:38:55.814599 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.814540 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7a2de1e-bb74-4df8-a958-f958880d5575-istio-data\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:38:55.914845 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.914791 2576 generic.go:356] "Generic (PLEG): container finished" podID="e7a2de1e-bb74-4df8-a958-f958880d5575" containerID="e7f9ab3d7c06f565c4da966f3cb52070f935233df0fe842f4b11d0256b8cb6ab" exitCode=0 Jul 17 18:38:55.914845 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.914840 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" Jul 17 18:38:55.914956 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.914840 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" event={"ID":"e7a2de1e-bb74-4df8-a958-f958880d5575","Type":"ContainerDied","Data":"e7f9ab3d7c06f565c4da966f3cb52070f935233df0fe842f4b11d0256b8cb6ab"} Jul 17 18:38:55.914956 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.914890 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m" event={"ID":"e7a2de1e-bb74-4df8-a958-f958880d5575","Type":"ContainerDied","Data":"5de3dd8f8cb65f17d919be134553d2c3fca60b521b09a46811442ec0cd95ccdb"} Jul 17 18:38:55.914956 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.914919 2576 scope.go:117] "RemoveContainer" containerID="e7f9ab3d7c06f565c4da966f3cb52070f935233df0fe842f4b11d0256b8cb6ab" Jul 17 18:38:55.923833 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.923817 2576 scope.go:117] "RemoveContainer" containerID="4a87e95592428cf8dfea9c1764717255f2f2654a8f7c5c8613fccec5205003dc" Jul 17 18:38:55.931151 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.931132 2576 scope.go:117] "RemoveContainer" containerID="e7f9ab3d7c06f565c4da966f3cb52070f935233df0fe842f4b11d0256b8cb6ab" Jul 17 18:38:55.931396 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:38:55.931379 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7f9ab3d7c06f565c4da966f3cb52070f935233df0fe842f4b11d0256b8cb6ab\": container with ID starting with e7f9ab3d7c06f565c4da966f3cb52070f935233df0fe842f4b11d0256b8cb6ab not found: ID does not exist" containerID="e7f9ab3d7c06f565c4da966f3cb52070f935233df0fe842f4b11d0256b8cb6ab" Jul 17 18:38:55.931448 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.931405 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7f9ab3d7c06f565c4da966f3cb52070f935233df0fe842f4b11d0256b8cb6ab"} err="failed to get container status \"e7f9ab3d7c06f565c4da966f3cb52070f935233df0fe842f4b11d0256b8cb6ab\": rpc error: code = NotFound desc = could not find container \"e7f9ab3d7c06f565c4da966f3cb52070f935233df0fe842f4b11d0256b8cb6ab\": container with ID starting with e7f9ab3d7c06f565c4da966f3cb52070f935233df0fe842f4b11d0256b8cb6ab not found: ID does not exist" Jul 17 18:38:55.931448 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.931421 2576 scope.go:117] "RemoveContainer" containerID="4a87e95592428cf8dfea9c1764717255f2f2654a8f7c5c8613fccec5205003dc" Jul 17 18:38:55.931622 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:38:55.931608 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a87e95592428cf8dfea9c1764717255f2f2654a8f7c5c8613fccec5205003dc\": container with ID starting with 4a87e95592428cf8dfea9c1764717255f2f2654a8f7c5c8613fccec5205003dc not found: ID does not exist" containerID="4a87e95592428cf8dfea9c1764717255f2f2654a8f7c5c8613fccec5205003dc" Jul 17 18:38:55.931658 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.931626 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a87e95592428cf8dfea9c1764717255f2f2654a8f7c5c8613fccec5205003dc"} err="failed to get container status \"4a87e95592428cf8dfea9c1764717255f2f2654a8f7c5c8613fccec5205003dc\": rpc error: code = NotFound desc = could not find container \"4a87e95592428cf8dfea9c1764717255f2f2654a8f7c5c8613fccec5205003dc\": container with ID starting with 4a87e95592428cf8dfea9c1764717255f2f2654a8f7c5c8613fccec5205003dc not found: ID does not exist" Jul 17 18:38:55.936380 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.936360 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m"] Jul 17 18:38:55.939824 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:55.939805 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-d37232e3-gw-openshift-default-7ccdf7d9dc-cmn5m"] Jul 17 18:38:56.103411 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:56.103388 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:38:56.528498 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:56.528471 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:38:56.665397 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:56.665374 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:38:57.185959 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:38:57.185929 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7a2de1e-bb74-4df8-a958-f958880d5575" path="/var/lib/kubelet/pods/e7a2de1e-bb74-4df8-a958-f958880d5575/volumes" Jul 17 18:39:02.117568 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.117541 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:39:02.218731 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.218701 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:39:02.256709 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.256676 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6"] Jul 17 18:39:02.257370 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.257310 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7a2de1e-bb74-4df8-a958-f958880d5575" containerName="istio-proxy" Jul 17 18:39:02.257370 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.257356 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7a2de1e-bb74-4df8-a958-f958880d5575" containerName="istio-proxy" Jul 17 18:39:02.257528 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.257386 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="100fdf56-1424-45f3-96d1-9631a12473a1" containerName="istio-proxy" Jul 17 18:39:02.257528 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.257402 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="100fdf56-1424-45f3-96d1-9631a12473a1" containerName="istio-proxy" Jul 17 18:39:02.257618 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.257604 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7a2de1e-bb74-4df8-a958-f958880d5575" containerName="istio-proxy" Jul 17 18:39:02.257654 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.257633 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="100fdf56-1424-45f3-96d1-9631a12473a1" containerName="istio-proxy" Jul 17 18:39:02.257654 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.257649 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="100fdf56-1424-45f3-96d1-9631a12473a1" containerName="istio-proxy" Jul 17 18:39:02.257717 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.257665 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7a2de1e-bb74-4df8-a958-f958880d5575" containerName="istio-proxy" Jul 17 18:39:02.261401 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.261381 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:02.263377 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.263360 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-9b0be972-openshift-default-dockercfg-bsc75\"" Jul 17 18:39:02.271841 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.271822 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6"] Jul 17 18:39:02.318580 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.318556 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:39:02.360929 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.360907 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2990376c-3a0e-4359-b285-9910197f9585-istio-podinfo\") pod \"e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:02.361050 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.360940 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2990376c-3a0e-4359-b285-9910197f9585-istio-token\") pod \"e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:02.361050 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.360965 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2990376c-3a0e-4359-b285-9910197f9585-istiod-ca-cert\") pod \"e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:02.361141 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.361042 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2990376c-3a0e-4359-b285-9910197f9585-istio-data\") pod \"e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:02.361141 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.361112 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86wqk\" (UniqueName: \"kubernetes.io/projected/2990376c-3a0e-4359-b285-9910197f9585-kube-api-access-86wqk\") pod \"e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:02.361141 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.361134 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2990376c-3a0e-4359-b285-9910197f9585-istio-envoy\") pod \"e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:02.361284 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.361166 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2990376c-3a0e-4359-b285-9910197f9585-credential-socket\") pod \"e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:02.361284 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.361242 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2990376c-3a0e-4359-b285-9910197f9585-workload-certs\") pod \"e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:02.361284 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.361271 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2990376c-3a0e-4359-b285-9910197f9585-workload-socket\") pod \"e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:02.461731 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.461650 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2990376c-3a0e-4359-b285-9910197f9585-credential-socket\") pod \"e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:02.461731 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.461713 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2990376c-3a0e-4359-b285-9910197f9585-workload-certs\") pod \"e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:02.461731 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.461736 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2990376c-3a0e-4359-b285-9910197f9585-workload-socket\") pod \"e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:02.462055 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.461760 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2990376c-3a0e-4359-b285-9910197f9585-istio-podinfo\") pod \"e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:02.462055 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.461777 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2990376c-3a0e-4359-b285-9910197f9585-istio-token\") pod \"e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:02.462055 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.461799 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2990376c-3a0e-4359-b285-9910197f9585-istiod-ca-cert\") pod \"e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:02.462055 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.461827 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2990376c-3a0e-4359-b285-9910197f9585-istio-data\") pod \"e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:02.462055 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.461908 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86wqk\" (UniqueName: \"kubernetes.io/projected/2990376c-3a0e-4359-b285-9910197f9585-kube-api-access-86wqk\") pod \"e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:02.462055 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.461929 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2990376c-3a0e-4359-b285-9910197f9585-istio-envoy\") pod \"e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:02.462055 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.462044 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2990376c-3a0e-4359-b285-9910197f9585-credential-socket\") pod \"e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:02.462404 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.462180 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2990376c-3a0e-4359-b285-9910197f9585-workload-certs\") pod \"e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:02.462404 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.462367 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2990376c-3a0e-4359-b285-9910197f9585-istio-data\") pod \"e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:02.462494 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.462404 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2990376c-3a0e-4359-b285-9910197f9585-workload-socket\") pod \"e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:02.462530 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.462508 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2990376c-3a0e-4359-b285-9910197f9585-istiod-ca-cert\") pod \"e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:02.463958 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.463940 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2990376c-3a0e-4359-b285-9910197f9585-istio-envoy\") pod \"e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:02.464116 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.464099 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2990376c-3a0e-4359-b285-9910197f9585-istio-podinfo\") pod \"e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:02.471867 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.471848 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2990376c-3a0e-4359-b285-9910197f9585-istio-token\") pod \"e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:02.474352 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.474327 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86wqk\" (UniqueName: \"kubernetes.io/projected/2990376c-3a0e-4359-b285-9910197f9585-kube-api-access-86wqk\") pod \"e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:02.575085 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.575063 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:02.703690 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.703666 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6"] Jul 17 18:39:02.705772 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:39:02.705744 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2990376c_3a0e_4359_b285_9910197f9585.slice/crio-049d23cb070221867a21623a49b3f797f549ce8f8452a337be95b534ee130f58 WatchSource:0}: Error finding container 049d23cb070221867a21623a49b3f797f549ce8f8452a337be95b534ee130f58: Status 404 returned error can't find the container with id 049d23cb070221867a21623a49b3f797f549ce8f8452a337be95b534ee130f58 Jul 17 18:39:02.707813 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.707782 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:39:02.707917 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.707853 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:39:02.707917 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.707896 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:39:02.946936 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.946903 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" event={"ID":"2990376c-3a0e-4359-b285-9910197f9585","Type":"ContainerStarted","Data":"57eed9201c240809e86a94a601d72fa9681428573d3ec90497170b0d0f81dc06"} Jul 17 18:39:02.947145 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.946963 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" event={"ID":"2990376c-3a0e-4359-b285-9910197f9585","Type":"ContainerStarted","Data":"049d23cb070221867a21623a49b3f797f549ce8f8452a337be95b534ee130f58"} Jul 17 18:39:02.965076 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:02.964959 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" podStartSLOduration=0.96494336 podStartE2EDuration="964.94336ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:39:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:39:02.964109933 +0000 UTC m=+1758.237721090" watchObservedRunningTime="2026-07-17 18:39:02.96494336 +0000 UTC m=+1758.238554502" Jul 17 18:39:03.479871 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:03.479812 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:39:03.556550 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:03.556523 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:39:03.575668 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:03.575640 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:03.580486 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:03.580460 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:03.647957 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:03.647935 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:39:03.951689 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:03.951658 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:39:03.952246 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:03.952223 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:03.953142 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:03.953125 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:04.322570 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:04.322546 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:39:04.900135 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:04.900097 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:39:06.164061 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:06.164029 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:39:15.001559 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:15.001529 2576 generic.go:356] "Generic (PLEG): container finished" podID="2990376c-3a0e-4359-b285-9910197f9585" containerID="57eed9201c240809e86a94a601d72fa9681428573d3ec90497170b0d0f81dc06" exitCode=0 Jul 17 18:39:15.001893 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:15.001565 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" event={"ID":"2990376c-3a0e-4359-b285-9910197f9585","Type":"ContainerDied","Data":"57eed9201c240809e86a94a601d72fa9681428573d3ec90497170b0d0f81dc06"} Jul 17 18:39:15.001893 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:15.001866 2576 scope.go:117] "RemoveContainer" containerID="57eed9201c240809e86a94a601d72fa9681428573d3ec90497170b0d0f81dc06" Jul 17 18:39:15.002766 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:15.002738 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:39:15.002824 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:15.002807 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:39:15.002858 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:15.002839 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:39:16.007847 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:16.007813 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" event={"ID":"2990376c-3a0e-4359-b285-9910197f9585","Type":"ContainerStarted","Data":"012e244be4af72719053e3bd16123ae0124d2c0e2b9441c3c78ae230c33613ba"} Jul 17 18:39:16.576193 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:16.576163 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:16.577367 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:16.577333 2576 patch_prober.go:28] interesting pod/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 17 18:39:16.577493 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:16.577397 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" podUID="2990376c-3a0e-4359-b285-9910197f9585" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 17 18:39:17.575329 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:17.575295 2576 patch_prober.go:28] interesting pod/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 17 18:39:17.575692 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:17.575345 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" podUID="2990376c-3a0e-4359-b285-9910197f9585" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 17 18:39:18.576335 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:18.576301 2576 patch_prober.go:28] interesting pod/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 17 18:39:18.576728 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:18.576365 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" podUID="2990376c-3a0e-4359-b285-9910197f9585" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 17 18:39:18.952157 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:18.952063 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:19.576083 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:19.576041 2576 patch_prober.go:28] interesting pod/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 17 18:39:19.576263 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:19.576116 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" podUID="2990376c-3a0e-4359-b285-9910197f9585" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 17 18:39:20.579543 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:20.579516 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:20.580504 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:20.580484 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:39:45.184342 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:45.184314 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nwqlr_c6017e7d-5ed2-4d7d-ba64-ba9ce933828f/console-operator/1.log" Jul 17 18:39:45.188856 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:45.188831 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nwqlr_c6017e7d-5ed2-4d7d-ba64-ba9ce933828f/console-operator/1.log" Jul 17 18:39:45.189937 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:45.189909 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6pqqj_a67c7573-deca-4960-b69f-5ad3bda075a8/ovn-acl-logging/0.log" Jul 17 18:39:45.194010 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:39:45.193972 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6pqqj_a67c7573-deca-4960-b69f-5ad3bda075a8/ovn-acl-logging/0.log" Jul 17 18:40:09.323585 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:09.323554 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:40:13.756156 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:13.756123 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:40:20.071386 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:20.071347 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:40:20.149380 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:20.149344 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:40:24.742677 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:24.742642 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6"] Jul 17 18:40:24.743116 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:24.742860 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" podUID="2990376c-3a0e-4359-b285-9910197f9585" containerName="istio-proxy" containerID="cri-o://012e244be4af72719053e3bd16123ae0124d2c0e2b9441c3c78ae230c33613ba" gracePeriod=30 Jul 17 18:40:24.768713 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:24.768636 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:40:25.050100 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.050071 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2"] Jul 17 18:40:25.050437 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.050426 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7a2de1e-bb74-4df8-a958-f958880d5575" containerName="istio-proxy" Jul 17 18:40:25.050481 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.050439 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7a2de1e-bb74-4df8-a958-f958880d5575" containerName="istio-proxy" Jul 17 18:40:25.050481 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.050450 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="100fdf56-1424-45f3-96d1-9631a12473a1" containerName="istio-proxy" Jul 17 18:40:25.050481 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.050456 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="100fdf56-1424-45f3-96d1-9631a12473a1" containerName="istio-proxy" Jul 17 18:40:25.053596 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.053576 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:25.055873 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.055688 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-1b52ad55-openshift-default-dockercfg-jlg5f\"" Jul 17 18:40:25.073164 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.073140 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2"] Jul 17 18:40:25.095923 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.095899 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:40:25.123898 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.123871 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-istiod-ca-cert\") pod \"e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:25.124002 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.123903 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-istio-podinfo\") pod \"e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:25.124002 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.123920 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-istio-token\") pod \"e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:25.124002 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.123939 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-workload-certs\") pod \"e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:25.124122 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.124030 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-workload-socket\") pod \"e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:25.124122 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.124060 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-istio-data\") pod \"e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:25.124122 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.124092 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvj9p\" (UniqueName: \"kubernetes.io/projected/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-kube-api-access-lvj9p\") pod \"e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:25.124229 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.124171 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-istio-envoy\") pod \"e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:25.124229 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.124198 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-credential-socket\") pod \"e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:25.225337 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.225308 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-istio-envoy\") pod \"e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:25.225521 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.225348 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-credential-socket\") pod \"e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:25.225521 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.225399 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-istiod-ca-cert\") pod \"e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:25.225521 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.225419 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-istio-podinfo\") pod \"e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:25.225521 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.225434 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-istio-token\") pod \"e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:25.225521 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.225457 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-workload-certs\") pod \"e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:25.225521 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.225511 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-workload-socket\") pod \"e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:25.225847 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.225617 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-istio-data\") pod \"e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:25.225847 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.225660 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvj9p\" (UniqueName: \"kubernetes.io/projected/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-kube-api-access-lvj9p\") pod \"e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:25.225952 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.225864 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-credential-socket\") pod \"e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:25.225952 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.225865 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-workload-socket\") pod \"e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:25.225952 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.225926 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-workload-certs\") pod \"e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:25.226137 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.226074 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-istio-data\") pod \"e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:25.226233 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.226208 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-istiod-ca-cert\") pod \"e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:25.227859 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.227841 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-istio-envoy\") pod \"e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:25.227859 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.227853 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-istio-podinfo\") pod \"e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:25.232892 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.232874 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-istio-token\") pod \"e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:25.233218 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.233199 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvj9p\" (UniqueName: \"kubernetes.io/projected/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-kube-api-access-lvj9p\") pod \"e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:25.366515 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.366465 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:25.500109 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.500086 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2"] Jul 17 18:40:25.502362 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:40:25.502328 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaf4dcdc_4a89_46ae_bdbf_287d88c88dc9.slice/crio-b7bfb1b8aa99dcd1ccd05d9c6f261c32a5f6898b95a2a27df0f4dc2288fc2295 WatchSource:0}: Error finding container b7bfb1b8aa99dcd1ccd05d9c6f261c32a5f6898b95a2a27df0f4dc2288fc2295: Status 404 returned error can't find the container with id b7bfb1b8aa99dcd1ccd05d9c6f261c32a5f6898b95a2a27df0f4dc2288fc2295 Jul 17 18:40:25.504434 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.504405 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:40:25.504535 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.504466 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:40:25.504535 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:25.504492 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:40:26.284116 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:26.284080 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:40:26.330391 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:26.330356 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" event={"ID":"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9","Type":"ContainerStarted","Data":"66d56451a89afd8430abafaa053b596eb8145420814a4a48a879953a919d0b5f"} Jul 17 18:40:26.330558 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:26.330447 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" event={"ID":"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9","Type":"ContainerStarted","Data":"b7bfb1b8aa99dcd1ccd05d9c6f261c32a5f6898b95a2a27df0f4dc2288fc2295"} Jul 17 18:40:26.356763 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:26.356718 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" podStartSLOduration=1.356706111 podStartE2EDuration="1.356706111s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:40:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:40:26.354563846 +0000 UTC m=+1841.628174988" watchObservedRunningTime="2026-07-17 18:40:26.356706111 +0000 UTC m=+1841.630317252" Jul 17 18:40:26.360161 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:26.360139 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:40:26.367031 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:26.367010 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:26.372409 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:26.372391 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:26.492044 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:26.492015 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:40:27.061891 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:27.061859 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:40:27.156240 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:27.156216 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:40:27.294879 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:27.294817 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:40:27.335171 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:27.335098 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:27.336064 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:27.336043 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:29.788016 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:29.787992 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:40:29.986203 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:29.986181 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:40:30.070253 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.070230 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2990376c-3a0e-4359-b285-9910197f9585-credential-socket\") pod \"2990376c-3a0e-4359-b285-9910197f9585\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " Jul 17 18:40:30.070387 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.070274 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2990376c-3a0e-4359-b285-9910197f9585-istio-podinfo\") pod \"2990376c-3a0e-4359-b285-9910197f9585\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " Jul 17 18:40:30.070387 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.070353 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2990376c-3a0e-4359-b285-9910197f9585-istiod-ca-cert\") pod \"2990376c-3a0e-4359-b285-9910197f9585\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " Jul 17 18:40:30.070501 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.070407 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86wqk\" (UniqueName: \"kubernetes.io/projected/2990376c-3a0e-4359-b285-9910197f9585-kube-api-access-86wqk\") pod \"2990376c-3a0e-4359-b285-9910197f9585\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " Jul 17 18:40:30.070501 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.070445 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2990376c-3a0e-4359-b285-9910197f9585-istio-data\") pod \"2990376c-3a0e-4359-b285-9910197f9585\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " Jul 17 18:40:30.070501 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.070472 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2990376c-3a0e-4359-b285-9910197f9585-istio-token\") pod \"2990376c-3a0e-4359-b285-9910197f9585\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " Jul 17 18:40:30.070501 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.070473 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2990376c-3a0e-4359-b285-9910197f9585-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2990376c-3a0e-4359-b285-9910197f9585" (UID: "2990376c-3a0e-4359-b285-9910197f9585"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:40:30.070699 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.070513 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2990376c-3a0e-4359-b285-9910197f9585-workload-socket\") pod \"2990376c-3a0e-4359-b285-9910197f9585\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " Jul 17 18:40:30.070699 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.070559 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2990376c-3a0e-4359-b285-9910197f9585-istio-envoy\") pod \"2990376c-3a0e-4359-b285-9910197f9585\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " Jul 17 18:40:30.070699 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.070593 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2990376c-3a0e-4359-b285-9910197f9585-workload-certs\") pod \"2990376c-3a0e-4359-b285-9910197f9585\" (UID: \"2990376c-3a0e-4359-b285-9910197f9585\") " Jul 17 18:40:30.070829 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.070806 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2990376c-3a0e-4359-b285-9910197f9585-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2990376c-3a0e-4359-b285-9910197f9585" (UID: "2990376c-3a0e-4359-b285-9910197f9585"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:40:30.070883 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.070834 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2990376c-3a0e-4359-b285-9910197f9585-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2990376c-3a0e-4359-b285-9910197f9585" (UID: "2990376c-3a0e-4359-b285-9910197f9585"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:40:30.070942 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.070932 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2990376c-3a0e-4359-b285-9910197f9585-istiod-ca-cert\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:40:30.071014 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.070951 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2990376c-3a0e-4359-b285-9910197f9585-workload-socket\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:40:30.071014 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.071001 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2990376c-3a0e-4359-b285-9910197f9585-credential-socket\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:40:30.071117 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.071054 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2990376c-3a0e-4359-b285-9910197f9585-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2990376c-3a0e-4359-b285-9910197f9585" (UID: "2990376c-3a0e-4359-b285-9910197f9585"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:40:30.071245 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.071219 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2990376c-3a0e-4359-b285-9910197f9585-istio-data" (OuterVolumeSpecName: "istio-data") pod "2990376c-3a0e-4359-b285-9910197f9585" (UID: "2990376c-3a0e-4359-b285-9910197f9585"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:40:30.073544 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.073393 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2990376c-3a0e-4359-b285-9910197f9585-istio-token" (OuterVolumeSpecName: "istio-token") pod "2990376c-3a0e-4359-b285-9910197f9585" (UID: "2990376c-3a0e-4359-b285-9910197f9585"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:40:30.073544 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.073479 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2990376c-3a0e-4359-b285-9910197f9585-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2990376c-3a0e-4359-b285-9910197f9585" (UID: "2990376c-3a0e-4359-b285-9910197f9585"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 18:40:30.073544 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.073482 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2990376c-3a0e-4359-b285-9910197f9585-kube-api-access-86wqk" (OuterVolumeSpecName: "kube-api-access-86wqk") pod "2990376c-3a0e-4359-b285-9910197f9585" (UID: "2990376c-3a0e-4359-b285-9910197f9585"). InnerVolumeSpecName "kube-api-access-86wqk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:40:30.073544 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.073504 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2990376c-3a0e-4359-b285-9910197f9585-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2990376c-3a0e-4359-b285-9910197f9585" (UID: "2990376c-3a0e-4359-b285-9910197f9585"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:40:30.171775 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.171751 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2990376c-3a0e-4359-b285-9910197f9585-workload-certs\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:40:30.171775 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.171771 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2990376c-3a0e-4359-b285-9910197f9585-istio-podinfo\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:40:30.171775 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.171779 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86wqk\" (UniqueName: \"kubernetes.io/projected/2990376c-3a0e-4359-b285-9910197f9585-kube-api-access-86wqk\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:40:30.171935 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.171788 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2990376c-3a0e-4359-b285-9910197f9585-istio-data\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:40:30.171935 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.171796 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2990376c-3a0e-4359-b285-9910197f9585-istio-token\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:40:30.171935 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.171803 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2990376c-3a0e-4359-b285-9910197f9585-istio-envoy\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:40:30.349605 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.349542 2576 generic.go:356] "Generic (PLEG): container finished" podID="2990376c-3a0e-4359-b285-9910197f9585" containerID="012e244be4af72719053e3bd16123ae0124d2c0e2b9441c3c78ae230c33613ba" exitCode=0 Jul 17 18:40:30.349605 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.349590 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" Jul 17 18:40:30.349761 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.349625 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" event={"ID":"2990376c-3a0e-4359-b285-9910197f9585","Type":"ContainerDied","Data":"012e244be4af72719053e3bd16123ae0124d2c0e2b9441c3c78ae230c33613ba"} Jul 17 18:40:30.349761 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.349672 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6" event={"ID":"2990376c-3a0e-4359-b285-9910197f9585","Type":"ContainerDied","Data":"049d23cb070221867a21623a49b3f797f549ce8f8452a337be95b534ee130f58"} Jul 17 18:40:30.349761 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.349694 2576 scope.go:117] "RemoveContainer" containerID="012e244be4af72719053e3bd16123ae0124d2c0e2b9441c3c78ae230c33613ba" Jul 17 18:40:30.359590 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.359554 2576 scope.go:117] "RemoveContainer" containerID="57eed9201c240809e86a94a601d72fa9681428573d3ec90497170b0d0f81dc06" Jul 17 18:40:30.367293 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.367281 2576 scope.go:117] "RemoveContainer" containerID="012e244be4af72719053e3bd16123ae0124d2c0e2b9441c3c78ae230c33613ba" Jul 17 18:40:30.367510 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:40:30.367492 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"012e244be4af72719053e3bd16123ae0124d2c0e2b9441c3c78ae230c33613ba\": container with ID starting with 012e244be4af72719053e3bd16123ae0124d2c0e2b9441c3c78ae230c33613ba not found: ID does not exist" containerID="012e244be4af72719053e3bd16123ae0124d2c0e2b9441c3c78ae230c33613ba" Jul 17 18:40:30.367561 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.367517 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"012e244be4af72719053e3bd16123ae0124d2c0e2b9441c3c78ae230c33613ba"} err="failed to get container status \"012e244be4af72719053e3bd16123ae0124d2c0e2b9441c3c78ae230c33613ba\": rpc error: code = NotFound desc = could not find container \"012e244be4af72719053e3bd16123ae0124d2c0e2b9441c3c78ae230c33613ba\": container with ID starting with 012e244be4af72719053e3bd16123ae0124d2c0e2b9441c3c78ae230c33613ba not found: ID does not exist" Jul 17 18:40:30.367561 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.367533 2576 scope.go:117] "RemoveContainer" containerID="57eed9201c240809e86a94a601d72fa9681428573d3ec90497170b0d0f81dc06" Jul 17 18:40:30.367754 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:40:30.367737 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57eed9201c240809e86a94a601d72fa9681428573d3ec90497170b0d0f81dc06\": container with ID starting with 57eed9201c240809e86a94a601d72fa9681428573d3ec90497170b0d0f81dc06 not found: ID does not exist" containerID="57eed9201c240809e86a94a601d72fa9681428573d3ec90497170b0d0f81dc06" Jul 17 18:40:30.367793 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.367760 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57eed9201c240809e86a94a601d72fa9681428573d3ec90497170b0d0f81dc06"} err="failed to get container status \"57eed9201c240809e86a94a601d72fa9681428573d3ec90497170b0d0f81dc06\": rpc error: code = NotFound desc = could not find container \"57eed9201c240809e86a94a601d72fa9681428573d3ec90497170b0d0f81dc06\": container with ID starting with 57eed9201c240809e86a94a601d72fa9681428573d3ec90497170b0d0f81dc06 not found: ID does not exist" Jul 17 18:40:30.375626 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.375606 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6"] Jul 17 18:40:30.387111 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:30.387088 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-9b0be972-openshift-default-5cd6f5f55f-gbzb6"] Jul 17 18:40:31.068781 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:31.068748 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:40:31.190179 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:31.188537 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2990376c-3a0e-4359-b285-9910197f9585" path="/var/lib/kubelet/pods/2990376c-3a0e-4359-b285-9910197f9585/volumes" Jul 17 18:40:31.256076 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:31.256044 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:40:31.355541 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:31.355449 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:40:34.466987 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:34.466957 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:40:42.336671 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:42.336641 2576 patch_prober.go:28] interesting pod/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 17 18:40:42.337079 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:42.336699 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" podUID="baf4dcdc-4a89-46ae-bdbf-287d88c88dc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 17 18:40:42.410411 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:42.410356 2576 generic.go:356] "Generic (PLEG): container finished" podID="baf4dcdc-4a89-46ae-bdbf-287d88c88dc9" containerID="66d56451a89afd8430abafaa053b596eb8145420814a4a48a879953a919d0b5f" exitCode=0 Jul 17 18:40:42.410501 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:42.410431 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" event={"ID":"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9","Type":"ContainerDied","Data":"66d56451a89afd8430abafaa053b596eb8145420814a4a48a879953a919d0b5f"} Jul 17 18:40:42.410742 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:42.410728 2576 scope.go:117] "RemoveContainer" containerID="66d56451a89afd8430abafaa053b596eb8145420814a4a48a879953a919d0b5f" Jul 17 18:40:42.411575 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:42.411551 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:40:42.411627 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:42.411616 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:40:42.411661 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:42.411649 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:40:43.416368 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:43.416338 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" event={"ID":"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9","Type":"ContainerStarted","Data":"e2c8246992fc3dd1d127f3f3323162826a9f045f9af13de84bbc71ca675f39f2"} Jul 17 18:40:44.366730 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:44.366704 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:44.366904 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:44.366821 2576 patch_prober.go:28] interesting pod/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 17 18:40:44.366904 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:44.366861 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" podUID="baf4dcdc-4a89-46ae-bdbf-287d88c88dc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 17 18:40:45.367186 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:45.367147 2576 patch_prober.go:28] interesting pod/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 17 18:40:45.367558 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:45.367207 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" podUID="baf4dcdc-4a89-46ae-bdbf-287d88c88dc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 17 18:40:46.367735 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:46.367698 2576 patch_prober.go:28] interesting pod/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 17 18:40:46.368205 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:46.367761 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" podUID="baf4dcdc-4a89-46ae-bdbf-287d88c88dc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 17 18:40:47.367287 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:47.367248 2576 patch_prober.go:28] interesting pod/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 17 18:40:47.367460 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:47.367315 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" podUID="baf4dcdc-4a89-46ae-bdbf-287d88c88dc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 17 18:40:48.367090 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:48.367056 2576 patch_prober.go:28] interesting pod/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 17 18:40:48.367465 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:48.367124 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" podUID="baf4dcdc-4a89-46ae-bdbf-287d88c88dc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 17 18:40:49.370562 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:49.370533 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:49.370931 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:49.370785 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:40:49.371427 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:40:49.371411 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:41:41.111647 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:41:41.111614 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:41:45.724601 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:41:45.724571 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:41:51.600017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:41:51.599971 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:41:51.668023 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:41:51.667991 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:41:55.905688 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:41:55.905656 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2"] Jul 17 18:41:55.906079 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:41:55.905833 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" podUID="baf4dcdc-4a89-46ae-bdbf-287d88c88dc9" containerName="istio-proxy" containerID="cri-o://e2c8246992fc3dd1d127f3f3323162826a9f045f9af13de84bbc71ca675f39f2" gracePeriod=30 Jul 17 18:41:55.938571 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:41:55.938546 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:41:56.554551 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:41:56.554522 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:41:56.649259 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:41:56.649229 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:41:56.748011 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:41:56.747970 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:41:58.343542 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:41:58.343515 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:42:01.161154 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.161130 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:42:01.298366 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.298332 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-istio-data\") pod \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " Jul 17 18:42:01.298366 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.298370 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-istiod-ca-cert\") pod \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " Jul 17 18:42:01.298595 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.298398 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-istio-envoy\") pod \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " Jul 17 18:42:01.298595 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.298434 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvj9p\" (UniqueName: \"kubernetes.io/projected/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-kube-api-access-lvj9p\") pod \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " Jul 17 18:42:01.298595 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.298464 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-istio-podinfo\") pod \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " Jul 17 18:42:01.298595 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.298525 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-workload-socket\") pod \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " Jul 17 18:42:01.298799 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.298740 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "baf4dcdc-4a89-46ae-bdbf-287d88c88dc9" (UID: "baf4dcdc-4a89-46ae-bdbf-287d88c88dc9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:42:01.298799 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.298771 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-istio-token\") pod \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " Jul 17 18:42:01.298901 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.298770 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "baf4dcdc-4a89-46ae-bdbf-287d88c88dc9" (UID: "baf4dcdc-4a89-46ae-bdbf-287d88c88dc9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:42:01.298901 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.298837 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-workload-certs\") pod \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " Jul 17 18:42:01.298901 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.298869 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-credential-socket\") pod \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\" (UID: \"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9\") " Jul 17 18:42:01.299080 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.299025 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "baf4dcdc-4a89-46ae-bdbf-287d88c88dc9" (UID: "baf4dcdc-4a89-46ae-bdbf-287d88c88dc9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:42:01.299153 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.299130 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-istio-data" (OuterVolumeSpecName: "istio-data") pod "baf4dcdc-4a89-46ae-bdbf-287d88c88dc9" (UID: "baf4dcdc-4a89-46ae-bdbf-287d88c88dc9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:42:01.299250 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.299228 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "baf4dcdc-4a89-46ae-bdbf-287d88c88dc9" (UID: "baf4dcdc-4a89-46ae-bdbf-287d88c88dc9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:42:01.299414 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.299265 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-workload-socket\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:42:01.299523 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.299424 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-workload-certs\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:42:01.299523 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.299442 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-istiod-ca-cert\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:42:01.301003 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.300950 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-istio-token" (OuterVolumeSpecName: "istio-token") pod "baf4dcdc-4a89-46ae-bdbf-287d88c88dc9" (UID: "baf4dcdc-4a89-46ae-bdbf-287d88c88dc9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:42:01.301107 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.301078 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "baf4dcdc-4a89-46ae-bdbf-287d88c88dc9" (UID: "baf4dcdc-4a89-46ae-bdbf-287d88c88dc9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:42:01.301107 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.301082 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "baf4dcdc-4a89-46ae-bdbf-287d88c88dc9" (UID: "baf4dcdc-4a89-46ae-bdbf-287d88c88dc9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 18:42:01.301217 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.301126 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-kube-api-access-lvj9p" (OuterVolumeSpecName: "kube-api-access-lvj9p") pod "baf4dcdc-4a89-46ae-bdbf-287d88c88dc9" (UID: "baf4dcdc-4a89-46ae-bdbf-287d88c88dc9"). InnerVolumeSpecName "kube-api-access-lvj9p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:42:01.400017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.399971 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-istio-data\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:42:01.400017 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.400013 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-istio-envoy\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:42:01.400186 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.400023 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvj9p\" (UniqueName: \"kubernetes.io/projected/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-kube-api-access-lvj9p\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:42:01.400186 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.400032 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-istio-podinfo\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:42:01.400186 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.400040 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-istio-token\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:42:01.400186 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.400047 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9-credential-socket\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:42:01.766820 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.766795 2576 generic.go:356] "Generic (PLEG): container finished" podID="baf4dcdc-4a89-46ae-bdbf-287d88c88dc9" containerID="e2c8246992fc3dd1d127f3f3323162826a9f045f9af13de84bbc71ca675f39f2" exitCode=0 Jul 17 18:42:01.766965 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.766840 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" Jul 17 18:42:01.766965 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.766882 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" event={"ID":"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9","Type":"ContainerDied","Data":"e2c8246992fc3dd1d127f3f3323162826a9f045f9af13de84bbc71ca675f39f2"} Jul 17 18:42:01.766965 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.766929 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2" event={"ID":"baf4dcdc-4a89-46ae-bdbf-287d88c88dc9","Type":"ContainerDied","Data":"b7bfb1b8aa99dcd1ccd05d9c6f261c32a5f6898b95a2a27df0f4dc2288fc2295"} Jul 17 18:42:01.766965 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.766950 2576 scope.go:117] "RemoveContainer" containerID="e2c8246992fc3dd1d127f3f3323162826a9f045f9af13de84bbc71ca675f39f2" Jul 17 18:42:01.775734 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.775714 2576 scope.go:117] "RemoveContainer" containerID="66d56451a89afd8430abafaa053b596eb8145420814a4a48a879953a919d0b5f" Jul 17 18:42:01.783533 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.783517 2576 scope.go:117] "RemoveContainer" containerID="e2c8246992fc3dd1d127f3f3323162826a9f045f9af13de84bbc71ca675f39f2" Jul 17 18:42:01.783755 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:42:01.783737 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2c8246992fc3dd1d127f3f3323162826a9f045f9af13de84bbc71ca675f39f2\": container with ID starting with e2c8246992fc3dd1d127f3f3323162826a9f045f9af13de84bbc71ca675f39f2 not found: ID does not exist" containerID="e2c8246992fc3dd1d127f3f3323162826a9f045f9af13de84bbc71ca675f39f2" Jul 17 18:42:01.783798 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.783761 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2c8246992fc3dd1d127f3f3323162826a9f045f9af13de84bbc71ca675f39f2"} err="failed to get container status \"e2c8246992fc3dd1d127f3f3323162826a9f045f9af13de84bbc71ca675f39f2\": rpc error: code = NotFound desc = could not find container \"e2c8246992fc3dd1d127f3f3323162826a9f045f9af13de84bbc71ca675f39f2\": container with ID starting with e2c8246992fc3dd1d127f3f3323162826a9f045f9af13de84bbc71ca675f39f2 not found: ID does not exist" Jul 17 18:42:01.783798 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.783776 2576 scope.go:117] "RemoveContainer" containerID="66d56451a89afd8430abafaa053b596eb8145420814a4a48a879953a919d0b5f" Jul 17 18:42:01.783957 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:42:01.783940 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66d56451a89afd8430abafaa053b596eb8145420814a4a48a879953a919d0b5f\": container with ID starting with 66d56451a89afd8430abafaa053b596eb8145420814a4a48a879953a919d0b5f not found: ID does not exist" containerID="66d56451a89afd8430abafaa053b596eb8145420814a4a48a879953a919d0b5f" Jul 17 18:42:01.784024 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.783961 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66d56451a89afd8430abafaa053b596eb8145420814a4a48a879953a919d0b5f"} err="failed to get container status \"66d56451a89afd8430abafaa053b596eb8145420814a4a48a879953a919d0b5f\": rpc error: code = NotFound desc = could not find container \"66d56451a89afd8430abafaa053b596eb8145420814a4a48a879953a919d0b5f\": container with ID starting with 66d56451a89afd8430abafaa053b596eb8145420814a4a48a879953a919d0b5f not found: ID does not exist" Jul 17 18:42:01.789873 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.789851 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2"] Jul 17 18:42:01.794867 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:01.794848 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-1b52ad55-openshift-default-78c47799cf-bsps2"] Jul 17 18:42:02.445659 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:02.445635 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:42:03.186768 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:03.186734 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="baf4dcdc-4a89-46ae-bdbf-287d88c88dc9" path="/var/lib/kubelet/pods/baf4dcdc-4a89-46ae-bdbf-287d88c88dc9/volumes" Jul 17 18:42:04.639882 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:04.639853 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:42:04.710668 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:04.710643 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:42:04.805481 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:04.805463 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:42:05.063587 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:05.063563 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:42:05.801031 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:05.801003 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:42:05.919774 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:05.919748 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:42:06.026516 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:06.026479 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:42:06.415855 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:06.415833 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:42:32.437481 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:32.437445 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:42:38.880220 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:38.880193 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:42:38.996615 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:38.996590 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:42:39.104277 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:39.104251 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:42:54.959015 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:42:54.958928 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:00.875161 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:00.875132 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:01.044920 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:01.044889 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:01.153009 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:01.152912 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:11.609502 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:11.609462 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:12.417039 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:12.417009 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:18.435396 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:18.435361 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:18.688514 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:18.688422 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:18.796686 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:18.796660 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:19.564300 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:19.564254 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:19.662060 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:19.662029 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:19.851398 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:19.851319 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:21.421704 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:21.421675 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:21.928761 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:21.928724 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:27.490930 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:27.490888 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:27.567105 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:27.567070 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:28.203561 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:28.203531 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:34.320213 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:34.320185 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:34.389777 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:34.389749 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:34.499044 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:34.499022 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:34.813559 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:34.813533 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd"] Jul 17 18:43:34.813918 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:34.813904 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baf4dcdc-4a89-46ae-bdbf-287d88c88dc9" containerName="istio-proxy" Jul 17 18:43:34.814041 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:34.813921 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="baf4dcdc-4a89-46ae-bdbf-287d88c88dc9" containerName="istio-proxy" Jul 17 18:43:34.814041 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:34.813932 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2990376c-3a0e-4359-b285-9910197f9585" containerName="istio-proxy" Jul 17 18:43:34.814041 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:34.813937 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2990376c-3a0e-4359-b285-9910197f9585" containerName="istio-proxy" Jul 17 18:43:34.814041 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:34.813945 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baf4dcdc-4a89-46ae-bdbf-287d88c88dc9" containerName="istio-proxy" Jul 17 18:43:34.814041 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:34.813951 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="baf4dcdc-4a89-46ae-bdbf-287d88c88dc9" containerName="istio-proxy" Jul 17 18:43:34.814041 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:34.814031 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2990376c-3a0e-4359-b285-9910197f9585" containerName="istio-proxy" Jul 17 18:43:34.814041 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:34.814040 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="baf4dcdc-4a89-46ae-bdbf-287d88c88dc9" containerName="istio-proxy" Jul 17 18:43:34.814041 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:34.814047 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="baf4dcdc-4a89-46ae-bdbf-287d88c88dc9" containerName="istio-proxy" Jul 17 18:43:34.814372 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:34.814054 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2990376c-3a0e-4359-b285-9910197f9585" containerName="istio-proxy" Jul 17 18:43:34.817008 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:34.816971 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:34.820731 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:34.820714 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-ba643e57-openshift-default-dockercfg-2k8sj\"" Jul 17 18:43:34.847213 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:34.847196 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd"] Jul 17 18:43:34.868375 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:34.868352 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:34.917774 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:34.917744 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1446cb13-fd51-4717-b05a-df00a632468b-istio-data\") pod \"e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:34.917914 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:34.917793 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1446cb13-fd51-4717-b05a-df00a632468b-credential-socket\") pod \"e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:34.917914 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:34.917846 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1446cb13-fd51-4717-b05a-df00a632468b-istiod-ca-cert\") pod \"e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:34.917914 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:34.917875 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1446cb13-fd51-4717-b05a-df00a632468b-istio-podinfo\") pod \"e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:34.918079 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:34.917922 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1446cb13-fd51-4717-b05a-df00a632468b-istio-envoy\") pod \"e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:34.918079 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:34.918056 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4rmt\" (UniqueName: \"kubernetes.io/projected/1446cb13-fd51-4717-b05a-df00a632468b-kube-api-access-b4rmt\") pod \"e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:34.918144 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:34.918095 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1446cb13-fd51-4717-b05a-df00a632468b-workload-certs\") pod \"e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:34.918144 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:34.918122 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1446cb13-fd51-4717-b05a-df00a632468b-istio-token\") pod \"e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:34.918248 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:34.918197 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1446cb13-fd51-4717-b05a-df00a632468b-workload-socket\") pod \"e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:35.012125 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:35.012095 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:35.019223 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:35.019198 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1446cb13-fd51-4717-b05a-df00a632468b-workload-socket\") pod \"e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:35.019351 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:35.019235 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1446cb13-fd51-4717-b05a-df00a632468b-istio-data\") pod \"e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:35.019351 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:35.019257 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1446cb13-fd51-4717-b05a-df00a632468b-credential-socket\") pod \"e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:35.019351 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:35.019277 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1446cb13-fd51-4717-b05a-df00a632468b-istiod-ca-cert\") pod \"e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:35.019351 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:35.019296 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1446cb13-fd51-4717-b05a-df00a632468b-istio-podinfo\") pod \"e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:35.019351 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:35.019325 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1446cb13-fd51-4717-b05a-df00a632468b-istio-envoy\") pod \"e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:35.019604 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:35.019384 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4rmt\" (UniqueName: \"kubernetes.io/projected/1446cb13-fd51-4717-b05a-df00a632468b-kube-api-access-b4rmt\") pod \"e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:35.019604 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:35.019401 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1446cb13-fd51-4717-b05a-df00a632468b-workload-certs\") pod \"e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:35.019604 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:35.019419 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1446cb13-fd51-4717-b05a-df00a632468b-istio-token\") pod \"e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:35.019774 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:35.019632 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1446cb13-fd51-4717-b05a-df00a632468b-workload-socket\") pod \"e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:35.019774 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:35.019697 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1446cb13-fd51-4717-b05a-df00a632468b-istio-data\") pod \"e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:35.019893 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:35.019861 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1446cb13-fd51-4717-b05a-df00a632468b-workload-certs\") pod \"e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:35.019969 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:35.019947 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1446cb13-fd51-4717-b05a-df00a632468b-credential-socket\") pod \"e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:35.020059 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:35.020003 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1446cb13-fd51-4717-b05a-df00a632468b-istiod-ca-cert\") pod \"e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:35.021593 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:35.021574 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1446cb13-fd51-4717-b05a-df00a632468b-istio-envoy\") pod \"e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:35.021717 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:35.021700 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1446cb13-fd51-4717-b05a-df00a632468b-istio-podinfo\") pod \"e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:35.027006 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:35.026968 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1446cb13-fd51-4717-b05a-df00a632468b-istio-token\") pod \"e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:35.027250 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:35.027232 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4rmt\" (UniqueName: \"kubernetes.io/projected/1446cb13-fd51-4717-b05a-df00a632468b-kube-api-access-b4rmt\") pod \"e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:35.127228 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:35.127172 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:35.262750 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:35.262722 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd"] Jul 17 18:43:35.264528 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:43:35.264505 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1446cb13_fd51_4717_b05a_df00a632468b.slice/crio-d3ba0a69663ab265f81c27c918e5f10b06eb63a9123f0488365ea1ab1cda4ade WatchSource:0}: Error finding container d3ba0a69663ab265f81c27c918e5f10b06eb63a9123f0488365ea1ab1cda4ade: Status 404 returned error can't find the container with id d3ba0a69663ab265f81c27c918e5f10b06eb63a9123f0488365ea1ab1cda4ade Jul 17 18:43:35.266627 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:35.266590 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:43:35.266701 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:35.266660 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:43:35.266701 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:35.266692 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:43:36.179101 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:36.179064 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" event={"ID":"1446cb13-fd51-4717-b05a-df00a632468b","Type":"ContainerStarted","Data":"58782bbbc50eb093913e1d23da39b174404881ff69b1838dc9c603c9e9a41a13"} Jul 17 18:43:36.179546 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:36.179116 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" event={"ID":"1446cb13-fd51-4717-b05a-df00a632468b","Type":"ContainerStarted","Data":"d3ba0a69663ab265f81c27c918e5f10b06eb63a9123f0488365ea1ab1cda4ade"} Jul 17 18:43:36.201690 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:36.201646 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" podStartSLOduration=2.201633 podStartE2EDuration="2.201633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:43:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:43:36.199276245 +0000 UTC m=+2031.472887378" watchObservedRunningTime="2026-07-17 18:43:36.201633 +0000 UTC m=+2031.475244142" Jul 17 18:43:36.566999 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:36.566956 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:37.128125 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:37.128097 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:37.132614 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:37.132594 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:37.185964 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:37.185940 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:37.186344 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:37.186046 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:38.133342 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:38.133313 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:38.245282 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:38.245249 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:38.334182 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:38.334155 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:38.675728 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:38.675697 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:38.914972 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:38.914943 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:39.013911 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:39.013833 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:42.715296 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:42.715267 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:43.361485 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:43.361456 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:43.453271 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:43.453224 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:43.764050 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:43.763963 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:49.531503 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:49.531435 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:49.631475 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:49.631451 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:53.004723 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:53.003263 2576 patch_prober.go:28] interesting pod/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": read tcp 10.132.0.2:50366->10.132.0.44:15021: read: connection reset by peer" start-of-body= Jul 17 18:43:53.004723 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:53.003322 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" podUID="1446cb13-fd51-4717-b05a-df00a632468b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": read tcp 10.132.0.2:50366->10.132.0.44:15021: read: connection reset by peer" Jul 17 18:43:53.259967 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:53.259870 2576 generic.go:356] "Generic (PLEG): container finished" podID="1446cb13-fd51-4717-b05a-df00a632468b" containerID="58782bbbc50eb093913e1d23da39b174404881ff69b1838dc9c603c9e9a41a13" exitCode=0 Jul 17 18:43:53.259967 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:53.259940 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" event={"ID":"1446cb13-fd51-4717-b05a-df00a632468b","Type":"ContainerDied","Data":"58782bbbc50eb093913e1d23da39b174404881ff69b1838dc9c603c9e9a41a13"} Jul 17 18:43:53.260370 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:53.260350 2576 scope.go:117] "RemoveContainer" containerID="58782bbbc50eb093913e1d23da39b174404881ff69b1838dc9c603c9e9a41a13" Jul 17 18:43:53.261336 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:53.261311 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:43:53.261417 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:53.261373 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:43:53.261460 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:53.261415 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:43:53.429917 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:53.429886 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:53.522840 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:53.522764 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:53.947290 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:53.947259 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:43:54.265804 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:54.265711 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" event={"ID":"1446cb13-fd51-4717-b05a-df00a632468b","Type":"ContainerStarted","Data":"be455c9a77ed87e98862506d05e51e1afb5f4bff676ee2fa1708e239c02a4b53"} Jul 17 18:43:55.127577 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:55.127535 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:55.127825 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:55.127801 2576 patch_prober.go:28] interesting pod/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 17 18:43:55.127884 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:55.127866 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" podUID="1446cb13-fd51-4717-b05a-df00a632468b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 17 18:43:56.128099 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:56.128063 2576 patch_prober.go:28] interesting pod/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 17 18:43:56.128465 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:56.128117 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" podUID="1446cb13-fd51-4717-b05a-df00a632468b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 17 18:43:57.128104 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:57.128072 2576 patch_prober.go:28] interesting pod/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 17 18:43:57.128479 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:57.128131 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" podUID="1446cb13-fd51-4717-b05a-df00a632468b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 17 18:43:58.128016 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:58.127962 2576 patch_prober.go:28] interesting pod/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 17 18:43:58.128215 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:58.128055 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" podUID="1446cb13-fd51-4717-b05a-df00a632468b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 17 18:43:59.130910 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:59.130878 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:59.131301 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:59.131100 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:59.131660 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:59.131645 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:43:59.940668 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:43:59.940642 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:44:00.044632 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:00.044603 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:44:00.243509 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:00.243438 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:44:05.037994 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:05.037948 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:44:11.252028 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:11.251920 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:44:11.391224 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:11.391195 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:44:15.614452 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:15.614419 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd"] Jul 17 18:44:15.614943 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:15.614621 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" podUID="1446cb13-fd51-4717-b05a-df00a632468b" containerName="istio-proxy" containerID="cri-o://be455c9a77ed87e98862506d05e51e1afb5f4bff676ee2fa1708e239c02a4b53" gracePeriod=30 Jul 17 18:44:15.641564 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:15.641538 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:44:15.892356 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:15.892285 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:44:16.007753 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:16.007720 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:44:16.107799 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:16.107770 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:44:16.235162 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:16.235075 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:44:20.863811 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:20.863788 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:44:21.006756 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.006700 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1446cb13-fd51-4717-b05a-df00a632468b-credential-socket\") pod \"1446cb13-fd51-4717-b05a-df00a632468b\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " Jul 17 18:44:21.006756 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.006740 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1446cb13-fd51-4717-b05a-df00a632468b-istiod-ca-cert\") pod \"1446cb13-fd51-4717-b05a-df00a632468b\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " Jul 17 18:44:21.006953 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.006764 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1446cb13-fd51-4717-b05a-df00a632468b-istio-token\") pod \"1446cb13-fd51-4717-b05a-df00a632468b\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " Jul 17 18:44:21.006953 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.006796 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1446cb13-fd51-4717-b05a-df00a632468b-istio-data\") pod \"1446cb13-fd51-4717-b05a-df00a632468b\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " Jul 17 18:44:21.006953 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.006911 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1446cb13-fd51-4717-b05a-df00a632468b-istio-podinfo\") pod \"1446cb13-fd51-4717-b05a-df00a632468b\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " Jul 17 18:44:21.006953 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.006946 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1446cb13-fd51-4717-b05a-df00a632468b-workload-socket\") pod \"1446cb13-fd51-4717-b05a-df00a632468b\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " Jul 17 18:44:21.007192 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.007000 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1446cb13-fd51-4717-b05a-df00a632468b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1446cb13-fd51-4717-b05a-df00a632468b" (UID: "1446cb13-fd51-4717-b05a-df00a632468b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:44:21.007192 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.007035 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1446cb13-fd51-4717-b05a-df00a632468b-workload-certs\") pod \"1446cb13-fd51-4717-b05a-df00a632468b\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " Jul 17 18:44:21.007192 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.007080 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4rmt\" (UniqueName: \"kubernetes.io/projected/1446cb13-fd51-4717-b05a-df00a632468b-kube-api-access-b4rmt\") pod \"1446cb13-fd51-4717-b05a-df00a632468b\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " Jul 17 18:44:21.007581 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.007535 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1446cb13-fd51-4717-b05a-df00a632468b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1446cb13-fd51-4717-b05a-df00a632468b" (UID: "1446cb13-fd51-4717-b05a-df00a632468b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:44:21.007714 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.007676 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1446cb13-fd51-4717-b05a-df00a632468b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1446cb13-fd51-4717-b05a-df00a632468b" (UID: "1446cb13-fd51-4717-b05a-df00a632468b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:44:21.007714 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.007686 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1446cb13-fd51-4717-b05a-df00a632468b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1446cb13-fd51-4717-b05a-df00a632468b" (UID: "1446cb13-fd51-4717-b05a-df00a632468b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:44:21.007857 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.007112 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1446cb13-fd51-4717-b05a-df00a632468b-istio-envoy\") pod \"1446cb13-fd51-4717-b05a-df00a632468b\" (UID: \"1446cb13-fd51-4717-b05a-df00a632468b\") " Jul 17 18:44:21.008474 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.008426 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1446cb13-fd51-4717-b05a-df00a632468b-istio-data" (OuterVolumeSpecName: "istio-data") pod "1446cb13-fd51-4717-b05a-df00a632468b" (UID: "1446cb13-fd51-4717-b05a-df00a632468b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:44:21.010056 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.008917 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1446cb13-fd51-4717-b05a-df00a632468b-credential-socket\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:44:21.010056 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.008956 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1446cb13-fd51-4717-b05a-df00a632468b-istiod-ca-cert\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:44:21.010056 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.009005 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1446cb13-fd51-4717-b05a-df00a632468b-istio-data\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:44:21.010056 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.009025 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1446cb13-fd51-4717-b05a-df00a632468b-workload-socket\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:44:21.010056 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.009044 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1446cb13-fd51-4717-b05a-df00a632468b-workload-certs\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:44:21.010387 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.010307 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1446cb13-fd51-4717-b05a-df00a632468b-istio-token" (OuterVolumeSpecName: "istio-token") pod "1446cb13-fd51-4717-b05a-df00a632468b" (UID: "1446cb13-fd51-4717-b05a-df00a632468b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:44:21.017297 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.017246 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1446cb13-fd51-4717-b05a-df00a632468b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1446cb13-fd51-4717-b05a-df00a632468b" (UID: "1446cb13-fd51-4717-b05a-df00a632468b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 18:44:21.017297 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.017262 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1446cb13-fd51-4717-b05a-df00a632468b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1446cb13-fd51-4717-b05a-df00a632468b" (UID: "1446cb13-fd51-4717-b05a-df00a632468b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:44:21.017375 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.017298 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1446cb13-fd51-4717-b05a-df00a632468b-kube-api-access-b4rmt" (OuterVolumeSpecName: "kube-api-access-b4rmt") pod "1446cb13-fd51-4717-b05a-df00a632468b" (UID: "1446cb13-fd51-4717-b05a-df00a632468b"). InnerVolumeSpecName "kube-api-access-b4rmt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:44:21.110074 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.110052 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4rmt\" (UniqueName: \"kubernetes.io/projected/1446cb13-fd51-4717-b05a-df00a632468b-kube-api-access-b4rmt\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:44:21.110074 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.110073 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1446cb13-fd51-4717-b05a-df00a632468b-istio-envoy\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:44:21.110194 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.110082 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1446cb13-fd51-4717-b05a-df00a632468b-istio-token\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:44:21.110194 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.110090 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1446cb13-fd51-4717-b05a-df00a632468b-istio-podinfo\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:44:21.393251 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.393223 2576 generic.go:356] "Generic (PLEG): container finished" podID="1446cb13-fd51-4717-b05a-df00a632468b" containerID="be455c9a77ed87e98862506d05e51e1afb5f4bff676ee2fa1708e239c02a4b53" exitCode=0 Jul 17 18:44:21.393342 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.393278 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" Jul 17 18:44:21.393391 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.393277 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" event={"ID":"1446cb13-fd51-4717-b05a-df00a632468b","Type":"ContainerDied","Data":"be455c9a77ed87e98862506d05e51e1afb5f4bff676ee2fa1708e239c02a4b53"} Jul 17 18:44:21.393432 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.393405 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd" event={"ID":"1446cb13-fd51-4717-b05a-df00a632468b","Type":"ContainerDied","Data":"d3ba0a69663ab265f81c27c918e5f10b06eb63a9123f0488365ea1ab1cda4ade"} Jul 17 18:44:21.393465 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.393440 2576 scope.go:117] "RemoveContainer" containerID="be455c9a77ed87e98862506d05e51e1afb5f4bff676ee2fa1708e239c02a4b53" Jul 17 18:44:21.401932 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.401916 2576 scope.go:117] "RemoveContainer" containerID="58782bbbc50eb093913e1d23da39b174404881ff69b1838dc9c603c9e9a41a13" Jul 17 18:44:21.409441 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.409419 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd"] Jul 17 18:44:21.409723 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.409709 2576 scope.go:117] "RemoveContainer" containerID="be455c9a77ed87e98862506d05e51e1afb5f4bff676ee2fa1708e239c02a4b53" Jul 17 18:44:21.409971 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:44:21.409952 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be455c9a77ed87e98862506d05e51e1afb5f4bff676ee2fa1708e239c02a4b53\": container with ID starting with be455c9a77ed87e98862506d05e51e1afb5f4bff676ee2fa1708e239c02a4b53 not found: ID does not exist" containerID="be455c9a77ed87e98862506d05e51e1afb5f4bff676ee2fa1708e239c02a4b53" Jul 17 18:44:21.410061 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.409993 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be455c9a77ed87e98862506d05e51e1afb5f4bff676ee2fa1708e239c02a4b53"} err="failed to get container status \"be455c9a77ed87e98862506d05e51e1afb5f4bff676ee2fa1708e239c02a4b53\": rpc error: code = NotFound desc = could not find container \"be455c9a77ed87e98862506d05e51e1afb5f4bff676ee2fa1708e239c02a4b53\": container with ID starting with be455c9a77ed87e98862506d05e51e1afb5f4bff676ee2fa1708e239c02a4b53 not found: ID does not exist" Jul 17 18:44:21.410061 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.410019 2576 scope.go:117] "RemoveContainer" containerID="58782bbbc50eb093913e1d23da39b174404881ff69b1838dc9c603c9e9a41a13" Jul 17 18:44:21.410262 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:44:21.410246 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58782bbbc50eb093913e1d23da39b174404881ff69b1838dc9c603c9e9a41a13\": container with ID starting with 58782bbbc50eb093913e1d23da39b174404881ff69b1838dc9c603c9e9a41a13 not found: ID does not exist" containerID="58782bbbc50eb093913e1d23da39b174404881ff69b1838dc9c603c9e9a41a13" Jul 17 18:44:21.410302 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.410268 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58782bbbc50eb093913e1d23da39b174404881ff69b1838dc9c603c9e9a41a13"} err="failed to get container status \"58782bbbc50eb093913e1d23da39b174404881ff69b1838dc9c603c9e9a41a13\": rpc error: code = NotFound desc = could not find container \"58782bbbc50eb093913e1d23da39b174404881ff69b1838dc9c603c9e9a41a13\": container with ID starting with 58782bbbc50eb093913e1d23da39b174404881ff69b1838dc9c603c9e9a41a13 not found: ID does not exist" Jul 17 18:44:21.416137 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:21.416117 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-ba643e57-openshift-default-c56f54cc5-zkszd"] Jul 17 18:44:22.177891 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:22.177861 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:44:22.269033 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:22.269002 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:44:22.388577 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:22.388553 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:44:22.626996 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:22.626952 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:44:23.185667 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:23.185643 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1446cb13-fd51-4717-b05a-df00a632468b" path="/var/lib/kubelet/pods/1446cb13-fd51-4717-b05a-df00a632468b/volumes" Jul 17 18:44:28.370209 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:28.370177 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:44:28.445391 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:28.445361 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:44:35.250921 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.250890 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:44:35.663366 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.663336 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf"] Jul 17 18:44:35.663678 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.663666 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1446cb13-fd51-4717-b05a-df00a632468b" containerName="istio-proxy" Jul 17 18:44:35.663730 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.663680 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1446cb13-fd51-4717-b05a-df00a632468b" containerName="istio-proxy" Jul 17 18:44:35.663730 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.663690 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2990376c-3a0e-4359-b285-9910197f9585" containerName="istio-proxy" Jul 17 18:44:35.663730 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.663696 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2990376c-3a0e-4359-b285-9910197f9585" containerName="istio-proxy" Jul 17 18:44:35.663730 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.663705 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1446cb13-fd51-4717-b05a-df00a632468b" containerName="istio-proxy" Jul 17 18:44:35.663730 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.663711 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1446cb13-fd51-4717-b05a-df00a632468b" containerName="istio-proxy" Jul 17 18:44:35.663881 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.663774 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1446cb13-fd51-4717-b05a-df00a632468b" containerName="istio-proxy" Jul 17 18:44:35.663881 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.663783 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1446cb13-fd51-4717-b05a-df00a632468b" containerName="istio-proxy" Jul 17 18:44:35.668291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.668273 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:35.671086 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.671059 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-5a93a056-openshift-default-dockercfg-88xgt\"" Jul 17 18:44:35.690457 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.690429 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf"] Jul 17 18:44:35.693890 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.693856 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:44:35.820041 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.820005 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b920677-1794-454c-b57a-3a88e73f613d-credential-socket\") pod \"e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:35.820204 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.820055 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b920677-1794-454c-b57a-3a88e73f613d-workload-socket\") pod \"e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:35.820204 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.820080 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b920677-1794-454c-b57a-3a88e73f613d-istio-data\") pod \"e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:35.820204 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.820108 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b920677-1794-454c-b57a-3a88e73f613d-istio-podinfo\") pod \"e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:35.820326 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.820213 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b920677-1794-454c-b57a-3a88e73f613d-istio-token\") pod \"e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:35.820326 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.820304 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b920677-1794-454c-b57a-3a88e73f613d-istiod-ca-cert\") pod \"e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:35.820407 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.820333 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b920677-1794-454c-b57a-3a88e73f613d-workload-certs\") pod \"e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:35.820407 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.820350 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfsw9\" (UniqueName: \"kubernetes.io/projected/0b920677-1794-454c-b57a-3a88e73f613d-kube-api-access-hfsw9\") pod \"e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:35.820473 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.820415 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b920677-1794-454c-b57a-3a88e73f613d-istio-envoy\") pod \"e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:35.921729 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.921669 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b920677-1794-454c-b57a-3a88e73f613d-istiod-ca-cert\") pod \"e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:35.921729 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.921701 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b920677-1794-454c-b57a-3a88e73f613d-workload-certs\") pod \"e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:35.921729 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.921717 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfsw9\" (UniqueName: \"kubernetes.io/projected/0b920677-1794-454c-b57a-3a88e73f613d-kube-api-access-hfsw9\") pod \"e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:35.921948 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.921919 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b920677-1794-454c-b57a-3a88e73f613d-istio-envoy\") pod \"e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:35.922031 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.921969 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b920677-1794-454c-b57a-3a88e73f613d-credential-socket\") pod \"e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:35.922090 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.922043 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b920677-1794-454c-b57a-3a88e73f613d-workload-socket\") pod \"e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:35.922090 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.922069 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b920677-1794-454c-b57a-3a88e73f613d-istio-data\") pod \"e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:35.922192 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.922102 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b920677-1794-454c-b57a-3a88e73f613d-istio-podinfo\") pod \"e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:35.922192 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.922149 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b920677-1794-454c-b57a-3a88e73f613d-workload-certs\") pod \"e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:35.922192 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.922170 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b920677-1794-454c-b57a-3a88e73f613d-istio-token\") pod \"e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:35.922379 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.922354 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b920677-1794-454c-b57a-3a88e73f613d-credential-socket\") pod \"e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:35.922442 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.922377 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b920677-1794-454c-b57a-3a88e73f613d-workload-socket\") pod \"e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:35.922442 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.922404 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b920677-1794-454c-b57a-3a88e73f613d-istio-data\") pod \"e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:35.922524 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.922476 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b920677-1794-454c-b57a-3a88e73f613d-istiod-ca-cert\") pod \"e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:35.924149 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.924130 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b920677-1794-454c-b57a-3a88e73f613d-istio-envoy\") pod \"e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:35.924358 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.924343 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b920677-1794-454c-b57a-3a88e73f613d-istio-podinfo\") pod \"e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:35.937653 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.937632 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b920677-1794-454c-b57a-3a88e73f613d-istio-token\") pod \"e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:35.938618 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.938597 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfsw9\" (UniqueName: \"kubernetes.io/projected/0b920677-1794-454c-b57a-3a88e73f613d-kube-api-access-hfsw9\") pod \"e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:35.979113 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:35.979092 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:36.075851 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:36.075821 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:44:36.111523 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:36.111494 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf"] Jul 17 18:44:36.115363 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:44:36.115338 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b920677_1794_454c_b57a_3a88e73f613d.slice/crio-cbea056ba464136af1373bfd576f3c6620b0427f4f27847fc3286995a80e9dba WatchSource:0}: Error finding container cbea056ba464136af1373bfd576f3c6620b0427f4f27847fc3286995a80e9dba: Status 404 returned error can't find the container with id cbea056ba464136af1373bfd576f3c6620b0427f4f27847fc3286995a80e9dba Jul 17 18:44:36.118143 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:36.118104 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:44:36.118279 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:36.118194 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:44:36.118279 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:36.118238 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:44:36.464129 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:36.464095 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" event={"ID":"0b920677-1794-454c-b57a-3a88e73f613d","Type":"ContainerStarted","Data":"ad6c66f8c36d85d44132100642e894da0fbdc0a65a320d8a1e073008129775cf"} Jul 17 18:44:36.464505 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:36.464146 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" event={"ID":"0b920677-1794-454c-b57a-3a88e73f613d","Type":"ContainerStarted","Data":"cbea056ba464136af1373bfd576f3c6620b0427f4f27847fc3286995a80e9dba"} Jul 17 18:44:36.979747 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:36.979717 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:37.984606 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:37.984580 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:38.007411 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:38.007366 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" podStartSLOduration=3.007350379 podStartE2EDuration="3.007350379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:44:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:44:36.484537423 +0000 UTC m=+2091.758148566" watchObservedRunningTime="2026-07-17 18:44:38.007350379 +0000 UTC m=+2093.280961521" Jul 17 18:44:38.441151 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:38.441122 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:44:38.473163 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:38.473137 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:38.474076 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:38.474060 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:38.597024 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:38.596989 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:44:38.766600 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:38.766523 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:44:38.960805 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:38.960778 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:44:39.341546 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:39.341513 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:44:39.442556 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:39.442530 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:44:42.923909 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:42.923878 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:44:45.212299 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:45.212226 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nwqlr_c6017e7d-5ed2-4d7d-ba64-ba9ce933828f/console-operator/1.log" Jul 17 18:44:45.219913 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:45.219883 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6pqqj_a67c7573-deca-4960-b69f-5ad3bda075a8/ovn-acl-logging/0.log" Jul 17 18:44:45.220516 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:45.220495 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nwqlr_c6017e7d-5ed2-4d7d-ba64-ba9ce933828f/console-operator/1.log" Jul 17 18:44:45.226503 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:45.226486 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6pqqj_a67c7573-deca-4960-b69f-5ad3bda075a8/ovn-acl-logging/0.log" Jul 17 18:44:51.530125 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:51.530045 2576 generic.go:356] "Generic (PLEG): container finished" podID="0b920677-1794-454c-b57a-3a88e73f613d" containerID="ad6c66f8c36d85d44132100642e894da0fbdc0a65a320d8a1e073008129775cf" exitCode=0 Jul 17 18:44:51.530125 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:51.530117 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" event={"ID":"0b920677-1794-454c-b57a-3a88e73f613d","Type":"ContainerDied","Data":"ad6c66f8c36d85d44132100642e894da0fbdc0a65a320d8a1e073008129775cf"} Jul 17 18:44:51.530676 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:51.530423 2576 scope.go:117] "RemoveContainer" containerID="ad6c66f8c36d85d44132100642e894da0fbdc0a65a320d8a1e073008129775cf" Jul 17 18:44:51.531331 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:51.531307 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:44:51.531388 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:51.531370 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:44:51.531426 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:51.531402 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:44:52.540020 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:52.539608 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" event={"ID":"0b920677-1794-454c-b57a-3a88e73f613d","Type":"ContainerStarted","Data":"0c036d2c227f6609fb1ffe8e717ea2e4ebd6812509e90c495f9d7ef2a1cf0636"} Jul 17 18:44:52.979969 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:52.979884 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:52.980972 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:52.980949 2576 patch_prober.go:28] interesting pod/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 17 18:44:52.981132 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:52.981009 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" podUID="0b920677-1794-454c-b57a-3a88e73f613d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 17 18:44:53.473946 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:53.473912 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:53.979764 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:53.979732 2576 patch_prober.go:28] interesting pod/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 17 18:44:53.980158 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:53.979789 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" podUID="0b920677-1794-454c-b57a-3a88e73f613d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 17 18:44:54.980116 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:54.980080 2576 patch_prober.go:28] interesting pod/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 17 18:44:54.980505 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:54.980138 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" podUID="0b920677-1794-454c-b57a-3a88e73f613d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 17 18:44:55.980100 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:55.980070 2576 patch_prober.go:28] interesting pod/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 17 18:44:55.980265 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:55.980120 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" podUID="0b920677-1794-454c-b57a-3a88e73f613d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 17 18:44:56.983023 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:56.982971 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:44:56.983924 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:44:56.983907 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:45:02.533531 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:45:02.533496 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:36.858737 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:45:36.858702 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:41.441590 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:45:41.441557 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:45:46.514475 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:45:46.514441 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:02.218695 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:02.218662 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:03.230856 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:03.230811 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:09.010273 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:09.010236 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:09.081069 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:09.081032 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:13.623654 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:13.623622 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf"] Jul 17 18:46:13.624163 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:13.623858 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" podUID="0b920677-1794-454c-b57a-3a88e73f613d" containerName="istio-proxy" containerID="cri-o://0c036d2c227f6609fb1ffe8e717ea2e4ebd6812509e90c495f9d7ef2a1cf0636" gracePeriod=30 Jul 17 18:46:13.645850 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:13.645826 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:13.873875 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:13.873790 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:14.979437 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:14.979407 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:15.074014 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:15.073970 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:15.171121 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:15.171097 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:15.934199 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:15.934166 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:16.036558 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:16.036517 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:16.138452 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:16.138428 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:17.596149 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:17.596101 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:18.870544 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:18.870523 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:46:18.927294 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:18.927235 2576 generic.go:356] "Generic (PLEG): container finished" podID="0b920677-1794-454c-b57a-3a88e73f613d" containerID="0c036d2c227f6609fb1ffe8e717ea2e4ebd6812509e90c495f9d7ef2a1cf0636" exitCode=0 Jul 17 18:46:18.927402 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:18.927289 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" Jul 17 18:46:18.927402 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:18.927311 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" event={"ID":"0b920677-1794-454c-b57a-3a88e73f613d","Type":"ContainerDied","Data":"0c036d2c227f6609fb1ffe8e717ea2e4ebd6812509e90c495f9d7ef2a1cf0636"} Jul 17 18:46:18.927402 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:18.927392 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf" event={"ID":"0b920677-1794-454c-b57a-3a88e73f613d","Type":"ContainerDied","Data":"cbea056ba464136af1373bfd576f3c6620b0427f4f27847fc3286995a80e9dba"} Jul 17 18:46:18.927504 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:18.927419 2576 scope.go:117] "RemoveContainer" containerID="0c036d2c227f6609fb1ffe8e717ea2e4ebd6812509e90c495f9d7ef2a1cf0636" Jul 17 18:46:18.936049 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:18.936030 2576 scope.go:117] "RemoveContainer" containerID="ad6c66f8c36d85d44132100642e894da0fbdc0a65a320d8a1e073008129775cf" Jul 17 18:46:18.941157 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:18.941138 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b920677-1794-454c-b57a-3a88e73f613d-istiod-ca-cert\") pod \"0b920677-1794-454c-b57a-3a88e73f613d\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " Jul 17 18:46:18.941252 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:18.941164 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfsw9\" (UniqueName: \"kubernetes.io/projected/0b920677-1794-454c-b57a-3a88e73f613d-kube-api-access-hfsw9\") pod \"0b920677-1794-454c-b57a-3a88e73f613d\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " Jul 17 18:46:18.941252 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:18.941181 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b920677-1794-454c-b57a-3a88e73f613d-istio-token\") pod \"0b920677-1794-454c-b57a-3a88e73f613d\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " Jul 17 18:46:18.941252 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:18.941204 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b920677-1794-454c-b57a-3a88e73f613d-istio-data\") pod \"0b920677-1794-454c-b57a-3a88e73f613d\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " Jul 17 18:46:18.941252 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:18.941223 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b920677-1794-454c-b57a-3a88e73f613d-workload-certs\") pod \"0b920677-1794-454c-b57a-3a88e73f613d\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " Jul 17 18:46:18.941447 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:18.941338 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b920677-1794-454c-b57a-3a88e73f613d-credential-socket\") pod \"0b920677-1794-454c-b57a-3a88e73f613d\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " Jul 17 18:46:18.941447 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:18.941412 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b920677-1794-454c-b57a-3a88e73f613d-workload-socket\") pod \"0b920677-1794-454c-b57a-3a88e73f613d\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " Jul 17 18:46:18.941554 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:18.941478 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b920677-1794-454c-b57a-3a88e73f613d-istio-podinfo\") pod \"0b920677-1794-454c-b57a-3a88e73f613d\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " Jul 17 18:46:18.941554 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:18.941491 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b920677-1794-454c-b57a-3a88e73f613d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0b920677-1794-454c-b57a-3a88e73f613d" (UID: "0b920677-1794-454c-b57a-3a88e73f613d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:46:18.941554 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:18.941518 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b920677-1794-454c-b57a-3a88e73f613d-istio-envoy\") pod \"0b920677-1794-454c-b57a-3a88e73f613d\" (UID: \"0b920677-1794-454c-b57a-3a88e73f613d\") " Jul 17 18:46:18.941709 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:18.941675 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b920677-1794-454c-b57a-3a88e73f613d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0b920677-1794-454c-b57a-3a88e73f613d" (UID: "0b920677-1794-454c-b57a-3a88e73f613d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:46:18.941769 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:18.941747 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b920677-1794-454c-b57a-3a88e73f613d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0b920677-1794-454c-b57a-3a88e73f613d" (UID: "0b920677-1794-454c-b57a-3a88e73f613d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:46:18.941876 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:18.941854 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b920677-1794-454c-b57a-3a88e73f613d-workload-certs\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:46:18.942032 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:18.941881 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b920677-1794-454c-b57a-3a88e73f613d-credential-socket\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:46:18.942032 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:18.941897 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b920677-1794-454c-b57a-3a88e73f613d-workload-socket\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:46:18.942032 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:18.941994 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b920677-1794-454c-b57a-3a88e73f613d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0b920677-1794-454c-b57a-3a88e73f613d" (UID: "0b920677-1794-454c-b57a-3a88e73f613d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:46:18.942272 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:18.942247 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b920677-1794-454c-b57a-3a88e73f613d-istio-data" (OuterVolumeSpecName: "istio-data") pod "0b920677-1794-454c-b57a-3a88e73f613d" (UID: "0b920677-1794-454c-b57a-3a88e73f613d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:46:18.943401 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:18.943378 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b920677-1794-454c-b57a-3a88e73f613d-kube-api-access-hfsw9" (OuterVolumeSpecName: "kube-api-access-hfsw9") pod "0b920677-1794-454c-b57a-3a88e73f613d" (UID: "0b920677-1794-454c-b57a-3a88e73f613d"). InnerVolumeSpecName "kube-api-access-hfsw9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:46:18.943657 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:18.943638 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b920677-1794-454c-b57a-3a88e73f613d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0b920677-1794-454c-b57a-3a88e73f613d" (UID: "0b920677-1794-454c-b57a-3a88e73f613d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:46:18.943754 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:18.943696 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0b920677-1794-454c-b57a-3a88e73f613d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0b920677-1794-454c-b57a-3a88e73f613d" (UID: "0b920677-1794-454c-b57a-3a88e73f613d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 18:46:18.943871 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:18.943857 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b920677-1794-454c-b57a-3a88e73f613d-istio-token" (OuterVolumeSpecName: "istio-token") pod "0b920677-1794-454c-b57a-3a88e73f613d" (UID: "0b920677-1794-454c-b57a-3a88e73f613d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:46:18.944552 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:18.944539 2576 scope.go:117] "RemoveContainer" containerID="0c036d2c227f6609fb1ffe8e717ea2e4ebd6812509e90c495f9d7ef2a1cf0636" Jul 17 18:46:18.944791 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:46:18.944773 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c036d2c227f6609fb1ffe8e717ea2e4ebd6812509e90c495f9d7ef2a1cf0636\": container with ID starting with 0c036d2c227f6609fb1ffe8e717ea2e4ebd6812509e90c495f9d7ef2a1cf0636 not found: ID does not exist" containerID="0c036d2c227f6609fb1ffe8e717ea2e4ebd6812509e90c495f9d7ef2a1cf0636" Jul 17 18:46:18.944846 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:18.944797 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c036d2c227f6609fb1ffe8e717ea2e4ebd6812509e90c495f9d7ef2a1cf0636"} err="failed to get container status \"0c036d2c227f6609fb1ffe8e717ea2e4ebd6812509e90c495f9d7ef2a1cf0636\": rpc error: code = NotFound desc = could not find container \"0c036d2c227f6609fb1ffe8e717ea2e4ebd6812509e90c495f9d7ef2a1cf0636\": container with ID starting with 0c036d2c227f6609fb1ffe8e717ea2e4ebd6812509e90c495f9d7ef2a1cf0636 not found: ID does not exist" Jul 17 18:46:18.944846 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:18.944812 2576 scope.go:117] "RemoveContainer" containerID="ad6c66f8c36d85d44132100642e894da0fbdc0a65a320d8a1e073008129775cf" Jul 17 18:46:18.945089 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:46:18.945072 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad6c66f8c36d85d44132100642e894da0fbdc0a65a320d8a1e073008129775cf\": container with ID starting with ad6c66f8c36d85d44132100642e894da0fbdc0a65a320d8a1e073008129775cf not found: ID does not exist" containerID="ad6c66f8c36d85d44132100642e894da0fbdc0a65a320d8a1e073008129775cf" Jul 17 18:46:18.945154 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:18.945095 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad6c66f8c36d85d44132100642e894da0fbdc0a65a320d8a1e073008129775cf"} err="failed to get container status \"ad6c66f8c36d85d44132100642e894da0fbdc0a65a320d8a1e073008129775cf\": rpc error: code = NotFound desc = could not find container \"ad6c66f8c36d85d44132100642e894da0fbdc0a65a320d8a1e073008129775cf\": container with ID starting with ad6c66f8c36d85d44132100642e894da0fbdc0a65a320d8a1e073008129775cf not found: ID does not exist" Jul 17 18:46:19.042988 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:19.042951 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b920677-1794-454c-b57a-3a88e73f613d-istio-podinfo\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:46:19.043074 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:19.042994 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b920677-1794-454c-b57a-3a88e73f613d-istio-envoy\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:46:19.043074 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:19.043005 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b920677-1794-454c-b57a-3a88e73f613d-istiod-ca-cert\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:46:19.043074 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:19.043012 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfsw9\" (UniqueName: \"kubernetes.io/projected/0b920677-1794-454c-b57a-3a88e73f613d-kube-api-access-hfsw9\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:46:19.043074 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:19.043022 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b920677-1794-454c-b57a-3a88e73f613d-istio-token\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:46:19.043074 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:19.043031 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b920677-1794-454c-b57a-3a88e73f613d-istio-data\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:46:19.245298 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:19.245274 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf"] Jul 17 18:46:19.257251 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:19.257225 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-5a93a056-openshift-default-65f584fdcf-nwqzf"] Jul 17 18:46:21.185351 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:21.185321 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b920677-1794-454c-b57a-3a88e73f613d" path="/var/lib/kubelet/pods/0b920677-1794-454c-b57a-3a88e73f613d/volumes" Jul 17 18:46:23.415854 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:23.415810 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:23.519468 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:23.519439 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:24.126723 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:24.126701 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:30.059352 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:30.059315 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:30.200389 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:30.200354 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:30.289489 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:30.289462 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:40.761034 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:40.761001 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:46:41.093516 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:46:41.093488 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:02.058596 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:02.058563 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:08.211347 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:08.211270 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:08.283712 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:08.283684 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:08.560782 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:08.560753 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:08.873174 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:08.873099 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2"] Jul 17 18:47:08.873457 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:08.873445 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b920677-1794-454c-b57a-3a88e73f613d" containerName="istio-proxy" Jul 17 18:47:08.873501 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:08.873459 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b920677-1794-454c-b57a-3a88e73f613d" containerName="istio-proxy" Jul 17 18:47:08.873501 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:08.873486 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b920677-1794-454c-b57a-3a88e73f613d" containerName="istio-proxy" Jul 17 18:47:08.873501 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:08.873491 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b920677-1794-454c-b57a-3a88e73f613d" containerName="istio-proxy" Jul 17 18:47:08.873601 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:08.873556 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b920677-1794-454c-b57a-3a88e73f613d" containerName="istio-proxy" Jul 17 18:47:08.876702 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:08.876686 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:08.884115 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:08.884098 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-764e6c-openshift-default-dockercfg-xtnxs\"" Jul 17 18:47:08.895831 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:08.895809 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2"] Jul 17 18:47:08.908472 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:08.908453 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:08.930804 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:08.930776 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8538bea3-2465-4131-a2e8-ec79ec073237-istio-podinfo\") pod \"e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:08.930932 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:08.930839 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxf5l\" (UniqueName: \"kubernetes.io/projected/8538bea3-2465-4131-a2e8-ec79ec073237-kube-api-access-rxf5l\") pod \"e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:08.930932 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:08.930898 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8538bea3-2465-4131-a2e8-ec79ec073237-credential-socket\") pod \"e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:08.931081 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:08.930955 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8538bea3-2465-4131-a2e8-ec79ec073237-istio-envoy\") pod \"e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:08.931081 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:08.931020 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8538bea3-2465-4131-a2e8-ec79ec073237-workload-socket\") pod \"e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:08.931081 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:08.931063 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8538bea3-2465-4131-a2e8-ec79ec073237-istio-token\") pod \"e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:08.931207 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:08.931138 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8538bea3-2465-4131-a2e8-ec79ec073237-istiod-ca-cert\") pod \"e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:08.931207 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:08.931161 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8538bea3-2465-4131-a2e8-ec79ec073237-workload-certs\") pod \"e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:08.931207 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:08.931175 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8538bea3-2465-4131-a2e8-ec79ec073237-istio-data\") pod \"e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:09.030883 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:09.030854 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:09.031999 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:09.031959 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8538bea3-2465-4131-a2e8-ec79ec073237-istiod-ca-cert\") pod \"e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:09.032076 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:09.032023 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8538bea3-2465-4131-a2e8-ec79ec073237-workload-certs\") pod \"e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:09.032076 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:09.032042 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8538bea3-2465-4131-a2e8-ec79ec073237-istio-data\") pod \"e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:09.032076 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:09.032075 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8538bea3-2465-4131-a2e8-ec79ec073237-istio-podinfo\") pod \"e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:09.032233 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:09.032120 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxf5l\" (UniqueName: \"kubernetes.io/projected/8538bea3-2465-4131-a2e8-ec79ec073237-kube-api-access-rxf5l\") pod \"e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:09.032233 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:09.032163 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8538bea3-2465-4131-a2e8-ec79ec073237-credential-socket\") pod \"e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:09.032233 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:09.032208 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8538bea3-2465-4131-a2e8-ec79ec073237-istio-envoy\") pod \"e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:09.032378 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:09.032244 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8538bea3-2465-4131-a2e8-ec79ec073237-workload-socket\") pod \"e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:09.032378 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:09.032269 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8538bea3-2465-4131-a2e8-ec79ec073237-istio-token\") pod \"e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:09.032761 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:09.032722 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8538bea3-2465-4131-a2e8-ec79ec073237-istiod-ca-cert\") pod \"e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:09.032844 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:09.032783 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8538bea3-2465-4131-a2e8-ec79ec073237-workload-socket\") pod \"e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:09.033072 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:09.033054 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8538bea3-2465-4131-a2e8-ec79ec073237-credential-socket\") pod \"e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:09.033297 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:09.033272 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8538bea3-2465-4131-a2e8-ec79ec073237-istio-data\") pod \"e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:09.033397 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:09.033323 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8538bea3-2465-4131-a2e8-ec79ec073237-workload-certs\") pod \"e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:09.034806 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:09.034778 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8538bea3-2465-4131-a2e8-ec79ec073237-istio-envoy\") pod \"e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:09.035340 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:09.035323 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8538bea3-2465-4131-a2e8-ec79ec073237-istio-podinfo\") pod \"e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:09.043157 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:09.043135 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8538bea3-2465-4131-a2e8-ec79ec073237-istio-token\") pod \"e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:09.043908 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:09.043880 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxf5l\" (UniqueName: \"kubernetes.io/projected/8538bea3-2465-4131-a2e8-ec79ec073237-kube-api-access-rxf5l\") pod \"e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:09.185718 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:09.185647 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:09.319192 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:09.319164 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2"] Jul 17 18:47:09.320926 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:47:09.320901 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8538bea3_2465_4131_a2e8_ec79ec073237.slice/crio-6aefeb4a4a43fd4dfc0fc2f9e70c98b5de38e5609d758e0a5bce31aa54ef4119 WatchSource:0}: Error finding container 6aefeb4a4a43fd4dfc0fc2f9e70c98b5de38e5609d758e0a5bce31aa54ef4119: Status 404 returned error can't find the container with id 6aefeb4a4a43fd4dfc0fc2f9e70c98b5de38e5609d758e0a5bce31aa54ef4119 Jul 17 18:47:09.323145 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:09.323102 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:47:09.323227 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:09.323180 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:47:09.323295 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:09.323230 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:47:10.157192 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:10.157162 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" event={"ID":"8538bea3-2465-4131-a2e8-ec79ec073237","Type":"ContainerStarted","Data":"3935aff4e14edc531fd6628dd381334dd453f3af4f41600de66eff5828fa802a"} Jul 17 18:47:10.157351 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:10.157209 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" event={"ID":"8538bea3-2465-4131-a2e8-ec79ec073237","Type":"ContainerStarted","Data":"6aefeb4a4a43fd4dfc0fc2f9e70c98b5de38e5609d758e0a5bce31aa54ef4119"} Jul 17 18:47:10.184219 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:10.184170 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" podStartSLOduration=2.184155911 podStartE2EDuration="2.184155911s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:47:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:47:10.182160876 +0000 UTC m=+2245.455772045" watchObservedRunningTime="2026-07-17 18:47:10.184155911 +0000 UTC m=+2245.457767051" Jul 17 18:47:10.186792 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:10.186776 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:10.191362 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:10.191340 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:11.161374 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:11.161340 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:11.162129 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:11.162111 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:12.230199 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:12.230170 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:12.316947 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:12.316921 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:12.514966 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:12.514886 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:12.602796 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:12.602764 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:13.154093 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:13.154065 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:13.254845 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:13.254804 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:16.612755 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:16.612725 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:16.943755 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:16.943679 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:17.264343 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.264280 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs"] Jul 17 18:47:17.264692 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.264680 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b920677-1794-454c-b57a-3a88e73f613d" containerName="istio-proxy" Jul 17 18:47:17.269009 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.268966 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:17.272245 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.272218 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-8f4385-openshift-default-dockercfg-wzqnt\"" Jul 17 18:47:17.292872 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.292849 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs"] Jul 17 18:47:17.302243 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.302222 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-istiod-ca-cert\") pod \"e2e-inf-b-8f4385-openshift-default-579b57467-drnxs\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:17.302352 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.302282 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-workload-socket\") pod \"e2e-inf-b-8f4385-openshift-default-579b57467-drnxs\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:17.302352 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.302300 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-istio-token\") pod \"e2e-inf-b-8f4385-openshift-default-579b57467-drnxs\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:17.302455 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.302398 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-istio-podinfo\") pod \"e2e-inf-b-8f4385-openshift-default-579b57467-drnxs\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:17.302523 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.302511 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-istio-envoy\") pod \"e2e-inf-b-8f4385-openshift-default-579b57467-drnxs\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:17.302582 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.302542 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-workload-certs\") pod \"e2e-inf-b-8f4385-openshift-default-579b57467-drnxs\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:17.302582 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.302565 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bztcv\" (UniqueName: \"kubernetes.io/projected/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-kube-api-access-bztcv\") pod \"e2e-inf-b-8f4385-openshift-default-579b57467-drnxs\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:17.302688 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.302655 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-istio-data\") pod \"e2e-inf-b-8f4385-openshift-default-579b57467-drnxs\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:17.302746 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.302727 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-credential-socket\") pod \"e2e-inf-b-8f4385-openshift-default-579b57467-drnxs\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:17.327961 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.327931 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:17.403522 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.403490 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-istiod-ca-cert\") pod \"e2e-inf-b-8f4385-openshift-default-579b57467-drnxs\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:17.403710 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.403537 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-workload-socket\") pod \"e2e-inf-b-8f4385-openshift-default-579b57467-drnxs\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:17.403710 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.403553 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-istio-token\") pod \"e2e-inf-b-8f4385-openshift-default-579b57467-drnxs\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:17.403710 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.403585 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-istio-podinfo\") pod \"e2e-inf-b-8f4385-openshift-default-579b57467-drnxs\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:17.403710 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.403605 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-istio-envoy\") pod \"e2e-inf-b-8f4385-openshift-default-579b57467-drnxs\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:17.403710 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.403621 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-workload-certs\") pod \"e2e-inf-b-8f4385-openshift-default-579b57467-drnxs\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:17.403710 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.403636 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bztcv\" (UniqueName: \"kubernetes.io/projected/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-kube-api-access-bztcv\") pod \"e2e-inf-b-8f4385-openshift-default-579b57467-drnxs\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:17.403710 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.403694 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-istio-data\") pod \"e2e-inf-b-8f4385-openshift-default-579b57467-drnxs\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:17.404118 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.403750 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-credential-socket\") pod \"e2e-inf-b-8f4385-openshift-default-579b57467-drnxs\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:17.404118 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.403952 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-workload-socket\") pod \"e2e-inf-b-8f4385-openshift-default-579b57467-drnxs\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:17.404118 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.404067 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-istio-data\") pod \"e2e-inf-b-8f4385-openshift-default-579b57467-drnxs\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:17.404279 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.404215 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-credential-socket\") pod \"e2e-inf-b-8f4385-openshift-default-579b57467-drnxs\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:17.404279 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.404234 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-workload-certs\") pod \"e2e-inf-b-8f4385-openshift-default-579b57467-drnxs\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:17.404391 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.404369 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-istiod-ca-cert\") pod \"e2e-inf-b-8f4385-openshift-default-579b57467-drnxs\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:17.405891 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.405874 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-istio-envoy\") pod \"e2e-inf-b-8f4385-openshift-default-579b57467-drnxs\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:17.406048 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.406032 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-istio-podinfo\") pod \"e2e-inf-b-8f4385-openshift-default-579b57467-drnxs\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:17.412516 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.412494 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-istio-token\") pod \"e2e-inf-b-8f4385-openshift-default-579b57467-drnxs\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:17.412656 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.412636 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bztcv\" (UniqueName: \"kubernetes.io/projected/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-kube-api-access-bztcv\") pod \"e2e-inf-b-8f4385-openshift-default-579b57467-drnxs\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:17.509027 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.508967 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:17.580263 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.580230 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:17.725285 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.725258 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs"] Jul 17 18:47:17.726609 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:47:17.726580 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cd599fe_33f6_4bd6_ba71_73ca1df15b19.slice/crio-79aa216ef544e5d66d70d00827f8a423b4e8964529db8068035d8afe45b72ed6 WatchSource:0}: Error finding container 79aa216ef544e5d66d70d00827f8a423b4e8964529db8068035d8afe45b72ed6: Status 404 returned error can't find the container with id 79aa216ef544e5d66d70d00827f8a423b4e8964529db8068035d8afe45b72ed6 Jul 17 18:47:17.728855 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.728820 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:47:17.728923 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.728902 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:47:17.728959 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:17.728943 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:47:18.193812 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:18.193772 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" event={"ID":"4cd599fe-33f6-4bd6-ba71-73ca1df15b19","Type":"ContainerStarted","Data":"f94a34bd6f1a545e921b2e93efba7dc7fe8ad19b8d6f17b6bb71f55a035d50b3"} Jul 17 18:47:18.194024 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:18.193823 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" event={"ID":"4cd599fe-33f6-4bd6-ba71-73ca1df15b19","Type":"ContainerStarted","Data":"79aa216ef544e5d66d70d00827f8a423b4e8964529db8068035d8afe45b72ed6"} Jul 17 18:47:18.581277 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:18.581247 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:18.585758 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:18.585734 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:18.609024 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:18.608959 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" podStartSLOduration=1.6089439620000001 podStartE2EDuration="1.608943962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:47:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:47:18.225055133 +0000 UTC m=+2253.498666275" watchObservedRunningTime="2026-07-17 18:47:18.608943962 +0000 UTC m=+2253.882555103" Jul 17 18:47:19.197609 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:19.197584 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:19.198452 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:19.198434 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:20.173258 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:20.173227 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:20.354091 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:20.354060 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:20.517020 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:20.516918 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:20.804105 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:20.804074 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:21.055420 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:21.055346 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:21.190610 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:21.190572 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:24.687131 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:24.687099 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:27.203127 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:27.203095 2576 patch_prober.go:28] interesting pod/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 17 18:47:27.203512 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:27.203146 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" podUID="8538bea3-2465-4131-a2e8-ec79ec073237" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 17 18:47:28.241825 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:28.241721 2576 generic.go:356] "Generic (PLEG): container finished" podID="8538bea3-2465-4131-a2e8-ec79ec073237" containerID="3935aff4e14edc531fd6628dd381334dd453f3af4f41600de66eff5828fa802a" exitCode=0 Jul 17 18:47:28.242487 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:28.242461 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" event={"ID":"8538bea3-2465-4131-a2e8-ec79ec073237","Type":"ContainerDied","Data":"3935aff4e14edc531fd6628dd381334dd453f3af4f41600de66eff5828fa802a"} Jul 17 18:47:28.243301 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:28.243277 2576 scope.go:117] "RemoveContainer" containerID="3935aff4e14edc531fd6628dd381334dd453f3af4f41600de66eff5828fa802a" Jul 17 18:47:28.245570 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:28.245526 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:47:28.245875 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:28.245847 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:47:28.246082 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:28.246058 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:47:29.252692 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:29.252653 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" event={"ID":"8538bea3-2465-4131-a2e8-ec79ec073237","Type":"ContainerStarted","Data":"4fc2adf0ff4bca522aa2333033c6beea19b809b071a1f4db75c4779f00202f25"} Jul 17 18:47:30.186518 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:30.186474 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:30.186737 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:30.186700 2576 patch_prober.go:28] interesting pod/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 17 18:47:30.186820 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:30.186746 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" podUID="8538bea3-2465-4131-a2e8-ec79ec073237" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 17 18:47:31.186750 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:31.186715 2576 patch_prober.go:28] interesting pod/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 17 18:47:31.187240 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:31.186773 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" podUID="8538bea3-2465-4131-a2e8-ec79ec073237" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 17 18:47:32.186419 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:32.186341 2576 patch_prober.go:28] interesting pod/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 17 18:47:32.186419 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:32.186392 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" podUID="8538bea3-2465-4131-a2e8-ec79ec073237" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 17 18:47:33.191036 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:33.191004 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:33.191523 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:33.191381 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:33.192125 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:33.192104 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:47:34.039277 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:34.039245 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:34.142256 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:34.142203 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:34.232488 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:34.232457 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:34.746958 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:34.746022 2576 patch_prober.go:28] interesting pod/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": read tcp 10.132.0.2:37148->10.132.0.47:15021: read: connection reset by peer" start-of-body= Jul 17 18:47:34.746958 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:34.746095 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" podUID="4cd599fe-33f6-4bd6-ba71-73ca1df15b19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": read tcp 10.132.0.2:37148->10.132.0.47:15021: read: connection reset by peer" Jul 17 18:47:35.290340 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:35.290316 2576 generic.go:356] "Generic (PLEG): container finished" podID="4cd599fe-33f6-4bd6-ba71-73ca1df15b19" containerID="f94a34bd6f1a545e921b2e93efba7dc7fe8ad19b8d6f17b6bb71f55a035d50b3" exitCode=0 Jul 17 18:47:35.290658 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:35.290391 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" event={"ID":"4cd599fe-33f6-4bd6-ba71-73ca1df15b19","Type":"ContainerDied","Data":"f94a34bd6f1a545e921b2e93efba7dc7fe8ad19b8d6f17b6bb71f55a035d50b3"} Jul 17 18:47:35.290720 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:35.290706 2576 scope.go:117] "RemoveContainer" containerID="f94a34bd6f1a545e921b2e93efba7dc7fe8ad19b8d6f17b6bb71f55a035d50b3" Jul 17 18:47:35.291629 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:35.291600 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:47:35.291686 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:35.291668 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:47:35.291720 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:35.291699 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:47:36.296835 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:36.296799 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" event={"ID":"4cd599fe-33f6-4bd6-ba71-73ca1df15b19","Type":"ContainerStarted","Data":"7d5200e6581c56ced27d12799c6312ee88c529fc7c46d665f3942c6fc7a1a97b"} Jul 17 18:47:36.581406 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:36.581315 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:36.581555 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:36.581477 2576 patch_prober.go:28] interesting pod/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 17 18:47:36.581555 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:36.581525 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" podUID="4cd599fe-33f6-4bd6-ba71-73ca1df15b19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 17 18:47:37.581398 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:37.581360 2576 patch_prober.go:28] interesting pod/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 17 18:47:37.581873 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:37.581429 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" podUID="4cd599fe-33f6-4bd6-ba71-73ca1df15b19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 17 18:47:38.581279 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:38.581246 2576 patch_prober.go:28] interesting pod/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 17 18:47:38.581455 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:38.581299 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" podUID="4cd599fe-33f6-4bd6-ba71-73ca1df15b19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 17 18:47:39.581526 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:39.581490 2576 patch_prober.go:28] interesting pod/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 17 18:47:39.581911 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:39.581541 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" podUID="4cd599fe-33f6-4bd6-ba71-73ca1df15b19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 17 18:47:40.583823 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:40.583794 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:40.584221 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:40.584044 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:40.584660 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:40.584643 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:47:42.112519 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:42.112491 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:42.217273 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:42.217232 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:47:53.306284 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:47:53.306249 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:48:13.034163 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:13.034134 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:48:13.907704 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:13.907669 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:48:14.662333 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:14.662301 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:48:14.759171 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:14.759144 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:48:24.610453 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:24.610419 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:48:29.156085 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:29.156048 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:48:35.237301 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:35.237271 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:48:35.337838 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:35.337807 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:48:39.208429 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:39.208394 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:48:39.309844 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:39.309819 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:48:39.857546 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:39.857512 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2"] Jul 17 18:48:39.857743 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:39.857718 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" podUID="8538bea3-2465-4131-a2e8-ec79ec073237" containerName="istio-proxy" containerID="cri-o://4fc2adf0ff4bca522aa2333033c6beea19b809b071a1f4db75c4779f00202f25" gracePeriod=30 Jul 17 18:48:39.883006 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:39.882963 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:48:40.138041 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:40.137957 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:48:41.144416 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:41.144385 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:48:41.240386 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:41.240360 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:48:45.103161 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.103141 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:48:45.164921 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.164896 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxf5l\" (UniqueName: \"kubernetes.io/projected/8538bea3-2465-4131-a2e8-ec79ec073237-kube-api-access-rxf5l\") pod \"8538bea3-2465-4131-a2e8-ec79ec073237\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " Jul 17 18:48:45.165058 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.164932 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8538bea3-2465-4131-a2e8-ec79ec073237-istiod-ca-cert\") pod \"8538bea3-2465-4131-a2e8-ec79ec073237\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " Jul 17 18:48:45.165058 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.165010 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8538bea3-2465-4131-a2e8-ec79ec073237-istio-podinfo\") pod \"8538bea3-2465-4131-a2e8-ec79ec073237\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " Jul 17 18:48:45.165179 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.165060 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8538bea3-2465-4131-a2e8-ec79ec073237-istio-data\") pod \"8538bea3-2465-4131-a2e8-ec79ec073237\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " Jul 17 18:48:45.165179 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.165095 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8538bea3-2465-4131-a2e8-ec79ec073237-workload-certs\") pod \"8538bea3-2465-4131-a2e8-ec79ec073237\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " Jul 17 18:48:45.165179 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.165125 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8538bea3-2465-4131-a2e8-ec79ec073237-istio-envoy\") pod \"8538bea3-2465-4131-a2e8-ec79ec073237\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " Jul 17 18:48:45.165325 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.165198 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8538bea3-2465-4131-a2e8-ec79ec073237-credential-socket\") pod \"8538bea3-2465-4131-a2e8-ec79ec073237\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " Jul 17 18:48:45.165325 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.165231 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8538bea3-2465-4131-a2e8-ec79ec073237-workload-socket\") pod \"8538bea3-2465-4131-a2e8-ec79ec073237\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " Jul 17 18:48:45.165325 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.165251 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8538bea3-2465-4131-a2e8-ec79ec073237-istio-token\") pod \"8538bea3-2465-4131-a2e8-ec79ec073237\" (UID: \"8538bea3-2465-4131-a2e8-ec79ec073237\") " Jul 17 18:48:45.165502 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.165405 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8538bea3-2465-4131-a2e8-ec79ec073237-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8538bea3-2465-4131-a2e8-ec79ec073237" (UID: "8538bea3-2465-4131-a2e8-ec79ec073237"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:48:45.165502 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.165422 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8538bea3-2465-4131-a2e8-ec79ec073237-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8538bea3-2465-4131-a2e8-ec79ec073237" (UID: "8538bea3-2465-4131-a2e8-ec79ec073237"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:48:45.165679 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.165635 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8538bea3-2465-4131-a2e8-ec79ec073237-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8538bea3-2465-4131-a2e8-ec79ec073237" (UID: "8538bea3-2465-4131-a2e8-ec79ec073237"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:48:45.165679 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.165655 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8538bea3-2465-4131-a2e8-ec79ec073237-workload-certs\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:48:45.165679 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.165678 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8538bea3-2465-4131-a2e8-ec79ec073237-istiod-ca-cert\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:48:45.165891 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.165684 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8538bea3-2465-4131-a2e8-ec79ec073237-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8538bea3-2465-4131-a2e8-ec79ec073237" (UID: "8538bea3-2465-4131-a2e8-ec79ec073237"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:48:45.166187 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.166162 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8538bea3-2465-4131-a2e8-ec79ec073237-istio-data" (OuterVolumeSpecName: "istio-data") pod "8538bea3-2465-4131-a2e8-ec79ec073237" (UID: "8538bea3-2465-4131-a2e8-ec79ec073237"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:48:45.167113 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.167090 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8538bea3-2465-4131-a2e8-ec79ec073237-kube-api-access-rxf5l" (OuterVolumeSpecName: "kube-api-access-rxf5l") pod "8538bea3-2465-4131-a2e8-ec79ec073237" (UID: "8538bea3-2465-4131-a2e8-ec79ec073237"). InnerVolumeSpecName "kube-api-access-rxf5l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:48:45.167488 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.167460 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8538bea3-2465-4131-a2e8-ec79ec073237-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8538bea3-2465-4131-a2e8-ec79ec073237" (UID: "8538bea3-2465-4131-a2e8-ec79ec073237"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 18:48:45.167571 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.167460 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8538bea3-2465-4131-a2e8-ec79ec073237-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8538bea3-2465-4131-a2e8-ec79ec073237" (UID: "8538bea3-2465-4131-a2e8-ec79ec073237"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:48:45.167571 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.167547 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8538bea3-2465-4131-a2e8-ec79ec073237-istio-token" (OuterVolumeSpecName: "istio-token") pod "8538bea3-2465-4131-a2e8-ec79ec073237" (UID: "8538bea3-2465-4131-a2e8-ec79ec073237"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:48:45.266181 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.266160 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8538bea3-2465-4131-a2e8-ec79ec073237-istio-data\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:48:45.266270 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.266185 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8538bea3-2465-4131-a2e8-ec79ec073237-istio-envoy\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:48:45.266270 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.266201 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8538bea3-2465-4131-a2e8-ec79ec073237-credential-socket\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:48:45.266270 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.266215 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8538bea3-2465-4131-a2e8-ec79ec073237-workload-socket\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:48:45.266270 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.266227 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8538bea3-2465-4131-a2e8-ec79ec073237-istio-token\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:48:45.266270 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.266240 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxf5l\" (UniqueName: \"kubernetes.io/projected/8538bea3-2465-4131-a2e8-ec79ec073237-kube-api-access-rxf5l\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:48:45.266270 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.266253 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8538bea3-2465-4131-a2e8-ec79ec073237-istio-podinfo\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:48:45.608495 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.608468 2576 generic.go:356] "Generic (PLEG): container finished" podID="8538bea3-2465-4131-a2e8-ec79ec073237" containerID="4fc2adf0ff4bca522aa2333033c6beea19b809b071a1f4db75c4779f00202f25" exitCode=0 Jul 17 18:48:45.608617 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.608513 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" Jul 17 18:48:45.608617 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.608550 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" event={"ID":"8538bea3-2465-4131-a2e8-ec79ec073237","Type":"ContainerDied","Data":"4fc2adf0ff4bca522aa2333033c6beea19b809b071a1f4db75c4779f00202f25"} Jul 17 18:48:45.608617 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.608596 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2" event={"ID":"8538bea3-2465-4131-a2e8-ec79ec073237","Type":"ContainerDied","Data":"6aefeb4a4a43fd4dfc0fc2f9e70c98b5de38e5609d758e0a5bce31aa54ef4119"} Jul 17 18:48:45.608749 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.608619 2576 scope.go:117] "RemoveContainer" containerID="4fc2adf0ff4bca522aa2333033c6beea19b809b071a1f4db75c4779f00202f25" Jul 17 18:48:45.616837 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.616823 2576 scope.go:117] "RemoveContainer" containerID="3935aff4e14edc531fd6628dd381334dd453f3af4f41600de66eff5828fa802a" Jul 17 18:48:45.624473 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.624453 2576 scope.go:117] "RemoveContainer" containerID="4fc2adf0ff4bca522aa2333033c6beea19b809b071a1f4db75c4779f00202f25" Jul 17 18:48:45.625449 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:48:45.625428 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fc2adf0ff4bca522aa2333033c6beea19b809b071a1f4db75c4779f00202f25\": container with ID starting with 4fc2adf0ff4bca522aa2333033c6beea19b809b071a1f4db75c4779f00202f25 not found: ID does not exist" containerID="4fc2adf0ff4bca522aa2333033c6beea19b809b071a1f4db75c4779f00202f25" Jul 17 18:48:45.625528 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.625456 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fc2adf0ff4bca522aa2333033c6beea19b809b071a1f4db75c4779f00202f25"} err="failed to get container status \"4fc2adf0ff4bca522aa2333033c6beea19b809b071a1f4db75c4779f00202f25\": rpc error: code = NotFound desc = could not find container \"4fc2adf0ff4bca522aa2333033c6beea19b809b071a1f4db75c4779f00202f25\": container with ID starting with 4fc2adf0ff4bca522aa2333033c6beea19b809b071a1f4db75c4779f00202f25 not found: ID does not exist" Jul 17 18:48:45.625528 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.625471 2576 scope.go:117] "RemoveContainer" containerID="3935aff4e14edc531fd6628dd381334dd453f3af4f41600de66eff5828fa802a" Jul 17 18:48:45.625736 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:48:45.625721 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3935aff4e14edc531fd6628dd381334dd453f3af4f41600de66eff5828fa802a\": container with ID starting with 3935aff4e14edc531fd6628dd381334dd453f3af4f41600de66eff5828fa802a not found: ID does not exist" containerID="3935aff4e14edc531fd6628dd381334dd453f3af4f41600de66eff5828fa802a" Jul 17 18:48:45.625784 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.625739 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3935aff4e14edc531fd6628dd381334dd453f3af4f41600de66eff5828fa802a"} err="failed to get container status \"3935aff4e14edc531fd6628dd381334dd453f3af4f41600de66eff5828fa802a\": rpc error: code = NotFound desc = could not find container \"3935aff4e14edc531fd6628dd381334dd453f3af4f41600de66eff5828fa802a\": container with ID starting with 3935aff4e14edc531fd6628dd381334dd453f3af4f41600de66eff5828fa802a not found: ID does not exist" Jul 17 18:48:45.627179 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.627158 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2"] Jul 17 18:48:45.631379 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:45.631360 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-764e6c-openshift-default-8bb4b8d79-7zwf2"] Jul 17 18:48:47.185184 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:47.185154 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8538bea3-2465-4131-a2e8-ec79ec073237" path="/var/lib/kubelet/pods/8538bea3-2465-4131-a2e8-ec79ec073237/volumes" Jul 17 18:48:50.917071 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:50.917039 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:48:54.287375 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:54.287339 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:48:54.388023 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:54.387997 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:48:55.343784 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:48:55.343758 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:01.299193 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:01.299151 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:01.371133 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:01.371102 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:06.007908 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:06.007865 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs"] Jul 17 18:49:06.008406 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:06.008086 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" podUID="4cd599fe-33f6-4bd6-ba71-73ca1df15b19" containerName="istio-proxy" containerID="cri-o://7d5200e6581c56ced27d12799c6312ee88c529fc7c46d665f3942c6fc7a1a97b" gracePeriod=30 Jul 17 18:49:06.033023 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:06.032999 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:06.289049 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:06.289010 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:06.595594 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:06.595530 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:06.921629 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:06.921561 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5"] Jul 17 18:49:06.921916 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:06.921905 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8538bea3-2465-4131-a2e8-ec79ec073237" containerName="istio-proxy" Jul 17 18:49:06.921962 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:06.921918 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8538bea3-2465-4131-a2e8-ec79ec073237" containerName="istio-proxy" Jul 17 18:49:06.921962 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:06.921927 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8538bea3-2465-4131-a2e8-ec79ec073237" containerName="istio-proxy" Jul 17 18:49:06.921962 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:06.921932 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8538bea3-2465-4131-a2e8-ec79ec073237" containerName="istio-proxy" Jul 17 18:49:06.922100 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:06.922024 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8538bea3-2465-4131-a2e8-ec79ec073237" containerName="istio-proxy" Jul 17 18:49:06.922100 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:06.922035 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8538bea3-2465-4131-a2e8-ec79ec073237" containerName="istio-proxy" Jul 17 18:49:06.925038 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:06.925022 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:06.935902 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:06.935882 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-82b1be-openshift-default-dockercfg-p42t5\"" Jul 17 18:49:06.967365 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:06.967340 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5"] Jul 17 18:49:06.985811 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:06.985789 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:07.033335 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.033315 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11b4048f-f444-4859-a7d1-d21f47224463-istio-token\") pod \"e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:07.033632 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.033342 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b4048f-f444-4859-a7d1-d21f47224463-credential-socket\") pod \"e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:07.033632 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.033370 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11b4048f-f444-4859-a7d1-d21f47224463-istio-podinfo\") pod \"e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:07.033632 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.033396 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klvk8\" (UniqueName: \"kubernetes.io/projected/11b4048f-f444-4859-a7d1-d21f47224463-kube-api-access-klvk8\") pod \"e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:07.033632 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.033454 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11b4048f-f444-4859-a7d1-d21f47224463-workload-certs\") pod \"e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:07.033632 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.033516 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11b4048f-f444-4859-a7d1-d21f47224463-istio-data\") pod \"e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:07.033632 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.033535 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b4048f-f444-4859-a7d1-d21f47224463-workload-socket\") pod \"e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:07.033632 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.033569 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11b4048f-f444-4859-a7d1-d21f47224463-istio-envoy\") pod \"e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:07.033632 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.033619 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11b4048f-f444-4859-a7d1-d21f47224463-istiod-ca-cert\") pod \"e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:07.119425 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.119395 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:07.134628 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.134594 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11b4048f-f444-4859-a7d1-d21f47224463-istio-podinfo\") pod \"e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:07.134766 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.134641 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klvk8\" (UniqueName: \"kubernetes.io/projected/11b4048f-f444-4859-a7d1-d21f47224463-kube-api-access-klvk8\") pod \"e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:07.134766 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.134674 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11b4048f-f444-4859-a7d1-d21f47224463-workload-certs\") pod \"e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:07.134766 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.134742 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11b4048f-f444-4859-a7d1-d21f47224463-istio-data\") pod \"e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:07.134933 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.134768 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b4048f-f444-4859-a7d1-d21f47224463-workload-socket\") pod \"e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:07.134933 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.134874 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11b4048f-f444-4859-a7d1-d21f47224463-istio-envoy\") pod \"e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:07.135063 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.134949 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11b4048f-f444-4859-a7d1-d21f47224463-istiod-ca-cert\") pod \"e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:07.135063 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.135026 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11b4048f-f444-4859-a7d1-d21f47224463-istio-token\") pod \"e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:07.135063 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.135056 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b4048f-f444-4859-a7d1-d21f47224463-credential-socket\") pod \"e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:07.135211 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.135169 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11b4048f-f444-4859-a7d1-d21f47224463-workload-certs\") pod \"e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:07.135301 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.135283 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b4048f-f444-4859-a7d1-d21f47224463-workload-socket\") pod \"e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:07.135449 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.135320 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11b4048f-f444-4859-a7d1-d21f47224463-istio-data\") pod \"e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:07.135570 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.135483 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b4048f-f444-4859-a7d1-d21f47224463-credential-socket\") pod \"e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:07.135672 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.135655 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11b4048f-f444-4859-a7d1-d21f47224463-istiod-ca-cert\") pod \"e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:07.137040 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.137023 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11b4048f-f444-4859-a7d1-d21f47224463-istio-envoy\") pod \"e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:07.137186 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.137171 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11b4048f-f444-4859-a7d1-d21f47224463-istio-podinfo\") pod \"e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:07.151117 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.151085 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klvk8\" (UniqueName: \"kubernetes.io/projected/11b4048f-f444-4859-a7d1-d21f47224463-kube-api-access-klvk8\") pod \"e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:07.152258 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.152238 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11b4048f-f444-4859-a7d1-d21f47224463-istio-token\") pod \"e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:07.235107 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.235058 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:07.384055 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.384028 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5"] Jul 17 18:49:07.384595 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:49:07.384572 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11b4048f_f444_4859_a7d1_d21f47224463.slice/crio-73b454365005f42604ab76ac729067d43b6d1d0dabc5ab01a51ebc94c34230a9 WatchSource:0}: Error finding container 73b454365005f42604ab76ac729067d43b6d1d0dabc5ab01a51ebc94c34230a9: Status 404 returned error can't find the container with id 73b454365005f42604ab76ac729067d43b6d1d0dabc5ab01a51ebc94c34230a9 Jul 17 18:49:07.386654 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.386623 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:49:07.386745 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.386698 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:49:07.386805 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.386742 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:49:07.710861 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.710822 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" event={"ID":"11b4048f-f444-4859-a7d1-d21f47224463","Type":"ContainerStarted","Data":"7b4a864051a39346a342a5fa87389ceba7699867856097537326a9398e30c798"} Jul 17 18:49:07.711076 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.710901 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" event={"ID":"11b4048f-f444-4859-a7d1-d21f47224463","Type":"ContainerStarted","Data":"73b454365005f42604ab76ac729067d43b6d1d0dabc5ab01a51ebc94c34230a9"} Jul 17 18:49:07.752815 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:07.752761 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" podStartSLOduration=1.7527474650000001 podStartE2EDuration="1.752747465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:49:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:49:07.750310159 +0000 UTC m=+2363.023921310" watchObservedRunningTime="2026-07-17 18:49:07.752747465 +0000 UTC m=+2363.026358607" Jul 17 18:49:08.235721 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:08.235687 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:08.241138 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:08.241117 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:08.715900 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:08.715869 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:08.716683 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:08.716664 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:09.812456 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:09.812424 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:09.951846 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:09.951780 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:10.047946 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:10.047905 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:10.247187 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:10.247109 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:10.557450 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:10.557397 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:10.586352 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:10.586322 2576 patch_prober.go:28] interesting pod/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 17 18:49:10.586478 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:10.586397 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" podUID="4cd599fe-33f6-4bd6-ba71-73ca1df15b19" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 17 18:49:10.662800 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:10.662774 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:11.254726 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.254706 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:49:11.371845 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.371817 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-workload-socket\") pod \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " Jul 17 18:49:11.372035 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.371853 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-istio-envoy\") pod \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " Jul 17 18:49:11.372035 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.371877 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bztcv\" (UniqueName: \"kubernetes.io/projected/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-kube-api-access-bztcv\") pod \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " Jul 17 18:49:11.372035 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.371946 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-istio-data\") pod \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " Jul 17 18:49:11.372035 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.372000 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-istio-token\") pod \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " Jul 17 18:49:11.372035 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.372027 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-istio-podinfo\") pod \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " Jul 17 18:49:11.372270 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.372058 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-credential-socket\") pod \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " Jul 17 18:49:11.372270 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.372091 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-workload-certs\") pod \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " Jul 17 18:49:11.372270 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.372137 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-istiod-ca-cert\") pod \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\" (UID: \"4cd599fe-33f6-4bd6-ba71-73ca1df15b19\") " Jul 17 18:49:11.372270 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.372158 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4cd599fe-33f6-4bd6-ba71-73ca1df15b19" (UID: "4cd599fe-33f6-4bd6-ba71-73ca1df15b19"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:49:11.372469 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.372381 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4cd599fe-33f6-4bd6-ba71-73ca1df15b19" (UID: "4cd599fe-33f6-4bd6-ba71-73ca1df15b19"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:49:11.372543 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.372520 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-credential-socket\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:49:11.372600 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.372542 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-workload-socket\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:49:11.372600 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.372576 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4cd599fe-33f6-4bd6-ba71-73ca1df15b19" (UID: "4cd599fe-33f6-4bd6-ba71-73ca1df15b19"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:49:11.372745 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.372699 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4cd599fe-33f6-4bd6-ba71-73ca1df15b19" (UID: "4cd599fe-33f6-4bd6-ba71-73ca1df15b19"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:49:11.373015 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.372921 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-istio-data" (OuterVolumeSpecName: "istio-data") pod "4cd599fe-33f6-4bd6-ba71-73ca1df15b19" (UID: "4cd599fe-33f6-4bd6-ba71-73ca1df15b19"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:49:11.374564 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.374541 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4cd599fe-33f6-4bd6-ba71-73ca1df15b19" (UID: "4cd599fe-33f6-4bd6-ba71-73ca1df15b19"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:49:11.374564 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.374552 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-istio-token" (OuterVolumeSpecName: "istio-token") pod "4cd599fe-33f6-4bd6-ba71-73ca1df15b19" (UID: "4cd599fe-33f6-4bd6-ba71-73ca1df15b19"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:49:11.374698 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.374575 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-kube-api-access-bztcv" (OuterVolumeSpecName: "kube-api-access-bztcv") pod "4cd599fe-33f6-4bd6-ba71-73ca1df15b19" (UID: "4cd599fe-33f6-4bd6-ba71-73ca1df15b19"). InnerVolumeSpecName "kube-api-access-bztcv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:49:11.374698 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.374667 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4cd599fe-33f6-4bd6-ba71-73ca1df15b19" (UID: "4cd599fe-33f6-4bd6-ba71-73ca1df15b19"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 18:49:11.473629 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.473609 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-istio-envoy\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:49:11.473629 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.473631 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bztcv\" (UniqueName: \"kubernetes.io/projected/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-kube-api-access-bztcv\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:49:11.473764 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.473640 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-istio-data\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:49:11.473764 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.473648 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-istio-token\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:49:11.473764 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.473655 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-istio-podinfo\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:49:11.473764 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.473663 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-workload-certs\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:49:11.473764 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.473669 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cd599fe-33f6-4bd6-ba71-73ca1df15b19-istiod-ca-cert\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:49:11.730918 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.730846 2576 generic.go:356] "Generic (PLEG): container finished" podID="4cd599fe-33f6-4bd6-ba71-73ca1df15b19" containerID="7d5200e6581c56ced27d12799c6312ee88c529fc7c46d665f3942c6fc7a1a97b" exitCode=0 Jul 17 18:49:11.730918 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.730892 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" event={"ID":"4cd599fe-33f6-4bd6-ba71-73ca1df15b19","Type":"ContainerDied","Data":"7d5200e6581c56ced27d12799c6312ee88c529fc7c46d665f3942c6fc7a1a97b"} Jul 17 18:49:11.731132 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.730931 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" event={"ID":"4cd599fe-33f6-4bd6-ba71-73ca1df15b19","Type":"ContainerDied","Data":"79aa216ef544e5d66d70d00827f8a423b4e8964529db8068035d8afe45b72ed6"} Jul 17 18:49:11.731132 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.730952 2576 scope.go:117] "RemoveContainer" containerID="7d5200e6581c56ced27d12799c6312ee88c529fc7c46d665f3942c6fc7a1a97b" Jul 17 18:49:11.731132 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.730894 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs" Jul 17 18:49:11.740379 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.740364 2576 scope.go:117] "RemoveContainer" containerID="f94a34bd6f1a545e921b2e93efba7dc7fe8ad19b8d6f17b6bb71f55a035d50b3" Jul 17 18:49:11.747947 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.747928 2576 scope.go:117] "RemoveContainer" containerID="7d5200e6581c56ced27d12799c6312ee88c529fc7c46d665f3942c6fc7a1a97b" Jul 17 18:49:11.748215 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:49:11.748194 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d5200e6581c56ced27d12799c6312ee88c529fc7c46d665f3942c6fc7a1a97b\": container with ID starting with 7d5200e6581c56ced27d12799c6312ee88c529fc7c46d665f3942c6fc7a1a97b not found: ID does not exist" containerID="7d5200e6581c56ced27d12799c6312ee88c529fc7c46d665f3942c6fc7a1a97b" Jul 17 18:49:11.748308 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.748220 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d5200e6581c56ced27d12799c6312ee88c529fc7c46d665f3942c6fc7a1a97b"} err="failed to get container status \"7d5200e6581c56ced27d12799c6312ee88c529fc7c46d665f3942c6fc7a1a97b\": rpc error: code = NotFound desc = could not find container \"7d5200e6581c56ced27d12799c6312ee88c529fc7c46d665f3942c6fc7a1a97b\": container with ID starting with 7d5200e6581c56ced27d12799c6312ee88c529fc7c46d665f3942c6fc7a1a97b not found: ID does not exist" Jul 17 18:49:11.748308 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.748236 2576 scope.go:117] "RemoveContainer" containerID="f94a34bd6f1a545e921b2e93efba7dc7fe8ad19b8d6f17b6bb71f55a035d50b3" Jul 17 18:49:11.748447 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:49:11.748430 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f94a34bd6f1a545e921b2e93efba7dc7fe8ad19b8d6f17b6bb71f55a035d50b3\": container with ID starting with f94a34bd6f1a545e921b2e93efba7dc7fe8ad19b8d6f17b6bb71f55a035d50b3 not found: ID does not exist" containerID="f94a34bd6f1a545e921b2e93efba7dc7fe8ad19b8d6f17b6bb71f55a035d50b3" Jul 17 18:49:11.748489 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.748454 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f94a34bd6f1a545e921b2e93efba7dc7fe8ad19b8d6f17b6bb71f55a035d50b3"} err="failed to get container status \"f94a34bd6f1a545e921b2e93efba7dc7fe8ad19b8d6f17b6bb71f55a035d50b3\": rpc error: code = NotFound desc = could not find container \"f94a34bd6f1a545e921b2e93efba7dc7fe8ad19b8d6f17b6bb71f55a035d50b3\": container with ID starting with f94a34bd6f1a545e921b2e93efba7dc7fe8ad19b8d6f17b6bb71f55a035d50b3 not found: ID does not exist" Jul 17 18:49:11.756519 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.756493 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs"] Jul 17 18:49:11.769278 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:11.769258 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-8f4385-openshift-default-579b57467-drnxs"] Jul 17 18:49:13.186060 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:13.186026 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cd599fe-33f6-4bd6-ba71-73ca1df15b19" path="/var/lib/kubelet/pods/4cd599fe-33f6-4bd6-ba71-73ca1df15b19/volumes" Jul 17 18:49:14.228315 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:14.228285 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:14.765571 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:14.765541 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:15.019867 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.019743 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2"] Jul 17 18:49:15.020258 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.020240 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cd599fe-33f6-4bd6-ba71-73ca1df15b19" containerName="istio-proxy" Jul 17 18:49:15.020357 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.020260 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cd599fe-33f6-4bd6-ba71-73ca1df15b19" containerName="istio-proxy" Jul 17 18:49:15.020357 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.020349 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cd599fe-33f6-4bd6-ba71-73ca1df15b19" containerName="istio-proxy" Jul 17 18:49:15.020459 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.020363 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cd599fe-33f6-4bd6-ba71-73ca1df15b19" containerName="istio-proxy" Jul 17 18:49:15.024784 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.024764 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:15.027541 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.027522 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-2cfeb4-openshift-default-dockercfg-cks5m\"" Jul 17 18:49:15.035660 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.035641 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2"] Jul 17 18:49:15.103196 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.103170 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jln4z\" (UniqueName: \"kubernetes.io/projected/5891f91d-0d8a-40ad-90f9-82a2ef847604-kube-api-access-jln4z\") pod \"e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:15.103323 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.103228 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5891f91d-0d8a-40ad-90f9-82a2ef847604-istio-podinfo\") pod \"e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:15.103323 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.103294 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5891f91d-0d8a-40ad-90f9-82a2ef847604-istio-envoy\") pod \"e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:15.103414 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.103340 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5891f91d-0d8a-40ad-90f9-82a2ef847604-workload-certs\") pod \"e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:15.103414 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.103386 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5891f91d-0d8a-40ad-90f9-82a2ef847604-istiod-ca-cert\") pod \"e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:15.103414 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.103409 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5891f91d-0d8a-40ad-90f9-82a2ef847604-istio-token\") pod \"e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:15.103532 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.103435 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5891f91d-0d8a-40ad-90f9-82a2ef847604-credential-socket\") pod \"e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:15.103532 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.103502 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5891f91d-0d8a-40ad-90f9-82a2ef847604-istio-data\") pod \"e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:15.103599 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.103545 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5891f91d-0d8a-40ad-90f9-82a2ef847604-workload-socket\") pod \"e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:15.204201 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.204171 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5891f91d-0d8a-40ad-90f9-82a2ef847604-istiod-ca-cert\") pod \"e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:15.204201 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.204202 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5891f91d-0d8a-40ad-90f9-82a2ef847604-istio-token\") pod \"e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:15.204447 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.204229 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5891f91d-0d8a-40ad-90f9-82a2ef847604-credential-socket\") pod \"e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:15.204447 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.204271 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5891f91d-0d8a-40ad-90f9-82a2ef847604-istio-data\") pod \"e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:15.204447 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.204318 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5891f91d-0d8a-40ad-90f9-82a2ef847604-workload-socket\") pod \"e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:15.204447 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.204361 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jln4z\" (UniqueName: \"kubernetes.io/projected/5891f91d-0d8a-40ad-90f9-82a2ef847604-kube-api-access-jln4z\") pod \"e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:15.204447 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.204419 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5891f91d-0d8a-40ad-90f9-82a2ef847604-istio-podinfo\") pod \"e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:15.204699 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.204465 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5891f91d-0d8a-40ad-90f9-82a2ef847604-istio-envoy\") pod \"e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:15.204699 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.204490 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5891f91d-0d8a-40ad-90f9-82a2ef847604-workload-certs\") pod \"e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:15.204699 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.204682 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5891f91d-0d8a-40ad-90f9-82a2ef847604-istio-data\") pod \"e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:15.204850 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.204761 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5891f91d-0d8a-40ad-90f9-82a2ef847604-credential-socket\") pod \"e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:15.204850 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.204791 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5891f91d-0d8a-40ad-90f9-82a2ef847604-workload-socket\") pod \"e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:15.204850 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.204819 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5891f91d-0d8a-40ad-90f9-82a2ef847604-workload-certs\") pod \"e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:15.204968 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.204929 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5891f91d-0d8a-40ad-90f9-82a2ef847604-istiod-ca-cert\") pod \"e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:15.206727 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.206703 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5891f91d-0d8a-40ad-90f9-82a2ef847604-istio-envoy\") pod \"e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:15.206905 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.206887 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5891f91d-0d8a-40ad-90f9-82a2ef847604-istio-podinfo\") pod \"e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:15.212664 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.212640 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5891f91d-0d8a-40ad-90f9-82a2ef847604-istio-token\") pod \"e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:15.212803 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.212785 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jln4z\" (UniqueName: \"kubernetes.io/projected/5891f91d-0d8a-40ad-90f9-82a2ef847604-kube-api-access-jln4z\") pod \"e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:15.336623 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.336592 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:15.471342 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.471313 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2"] Jul 17 18:49:15.473132 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:49:15.473102 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5891f91d_0d8a_40ad_90f9_82a2ef847604.slice/crio-1c8d52c6252c786a26edc41555b917b7572f4b66ac22e8555de6a28417fffbcb WatchSource:0}: Error finding container 1c8d52c6252c786a26edc41555b917b7572f4b66ac22e8555de6a28417fffbcb: Status 404 returned error can't find the container with id 1c8d52c6252c786a26edc41555b917b7572f4b66ac22e8555de6a28417fffbcb Jul 17 18:49:15.475375 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.475346 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:49:15.475448 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.475410 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:49:15.475448 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.475438 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:49:15.623589 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.623511 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:15.688150 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.688087 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:15.752696 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.752664 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" event={"ID":"5891f91d-0d8a-40ad-90f9-82a2ef847604","Type":"ContainerStarted","Data":"70a98c5458f0431291794bec6e3c13f91daaf22240433fee775386384ea0ef1d"} Jul 17 18:49:15.752877 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.752720 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" event={"ID":"5891f91d-0d8a-40ad-90f9-82a2ef847604","Type":"ContainerStarted","Data":"1c8d52c6252c786a26edc41555b917b7572f4b66ac22e8555de6a28417fffbcb"} Jul 17 18:49:15.773317 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:15.773255 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" podStartSLOduration=1.77323291 podStartE2EDuration="1.77323291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:49:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:49:15.771795114 +0000 UTC m=+2371.045406254" watchObservedRunningTime="2026-07-17 18:49:15.77323291 +0000 UTC m=+2371.046844053" Jul 17 18:49:16.337455 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:16.337418 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:16.357302 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:16.357267 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:16.758867 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:16.758784 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:16.759745 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:16.759729 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:17.745883 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:17.745830 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:17.846511 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:17.846470 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:17.949718 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:17.949643 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:18.192970 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:18.192934 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:18.489360 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:18.489237 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:18.607013 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:18.606963 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:22.192361 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:22.192330 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:22.789537 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:22.789506 2576 generic.go:356] "Generic (PLEG): container finished" podID="11b4048f-f444-4859-a7d1-d21f47224463" containerID="7b4a864051a39346a342a5fa87389ceba7699867856097537326a9398e30c798" exitCode=0 Jul 17 18:49:22.789683 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:22.789577 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" event={"ID":"11b4048f-f444-4859-a7d1-d21f47224463","Type":"ContainerDied","Data":"7b4a864051a39346a342a5fa87389ceba7699867856097537326a9398e30c798"} Jul 17 18:49:22.789915 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:22.789902 2576 scope.go:117] "RemoveContainer" containerID="7b4a864051a39346a342a5fa87389ceba7699867856097537326a9398e30c798" Jul 17 18:49:22.790954 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:22.790925 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:49:22.791066 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:22.791042 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:49:22.791128 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:22.791093 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:49:23.716337 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:23.716300 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:23.800869 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:23.800830 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" event={"ID":"11b4048f-f444-4859-a7d1-d21f47224463","Type":"ContainerStarted","Data":"c2eb216d81ed83d57d76e746f91569cf3ee19e5683754a77b1effc0887c3366d"} Jul 17 18:49:24.235377 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:24.235343 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:24.236085 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:24.236053 2576 patch_prober.go:28] interesting pod/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 17 18:49:24.236223 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:24.236113 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" podUID="11b4048f-f444-4859-a7d1-d21f47224463" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 17 18:49:25.236474 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:25.236442 2576 patch_prober.go:28] interesting pod/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 17 18:49:25.237066 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:25.237033 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" podUID="11b4048f-f444-4859-a7d1-d21f47224463" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 17 18:49:26.235839 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:26.235796 2576 patch_prober.go:28] interesting pod/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 17 18:49:26.236065 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:26.235870 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" podUID="11b4048f-f444-4859-a7d1-d21f47224463" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 17 18:49:27.236489 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:27.236445 2576 patch_prober.go:28] interesting pod/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 17 18:49:27.237010 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:27.236616 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" podUID="11b4048f-f444-4859-a7d1-d21f47224463" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 17 18:49:28.256446 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:28.256411 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:28.257114 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:28.257090 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:28.257600 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:28.257581 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:49:31.025910 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:31.025816 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:31.130465 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:31.130425 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:32.800106 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:32.800063 2576 patch_prober.go:28] interesting pod/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 17 18:49:32.800573 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:32.800119 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" podUID="5891f91d-0d8a-40ad-90f9-82a2ef847604" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 17 18:49:33.848182 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:33.848155 2576 generic.go:356] "Generic (PLEG): container finished" podID="5891f91d-0d8a-40ad-90f9-82a2ef847604" containerID="70a98c5458f0431291794bec6e3c13f91daaf22240433fee775386384ea0ef1d" exitCode=0 Jul 17 18:49:33.848597 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:33.848230 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" event={"ID":"5891f91d-0d8a-40ad-90f9-82a2ef847604","Type":"ContainerDied","Data":"70a98c5458f0431291794bec6e3c13f91daaf22240433fee775386384ea0ef1d"} Jul 17 18:49:33.848720 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:33.848703 2576 scope.go:117] "RemoveContainer" containerID="70a98c5458f0431291794bec6e3c13f91daaf22240433fee775386384ea0ef1d" Jul 17 18:49:33.849808 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:33.849778 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:49:33.849893 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:33.849877 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:49:33.849933 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:33.849925 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:49:34.857912 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:34.857877 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" event={"ID":"5891f91d-0d8a-40ad-90f9-82a2ef847604","Type":"ContainerStarted","Data":"3bb1aa3d1292fd1e630c04edc9fcc5666c497ae3898888f93db2b58976c185c5"} Jul 17 18:49:35.337687 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:35.337655 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:35.338039 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:35.338015 2576 patch_prober.go:28] interesting pod/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 17 18:49:35.338215 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:35.338188 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" podUID="5891f91d-0d8a-40ad-90f9-82a2ef847604" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 17 18:49:36.337670 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:36.337636 2576 patch_prober.go:28] interesting pod/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 17 18:49:36.338158 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:36.337695 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" podUID="5891f91d-0d8a-40ad-90f9-82a2ef847604" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 17 18:49:37.337656 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:37.337620 2576 patch_prober.go:28] interesting pod/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 17 18:49:37.337935 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:37.337907 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" podUID="5891f91d-0d8a-40ad-90f9-82a2ef847604" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 17 18:49:38.337487 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:38.337452 2576 patch_prober.go:28] interesting pod/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 17 18:49:38.337751 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:38.337722 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" podUID="5891f91d-0d8a-40ad-90f9-82a2ef847604" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 17 18:49:39.340622 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:39.340595 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:39.341020 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:39.340895 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:39.341453 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:39.341437 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:49:39.780080 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:39.780006 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:39.881744 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:39.881706 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:40.787559 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:40.787527 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:40.892386 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:40.892363 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:41.079409 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:41.079377 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:45.243432 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:45.243360 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nwqlr_c6017e7d-5ed2-4d7d-ba64-ba9ce933828f/console-operator/1.log" Jul 17 18:49:45.248866 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:45.248847 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6pqqj_a67c7573-deca-4960-b69f-5ad3bda075a8/ovn-acl-logging/0.log" Jul 17 18:49:45.250572 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:45.250555 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nwqlr_c6017e7d-5ed2-4d7d-ba64-ba9ce933828f/console-operator/1.log" Jul 17 18:49:45.255826 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:45.255810 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6pqqj_a67c7573-deca-4960-b69f-5ad3bda075a8/ovn-acl-logging/0.log" Jul 17 18:49:45.323876 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:45.323858 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:51.372586 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:51.372544 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:51.453152 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:51.453122 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:55.977162 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:55.977130 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5"] Jul 17 18:49:55.977583 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:55.977367 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" podUID="11b4048f-f444-4859-a7d1-d21f47224463" containerName="istio-proxy" containerID="cri-o://c2eb216d81ed83d57d76e746f91569cf3ee19e5683754a77b1effc0887c3366d" gracePeriod=30 Jul 17 18:49:55.997638 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:55.997614 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:56.226262 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:56.226232 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:56.906158 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:56.906116 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:57.014850 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:57.014820 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:49:58.259344 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:58.259308 2576 patch_prober.go:28] interesting pod/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused Jul 17 18:49:58.259717 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:49:58.259373 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" podUID="11b4048f-f444-4859-a7d1-d21f47224463" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 17 18:50:01.243281 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.243223 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:50:01.314547 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.314518 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11b4048f-f444-4859-a7d1-d21f47224463-istio-data\") pod \"11b4048f-f444-4859-a7d1-d21f47224463\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " Jul 17 18:50:01.314709 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.314554 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11b4048f-f444-4859-a7d1-d21f47224463-istio-envoy\") pod \"11b4048f-f444-4859-a7d1-d21f47224463\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " Jul 17 18:50:01.314709 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.314576 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b4048f-f444-4859-a7d1-d21f47224463-credential-socket\") pod \"11b4048f-f444-4859-a7d1-d21f47224463\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " Jul 17 18:50:01.314709 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.314590 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b4048f-f444-4859-a7d1-d21f47224463-workload-socket\") pod \"11b4048f-f444-4859-a7d1-d21f47224463\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " Jul 17 18:50:01.314709 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.314643 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klvk8\" (UniqueName: \"kubernetes.io/projected/11b4048f-f444-4859-a7d1-d21f47224463-kube-api-access-klvk8\") pod \"11b4048f-f444-4859-a7d1-d21f47224463\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " Jul 17 18:50:01.314709 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.314692 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11b4048f-f444-4859-a7d1-d21f47224463-istio-token\") pod \"11b4048f-f444-4859-a7d1-d21f47224463\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " Jul 17 18:50:01.315002 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.314748 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11b4048f-f444-4859-a7d1-d21f47224463-workload-certs\") pod \"11b4048f-f444-4859-a7d1-d21f47224463\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " Jul 17 18:50:01.315002 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.314783 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11b4048f-f444-4859-a7d1-d21f47224463-istiod-ca-cert\") pod \"11b4048f-f444-4859-a7d1-d21f47224463\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " Jul 17 18:50:01.315002 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.314815 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11b4048f-f444-4859-a7d1-d21f47224463-istio-podinfo\") pod \"11b4048f-f444-4859-a7d1-d21f47224463\" (UID: \"11b4048f-f444-4859-a7d1-d21f47224463\") " Jul 17 18:50:01.315002 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.314925 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11b4048f-f444-4859-a7d1-d21f47224463-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "11b4048f-f444-4859-a7d1-d21f47224463" (UID: "11b4048f-f444-4859-a7d1-d21f47224463"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:50:01.315251 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.315228 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11b4048f-f444-4859-a7d1-d21f47224463-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "11b4048f-f444-4859-a7d1-d21f47224463" (UID: "11b4048f-f444-4859-a7d1-d21f47224463"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:50:01.315311 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.315230 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b4048f-f444-4859-a7d1-d21f47224463-workload-socket\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:50:01.315368 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.315319 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11b4048f-f444-4859-a7d1-d21f47224463-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "11b4048f-f444-4859-a7d1-d21f47224463" (UID: "11b4048f-f444-4859-a7d1-d21f47224463"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:50:01.315581 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.315547 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11b4048f-f444-4859-a7d1-d21f47224463-istio-data" (OuterVolumeSpecName: "istio-data") pod "11b4048f-f444-4859-a7d1-d21f47224463" (UID: "11b4048f-f444-4859-a7d1-d21f47224463"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:50:01.315581 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.315569 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11b4048f-f444-4859-a7d1-d21f47224463-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "11b4048f-f444-4859-a7d1-d21f47224463" (UID: "11b4048f-f444-4859-a7d1-d21f47224463"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:50:01.316919 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.316897 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11b4048f-f444-4859-a7d1-d21f47224463-kube-api-access-klvk8" (OuterVolumeSpecName: "kube-api-access-klvk8") pod "11b4048f-f444-4859-a7d1-d21f47224463" (UID: "11b4048f-f444-4859-a7d1-d21f47224463"). InnerVolumeSpecName "kube-api-access-klvk8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:50:01.317382 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.317347 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11b4048f-f444-4859-a7d1-d21f47224463-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "11b4048f-f444-4859-a7d1-d21f47224463" (UID: "11b4048f-f444-4859-a7d1-d21f47224463"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:50:01.317465 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.317426 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/11b4048f-f444-4859-a7d1-d21f47224463-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "11b4048f-f444-4859-a7d1-d21f47224463" (UID: "11b4048f-f444-4859-a7d1-d21f47224463"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 18:50:01.317465 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.317432 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11b4048f-f444-4859-a7d1-d21f47224463-istio-token" (OuterVolumeSpecName: "istio-token") pod "11b4048f-f444-4859-a7d1-d21f47224463" (UID: "11b4048f-f444-4859-a7d1-d21f47224463"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:50:01.416064 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.416044 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11b4048f-f444-4859-a7d1-d21f47224463-istio-data\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:50:01.416064 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.416063 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11b4048f-f444-4859-a7d1-d21f47224463-istio-envoy\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:50:01.416189 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.416072 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b4048f-f444-4859-a7d1-d21f47224463-credential-socket\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:50:01.416189 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.416081 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klvk8\" (UniqueName: \"kubernetes.io/projected/11b4048f-f444-4859-a7d1-d21f47224463-kube-api-access-klvk8\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:50:01.416189 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.416090 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11b4048f-f444-4859-a7d1-d21f47224463-istio-token\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:50:01.416189 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.416098 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11b4048f-f444-4859-a7d1-d21f47224463-workload-certs\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:50:01.416189 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.416105 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11b4048f-f444-4859-a7d1-d21f47224463-istiod-ca-cert\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:50:01.416189 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.416112 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11b4048f-f444-4859-a7d1-d21f47224463-istio-podinfo\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:50:01.983908 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.983882 2576 generic.go:356] "Generic (PLEG): container finished" podID="11b4048f-f444-4859-a7d1-d21f47224463" containerID="c2eb216d81ed83d57d76e746f91569cf3ee19e5683754a77b1effc0887c3366d" exitCode=0 Jul 17 18:50:01.984064 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.983934 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" Jul 17 18:50:01.984064 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.983967 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" event={"ID":"11b4048f-f444-4859-a7d1-d21f47224463","Type":"ContainerDied","Data":"c2eb216d81ed83d57d76e746f91569cf3ee19e5683754a77b1effc0887c3366d"} Jul 17 18:50:01.984064 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.984034 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5" event={"ID":"11b4048f-f444-4859-a7d1-d21f47224463","Type":"ContainerDied","Data":"73b454365005f42604ab76ac729067d43b6d1d0dabc5ab01a51ebc94c34230a9"} Jul 17 18:50:01.984064 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.984058 2576 scope.go:117] "RemoveContainer" containerID="c2eb216d81ed83d57d76e746f91569cf3ee19e5683754a77b1effc0887c3366d" Jul 17 18:50:01.992573 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:01.992556 2576 scope.go:117] "RemoveContainer" containerID="7b4a864051a39346a342a5fa87389ceba7699867856097537326a9398e30c798" Jul 17 18:50:02.000182 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:02.000161 2576 scope.go:117] "RemoveContainer" containerID="c2eb216d81ed83d57d76e746f91569cf3ee19e5683754a77b1effc0887c3366d" Jul 17 18:50:02.000435 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:50:02.000417 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2eb216d81ed83d57d76e746f91569cf3ee19e5683754a77b1effc0887c3366d\": container with ID starting with c2eb216d81ed83d57d76e746f91569cf3ee19e5683754a77b1effc0887c3366d not found: ID does not exist" containerID="c2eb216d81ed83d57d76e746f91569cf3ee19e5683754a77b1effc0887c3366d" Jul 17 18:50:02.000476 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:02.000443 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2eb216d81ed83d57d76e746f91569cf3ee19e5683754a77b1effc0887c3366d"} err="failed to get container status \"c2eb216d81ed83d57d76e746f91569cf3ee19e5683754a77b1effc0887c3366d\": rpc error: code = NotFound desc = could not find container \"c2eb216d81ed83d57d76e746f91569cf3ee19e5683754a77b1effc0887c3366d\": container with ID starting with c2eb216d81ed83d57d76e746f91569cf3ee19e5683754a77b1effc0887c3366d not found: ID does not exist" Jul 17 18:50:02.000476 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:02.000460 2576 scope.go:117] "RemoveContainer" containerID="7b4a864051a39346a342a5fa87389ceba7699867856097537326a9398e30c798" Jul 17 18:50:02.000713 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:50:02.000693 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b4a864051a39346a342a5fa87389ceba7699867856097537326a9398e30c798\": container with ID starting with 7b4a864051a39346a342a5fa87389ceba7699867856097537326a9398e30c798 not found: ID does not exist" containerID="7b4a864051a39346a342a5fa87389ceba7699867856097537326a9398e30c798" Jul 17 18:50:02.000795 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:02.000718 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b4a864051a39346a342a5fa87389ceba7699867856097537326a9398e30c798"} err="failed to get container status \"7b4a864051a39346a342a5fa87389ceba7699867856097537326a9398e30c798\": rpc error: code = NotFound desc = could not find container \"7b4a864051a39346a342a5fa87389ceba7699867856097537326a9398e30c798\": container with ID starting with 7b4a864051a39346a342a5fa87389ceba7699867856097537326a9398e30c798 not found: ID does not exist" Jul 17 18:50:02.007064 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:02.007045 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5"] Jul 17 18:50:02.012219 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:02.012200 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-82b1be-openshift-default-5dbd594c5-7swl5"] Jul 17 18:50:03.185547 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:03.185508 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11b4048f-f444-4859-a7d1-d21f47224463" path="/var/lib/kubelet/pods/11b4048f-f444-4859-a7d1-d21f47224463/volumes" Jul 17 18:50:07.313134 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:07.313061 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:11.461788 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:11.461755 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:17.264137 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:17.264105 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:17.351084 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:17.351048 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:22.115185 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:22.115156 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2"] Jul 17 18:50:22.115566 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:22.115337 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" podUID="5891f91d-0d8a-40ad-90f9-82a2ef847604" containerName="istio-proxy" containerID="cri-o://3bb1aa3d1292fd1e630c04edc9fcc5666c497ae3898888f93db2b58976c185c5" gracePeriod=30 Jul 17 18:50:22.144083 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:22.144059 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:22.336345 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:22.336315 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:22.712253 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:22.712212 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:23.071099 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.071069 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h"] Jul 17 18:50:23.071459 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.071446 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cd599fe-33f6-4bd6-ba71-73ca1df15b19" containerName="istio-proxy" Jul 17 18:50:23.071502 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.071460 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cd599fe-33f6-4bd6-ba71-73ca1df15b19" containerName="istio-proxy" Jul 17 18:50:23.071502 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.071472 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11b4048f-f444-4859-a7d1-d21f47224463" containerName="istio-proxy" Jul 17 18:50:23.071502 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.071478 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="11b4048f-f444-4859-a7d1-d21f47224463" containerName="istio-proxy" Jul 17 18:50:23.071502 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.071488 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11b4048f-f444-4859-a7d1-d21f47224463" containerName="istio-proxy" Jul 17 18:50:23.071502 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.071496 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="11b4048f-f444-4859-a7d1-d21f47224463" containerName="istio-proxy" Jul 17 18:50:23.071658 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.071559 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="11b4048f-f444-4859-a7d1-d21f47224463" containerName="istio-proxy" Jul 17 18:50:23.071658 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.071571 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="11b4048f-f444-4859-a7d1-d21f47224463" containerName="istio-proxy" Jul 17 18:50:23.074609 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.074593 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:23.080296 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.080267 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-4280a6-openshift-default-dockercfg-xhkln\"" Jul 17 18:50:23.094013 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.093968 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/211015c5-a43a-4a3d-a596-1755e4083b9d-istio-podinfo\") pod \"e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:23.094107 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.094025 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/211015c5-a43a-4a3d-a596-1755e4083b9d-credential-socket\") pod \"e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:23.094107 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.094045 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/211015c5-a43a-4a3d-a596-1755e4083b9d-istio-envoy\") pod \"e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:23.094107 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.094060 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/211015c5-a43a-4a3d-a596-1755e4083b9d-istio-data\") pod \"e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:23.094216 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.094146 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/211015c5-a43a-4a3d-a596-1755e4083b9d-workload-socket\") pod \"e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:23.094216 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.094181 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/211015c5-a43a-4a3d-a596-1755e4083b9d-workload-certs\") pod \"e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:23.094309 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.094213 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/211015c5-a43a-4a3d-a596-1755e4083b9d-istio-token\") pod \"e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:23.094363 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.094313 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/211015c5-a43a-4a3d-a596-1755e4083b9d-istiod-ca-cert\") pod \"e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:23.094423 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.094363 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vndr\" (UniqueName: \"kubernetes.io/projected/211015c5-a43a-4a3d-a596-1755e4083b9d-kube-api-access-7vndr\") pod \"e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:23.113871 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.113852 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h"] Jul 17 18:50:23.126654 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.126626 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:23.195558 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.195529 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/211015c5-a43a-4a3d-a596-1755e4083b9d-workload-socket\") pod \"e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:23.195777 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.195581 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/211015c5-a43a-4a3d-a596-1755e4083b9d-workload-certs\") pod \"e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:23.195777 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.195633 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/211015c5-a43a-4a3d-a596-1755e4083b9d-istio-token\") pod \"e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:23.195777 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.195710 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/211015c5-a43a-4a3d-a596-1755e4083b9d-istiod-ca-cert\") pod \"e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:23.195777 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.195744 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vndr\" (UniqueName: \"kubernetes.io/projected/211015c5-a43a-4a3d-a596-1755e4083b9d-kube-api-access-7vndr\") pod \"e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:23.195777 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.195773 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/211015c5-a43a-4a3d-a596-1755e4083b9d-istio-podinfo\") pod \"e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:23.196055 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.195874 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/211015c5-a43a-4a3d-a596-1755e4083b9d-workload-socket\") pod \"e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:23.196055 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.195916 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/211015c5-a43a-4a3d-a596-1755e4083b9d-credential-socket\") pod \"e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:23.196055 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.195946 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/211015c5-a43a-4a3d-a596-1755e4083b9d-istio-envoy\") pod \"e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:23.196055 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.195954 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/211015c5-a43a-4a3d-a596-1755e4083b9d-workload-certs\") pod \"e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:23.196055 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.195968 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/211015c5-a43a-4a3d-a596-1755e4083b9d-istio-data\") pod \"e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:23.196256 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.196208 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/211015c5-a43a-4a3d-a596-1755e4083b9d-istio-data\") pod \"e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:23.196256 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.196235 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/211015c5-a43a-4a3d-a596-1755e4083b9d-credential-socket\") pod \"e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:23.196389 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.196370 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/211015c5-a43a-4a3d-a596-1755e4083b9d-istiod-ca-cert\") pod \"e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:23.197971 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.197954 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/211015c5-a43a-4a3d-a596-1755e4083b9d-istio-envoy\") pod \"e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:23.198326 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.198307 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/211015c5-a43a-4a3d-a596-1755e4083b9d-istio-podinfo\") pod \"e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:23.216365 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.216341 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vndr\" (UniqueName: \"kubernetes.io/projected/211015c5-a43a-4a3d-a596-1755e4083b9d-kube-api-access-7vndr\") pod \"e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:23.219021 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.219000 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/211015c5-a43a-4a3d-a596-1755e4083b9d-istio-token\") pod \"e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:23.272567 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.272545 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:23.385224 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.385151 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:23.534945 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.534919 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h"] Jul 17 18:50:23.536287 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:50:23.536261 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod211015c5_a43a_4a3d_a596_1755e4083b9d.slice/crio-c39aa9bd0a07e7c9e911729b2b5f0e69d8f08a66c37fe7aa70d56ae43f3149ed WatchSource:0}: Error finding container c39aa9bd0a07e7c9e911729b2b5f0e69d8f08a66c37fe7aa70d56ae43f3149ed: Status 404 returned error can't find the container with id c39aa9bd0a07e7c9e911729b2b5f0e69d8f08a66c37fe7aa70d56ae43f3149ed Jul 17 18:50:23.538333 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.538301 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:50:23.538408 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.538363 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:50:23.538408 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:23.538394 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:50:24.090165 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:24.090134 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" event={"ID":"211015c5-a43a-4a3d-a596-1755e4083b9d","Type":"ContainerStarted","Data":"b9cd820102a58a5ba8e94a41c02f5094222e079e1196fbe7c90b05abc4282d23"} Jul 17 18:50:24.090472 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:24.090186 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" event={"ID":"211015c5-a43a-4a3d-a596-1755e4083b9d","Type":"ContainerStarted","Data":"c39aa9bd0a07e7c9e911729b2b5f0e69d8f08a66c37fe7aa70d56ae43f3149ed"} Jul 17 18:50:24.119381 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:24.119335 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" podStartSLOduration=1.11932008 podStartE2EDuration="1.11932008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:50:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:50:24.115081653 +0000 UTC m=+2439.388692819" watchObservedRunningTime="2026-07-17 18:50:24.11932008 +0000 UTC m=+2439.392931222" Jul 17 18:50:24.343111 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:24.343026 2576 patch_prober.go:28] interesting pod/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 17 18:50:24.343111 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:24.343095 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" podUID="5891f91d-0d8a-40ad-90f9-82a2ef847604" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 17 18:50:24.385507 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:24.385484 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:24.389782 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:24.389765 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:25.095662 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:25.095634 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:25.096364 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:25.096349 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:26.125544 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:26.125503 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:26.356293 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:26.356262 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:26.456763 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:26.456703 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:26.557324 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:26.557306 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:26.773836 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:26.773783 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:26.875050 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:26.875024 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:27.360600 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:27.360576 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:50:27.431118 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:27.431063 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5891f91d-0d8a-40ad-90f9-82a2ef847604-istio-podinfo\") pod \"5891f91d-0d8a-40ad-90f9-82a2ef847604\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " Jul 17 18:50:27.431118 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:27.431103 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5891f91d-0d8a-40ad-90f9-82a2ef847604-istio-envoy\") pod \"5891f91d-0d8a-40ad-90f9-82a2ef847604\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " Jul 17 18:50:27.431291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:27.431127 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5891f91d-0d8a-40ad-90f9-82a2ef847604-credential-socket\") pod \"5891f91d-0d8a-40ad-90f9-82a2ef847604\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " Jul 17 18:50:27.431291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:27.431180 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5891f91d-0d8a-40ad-90f9-82a2ef847604-workload-certs\") pod \"5891f91d-0d8a-40ad-90f9-82a2ef847604\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " Jul 17 18:50:27.431291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:27.431206 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5891f91d-0d8a-40ad-90f9-82a2ef847604-istio-data\") pod \"5891f91d-0d8a-40ad-90f9-82a2ef847604\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " Jul 17 18:50:27.431291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:27.431221 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5891f91d-0d8a-40ad-90f9-82a2ef847604-istiod-ca-cert\") pod \"5891f91d-0d8a-40ad-90f9-82a2ef847604\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " Jul 17 18:50:27.431291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:27.431248 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5891f91d-0d8a-40ad-90f9-82a2ef847604-workload-socket\") pod \"5891f91d-0d8a-40ad-90f9-82a2ef847604\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " Jul 17 18:50:27.431291 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:27.431273 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5891f91d-0d8a-40ad-90f9-82a2ef847604-istio-token\") pod \"5891f91d-0d8a-40ad-90f9-82a2ef847604\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " Jul 17 18:50:27.431589 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:27.431296 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jln4z\" (UniqueName: \"kubernetes.io/projected/5891f91d-0d8a-40ad-90f9-82a2ef847604-kube-api-access-jln4z\") pod \"5891f91d-0d8a-40ad-90f9-82a2ef847604\" (UID: \"5891f91d-0d8a-40ad-90f9-82a2ef847604\") " Jul 17 18:50:27.431589 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:27.431434 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5891f91d-0d8a-40ad-90f9-82a2ef847604-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5891f91d-0d8a-40ad-90f9-82a2ef847604" (UID: "5891f91d-0d8a-40ad-90f9-82a2ef847604"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:50:27.431589 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:27.431469 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5891f91d-0d8a-40ad-90f9-82a2ef847604-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5891f91d-0d8a-40ad-90f9-82a2ef847604" (UID: "5891f91d-0d8a-40ad-90f9-82a2ef847604"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:50:27.431589 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:27.431574 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5891f91d-0d8a-40ad-90f9-82a2ef847604-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5891f91d-0d8a-40ad-90f9-82a2ef847604" (UID: "5891f91d-0d8a-40ad-90f9-82a2ef847604"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:50:27.431805 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:27.431632 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5891f91d-0d8a-40ad-90f9-82a2ef847604-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5891f91d-0d8a-40ad-90f9-82a2ef847604" (UID: "5891f91d-0d8a-40ad-90f9-82a2ef847604"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:50:27.431866 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:27.431820 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5891f91d-0d8a-40ad-90f9-82a2ef847604-credential-socket\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:50:27.431866 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:27.431839 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5891f91d-0d8a-40ad-90f9-82a2ef847604-workload-certs\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:50:27.431866 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:27.431852 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5891f91d-0d8a-40ad-90f9-82a2ef847604-istiod-ca-cert\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:50:27.431866 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:27.431864 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5891f91d-0d8a-40ad-90f9-82a2ef847604-workload-socket\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:50:27.433088 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:27.433039 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5891f91d-0d8a-40ad-90f9-82a2ef847604-istio-data" (OuterVolumeSpecName: "istio-data") pod "5891f91d-0d8a-40ad-90f9-82a2ef847604" (UID: "5891f91d-0d8a-40ad-90f9-82a2ef847604"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:50:27.433632 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:27.433605 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5891f91d-0d8a-40ad-90f9-82a2ef847604-kube-api-access-jln4z" (OuterVolumeSpecName: "kube-api-access-jln4z") pod "5891f91d-0d8a-40ad-90f9-82a2ef847604" (UID: "5891f91d-0d8a-40ad-90f9-82a2ef847604"). InnerVolumeSpecName "kube-api-access-jln4z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:50:27.433721 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:27.433635 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5891f91d-0d8a-40ad-90f9-82a2ef847604-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5891f91d-0d8a-40ad-90f9-82a2ef847604" (UID: "5891f91d-0d8a-40ad-90f9-82a2ef847604"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 18:50:27.433721 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:27.433639 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5891f91d-0d8a-40ad-90f9-82a2ef847604-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5891f91d-0d8a-40ad-90f9-82a2ef847604" (UID: "5891f91d-0d8a-40ad-90f9-82a2ef847604"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:50:27.433795 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:27.433726 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5891f91d-0d8a-40ad-90f9-82a2ef847604-istio-token" (OuterVolumeSpecName: "istio-token") pod "5891f91d-0d8a-40ad-90f9-82a2ef847604" (UID: "5891f91d-0d8a-40ad-90f9-82a2ef847604"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:50:27.532390 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:27.532365 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5891f91d-0d8a-40ad-90f9-82a2ef847604-istio-podinfo\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:50:27.532390 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:27.532388 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5891f91d-0d8a-40ad-90f9-82a2ef847604-istio-envoy\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:50:27.532528 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:27.532414 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5891f91d-0d8a-40ad-90f9-82a2ef847604-istio-data\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:50:27.532528 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:27.532425 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5891f91d-0d8a-40ad-90f9-82a2ef847604-istio-token\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:50:27.532528 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:27.532437 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jln4z\" (UniqueName: \"kubernetes.io/projected/5891f91d-0d8a-40ad-90f9-82a2ef847604-kube-api-access-jln4z\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:50:28.112022 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:28.111993 2576 generic.go:356] "Generic (PLEG): container finished" podID="5891f91d-0d8a-40ad-90f9-82a2ef847604" containerID="3bb1aa3d1292fd1e630c04edc9fcc5666c497ae3898888f93db2b58976c185c5" exitCode=0 Jul 17 18:50:28.112171 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:28.112050 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" Jul 17 18:50:28.112171 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:28.112066 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" event={"ID":"5891f91d-0d8a-40ad-90f9-82a2ef847604","Type":"ContainerDied","Data":"3bb1aa3d1292fd1e630c04edc9fcc5666c497ae3898888f93db2b58976c185c5"} Jul 17 18:50:28.112171 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:28.112144 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2" event={"ID":"5891f91d-0d8a-40ad-90f9-82a2ef847604","Type":"ContainerDied","Data":"1c8d52c6252c786a26edc41555b917b7572f4b66ac22e8555de6a28417fffbcb"} Jul 17 18:50:28.112171 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:28.112170 2576 scope.go:117] "RemoveContainer" containerID="3bb1aa3d1292fd1e630c04edc9fcc5666c497ae3898888f93db2b58976c185c5" Jul 17 18:50:28.120733 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:28.120719 2576 scope.go:117] "RemoveContainer" containerID="70a98c5458f0431291794bec6e3c13f91daaf22240433fee775386384ea0ef1d" Jul 17 18:50:28.128122 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:28.128104 2576 scope.go:117] "RemoveContainer" containerID="3bb1aa3d1292fd1e630c04edc9fcc5666c497ae3898888f93db2b58976c185c5" Jul 17 18:50:28.128432 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:50:28.128414 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bb1aa3d1292fd1e630c04edc9fcc5666c497ae3898888f93db2b58976c185c5\": container with ID starting with 3bb1aa3d1292fd1e630c04edc9fcc5666c497ae3898888f93db2b58976c185c5 not found: ID does not exist" containerID="3bb1aa3d1292fd1e630c04edc9fcc5666c497ae3898888f93db2b58976c185c5" Jul 17 18:50:28.128498 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:28.128439 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bb1aa3d1292fd1e630c04edc9fcc5666c497ae3898888f93db2b58976c185c5"} err="failed to get container status \"3bb1aa3d1292fd1e630c04edc9fcc5666c497ae3898888f93db2b58976c185c5\": rpc error: code = NotFound desc = could not find container \"3bb1aa3d1292fd1e630c04edc9fcc5666c497ae3898888f93db2b58976c185c5\": container with ID starting with 3bb1aa3d1292fd1e630c04edc9fcc5666c497ae3898888f93db2b58976c185c5 not found: ID does not exist" Jul 17 18:50:28.128498 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:28.128456 2576 scope.go:117] "RemoveContainer" containerID="70a98c5458f0431291794bec6e3c13f91daaf22240433fee775386384ea0ef1d" Jul 17 18:50:28.128692 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:50:28.128677 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70a98c5458f0431291794bec6e3c13f91daaf22240433fee775386384ea0ef1d\": container with ID starting with 70a98c5458f0431291794bec6e3c13f91daaf22240433fee775386384ea0ef1d not found: ID does not exist" containerID="70a98c5458f0431291794bec6e3c13f91daaf22240433fee775386384ea0ef1d" Jul 17 18:50:28.128729 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:28.128695 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70a98c5458f0431291794bec6e3c13f91daaf22240433fee775386384ea0ef1d"} err="failed to get container status \"70a98c5458f0431291794bec6e3c13f91daaf22240433fee775386384ea0ef1d\": rpc error: code = NotFound desc = could not find container \"70a98c5458f0431291794bec6e3c13f91daaf22240433fee775386384ea0ef1d\": container with ID starting with 70a98c5458f0431291794bec6e3c13f91daaf22240433fee775386384ea0ef1d not found: ID does not exist" Jul 17 18:50:28.134183 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:28.134164 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2"] Jul 17 18:50:28.138450 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:28.138431 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-2cfeb4-openshift-default-5c9999c5c-g2rh2"] Jul 17 18:50:29.185299 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:29.185270 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5891f91d-0d8a-40ad-90f9-82a2ef847604" path="/var/lib/kubelet/pods/5891f91d-0d8a-40ad-90f9-82a2ef847604/volumes" Jul 17 18:50:30.597447 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:30.597418 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:30.934893 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:30.934830 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:31.246457 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.246387 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7"] Jul 17 18:50:31.246778 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.246744 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5891f91d-0d8a-40ad-90f9-82a2ef847604" containerName="istio-proxy" Jul 17 18:50:31.246778 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.246757 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5891f91d-0d8a-40ad-90f9-82a2ef847604" containerName="istio-proxy" Jul 17 18:50:31.246778 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.246768 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5891f91d-0d8a-40ad-90f9-82a2ef847604" containerName="istio-proxy" Jul 17 18:50:31.246778 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.246773 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5891f91d-0d8a-40ad-90f9-82a2ef847604" containerName="istio-proxy" Jul 17 18:50:31.246937 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.246839 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5891f91d-0d8a-40ad-90f9-82a2ef847604" containerName="istio-proxy" Jul 17 18:50:31.246937 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.246848 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5891f91d-0d8a-40ad-90f9-82a2ef847604" containerName="istio-proxy" Jul 17 18:50:31.251261 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.251240 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:31.255123 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.255103 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-1671a0-openshift-default-dockercfg-k66n9\"" Jul 17 18:50:31.266139 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.266119 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7"] Jul 17 18:50:31.370520 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.370490 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3efda893-d0bf-4b82-b4ee-055a37efe44d-workload-certs\") pod \"e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:31.370692 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.370526 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3efda893-d0bf-4b82-b4ee-055a37efe44d-istio-token\") pod \"e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:31.370692 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.370560 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3efda893-d0bf-4b82-b4ee-055a37efe44d-workload-socket\") pod \"e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:31.370692 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.370592 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3efda893-d0bf-4b82-b4ee-055a37efe44d-istio-data\") pod \"e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:31.370692 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.370657 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3efda893-d0bf-4b82-b4ee-055a37efe44d-istio-envoy\") pod \"e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:31.370931 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.370756 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3efda893-d0bf-4b82-b4ee-055a37efe44d-istio-podinfo\") pod \"e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:31.370931 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.370782 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn5mx\" (UniqueName: \"kubernetes.io/projected/3efda893-d0bf-4b82-b4ee-055a37efe44d-kube-api-access-vn5mx\") pod \"e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:31.370931 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.370824 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3efda893-d0bf-4b82-b4ee-055a37efe44d-istiod-ca-cert\") pod \"e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:31.370931 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.370918 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3efda893-d0bf-4b82-b4ee-055a37efe44d-credential-socket\") pod \"e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:31.392731 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.392704 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:31.471804 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.471772 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3efda893-d0bf-4b82-b4ee-055a37efe44d-istio-data\") pod \"e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:31.471953 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.471807 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3efda893-d0bf-4b82-b4ee-055a37efe44d-istio-envoy\") pod \"e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:31.471953 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.471874 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3efda893-d0bf-4b82-b4ee-055a37efe44d-istio-podinfo\") pod \"e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:31.471953 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.471898 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn5mx\" (UniqueName: \"kubernetes.io/projected/3efda893-d0bf-4b82-b4ee-055a37efe44d-kube-api-access-vn5mx\") pod \"e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:31.472203 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.472025 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3efda893-d0bf-4b82-b4ee-055a37efe44d-istiod-ca-cert\") pod \"e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:31.472392 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.472182 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3efda893-d0bf-4b82-b4ee-055a37efe44d-istio-data\") pod \"e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:31.472506 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.472367 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3efda893-d0bf-4b82-b4ee-055a37efe44d-credential-socket\") pod \"e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:31.472506 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.472467 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3efda893-d0bf-4b82-b4ee-055a37efe44d-workload-certs\") pod \"e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:31.472506 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.472498 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3efda893-d0bf-4b82-b4ee-055a37efe44d-istio-token\") pod \"e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:31.472671 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.472549 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3efda893-d0bf-4b82-b4ee-055a37efe44d-workload-socket\") pod \"e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:31.472671 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.472617 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3efda893-d0bf-4b82-b4ee-055a37efe44d-credential-socket\") pod \"e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:31.472804 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.472782 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3efda893-d0bf-4b82-b4ee-055a37efe44d-istiod-ca-cert\") pod \"e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:31.472907 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.472839 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3efda893-d0bf-4b82-b4ee-055a37efe44d-workload-certs\") pod \"e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:31.472907 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.472860 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3efda893-d0bf-4b82-b4ee-055a37efe44d-workload-socket\") pod \"e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:31.474249 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.474228 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3efda893-d0bf-4b82-b4ee-055a37efe44d-istio-envoy\") pod \"e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:31.474418 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.474400 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3efda893-d0bf-4b82-b4ee-055a37efe44d-istio-podinfo\") pod \"e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:31.480909 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.480882 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3efda893-d0bf-4b82-b4ee-055a37efe44d-istio-token\") pod \"e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:31.481241 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.481220 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn5mx\" (UniqueName: \"kubernetes.io/projected/3efda893-d0bf-4b82-b4ee-055a37efe44d-kube-api-access-vn5mx\") pod \"e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:31.561630 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.561609 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:31.700945 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.700922 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7"] Jul 17 18:50:31.703048 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:50:31.703018 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3efda893_d0bf_4b82_b4ee_055a37efe44d.slice/crio-dfd90f5ad08e38aa9a8a32ebaa436d4905a062841eeb457fc1d25b517ee62ff6 WatchSource:0}: Error finding container dfd90f5ad08e38aa9a8a32ebaa436d4905a062841eeb457fc1d25b517ee62ff6: Status 404 returned error can't find the container with id dfd90f5ad08e38aa9a8a32ebaa436d4905a062841eeb457fc1d25b517ee62ff6 Jul 17 18:50:31.705616 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.705580 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:50:31.705698 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.705671 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:50:31.705733 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.705700 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:50:31.754332 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:31.754251 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:32.134483 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:32.134440 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" event={"ID":"3efda893-d0bf-4b82-b4ee-055a37efe44d","Type":"ContainerStarted","Data":"8c30459a603a8af5431c1039a60b38f92611db13c666d330fbf421fcc7ef3e2f"} Jul 17 18:50:32.134674 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:32.134512 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" event={"ID":"3efda893-d0bf-4b82-b4ee-055a37efe44d","Type":"ContainerStarted","Data":"dfd90f5ad08e38aa9a8a32ebaa436d4905a062841eeb457fc1d25b517ee62ff6"} Jul 17 18:50:32.163402 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:32.163353 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" podStartSLOduration=1.163335815 podStartE2EDuration="1.163335815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:50:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:50:32.162006096 +0000 UTC m=+2447.435617232" watchObservedRunningTime="2026-07-17 18:50:32.163335815 +0000 UTC m=+2447.436946958" Jul 17 18:50:32.561751 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:32.561718 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:32.566812 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:32.566788 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:33.142433 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:33.142404 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:33.147691 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:33.147672 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:34.148401 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:34.148370 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:34.242937 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:34.242900 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:34.362127 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:34.362089 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:34.750225 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:34.750187 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:34.962387 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:34.962359 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:35.062814 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:35.062786 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:37.054702 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:37.054663 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:38.620201 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:38.620171 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:39.179893 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:39.179866 2576 generic.go:356] "Generic (PLEG): container finished" podID="211015c5-a43a-4a3d-a596-1755e4083b9d" containerID="b9cd820102a58a5ba8e94a41c02f5094222e079e1196fbe7c90b05abc4282d23" exitCode=0 Jul 17 18:50:39.185159 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:39.185129 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" event={"ID":"211015c5-a43a-4a3d-a596-1755e4083b9d","Type":"ContainerDied","Data":"b9cd820102a58a5ba8e94a41c02f5094222e079e1196fbe7c90b05abc4282d23"} Jul 17 18:50:39.185524 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:39.185506 2576 scope.go:117] "RemoveContainer" containerID="b9cd820102a58a5ba8e94a41c02f5094222e079e1196fbe7c90b05abc4282d23" Jul 17 18:50:39.186458 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:39.186430 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:50:39.186517 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:39.186497 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:50:39.186553 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:39.186528 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:50:40.095866 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:40.095812 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:40.186368 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:40.186337 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" event={"ID":"211015c5-a43a-4a3d-a596-1755e4083b9d","Type":"ContainerStarted","Data":"3c35424474ff058c89c0debe00f03d2e2ad146b7dfa6d15cc34f6cc43f499737"} Jul 17 18:50:40.386335 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:40.386242 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:40.387540 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:40.387509 2576 patch_prober.go:28] interesting pod/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 17 18:50:40.387696 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:40.387598 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" podUID="211015c5-a43a-4a3d-a596-1755e4083b9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 17 18:50:41.386495 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:41.386465 2576 patch_prober.go:28] interesting pod/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 17 18:50:41.386886 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:41.386517 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" podUID="211015c5-a43a-4a3d-a596-1755e4083b9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 17 18:50:42.386066 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:42.386035 2576 patch_prober.go:28] interesting pod/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 17 18:50:42.386235 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:42.386097 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" podUID="211015c5-a43a-4a3d-a596-1755e4083b9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 17 18:50:43.386286 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:43.386245 2576 patch_prober.go:28] interesting pod/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 17 18:50:43.386660 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:43.386304 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" podUID="211015c5-a43a-4a3d-a596-1755e4083b9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 17 18:50:44.389467 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:44.389435 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:44.389876 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:44.389776 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:44.390378 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:44.390361 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:50:47.582298 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:47.582258 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:47.683623 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:47.683593 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:49.185109 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:49.185074 2576 patch_prober.go:28] interesting pod/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 17 18:50:49.185634 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:49.185118 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" podUID="3efda893-d0bf-4b82-b4ee-055a37efe44d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 17 18:50:50.233279 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:50.233252 2576 generic.go:356] "Generic (PLEG): container finished" podID="3efda893-d0bf-4b82-b4ee-055a37efe44d" containerID="8c30459a603a8af5431c1039a60b38f92611db13c666d330fbf421fcc7ef3e2f" exitCode=0 Jul 17 18:50:50.233649 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:50.233313 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" event={"ID":"3efda893-d0bf-4b82-b4ee-055a37efe44d","Type":"ContainerDied","Data":"8c30459a603a8af5431c1039a60b38f92611db13c666d330fbf421fcc7ef3e2f"} Jul 17 18:50:50.233701 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:50.233655 2576 scope.go:117] "RemoveContainer" containerID="8c30459a603a8af5431c1039a60b38f92611db13c666d330fbf421fcc7ef3e2f" Jul 17 18:50:50.234626 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:50.234597 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:50:50.234700 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:50.234682 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:50:50.234749 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:50.234735 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 17 18:50:51.243825 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:51.242859 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" event={"ID":"3efda893-d0bf-4b82-b4ee-055a37efe44d","Type":"ContainerStarted","Data":"b58ebcb389b52ba72a7c7c04b1d9564e82acb0848446e33854d3cba474f4607d"} Jul 17 18:50:51.562060 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:51.562028 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:51.562287 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:51.562269 2576 patch_prober.go:28] interesting pod/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 17 18:50:51.562333 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:51.562310 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" podUID="3efda893-d0bf-4b82-b4ee-055a37efe44d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 17 18:50:52.562521 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:52.562485 2576 patch_prober.go:28] interesting pod/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 17 18:50:52.562904 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:52.562552 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" podUID="3efda893-d0bf-4b82-b4ee-055a37efe44d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 17 18:50:53.562286 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:53.562248 2576 patch_prober.go:28] interesting pod/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 17 18:50:53.562461 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:53.562314 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" podUID="3efda893-d0bf-4b82-b4ee-055a37efe44d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 17 18:50:54.562256 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:54.562223 2576 patch_prober.go:28] interesting pod/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 17 18:50:54.562622 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:54.562289 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" podUID="3efda893-d0bf-4b82-b4ee-055a37efe44d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 17 18:50:55.565681 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:55.565657 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:55.566068 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:55.565911 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:55.566647 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:55.566631 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:50:55.976385 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:55.976302 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:56.077071 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:56.077045 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:50:57.987833 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:50:57.987803 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:51:25.786432 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:51:25.786402 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:52:02.611906 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:52:02.611876 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:52:02.712515 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:52:02.712484 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:52:16.793656 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:52:16.793624 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:52:16.854712 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:52:16.854683 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:17.216890 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:53:17.216817 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:17.276430 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:53:17.276401 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:25.395376 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:53:25.395342 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:26.432901 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:53:26.432872 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:27.489381 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:53:27.489346 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:41.221122 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:53:41.221084 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:55.136129 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:53:55.136095 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:53:55.233090 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:53:55.233068 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:54:03.565474 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:54:03.565444 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:54:44.519466 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:54:44.519433 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:54:45.271415 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:54:45.271395 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nwqlr_c6017e7d-5ed2-4d7d-ba64-ba9ce933828f/console-operator/1.log" Jul 17 18:54:45.282016 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:54:45.281970 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6pqqj_a67c7573-deca-4960-b69f-5ad3bda075a8/ovn-acl-logging/0.log" Jul 17 18:54:45.285806 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:54:45.285788 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nwqlr_c6017e7d-5ed2-4d7d-ba64-ba9ce933828f/console-operator/1.log" Jul 17 18:54:45.291323 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:54:45.291307 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6pqqj_a67c7573-deca-4960-b69f-5ad3bda075a8/ovn-acl-logging/0.log" Jul 17 18:54:48.924331 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:54:48.924304 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:54:49.900512 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:54:49.900482 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:54:59.714823 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:54:59.714789 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:55:19.280763 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:55:19.280728 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:55:48.380819 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:55:48.380791 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:55:49.529180 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:55:49.529149 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:55:56.898739 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:55:56.898709 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:55:57.006514 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:55:57.006481 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:56:13.454705 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:56:13.454629 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:56:14.610511 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:56:14.610486 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:56:34.275710 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:56:34.275680 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:56:34.373415 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:56:34.373382 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:56:44.253079 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:56:44.253049 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:56:48.824324 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:56:48.824294 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:56:55.092068 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:56:55.092034 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:56:55.157253 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:56:55.157217 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:56:59.506710 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:56:59.506678 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h"] Jul 17 18:56:59.507188 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:56:59.506922 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" podUID="211015c5-a43a-4a3d-a596-1755e4083b9d" containerName="istio-proxy" containerID="cri-o://3c35424474ff058c89c0debe00f03d2e2ad146b7dfa6d15cc34f6cc43f499737" gracePeriod=30 Jul 17 18:56:59.529378 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:56:59.529343 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:56:59.762911 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:56:59.762836 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:57:00.445947 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:00.445917 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:57:00.556190 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:00.556167 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:57:04.755119 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.755096 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:57:04.864875 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.864853 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/211015c5-a43a-4a3d-a596-1755e4083b9d-istiod-ca-cert\") pod \"211015c5-a43a-4a3d-a596-1755e4083b9d\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " Jul 17 18:57:04.865028 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.864886 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vndr\" (UniqueName: \"kubernetes.io/projected/211015c5-a43a-4a3d-a596-1755e4083b9d-kube-api-access-7vndr\") pod \"211015c5-a43a-4a3d-a596-1755e4083b9d\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " Jul 17 18:57:04.865028 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.864911 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/211015c5-a43a-4a3d-a596-1755e4083b9d-credential-socket\") pod \"211015c5-a43a-4a3d-a596-1755e4083b9d\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " Jul 17 18:57:04.865028 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.864930 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/211015c5-a43a-4a3d-a596-1755e4083b9d-istio-data\") pod \"211015c5-a43a-4a3d-a596-1755e4083b9d\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " Jul 17 18:57:04.865028 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.864996 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/211015c5-a43a-4a3d-a596-1755e4083b9d-workload-socket\") pod \"211015c5-a43a-4a3d-a596-1755e4083b9d\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " Jul 17 18:57:04.865239 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.865032 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/211015c5-a43a-4a3d-a596-1755e4083b9d-workload-certs\") pod \"211015c5-a43a-4a3d-a596-1755e4083b9d\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " Jul 17 18:57:04.865239 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.865066 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/211015c5-a43a-4a3d-a596-1755e4083b9d-istio-token\") pod \"211015c5-a43a-4a3d-a596-1755e4083b9d\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " Jul 17 18:57:04.865239 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.865153 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/211015c5-a43a-4a3d-a596-1755e4083b9d-istio-envoy\") pod \"211015c5-a43a-4a3d-a596-1755e4083b9d\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " Jul 17 18:57:04.865239 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.865189 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/211015c5-a43a-4a3d-a596-1755e4083b9d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "211015c5-a43a-4a3d-a596-1755e4083b9d" (UID: "211015c5-a43a-4a3d-a596-1755e4083b9d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:57:04.865239 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.865201 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/211015c5-a43a-4a3d-a596-1755e4083b9d-istio-podinfo\") pod \"211015c5-a43a-4a3d-a596-1755e4083b9d\" (UID: \"211015c5-a43a-4a3d-a596-1755e4083b9d\") " Jul 17 18:57:04.865501 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.865233 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/211015c5-a43a-4a3d-a596-1755e4083b9d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "211015c5-a43a-4a3d-a596-1755e4083b9d" (UID: "211015c5-a43a-4a3d-a596-1755e4083b9d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:57:04.865501 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.865293 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/211015c5-a43a-4a3d-a596-1755e4083b9d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "211015c5-a43a-4a3d-a596-1755e4083b9d" (UID: "211015c5-a43a-4a3d-a596-1755e4083b9d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:57:04.865501 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.865328 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/211015c5-a43a-4a3d-a596-1755e4083b9d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "211015c5-a43a-4a3d-a596-1755e4083b9d" (UID: "211015c5-a43a-4a3d-a596-1755e4083b9d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:57:04.865659 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.865591 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/211015c5-a43a-4a3d-a596-1755e4083b9d-istiod-ca-cert\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:57:04.865659 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.865613 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/211015c5-a43a-4a3d-a596-1755e4083b9d-credential-socket\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:57:04.865659 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.865627 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/211015c5-a43a-4a3d-a596-1755e4083b9d-workload-socket\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:57:04.865659 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.865640 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/211015c5-a43a-4a3d-a596-1755e4083b9d-workload-certs\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:57:04.866209 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.866183 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/211015c5-a43a-4a3d-a596-1755e4083b9d-istio-data" (OuterVolumeSpecName: "istio-data") pod "211015c5-a43a-4a3d-a596-1755e4083b9d" (UID: "211015c5-a43a-4a3d-a596-1755e4083b9d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:57:04.866994 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.866951 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/211015c5-a43a-4a3d-a596-1755e4083b9d-kube-api-access-7vndr" (OuterVolumeSpecName: "kube-api-access-7vndr") pod "211015c5-a43a-4a3d-a596-1755e4083b9d" (UID: "211015c5-a43a-4a3d-a596-1755e4083b9d"). InnerVolumeSpecName "kube-api-access-7vndr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:57:04.867086 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.867074 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/211015c5-a43a-4a3d-a596-1755e4083b9d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "211015c5-a43a-4a3d-a596-1755e4083b9d" (UID: "211015c5-a43a-4a3d-a596-1755e4083b9d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 18:57:04.867465 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.867437 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/211015c5-a43a-4a3d-a596-1755e4083b9d-istio-token" (OuterVolumeSpecName: "istio-token") pod "211015c5-a43a-4a3d-a596-1755e4083b9d" (UID: "211015c5-a43a-4a3d-a596-1755e4083b9d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:57:04.867540 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.867488 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/211015c5-a43a-4a3d-a596-1755e4083b9d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "211015c5-a43a-4a3d-a596-1755e4083b9d" (UID: "211015c5-a43a-4a3d-a596-1755e4083b9d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:57:04.935470 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.935447 2576 generic.go:356] "Generic (PLEG): container finished" podID="211015c5-a43a-4a3d-a596-1755e4083b9d" containerID="3c35424474ff058c89c0debe00f03d2e2ad146b7dfa6d15cc34f6cc43f499737" exitCode=0 Jul 17 18:57:04.935551 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.935492 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" Jul 17 18:57:04.935588 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.935492 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" event={"ID":"211015c5-a43a-4a3d-a596-1755e4083b9d","Type":"ContainerDied","Data":"3c35424474ff058c89c0debe00f03d2e2ad146b7dfa6d15cc34f6cc43f499737"} Jul 17 18:57:04.935628 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.935612 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h" event={"ID":"211015c5-a43a-4a3d-a596-1755e4083b9d","Type":"ContainerDied","Data":"c39aa9bd0a07e7c9e911729b2b5f0e69d8f08a66c37fe7aa70d56ae43f3149ed"} Jul 17 18:57:04.935662 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.935638 2576 scope.go:117] "RemoveContainer" containerID="3c35424474ff058c89c0debe00f03d2e2ad146b7dfa6d15cc34f6cc43f499737" Jul 17 18:57:04.944013 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.943994 2576 scope.go:117] "RemoveContainer" containerID="b9cd820102a58a5ba8e94a41c02f5094222e079e1196fbe7c90b05abc4282d23" Jul 17 18:57:04.951437 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.951420 2576 scope.go:117] "RemoveContainer" containerID="3c35424474ff058c89c0debe00f03d2e2ad146b7dfa6d15cc34f6cc43f499737" Jul 17 18:57:04.951663 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:57:04.951646 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c35424474ff058c89c0debe00f03d2e2ad146b7dfa6d15cc34f6cc43f499737\": container with ID starting with 3c35424474ff058c89c0debe00f03d2e2ad146b7dfa6d15cc34f6cc43f499737 not found: ID does not exist" containerID="3c35424474ff058c89c0debe00f03d2e2ad146b7dfa6d15cc34f6cc43f499737" Jul 17 18:57:04.951712 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.951670 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c35424474ff058c89c0debe00f03d2e2ad146b7dfa6d15cc34f6cc43f499737"} err="failed to get container status \"3c35424474ff058c89c0debe00f03d2e2ad146b7dfa6d15cc34f6cc43f499737\": rpc error: code = NotFound desc = could not find container \"3c35424474ff058c89c0debe00f03d2e2ad146b7dfa6d15cc34f6cc43f499737\": container with ID starting with 3c35424474ff058c89c0debe00f03d2e2ad146b7dfa6d15cc34f6cc43f499737 not found: ID does not exist" Jul 17 18:57:04.951712 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.951686 2576 scope.go:117] "RemoveContainer" containerID="b9cd820102a58a5ba8e94a41c02f5094222e079e1196fbe7c90b05abc4282d23" Jul 17 18:57:04.951924 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:57:04.951907 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9cd820102a58a5ba8e94a41c02f5094222e079e1196fbe7c90b05abc4282d23\": container with ID starting with b9cd820102a58a5ba8e94a41c02f5094222e079e1196fbe7c90b05abc4282d23 not found: ID does not exist" containerID="b9cd820102a58a5ba8e94a41c02f5094222e079e1196fbe7c90b05abc4282d23" Jul 17 18:57:04.951969 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.951930 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9cd820102a58a5ba8e94a41c02f5094222e079e1196fbe7c90b05abc4282d23"} err="failed to get container status \"b9cd820102a58a5ba8e94a41c02f5094222e079e1196fbe7c90b05abc4282d23\": rpc error: code = NotFound desc = could not find container \"b9cd820102a58a5ba8e94a41c02f5094222e079e1196fbe7c90b05abc4282d23\": container with ID starting with b9cd820102a58a5ba8e94a41c02f5094222e079e1196fbe7c90b05abc4282d23 not found: ID does not exist" Jul 17 18:57:04.955589 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.955568 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h"] Jul 17 18:57:04.959247 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.959228 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-4280a6-openshift-default-5c8f7695cf-wlk8h"] Jul 17 18:57:04.966552 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.966532 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/211015c5-a43a-4a3d-a596-1755e4083b9d-istio-token\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:57:04.966616 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.966554 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/211015c5-a43a-4a3d-a596-1755e4083b9d-istio-envoy\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:57:04.966616 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.966563 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/211015c5-a43a-4a3d-a596-1755e4083b9d-istio-podinfo\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:57:04.966616 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.966572 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vndr\" (UniqueName: \"kubernetes.io/projected/211015c5-a43a-4a3d-a596-1755e4083b9d-kube-api-access-7vndr\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:57:04.966616 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:04.966581 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/211015c5-a43a-4a3d-a596-1755e4083b9d-istio-data\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:57:05.186047 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:05.185997 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="211015c5-a43a-4a3d-a596-1755e4083b9d" path="/var/lib/kubelet/pods/211015c5-a43a-4a3d-a596-1755e4083b9d/volumes" Jul 17 18:57:10.418601 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:10.418570 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:57:14.989881 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:14.989852 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:57:20.908515 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:20.908481 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:57:20.984471 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:20.984442 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:57:25.628556 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:25.628525 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7"] Jul 17 18:57:25.628990 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:25.628725 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" podUID="3efda893-d0bf-4b82-b4ee-055a37efe44d" containerName="istio-proxy" containerID="cri-o://b58ebcb389b52ba72a7c7c04b1d9564e82acb0848446e33854d3cba474f4607d" gracePeriod=30 Jul 17 18:57:25.650991 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:25.650953 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:57:25.872337 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:25.872294 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:57:30.870134 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:30.870108 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:57:30.957339 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:30.957279 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3efda893-d0bf-4b82-b4ee-055a37efe44d-istio-envoy\") pod \"3efda893-d0bf-4b82-b4ee-055a37efe44d\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " Jul 17 18:57:30.957339 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:30.957320 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3efda893-d0bf-4b82-b4ee-055a37efe44d-workload-certs\") pod \"3efda893-d0bf-4b82-b4ee-055a37efe44d\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " Jul 17 18:57:30.957534 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:30.957359 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3efda893-d0bf-4b82-b4ee-055a37efe44d-workload-socket\") pod \"3efda893-d0bf-4b82-b4ee-055a37efe44d\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " Jul 17 18:57:30.957534 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:30.957390 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3efda893-d0bf-4b82-b4ee-055a37efe44d-istiod-ca-cert\") pod \"3efda893-d0bf-4b82-b4ee-055a37efe44d\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " Jul 17 18:57:30.957534 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:30.957412 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3efda893-d0bf-4b82-b4ee-055a37efe44d-istio-podinfo\") pod \"3efda893-d0bf-4b82-b4ee-055a37efe44d\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " Jul 17 18:57:30.957534 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:30.957430 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3efda893-d0bf-4b82-b4ee-055a37efe44d-istio-token\") pod \"3efda893-d0bf-4b82-b4ee-055a37efe44d\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " Jul 17 18:57:30.957740 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:30.957554 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3efda893-d0bf-4b82-b4ee-055a37efe44d-credential-socket\") pod \"3efda893-d0bf-4b82-b4ee-055a37efe44d\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " Jul 17 18:57:30.957740 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:30.957612 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vn5mx\" (UniqueName: \"kubernetes.io/projected/3efda893-d0bf-4b82-b4ee-055a37efe44d-kube-api-access-vn5mx\") pod \"3efda893-d0bf-4b82-b4ee-055a37efe44d\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " Jul 17 18:57:30.957740 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:30.957642 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3efda893-d0bf-4b82-b4ee-055a37efe44d-istio-data\") pod \"3efda893-d0bf-4b82-b4ee-055a37efe44d\" (UID: \"3efda893-d0bf-4b82-b4ee-055a37efe44d\") " Jul 17 18:57:30.957740 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:30.957662 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3efda893-d0bf-4b82-b4ee-055a37efe44d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3efda893-d0bf-4b82-b4ee-055a37efe44d" (UID: "3efda893-d0bf-4b82-b4ee-055a37efe44d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:57:30.957740 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:30.957690 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3efda893-d0bf-4b82-b4ee-055a37efe44d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3efda893-d0bf-4b82-b4ee-055a37efe44d" (UID: "3efda893-d0bf-4b82-b4ee-055a37efe44d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:57:30.958014 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:30.957771 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3efda893-d0bf-4b82-b4ee-055a37efe44d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3efda893-d0bf-4b82-b4ee-055a37efe44d" (UID: "3efda893-d0bf-4b82-b4ee-055a37efe44d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:57:30.958014 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:30.957879 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3efda893-d0bf-4b82-b4ee-055a37efe44d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3efda893-d0bf-4b82-b4ee-055a37efe44d" (UID: "3efda893-d0bf-4b82-b4ee-055a37efe44d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:57:30.958132 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:30.958050 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3efda893-d0bf-4b82-b4ee-055a37efe44d-workload-certs\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:57:30.958132 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:30.958070 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3efda893-d0bf-4b82-b4ee-055a37efe44d-workload-socket\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:57:30.958132 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:30.958083 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3efda893-d0bf-4b82-b4ee-055a37efe44d-istiod-ca-cert\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:57:30.958132 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:30.958096 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3efda893-d0bf-4b82-b4ee-055a37efe44d-credential-socket\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:57:30.958599 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:30.958580 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3efda893-d0bf-4b82-b4ee-055a37efe44d-istio-data" (OuterVolumeSpecName: "istio-data") pod "3efda893-d0bf-4b82-b4ee-055a37efe44d" (UID: "3efda893-d0bf-4b82-b4ee-055a37efe44d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:57:30.959877 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:30.959849 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3efda893-d0bf-4b82-b4ee-055a37efe44d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3efda893-d0bf-4b82-b4ee-055a37efe44d" (UID: "3efda893-d0bf-4b82-b4ee-055a37efe44d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:57:30.960037 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:30.959883 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3efda893-d0bf-4b82-b4ee-055a37efe44d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3efda893-d0bf-4b82-b4ee-055a37efe44d" (UID: "3efda893-d0bf-4b82-b4ee-055a37efe44d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 18:57:30.960037 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:30.959897 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3efda893-d0bf-4b82-b4ee-055a37efe44d-istio-token" (OuterVolumeSpecName: "istio-token") pod "3efda893-d0bf-4b82-b4ee-055a37efe44d" (UID: "3efda893-d0bf-4b82-b4ee-055a37efe44d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:57:30.960037 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:30.959919 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3efda893-d0bf-4b82-b4ee-055a37efe44d-kube-api-access-vn5mx" (OuterVolumeSpecName: "kube-api-access-vn5mx") pod "3efda893-d0bf-4b82-b4ee-055a37efe44d" (UID: "3efda893-d0bf-4b82-b4ee-055a37efe44d"). InnerVolumeSpecName "kube-api-access-vn5mx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:57:31.055085 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:31.055041 2576 generic.go:356] "Generic (PLEG): container finished" podID="3efda893-d0bf-4b82-b4ee-055a37efe44d" containerID="b58ebcb389b52ba72a7c7c04b1d9564e82acb0848446e33854d3cba474f4607d" exitCode=0 Jul 17 18:57:31.055261 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:31.055094 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" Jul 17 18:57:31.055261 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:31.055093 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" event={"ID":"3efda893-d0bf-4b82-b4ee-055a37efe44d","Type":"ContainerDied","Data":"b58ebcb389b52ba72a7c7c04b1d9564e82acb0848446e33854d3cba474f4607d"} Jul 17 18:57:31.055261 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:31.055209 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7" event={"ID":"3efda893-d0bf-4b82-b4ee-055a37efe44d","Type":"ContainerDied","Data":"dfd90f5ad08e38aa9a8a32ebaa436d4905a062841eeb457fc1d25b517ee62ff6"} Jul 17 18:57:31.055261 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:31.055232 2576 scope.go:117] "RemoveContainer" containerID="b58ebcb389b52ba72a7c7c04b1d9564e82acb0848446e33854d3cba474f4607d" Jul 17 18:57:31.058680 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:31.058654 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3efda893-d0bf-4b82-b4ee-055a37efe44d-istio-podinfo\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:57:31.058781 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:31.058682 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3efda893-d0bf-4b82-b4ee-055a37efe44d-istio-token\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:57:31.058781 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:31.058696 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vn5mx\" (UniqueName: \"kubernetes.io/projected/3efda893-d0bf-4b82-b4ee-055a37efe44d-kube-api-access-vn5mx\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:57:31.058781 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:31.058709 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3efda893-d0bf-4b82-b4ee-055a37efe44d-istio-data\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:57:31.058781 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:31.058726 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3efda893-d0bf-4b82-b4ee-055a37efe44d-istio-envoy\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jul 17 18:57:31.064027 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:31.064013 2576 scope.go:117] "RemoveContainer" containerID="8c30459a603a8af5431c1039a60b38f92611db13c666d330fbf421fcc7ef3e2f" Jul 17 18:57:31.071595 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:31.071576 2576 scope.go:117] "RemoveContainer" containerID="b58ebcb389b52ba72a7c7c04b1d9564e82acb0848446e33854d3cba474f4607d" Jul 17 18:57:31.071845 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:57:31.071826 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b58ebcb389b52ba72a7c7c04b1d9564e82acb0848446e33854d3cba474f4607d\": container with ID starting with b58ebcb389b52ba72a7c7c04b1d9564e82acb0848446e33854d3cba474f4607d not found: ID does not exist" containerID="b58ebcb389b52ba72a7c7c04b1d9564e82acb0848446e33854d3cba474f4607d" Jul 17 18:57:31.071889 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:31.071852 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b58ebcb389b52ba72a7c7c04b1d9564e82acb0848446e33854d3cba474f4607d"} err="failed to get container status \"b58ebcb389b52ba72a7c7c04b1d9564e82acb0848446e33854d3cba474f4607d\": rpc error: code = NotFound desc = could not find container \"b58ebcb389b52ba72a7c7c04b1d9564e82acb0848446e33854d3cba474f4607d\": container with ID starting with b58ebcb389b52ba72a7c7c04b1d9564e82acb0848446e33854d3cba474f4607d not found: ID does not exist" Jul 17 18:57:31.071889 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:31.071869 2576 scope.go:117] "RemoveContainer" containerID="8c30459a603a8af5431c1039a60b38f92611db13c666d330fbf421fcc7ef3e2f" Jul 17 18:57:31.072082 ip-10-0-132-68 kubenswrapper[2576]: E0717 18:57:31.072066 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c30459a603a8af5431c1039a60b38f92611db13c666d330fbf421fcc7ef3e2f\": container with ID starting with 8c30459a603a8af5431c1039a60b38f92611db13c666d330fbf421fcc7ef3e2f not found: ID does not exist" containerID="8c30459a603a8af5431c1039a60b38f92611db13c666d330fbf421fcc7ef3e2f" Jul 17 18:57:31.072131 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:31.072086 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c30459a603a8af5431c1039a60b38f92611db13c666d330fbf421fcc7ef3e2f"} err="failed to get container status \"8c30459a603a8af5431c1039a60b38f92611db13c666d330fbf421fcc7ef3e2f\": rpc error: code = NotFound desc = could not find container \"8c30459a603a8af5431c1039a60b38f92611db13c666d330fbf421fcc7ef3e2f\": container with ID starting with 8c30459a603a8af5431c1039a60b38f92611db13c666d330fbf421fcc7ef3e2f not found: ID does not exist" Jul 17 18:57:31.085743 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:31.085720 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7"] Jul 17 18:57:31.096369 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:31.096345 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-1671a0-openshift-default-65f6d897bc-h4fl7"] Jul 17 18:57:31.186072 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:31.186053 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3efda893-d0bf-4b82-b4ee-055a37efe44d" path="/var/lib/kubelet/pods/3efda893-d0bf-4b82-b4ee-055a37efe44d/volumes" Jul 17 18:57:31.927073 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:31.927050 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5f5fb87b96-glq24_9bd74a12-063b-4faf-b7cb-fe27b56554d3/manager/0.log" Jul 17 18:57:32.651521 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:32.651500 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9846c54f8-nvnp7_41b0f71f-e1bb-4030-861c-bb5dd52fa752/copy-manifests/0.log" Jul 17 18:57:32.662219 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:32.662195 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9846c54f8-nvnp7_41b0f71f-e1bb-4030-861c-bb5dd52fa752/manager/0.log" Jul 17 18:57:33.037578 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:33.037528 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-59dfc85689-2gljp_7c249a9d-20fb-4331-b7c3-21fd196631e4/maas-api/0.log" Jul 17 18:57:37.369921 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:37.369850 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4p4wlv_4d9fd590-4de6-4c58-8760-d79ad04eb1bd/istio-proxy/0.log" Jul 17 18:57:37.491273 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:37.491249 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-r6ggj_abd1833e-41a6-467c-a21a-b75466997983/discovery/0.log" Jul 17 18:57:37.846704 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:37.846679 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-nbk6d_5b1c7635-d7ef-4616-9078-7a391c0adfde/istio-proxy/1.log" Jul 17 18:57:38.084809 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:38.084779 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-hb58j_949af1d4-703e-461d-bd64-e7656cb87a14/payload-processing/0.log" Jul 17 18:57:38.195571 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:38.195515 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b45f6d8d8-rp2wb_ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27/router/0.log" Jul 17 18:57:38.669507 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:38.669480 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-2jqzs_c56edef8-0c3f-486a-970a-d5f86654a3d7/main/0.log" Jul 17 18:57:38.902747 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:38.902729 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtmdr2_00d8ec73-2166-4b06-9cb2-5661e9793a75/main/0.log" Jul 17 18:57:44.462225 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:44.462195 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:57:44.546933 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:44.546910 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:57:47.473072 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:47.473040 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9sg94_a0e11cff-8760-45ef-80a5-d966038cf469/global-pull-secret-syncer/0.log" Jul 17 18:57:47.582146 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:47.582118 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" Jul 17 18:57:47.678221 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:47.678189 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-68.ec2.internal_058d024324ce103e994a009799d7facb/haproxy/0.log" Jul 17 18:57:55.321104 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:55.321075 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-rsbql_a24dfc7c-8415-4449-908f-4376cf8c694c/cluster-monitoring-operator/0.log" Jul 17 18:57:55.349417 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:55.349394 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-7964f_3c8f09f8-88c0-45aa-8574-e746b1fa4749/kube-state-metrics/0.log" Jul 17 18:57:55.374221 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:55.374196 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-7964f_3c8f09f8-88c0-45aa-8574-e746b1fa4749/kube-rbac-proxy-main/0.log" Jul 17 18:57:55.400079 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:55.400055 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-7964f_3c8f09f8-88c0-45aa-8574-e746b1fa4749/kube-rbac-proxy-self/0.log" Jul 17 18:57:55.659204 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:55.659179 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r96rb_87fe467f-2f60-4f80-b5df-3d062652bb55/node-exporter/0.log" Jul 17 18:57:55.682946 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:55.682920 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r96rb_87fe467f-2f60-4f80-b5df-3d062652bb55/kube-rbac-proxy/0.log" Jul 17 18:57:55.706346 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:55.706324 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r96rb_87fe467f-2f60-4f80-b5df-3d062652bb55/init-textfile/0.log" Jul 17 18:57:55.835115 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:55.835087 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a24ad2e1-8e7f-4726-b9ce-e81ef3173381/prometheus/0.log" Jul 17 18:57:55.860497 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:55.860469 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a24ad2e1-8e7f-4726-b9ce-e81ef3173381/config-reloader/0.log" Jul 17 18:57:55.886783 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:55.886754 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a24ad2e1-8e7f-4726-b9ce-e81ef3173381/thanos-sidecar/0.log" Jul 17 18:57:55.917635 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:55.917571 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a24ad2e1-8e7f-4726-b9ce-e81ef3173381/kube-rbac-proxy-web/0.log" Jul 17 18:57:55.940828 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:55.940808 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a24ad2e1-8e7f-4726-b9ce-e81ef3173381/kube-rbac-proxy/0.log" Jul 17 18:57:55.967972 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:55.967926 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a24ad2e1-8e7f-4726-b9ce-e81ef3173381/kube-rbac-proxy-thanos/0.log" Jul 17 18:57:55.992092 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:55.992073 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a24ad2e1-8e7f-4726-b9ce-e81ef3173381/init-config-reloader/0.log" Jul 17 18:57:57.244083 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.244054 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5s9n5/perf-node-gather-daemonset-9jqgn"] Jul 17 18:57:57.244449 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.244384 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3efda893-d0bf-4b82-b4ee-055a37efe44d" containerName="istio-proxy" Jul 17 18:57:57.244449 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.244397 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3efda893-d0bf-4b82-b4ee-055a37efe44d" containerName="istio-proxy" Jul 17 18:57:57.244449 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.244405 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="211015c5-a43a-4a3d-a596-1755e4083b9d" containerName="istio-proxy" Jul 17 18:57:57.244449 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.244411 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="211015c5-a43a-4a3d-a596-1755e4083b9d" containerName="istio-proxy" Jul 17 18:57:57.244449 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.244421 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3efda893-d0bf-4b82-b4ee-055a37efe44d" containerName="istio-proxy" Jul 17 18:57:57.244449 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.244426 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3efda893-d0bf-4b82-b4ee-055a37efe44d" containerName="istio-proxy" Jul 17 18:57:57.244449 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.244441 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="211015c5-a43a-4a3d-a596-1755e4083b9d" containerName="istio-proxy" Jul 17 18:57:57.244449 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.244446 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="211015c5-a43a-4a3d-a596-1755e4083b9d" containerName="istio-proxy" Jul 17 18:57:57.244693 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.244505 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3efda893-d0bf-4b82-b4ee-055a37efe44d" containerName="istio-proxy" Jul 17 18:57:57.244693 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.244515 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3efda893-d0bf-4b82-b4ee-055a37efe44d" containerName="istio-proxy" Jul 17 18:57:57.244693 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.244522 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="211015c5-a43a-4a3d-a596-1755e4083b9d" containerName="istio-proxy" Jul 17 18:57:57.244693 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.244527 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="211015c5-a43a-4a3d-a596-1755e4083b9d" containerName="istio-proxy" Jul 17 18:57:57.247549 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.247526 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5s9n5/perf-node-gather-daemonset-9jqgn" Jul 17 18:57:57.249618 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.249599 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5s9n5\"/\"kube-root-ca.crt\"" Jul 17 18:57:57.249756 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.249739 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5s9n5\"/\"openshift-service-ca.crt\"" Jul 17 18:57:57.250299 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.250283 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5s9n5\"/\"default-dockercfg-dw4zq\"" Jul 17 18:57:57.256618 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.256598 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5s9n5/perf-node-gather-daemonset-9jqgn"] Jul 17 18:57:57.377335 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.377309 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3186221-30d6-4449-bc37-c0dbaee6020e-sys\") pod \"perf-node-gather-daemonset-9jqgn\" (UID: \"c3186221-30d6-4449-bc37-c0dbaee6020e\") " pod="openshift-must-gather-5s9n5/perf-node-gather-daemonset-9jqgn" Jul 17 18:57:57.377464 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.377394 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c44p4\" (UniqueName: \"kubernetes.io/projected/c3186221-30d6-4449-bc37-c0dbaee6020e-kube-api-access-c44p4\") pod \"perf-node-gather-daemonset-9jqgn\" (UID: \"c3186221-30d6-4449-bc37-c0dbaee6020e\") " pod="openshift-must-gather-5s9n5/perf-node-gather-daemonset-9jqgn" Jul 17 18:57:57.377464 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.377430 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3186221-30d6-4449-bc37-c0dbaee6020e-lib-modules\") pod \"perf-node-gather-daemonset-9jqgn\" (UID: \"c3186221-30d6-4449-bc37-c0dbaee6020e\") " pod="openshift-must-gather-5s9n5/perf-node-gather-daemonset-9jqgn" Jul 17 18:57:57.377573 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.377470 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c3186221-30d6-4449-bc37-c0dbaee6020e-podres\") pod \"perf-node-gather-daemonset-9jqgn\" (UID: \"c3186221-30d6-4449-bc37-c0dbaee6020e\") " pod="openshift-must-gather-5s9n5/perf-node-gather-daemonset-9jqgn" Jul 17 18:57:57.377573 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.377520 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c3186221-30d6-4449-bc37-c0dbaee6020e-proc\") pod \"perf-node-gather-daemonset-9jqgn\" (UID: \"c3186221-30d6-4449-bc37-c0dbaee6020e\") " pod="openshift-must-gather-5s9n5/perf-node-gather-daemonset-9jqgn" Jul 17 18:57:57.478613 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.478591 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c44p4\" (UniqueName: \"kubernetes.io/projected/c3186221-30d6-4449-bc37-c0dbaee6020e-kube-api-access-c44p4\") pod \"perf-node-gather-daemonset-9jqgn\" (UID: \"c3186221-30d6-4449-bc37-c0dbaee6020e\") " pod="openshift-must-gather-5s9n5/perf-node-gather-daemonset-9jqgn" Jul 17 18:57:57.478722 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.478620 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3186221-30d6-4449-bc37-c0dbaee6020e-lib-modules\") pod \"perf-node-gather-daemonset-9jqgn\" (UID: \"c3186221-30d6-4449-bc37-c0dbaee6020e\") " pod="openshift-must-gather-5s9n5/perf-node-gather-daemonset-9jqgn" Jul 17 18:57:57.478722 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.478644 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c3186221-30d6-4449-bc37-c0dbaee6020e-podres\") pod \"perf-node-gather-daemonset-9jqgn\" (UID: \"c3186221-30d6-4449-bc37-c0dbaee6020e\") " pod="openshift-must-gather-5s9n5/perf-node-gather-daemonset-9jqgn" Jul 17 18:57:57.478722 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.478670 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c3186221-30d6-4449-bc37-c0dbaee6020e-proc\") pod \"perf-node-gather-daemonset-9jqgn\" (UID: \"c3186221-30d6-4449-bc37-c0dbaee6020e\") " pod="openshift-must-gather-5s9n5/perf-node-gather-daemonset-9jqgn" Jul 17 18:57:57.478722 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.478686 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3186221-30d6-4449-bc37-c0dbaee6020e-sys\") pod \"perf-node-gather-daemonset-9jqgn\" (UID: \"c3186221-30d6-4449-bc37-c0dbaee6020e\") " pod="openshift-must-gather-5s9n5/perf-node-gather-daemonset-9jqgn" Jul 17 18:57:57.478878 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.478747 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3186221-30d6-4449-bc37-c0dbaee6020e-sys\") pod \"perf-node-gather-daemonset-9jqgn\" (UID: \"c3186221-30d6-4449-bc37-c0dbaee6020e\") " pod="openshift-must-gather-5s9n5/perf-node-gather-daemonset-9jqgn" Jul 17 18:57:57.478878 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.478778 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c3186221-30d6-4449-bc37-c0dbaee6020e-podres\") pod \"perf-node-gather-daemonset-9jqgn\" (UID: \"c3186221-30d6-4449-bc37-c0dbaee6020e\") " pod="openshift-must-gather-5s9n5/perf-node-gather-daemonset-9jqgn" Jul 17 18:57:57.478878 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.478828 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3186221-30d6-4449-bc37-c0dbaee6020e-lib-modules\") pod \"perf-node-gather-daemonset-9jqgn\" (UID: \"c3186221-30d6-4449-bc37-c0dbaee6020e\") " pod="openshift-must-gather-5s9n5/perf-node-gather-daemonset-9jqgn" Jul 17 18:57:57.478878 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.478832 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c3186221-30d6-4449-bc37-c0dbaee6020e-proc\") pod \"perf-node-gather-daemonset-9jqgn\" (UID: \"c3186221-30d6-4449-bc37-c0dbaee6020e\") " pod="openshift-must-gather-5s9n5/perf-node-gather-daemonset-9jqgn" Jul 17 18:57:57.487542 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.487527 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c44p4\" (UniqueName: \"kubernetes.io/projected/c3186221-30d6-4449-bc37-c0dbaee6020e-kube-api-access-c44p4\") pod \"perf-node-gather-daemonset-9jqgn\" (UID: \"c3186221-30d6-4449-bc37-c0dbaee6020e\") " pod="openshift-must-gather-5s9n5/perf-node-gather-daemonset-9jqgn" Jul 17 18:57:57.509787 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.509731 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-4qhqv_b52e56d1-173f-4c0b-b1ce-23904145a410/networking-console-plugin/0.log" Jul 17 18:57:57.557179 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.557156 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5s9n5/perf-node-gather-daemonset-9jqgn" Jul 17 18:57:57.681969 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:57.681944 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5s9n5/perf-node-gather-daemonset-9jqgn"] Jul 17 18:57:57.684316 ip-10-0-132-68 kubenswrapper[2576]: W0717 18:57:57.684292 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc3186221_30d6_4449_bc37_c0dbaee6020e.slice/crio-b81ef5c9a428d00032671dcbed0fce6cccb77e4bd210d171b581456b0ed85804 WatchSource:0}: Error finding container b81ef5c9a428d00032671dcbed0fce6cccb77e4bd210d171b581456b0ed85804: Status 404 returned error can't find the container with id b81ef5c9a428d00032671dcbed0fce6cccb77e4bd210d171b581456b0ed85804 Jul 17 18:57:58.179418 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:58.179387 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5s9n5/perf-node-gather-daemonset-9jqgn" event={"ID":"c3186221-30d6-4449-bc37-c0dbaee6020e","Type":"ContainerStarted","Data":"ecbd247a2cfd728b21d51fed1355e80f9403ae69b2841ff04ee33471499d4e5e"} Jul 17 18:57:58.179614 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:58.179444 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5s9n5/perf-node-gather-daemonset-9jqgn" event={"ID":"c3186221-30d6-4449-bc37-c0dbaee6020e","Type":"ContainerStarted","Data":"b81ef5c9a428d00032671dcbed0fce6cccb77e4bd210d171b581456b0ed85804"} Jul 17 18:57:58.179614 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:58.179473 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5s9n5/perf-node-gather-daemonset-9jqgn" Jul 17 18:57:58.192035 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:58.191970 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nwqlr_c6017e7d-5ed2-4d7d-ba64-ba9ce933828f/console-operator/1.log" Jul 17 18:57:58.196840 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:58.196817 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nwqlr_c6017e7d-5ed2-4d7d-ba64-ba9ce933828f/console-operator/2.log" Jul 17 18:57:58.197142 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:58.197099 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5s9n5/perf-node-gather-daemonset-9jqgn" podStartSLOduration=1.1970851279999999 podStartE2EDuration="1.197085128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:57:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:57:58.195153679 +0000 UTC m=+2893.468764837" watchObservedRunningTime="2026-07-17 18:57:58.197085128 +0000 UTC m=+2893.470696269" Jul 17 18:57:59.305578 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:57:59.305539 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-l8njm_0d37e971-7201-4f9b-a44c-e79ba57d5baa/volume-data-source-validator/0.log" Jul 17 18:58:00.330492 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:00.330463 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8jm6x_852a630b-6cf7-4355-ae0b-49347eb3c4e1/dns/0.log" Jul 17 18:58:00.354218 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:00.354195 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8jm6x_852a630b-6cf7-4355-ae0b-49347eb3c4e1/kube-rbac-proxy/0.log" Jul 17 18:58:00.502317 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:00.502297 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5hrpr_d74aab62-4360-4e21-9d51-57f2a63da3c4/dns-node-resolver/0.log" Jul 17 18:58:01.164848 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:01.164818 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hpwk9_780d0c42-753a-4fd5-96d3-8a6fd8177494/node-ca/0.log" Jul 17 18:58:02.227446 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:02.227417 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4p4wlv_4d9fd590-4de6-4c58-8760-d79ad04eb1bd/istio-proxy/0.log" Jul 17 18:58:02.342151 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:02.342124 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-r6ggj_abd1833e-41a6-467c-a21a-b75466997983/discovery/0.log" Jul 17 18:58:02.449453 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:02.449427 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-nbk6d_5b1c7635-d7ef-4616-9078-7a391c0adfde/istio-proxy/0.log" Jul 17 18:58:02.479171 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:02.479098 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-nbk6d_5b1c7635-d7ef-4616-9078-7a391c0adfde/istio-proxy/1.log" Jul 17 18:58:02.556451 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:02.556426 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-hb58j_949af1d4-703e-461d-bd64-e7656cb87a14/payload-processing/0.log" Jul 17 18:58:02.593724 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:02.593694 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b45f6d8d8-rp2wb_ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27/router/0.log" Jul 17 18:58:03.305215 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:03.305190 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gx8nh_f345c916-a0a1-4610-90b8-113fada2a49a/serve-healthcheck-canary/0.log" Jul 17 18:58:03.849035 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:03.849007 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-jxfz9_e82b2034-7625-41a9-a5f0-cec5b7605b5c/insights-operator/0.log" Jul 17 18:58:03.849504 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:03.849482 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-jxfz9_e82b2034-7625-41a9-a5f0-cec5b7605b5c/insights-operator/1.log" Jul 17 18:58:03.873929 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:03.873904 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-27qbd_69ee051d-625f-4724-abcb-49fa56dd3983/kube-rbac-proxy/0.log" Jul 17 18:58:03.898936 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:03.898894 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-27qbd_69ee051d-625f-4724-abcb-49fa56dd3983/exporter/0.log" Jul 17 18:58:03.922177 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:03.922155 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-27qbd_69ee051d-625f-4724-abcb-49fa56dd3983/extractor/0.log" Jul 17 18:58:04.194792 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:04.194719 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5s9n5/perf-node-gather-daemonset-9jqgn" Jul 17 18:58:06.593145 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:06.593116 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5f5fb87b96-glq24_9bd74a12-063b-4faf-b7cb-fe27b56554d3/manager/0.log" Jul 17 18:58:06.903374 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:06.903353 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9846c54f8-nvnp7_41b0f71f-e1bb-4030-861c-bb5dd52fa752/manager/0.log" Jul 17 18:58:06.928908 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:06.928882 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9846c54f8-nvnp7_41b0f71f-e1bb-4030-861c-bb5dd52fa752/copy-manifests/0.log" Jul 17 18:58:08.192522 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:08.192494 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4p4wlv_4d9fd590-4de6-4c58-8760-d79ad04eb1bd/istio-proxy/0.log" Jul 17 18:58:08.255743 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:08.255718 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7cf59f64f5-jzwm8_4553dba1-6212-4374-bb08-abde863e0940/manager/0.log" Jul 17 18:58:08.316130 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:08.316108 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-r6ggj_abd1833e-41a6-467c-a21a-b75466997983/discovery/0.log" Jul 17 18:58:08.372804 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:08.372782 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-nbk6d_5b1c7635-d7ef-4616-9078-7a391c0adfde/istio-proxy/0.log" Jul 17 18:58:08.403708 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:08.403687 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-nbk6d_5b1c7635-d7ef-4616-9078-7a391c0adfde/istio-proxy/1.log" Jul 17 18:58:08.449643 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:08.449572 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-hb58j_949af1d4-703e-461d-bd64-e7656cb87a14/payload-processing/0.log" Jul 17 18:58:08.472278 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:08.472259 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b45f6d8d8-rp2wb_ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27/router/0.log" Jul 17 18:58:09.726883 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:09.726852 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4p4wlv_4d9fd590-4de6-4c58-8760-d79ad04eb1bd/istio-proxy/0.log" Jul 17 18:58:09.836847 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:09.836815 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-r6ggj_abd1833e-41a6-467c-a21a-b75466997983/discovery/0.log" Jul 17 18:58:09.891613 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:09.891580 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-nbk6d_5b1c7635-d7ef-4616-9078-7a391c0adfde/istio-proxy/0.log" Jul 17 18:58:09.920090 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:09.920070 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-nbk6d_5b1c7635-d7ef-4616-9078-7a391c0adfde/istio-proxy/1.log" Jul 17 18:58:09.964874 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:09.964850 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-hb58j_949af1d4-703e-461d-bd64-e7656cb87a14/payload-processing/0.log" Jul 17 18:58:09.982662 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:09.982611 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b45f6d8d8-rp2wb_ea07b754-ab4b-4f27-bdb4-d7ac4f0bce27/router/0.log" Jul 17 18:58:11.604671 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:11.604644 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lv9fl_ddb5f6e9-3b9b-4087-8196-b55e879f7c62/konnectivity-agent/0.log" limit=1024 Jul 17 18:58:13.686623 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:13.686591 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-hghkd_490303ef-c958-4260-84ee-1852150aae55/kube-storage-version-migrator-operator/1.log" Jul 17 18:58:13.687556 ip-10-0-132-68 kubenswrapper[2576]: I0717 18:58:13.687535 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-hghkd_490303ef-c958-4260-84ee-1852150aae55/kube-storage-version-migrator-operator/0.log"