Jul 15 13:09:11.761871 ip-10-0-132-114 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 15 13:09:11.761880 ip-10-0-132-114 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 15 13:09:11.761887 ip-10-0-132-114 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 15 13:09:11.762106 ip-10-0-132-114 systemd[1]: Failed to start Kubernetes Kubelet. Jul 15 13:09:21.922785 ip-10-0-132-114 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 15 13:09:21.922809 ip-10-0-132-114 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 70e68af6a7094a12a75d2eb2e27a6596 -- Jul 15 13:11:25.410834 ip-10-0-132-114 systemd[1]: Starting Kubernetes Kubelet... Jul 15 13:11:26.860515 ip-10-0-132-114 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 13:11:26.860515 ip-10-0-132-114 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 15 13:11:26.860515 ip-10-0-132-114 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 13:11:26.860515 ip-10-0-132-114 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 15 13:11:26.860515 ip-10-0-132-114 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 13:11:26.861742 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.861655 2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 15 13:11:26.866274 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866257 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 13:11:26.866274 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866273 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 13:11:26.866336 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866277 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 13:11:26.866336 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866281 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 13:11:26.866336 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866285 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 13:11:26.866336 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866294 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 13:11:26.866336 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866299 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 13:11:26.866336 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866302 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 13:11:26.866336 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866305 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 13:11:26.866336 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866308 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 13:11:26.866336 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866311 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 13:11:26.866336 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866313 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 13:11:26.866336 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866316 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 13:11:26.866336 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866319 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 13:11:26.866336 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866321 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 13:11:26.866336 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866324 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 13:11:26.866336 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866327 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 13:11:26.866336 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866329 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 13:11:26.866336 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866332 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 13:11:26.866336 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866335 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 13:11:26.866336 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866338 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 13:11:26.866770 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866340 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 15 13:11:26.866770 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866343 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 13:11:26.866770 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866346 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 13:11:26.866770 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866349 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 13:11:26.866770 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866351 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 13:11:26.866770 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866354 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 13:11:26.866770 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866357 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 13:11:26.866770 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866359 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 13:11:26.866770 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866362 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 13:11:26.866770 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866365 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 13:11:26.866770 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866368 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 13:11:26.866770 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866370 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 13:11:26.866770 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866373 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 13:11:26.866770 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866375 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 13:11:26.866770 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866378 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 13:11:26.866770 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866381 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 13:11:26.866770 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866383 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 13:11:26.866770 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866386 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 13:11:26.866770 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866388 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 13:11:26.866770 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866391 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 13:11:26.867287 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866393 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 13:11:26.867287 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866396 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 13:11:26.867287 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866398 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 13:11:26.867287 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866401 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 13:11:26.867287 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866403 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 13:11:26.867287 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866406 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 13:11:26.867287 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866408 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 13:11:26.867287 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866411 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 13:11:26.867287 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866413 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 13:11:26.867287 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866416 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 13:11:26.867287 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866418 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 13:11:26.867287 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866421 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 13:11:26.867287 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866423 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 13:11:26.867287 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866427 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 13:11:26.867287 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866429 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 13:11:26.867287 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866433 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 13:11:26.867287 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866436 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 13:11:26.867287 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866438 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 13:11:26.867287 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866441 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 13:11:26.867287 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866443 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 13:11:26.867778 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866446 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 13:11:26.867778 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866449 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 13:11:26.867778 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866451 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 13:11:26.867778 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866454 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 13:11:26.867778 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866456 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 13:11:26.867778 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866459 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 13:11:26.867778 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866461 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 13:11:26.867778 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866464 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 13:11:26.867778 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866466 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 13:11:26.867778 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866469 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 13:11:26.867778 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866471 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 13:11:26.867778 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866474 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 13:11:26.867778 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866477 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 13:11:26.867778 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866479 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 13:11:26.867778 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866482 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 13:11:26.867778 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866487 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 13:11:26.867778 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866490 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 13:11:26.867778 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866493 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 13:11:26.867778 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866496 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 13:11:26.868275 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866499 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 13:11:26.868275 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866501 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 13:11:26.868275 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866505 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 13:11:26.868275 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866508 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 13:11:26.868275 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866511 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 13:11:26.868275 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866514 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 13:11:26.868275 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866519 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 13:11:26.868275 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866522 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 13:11:26.868275 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866525 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 13:11:26.868275 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866528 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 13:11:26.868275 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866531 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 13:11:26.868275 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866534 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 13:11:26.868275 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866537 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 13:11:26.868275 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866539 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 13:11:26.868275 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866542 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 13:11:26.868275 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866545 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 13:11:26.868275 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866548 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 13:11:26.868275 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866551 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 13:11:26.868275 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.866553 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 13:11:26.868275 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868128 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 13:11:26.868741 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868136 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 13:11:26.868741 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868139 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 13:11:26.868741 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868143 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 13:11:26.868741 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868145 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 13:11:26.868741 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868148 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 13:11:26.868741 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868151 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 13:11:26.868741 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868154 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 13:11:26.868741 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868156 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 13:11:26.868741 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868159 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 13:11:26.868741 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868161 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 13:11:26.868741 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868164 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 13:11:26.868741 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868166 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 13:11:26.868741 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868169 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 13:11:26.868741 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868172 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 13:11:26.868741 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868175 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 13:11:26.868741 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868177 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 13:11:26.868741 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868180 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 13:11:26.868741 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868183 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 13:11:26.868741 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868186 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 13:11:26.869233 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868188 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 13:11:26.869233 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868193 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 13:11:26.869233 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868196 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 13:11:26.869233 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868200 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 13:11:26.869233 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868203 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 13:11:26.869233 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868206 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 13:11:26.869233 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868208 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 13:11:26.869233 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868211 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 13:11:26.869233 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868214 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 13:11:26.869233 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868218 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 13:11:26.869233 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868220 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 13:11:26.869233 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868223 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 13:11:26.869233 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868226 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 13:11:26.869233 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868228 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 13:11:26.869233 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868231 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 13:11:26.869233 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868234 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 13:11:26.869233 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868237 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 13:11:26.869233 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868239 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 13:11:26.869233 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868242 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 13:11:26.869685 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868245 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 13:11:26.869685 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868248 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 13:11:26.869685 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868251 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 13:11:26.869685 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868253 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 13:11:26.869685 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868256 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 13:11:26.869685 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868258 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 13:11:26.869685 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868261 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 13:11:26.869685 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868263 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 13:11:26.869685 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868266 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 13:11:26.869685 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868269 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 13:11:26.869685 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868271 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 13:11:26.869685 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868276 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 13:11:26.869685 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868279 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 13:11:26.869685 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868282 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 13:11:26.869685 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868285 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 13:11:26.869685 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868288 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 13:11:26.869685 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868291 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 13:11:26.869685 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868295 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 13:11:26.869685 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868298 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 13:11:26.870164 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868301 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 13:11:26.870164 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868304 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 13:11:26.870164 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868306 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 13:11:26.870164 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868309 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 13:11:26.870164 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868312 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 13:11:26.870164 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868315 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 13:11:26.870164 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868318 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 13:11:26.870164 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868320 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 13:11:26.870164 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868323 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 13:11:26.870164 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868325 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 13:11:26.870164 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868328 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 13:11:26.870164 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868331 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 13:11:26.870164 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868334 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 13:11:26.870164 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868336 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 13:11:26.870164 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868339 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 13:11:26.870164 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868341 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 13:11:26.870164 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868344 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 15 13:11:26.870164 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868348 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 13:11:26.870164 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868350 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 13:11:26.870164 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868353 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 13:11:26.870663 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868355 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 13:11:26.870663 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868358 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 13:11:26.870663 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868361 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 13:11:26.870663 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868364 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 13:11:26.870663 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868367 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 13:11:26.870663 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868369 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 13:11:26.870663 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868372 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 13:11:26.870663 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868374 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 13:11:26.870663 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868377 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 13:11:26.870663 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868379 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 13:11:26.870663 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868381 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 13:11:26.870663 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868384 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 13:11:26.870663 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868387 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 13:11:26.870663 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868390 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 13:11:26.870663 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868392 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 13:11:26.870663 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868395 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 13:11:26.870663 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868397 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 13:11:26.870663 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868400 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 13:11:26.870663 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868403 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 13:11:26.870663 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868405 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 13:11:26.871162 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868407 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 13:11:26.871162 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868806 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 13:11:26.871162 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868811 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 13:11:26.871162 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868814 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 13:11:26.871162 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868817 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 13:11:26.871162 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868820 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 13:11:26.871162 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868823 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 13:11:26.871162 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868825 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 13:11:26.871162 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868828 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 13:11:26.871162 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868831 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 13:11:26.871162 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868833 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 13:11:26.871162 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868836 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 13:11:26.871162 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868838 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 13:11:26.871162 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868842 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 13:11:26.871162 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868844 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 13:11:26.871162 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868847 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 13:11:26.871162 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868850 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 13:11:26.871162 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868853 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 13:11:26.871162 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868857 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 13:11:26.871162 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868861 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 15 13:11:26.871740 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868864 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 13:11:26.871740 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868867 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 13:11:26.871740 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868869 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 13:11:26.871740 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868872 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 13:11:26.871740 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868875 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 13:11:26.871740 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868878 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 13:11:26.871740 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868881 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 13:11:26.871740 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868884 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 13:11:26.871740 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868888 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 13:11:26.871740 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868891 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 13:11:26.871740 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868895 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 13:11:26.871740 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868898 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 13:11:26.871740 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868901 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 13:11:26.871740 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868904 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 13:11:26.871740 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868906 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 13:11:26.871740 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868909 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 13:11:26.871740 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868912 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 13:11:26.871740 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868914 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 13:11:26.871740 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868917 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 13:11:26.871740 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868919 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 13:11:26.872231 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868922 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 13:11:26.872231 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868924 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 13:11:26.872231 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868927 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 13:11:26.872231 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868929 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 13:11:26.872231 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868932 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 13:11:26.872231 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868936 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 13:11:26.872231 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868938 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 13:11:26.872231 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868941 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 13:11:26.872231 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868945 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 13:11:26.872231 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868948 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 13:11:26.872231 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868951 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 13:11:26.872231 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868954 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 13:11:26.872231 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868956 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 13:11:26.872231 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868959 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 13:11:26.872231 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868961 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 13:11:26.872231 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868964 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 13:11:26.872231 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868966 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 13:11:26.872231 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868969 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 13:11:26.872231 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868971 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 13:11:26.872231 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868974 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 13:11:26.872703 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868991 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 13:11:26.872703 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.868996 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 13:11:26.872703 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869000 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 13:11:26.872703 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869004 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 13:11:26.872703 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869008 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 13:11:26.872703 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869011 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 13:11:26.872703 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869014 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 13:11:26.872703 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869017 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 13:11:26.872703 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869019 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 13:11:26.872703 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869022 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 13:11:26.872703 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869024 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 13:11:26.872703 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869027 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 13:11:26.872703 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869029 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 13:11:26.872703 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869033 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 13:11:26.872703 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869035 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 13:11:26.872703 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869038 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 13:11:26.872703 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869040 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 13:11:26.872703 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869043 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 13:11:26.872703 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869045 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 13:11:26.873207 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869047 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 13:11:26.873207 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869050 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 13:11:26.873207 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869052 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 13:11:26.873207 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869055 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 13:11:26.873207 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869058 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 13:11:26.873207 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869060 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 13:11:26.873207 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869062 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 13:11:26.873207 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869065 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 13:11:26.873207 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869067 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 13:11:26.873207 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869070 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 13:11:26.873207 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869072 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 13:11:26.873207 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869075 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 13:11:26.873207 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869077 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 13:11:26.873207 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869080 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 13:11:26.873207 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869082 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 13:11:26.873207 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869085 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 13:11:26.873207 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869088 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 13:11:26.873207 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869091 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 13:11:26.873207 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869093 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 13:11:26.873207 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869096 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 13:11:26.873673 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869098 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 13:11:26.873673 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869170 2554 flags.go:64] FLAG: --address="0.0.0.0" Jul 15 13:11:26.873673 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869177 2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 15 13:11:26.873673 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869183 2554 flags.go:64] FLAG: --anonymous-auth="true" Jul 15 13:11:26.873673 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869188 2554 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 15 13:11:26.873673 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869192 2554 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 15 13:11:26.873673 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869195 2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 15 13:11:26.873673 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869199 2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 15 13:11:26.873673 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869203 2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 15 13:11:26.873673 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869207 2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 15 13:11:26.873673 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869210 2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 15 13:11:26.873673 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869213 2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 15 13:11:26.873673 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869217 2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 15 13:11:26.873673 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869220 2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 15 13:11:26.873673 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869223 2554 flags.go:64] FLAG: --cgroup-root="" Jul 15 13:11:26.873673 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869226 2554 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 15 13:11:26.873673 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869229 2554 flags.go:64] FLAG: --client-ca-file="" Jul 15 13:11:26.873673 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869232 2554 flags.go:64] FLAG: --cloud-provider="external" Jul 15 13:11:26.873673 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869235 2554 flags.go:64] FLAG: --cluster-dns="[]" Jul 15 13:11:26.873673 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869240 2554 flags.go:64] FLAG: --cluster-domain="" Jul 15 13:11:26.873673 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869243 2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 15 13:11:26.873673 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869246 2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 15 13:11:26.873673 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869249 2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 15 13:11:26.873673 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869252 2554 flags.go:64] FLAG: --container-log-max-files="5" Jul 15 13:11:26.874268 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869256 2554 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 15 13:11:26.874268 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869259 2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 15 13:11:26.874268 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869262 2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 15 13:11:26.874268 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869265 2554 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 15 13:11:26.874268 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869268 2554 flags.go:64] FLAG: --contention-profiling="false" Jul 15 13:11:26.874268 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869272 2554 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 15 13:11:26.874268 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869275 2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 15 13:11:26.874268 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869278 2554 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 15 13:11:26.874268 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869281 2554 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 15 13:11:26.874268 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869286 2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 15 13:11:26.874268 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869289 2554 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 15 13:11:26.874268 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869292 2554 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 15 13:11:26.874268 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869295 2554 flags.go:64] FLAG: --enable-load-reader="false" Jul 15 13:11:26.874268 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869298 2554 flags.go:64] FLAG: --enable-server="true" Jul 15 13:11:26.874268 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869303 2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 15 13:11:26.874268 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869308 2554 flags.go:64] FLAG: --event-burst="100" Jul 15 13:11:26.874268 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869311 2554 flags.go:64] FLAG: --event-qps="50" Jul 15 13:11:26.874268 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869314 2554 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 15 13:11:26.874268 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869317 2554 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 15 13:11:26.874268 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869319 2554 flags.go:64] FLAG: --eviction-hard="" Jul 15 13:11:26.874268 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869323 2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 15 13:11:26.874268 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869326 2554 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 15 13:11:26.874268 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869329 2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 15 13:11:26.874268 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869332 2554 flags.go:64] FLAG: --eviction-soft="" Jul 15 13:11:26.874268 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869335 2554 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 15 13:11:26.874843 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869338 2554 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 15 13:11:26.874843 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869341 2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 15 13:11:26.874843 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869343 2554 flags.go:64] FLAG: --experimental-mounter-path="" Jul 15 13:11:26.874843 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869346 2554 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 15 13:11:26.874843 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869349 2554 flags.go:64] FLAG: --fail-swap-on="true" Jul 15 13:11:26.874843 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869352 2554 flags.go:64] FLAG: --feature-gates="" Jul 15 13:11:26.874843 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869355 2554 flags.go:64] FLAG: --file-check-frequency="20s" Jul 15 13:11:26.874843 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869358 2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 15 13:11:26.874843 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869361 2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 15 13:11:26.874843 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869365 2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 15 13:11:26.874843 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869368 2554 flags.go:64] FLAG: --healthz-port="10248" Jul 15 13:11:26.874843 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869371 2554 flags.go:64] FLAG: --help="false" Jul 15 13:11:26.874843 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869374 2554 flags.go:64] FLAG: --hostname-override="ip-10-0-132-114.ec2.internal" Jul 15 13:11:26.874843 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869379 2554 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 15 13:11:26.874843 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869382 2554 flags.go:64] FLAG: --http-check-frequency="20s" Jul 15 13:11:26.874843 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869385 2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 15 13:11:26.874843 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869388 2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 15 13:11:26.874843 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869392 2554 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 15 13:11:26.874843 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869395 2554 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 15 13:11:26.874843 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869397 2554 flags.go:64] FLAG: --image-service-endpoint="" Jul 15 13:11:26.874843 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869400 2554 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 15 13:11:26.874843 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869404 2554 flags.go:64] FLAG: --kube-api-burst="100" Jul 15 13:11:26.874843 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869407 2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 15 13:11:26.875448 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869410 2554 flags.go:64] FLAG: --kube-api-qps="50" Jul 15 13:11:26.875448 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869413 2554 flags.go:64] FLAG: --kube-reserved="" Jul 15 13:11:26.875448 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869416 2554 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 15 13:11:26.875448 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869418 2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 15 13:11:26.875448 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869422 2554 flags.go:64] FLAG: --kubelet-cgroups="" Jul 15 13:11:26.875448 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869425 2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 15 13:11:26.875448 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869428 2554 flags.go:64] FLAG: --lock-file="" Jul 15 13:11:26.875448 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869430 2554 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 15 13:11:26.875448 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869433 2554 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 15 13:11:26.875448 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869436 2554 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 15 13:11:26.875448 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869441 2554 flags.go:64] FLAG: --log-json-split-stream="false" Jul 15 13:11:26.875448 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869444 2554 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 15 13:11:26.875448 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869447 2554 flags.go:64] FLAG: --log-text-split-stream="false" Jul 15 13:11:26.875448 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869450 2554 flags.go:64] FLAG: --logging-format="text" Jul 15 13:11:26.875448 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869453 2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 15 13:11:26.875448 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869456 2554 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 15 13:11:26.875448 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869459 2554 flags.go:64] FLAG: --manifest-url="" Jul 15 13:11:26.875448 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869461 2554 flags.go:64] FLAG: --manifest-url-header="" Jul 15 13:11:26.875448 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869465 2554 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 15 13:11:26.875448 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869468 2554 flags.go:64] FLAG: --max-open-files="1000000" Jul 15 13:11:26.875448 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869472 2554 flags.go:64] FLAG: --max-pods="110" Jul 15 13:11:26.875448 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869474 2554 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 15 13:11:26.875448 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869479 2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 15 13:11:26.875448 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869482 2554 flags.go:64] FLAG: --memory-manager-policy="None" Jul 15 13:11:26.875448 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869485 2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 15 13:11:26.876081 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869488 2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 15 13:11:26.876081 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869491 2554 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 15 13:11:26.876081 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869494 2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 15 13:11:26.876081 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869500 2554 flags.go:64] FLAG: --node-status-max-images="50" Jul 15 13:11:26.876081 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869503 2554 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 15 13:11:26.876081 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869507 2554 flags.go:64] FLAG: --oom-score-adj="-999" Jul 15 13:11:26.876081 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869511 2554 flags.go:64] FLAG: --pod-cidr="" Jul 15 13:11:26.876081 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869514 2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 15 13:11:26.876081 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869518 2554 flags.go:64] FLAG: --pod-manifest-path="" Jul 15 13:11:26.876081 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869521 2554 flags.go:64] FLAG: --pod-max-pids="-1" Jul 15 13:11:26.876081 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869524 2554 flags.go:64] FLAG: --pods-per-core="0" Jul 15 13:11:26.876081 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869527 2554 flags.go:64] FLAG: --port="10250" Jul 15 13:11:26.876081 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869530 2554 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 15 13:11:26.876081 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869533 2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f197720805f5d790" Jul 15 13:11:26.876081 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869536 2554 flags.go:64] FLAG: --qos-reserved="" Jul 15 13:11:26.876081 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869539 2554 flags.go:64] FLAG: --read-only-port="10255" Jul 15 13:11:26.876081 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869542 2554 flags.go:64] FLAG: --register-node="true" Jul 15 13:11:26.876081 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869544 2554 flags.go:64] FLAG: --register-with-taints="" Jul 15 13:11:26.876081 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869548 2554 flags.go:64] FLAG: --registry-burst="10" Jul 15 13:11:26.876081 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869551 2554 flags.go:64] FLAG: --registry-qps="5" Jul 15 13:11:26.876081 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869554 2554 flags.go:64] FLAG: --reserved-cpus="" Jul 15 13:11:26.876081 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869556 2554 flags.go:64] FLAG: --reserved-memory="" Jul 15 13:11:26.876081 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869560 2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 15 13:11:26.876081 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869563 2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 15 13:11:26.876081 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869566 2554 flags.go:64] FLAG: --rotate-certificates="false" Jul 15 13:11:26.876744 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869569 2554 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 15 13:11:26.876744 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869571 2554 flags.go:64] FLAG: --runonce="false" Jul 15 13:11:26.876744 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869574 2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 15 13:11:26.876744 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869577 2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 15 13:11:26.876744 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869580 2554 flags.go:64] FLAG: --seccomp-default="false" Jul 15 13:11:26.876744 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869586 2554 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 15 13:11:26.876744 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869590 2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 15 13:11:26.876744 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869592 2554 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 15 13:11:26.876744 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869595 2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 15 13:11:26.876744 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869598 2554 flags.go:64] FLAG: --storage-driver-password="root" Jul 15 13:11:26.876744 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869601 2554 flags.go:64] FLAG: --storage-driver-secure="false" Jul 15 13:11:26.876744 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869604 2554 flags.go:64] FLAG: --storage-driver-table="stats" Jul 15 13:11:26.876744 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869608 2554 flags.go:64] FLAG: --storage-driver-user="root" Jul 15 13:11:26.876744 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869611 2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 15 13:11:26.876744 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869615 2554 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 15 13:11:26.876744 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869618 2554 flags.go:64] FLAG: --system-cgroups="" Jul 15 13:11:26.876744 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869621 2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 15 13:11:26.876744 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869626 2554 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 15 13:11:26.876744 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869628 2554 flags.go:64] FLAG: --tls-cert-file="" Jul 15 13:11:26.876744 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869631 2554 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 15 13:11:26.876744 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869635 2554 flags.go:64] FLAG: --tls-min-version="" Jul 15 13:11:26.876744 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869638 2554 flags.go:64] FLAG: --tls-private-key-file="" Jul 15 13:11:26.876744 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869641 2554 flags.go:64] FLAG: --topology-manager-policy="none" Jul 15 13:11:26.876744 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869644 2554 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 15 13:11:26.876744 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869647 2554 flags.go:64] FLAG: --topology-manager-scope="container" Jul 15 13:11:26.877730 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869650 2554 flags.go:64] FLAG: --v="2" Jul 15 13:11:26.877730 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869654 2554 flags.go:64] FLAG: --version="false" Jul 15 13:11:26.877730 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869661 2554 flags.go:64] FLAG: --vmodule="" Jul 15 13:11:26.877730 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869664 2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 15 13:11:26.877730 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.869667 2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 15 13:11:26.877730 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869787 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 13:11:26.877730 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869791 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 13:11:26.877730 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869795 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 13:11:26.877730 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869798 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 13:11:26.877730 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869802 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 13:11:26.877730 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869804 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 13:11:26.877730 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869807 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 13:11:26.877730 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869811 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 13:11:26.877730 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869814 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 13:11:26.877730 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869817 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 13:11:26.877730 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869819 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 13:11:26.877730 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869822 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 13:11:26.877730 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869826 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 13:11:26.877730 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869830 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 13:11:26.877730 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869835 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 13:11:26.877730 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869838 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 13:11:26.878266 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869840 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 13:11:26.878266 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869843 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 13:11:26.878266 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869846 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 13:11:26.878266 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869848 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 13:11:26.878266 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869851 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 13:11:26.878266 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869854 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 13:11:26.878266 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869857 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 13:11:26.878266 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869860 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 13:11:26.878266 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869863 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 13:11:26.878266 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869865 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 13:11:26.878266 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869868 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 13:11:26.878266 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869870 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 13:11:26.878266 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869873 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 13:11:26.878266 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869877 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 13:11:26.878266 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869880 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 13:11:26.878266 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869883 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 13:11:26.878266 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869886 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 13:11:26.878266 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869889 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 13:11:26.878266 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869891 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 13:11:26.878266 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869894 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 13:11:26.878754 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869896 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 13:11:26.878754 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869899 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 13:11:26.878754 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869901 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 13:11:26.878754 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869906 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 13:11:26.878754 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869908 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 13:11:26.878754 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869911 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 13:11:26.878754 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869915 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 13:11:26.878754 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869918 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 13:11:26.878754 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869921 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 13:11:26.878754 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869924 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 13:11:26.878754 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869929 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 13:11:26.878754 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869931 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 13:11:26.878754 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869934 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 13:11:26.878754 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869937 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 13:11:26.878754 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869939 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 13:11:26.878754 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869942 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 13:11:26.878754 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869944 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 13:11:26.878754 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869947 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 13:11:26.878754 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869950 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 13:11:26.879304 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869952 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 13:11:26.879304 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869955 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 13:11:26.879304 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869957 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 13:11:26.879304 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869960 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 13:11:26.879304 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869963 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 13:11:26.879304 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869965 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 13:11:26.879304 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869968 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 13:11:26.879304 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869970 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 13:11:26.879304 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869973 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 13:11:26.879304 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.869976 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 13:11:26.879304 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870000 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 13:11:26.879304 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870002 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 13:11:26.879304 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870005 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 13:11:26.879304 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870007 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 13:11:26.879304 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870010 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 13:11:26.879304 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870012 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 13:11:26.879304 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870016 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 13:11:26.879304 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870019 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 13:11:26.879304 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870022 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 13:11:26.879769 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870024 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 13:11:26.879769 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870027 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 15 13:11:26.879769 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870030 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 13:11:26.879769 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870033 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 13:11:26.879769 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870037 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 13:11:26.879769 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870040 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 13:11:26.879769 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870043 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 13:11:26.879769 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870045 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 13:11:26.879769 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870048 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 13:11:26.879769 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870050 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 13:11:26.879769 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870053 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 13:11:26.879769 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870055 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 13:11:26.879769 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870058 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 13:11:26.879769 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870060 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 13:11:26.879769 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870063 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 13:11:26.879769 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870065 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 13:11:26.879769 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870068 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 13:11:26.879769 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870070 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 13:11:26.879769 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870074 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 13:11:26.879769 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870076 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 13:11:26.880255 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870079 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 13:11:26.880255 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870081 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 13:11:26.880255 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870084 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 13:11:26.880255 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870086 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 13:11:26.880255 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.870089 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 13:11:26.880255 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.870827 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 13:11:26.880255 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.879755 2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 15 13:11:26.880255 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.879770 2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 15 13:11:26.880255 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.879791 2554 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 15 13:11:26.880255 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.879797 2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 15 13:11:26.880255 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.879907 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 13:11:26.880255 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.879912 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 13:11:26.880255 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.879916 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 13:11:26.880255 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.879919 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 13:11:26.880255 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.879922 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 13:11:26.880641 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.879926 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 13:11:26.880641 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.879928 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 13:11:26.880641 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.879931 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 13:11:26.880641 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.879934 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 13:11:26.880641 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.879940 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 13:11:26.880641 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.879942 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 13:11:26.880641 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.879945 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 13:11:26.880641 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.879947 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 13:11:26.880641 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.879950 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 13:11:26.880641 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.879953 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 13:11:26.880641 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.879956 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 13:11:26.880641 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.879958 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 13:11:26.880641 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.879961 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 13:11:26.880641 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.879964 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 13:11:26.880641 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.879967 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 13:11:26.880641 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.879970 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 13:11:26.880641 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.879975 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 13:11:26.880641 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.879994 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 13:11:26.880641 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.879998 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 13:11:26.881103 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880001 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 13:11:26.881103 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880004 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 13:11:26.881103 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880006 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 13:11:26.881103 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880009 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 13:11:26.881103 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880012 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 13:11:26.881103 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880023 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 13:11:26.881103 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880027 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 13:11:26.881103 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880030 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 13:11:26.881103 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880034 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 13:11:26.881103 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880040 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 13:11:26.881103 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880043 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 13:11:26.881103 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880046 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 13:11:26.881103 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880049 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 13:11:26.881103 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880052 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 13:11:26.881103 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880055 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 13:11:26.881103 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880058 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 13:11:26.881103 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880061 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 13:11:26.881103 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880064 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 13:11:26.881103 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880067 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 13:11:26.881103 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880069 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 13:11:26.881570 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880072 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 13:11:26.881570 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880075 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 13:11:26.881570 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880080 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 13:11:26.881570 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880083 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 13:11:26.881570 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880086 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 13:11:26.881570 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880089 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 13:11:26.881570 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880091 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 13:11:26.881570 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880094 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 13:11:26.881570 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880097 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 13:11:26.881570 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880099 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 13:11:26.881570 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880102 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 13:11:26.881570 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880105 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 13:11:26.881570 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880108 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 13:11:26.881570 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880111 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 13:11:26.881570 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880114 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 13:11:26.881570 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880119 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 13:11:26.881570 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880121 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 13:11:26.881570 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880124 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 13:11:26.881570 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880133 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 13:11:26.881570 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880136 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 13:11:26.882057 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880138 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 13:11:26.882057 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880141 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 13:11:26.882057 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880144 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 13:11:26.882057 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880147 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 13:11:26.882057 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880149 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 13:11:26.882057 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880152 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 13:11:26.882057 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880155 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 13:11:26.882057 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880159 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 13:11:26.882057 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880165 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 13:11:26.882057 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880168 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 13:11:26.882057 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880171 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 13:11:26.882057 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880174 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 13:11:26.882057 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880178 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 13:11:26.882057 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880182 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 13:11:26.882057 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880185 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 13:11:26.882057 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880188 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 13:11:26.882057 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880191 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 13:11:26.882057 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880194 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 13:11:26.882057 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880197 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 13:11:26.882534 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880202 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 13:11:26.882534 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880205 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 13:11:26.882534 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880208 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 13:11:26.882534 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880210 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 13:11:26.882534 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880213 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 13:11:26.882534 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880216 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 13:11:26.882534 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880219 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 13:11:26.882534 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880221 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 13:11:26.882534 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880224 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 13:11:26.882534 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880227 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 13:11:26.882534 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880230 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 13:11:26.882534 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880232 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 13:11:26.882534 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880241 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 13:11:26.882534 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880246 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 13:11:26.882534 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880249 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 15 13:11:26.882534 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880251 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 13:11:26.882919 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.880257 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 13:11:26.882919 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880511 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 13:11:26.882919 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880516 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 13:11:26.882919 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880519 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 13:11:26.882919 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880522 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 13:11:26.882919 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880525 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 13:11:26.882919 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880528 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 13:11:26.882919 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880531 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 13:11:26.882919 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880534 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 13:11:26.882919 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880538 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 13:11:26.882919 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880542 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 13:11:26.882919 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880545 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 13:11:26.882919 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880548 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 13:11:26.883369 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880554 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 13:11:26.883369 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880557 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 13:11:26.883369 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880560 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 13:11:26.883369 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880563 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 13:11:26.883369 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880565 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 13:11:26.883369 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880568 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 13:11:26.883369 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880571 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 13:11:26.883369 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880574 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 13:11:26.883369 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880576 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 13:11:26.883369 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880580 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 13:11:26.883369 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880583 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 13:11:26.883369 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880585 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 13:11:26.883369 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880588 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 13:11:26.883369 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880593 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 13:11:26.883369 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880596 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 13:11:26.883369 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880598 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 13:11:26.883369 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880608 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 13:11:26.883369 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880611 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 13:11:26.883369 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880613 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 13:11:26.883369 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880616 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 13:11:26.883900 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880619 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 13:11:26.883900 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880622 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 15 13:11:26.883900 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880625 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 13:11:26.883900 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880627 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 13:11:26.883900 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880630 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 13:11:26.883900 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880632 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 13:11:26.883900 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880637 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 13:11:26.883900 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880640 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 13:11:26.883900 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880643 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 13:11:26.883900 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880645 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 13:11:26.883900 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880648 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 13:11:26.883900 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880651 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 13:11:26.883900 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880654 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 13:11:26.883900 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880656 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 13:11:26.883900 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880659 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 13:11:26.883900 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880662 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 13:11:26.883900 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880664 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 13:11:26.883900 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880667 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 13:11:26.883900 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880672 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 13:11:26.883900 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880675 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 13:11:26.884420 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880678 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 13:11:26.884420 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880681 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 13:11:26.884420 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880683 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 13:11:26.884420 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880686 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 13:11:26.884420 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880689 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 13:11:26.884420 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880691 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 13:11:26.884420 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880694 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 13:11:26.884420 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880697 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 13:11:26.884420 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880699 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 13:11:26.884420 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880707 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 13:11:26.884420 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880710 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 13:11:26.884420 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880716 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 13:11:26.884420 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880718 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 13:11:26.884420 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880721 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 13:11:26.884420 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880723 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 13:11:26.884420 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880726 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 13:11:26.884420 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880728 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 13:11:26.884420 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880731 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 13:11:26.884420 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880733 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 13:11:26.884420 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880742 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 13:11:26.884893 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880745 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 13:11:26.884893 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880747 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 13:11:26.884893 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880751 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 13:11:26.884893 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880757 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 13:11:26.884893 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880760 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 13:11:26.884893 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880762 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 13:11:26.884893 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880765 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 13:11:26.884893 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880767 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 13:11:26.884893 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880770 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 13:11:26.884893 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880773 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 13:11:26.884893 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880775 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 13:11:26.884893 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880778 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 13:11:26.884893 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880781 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 13:11:26.884893 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880784 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 13:11:26.884893 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880787 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 13:11:26.884893 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880789 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 13:11:26.884893 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880794 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 13:11:26.884893 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880797 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 13:11:26.884893 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880800 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 13:11:26.884893 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880803 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 13:11:26.885374 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880805 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 13:11:26.885374 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880808 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 13:11:26.885374 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880816 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 13:11:26.885374 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880819 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 13:11:26.885374 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880822 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 13:11:26.885374 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880825 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 13:11:26.885374 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:26.880827 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 13:11:26.885374 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.880832 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 13:11:26.885374 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.881013 2554 server.go:962] "Client rotation is on, will bootstrap in background" Jul 15 13:11:26.885374 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.883526 2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 15 13:11:26.885374 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.885207 2554 server.go:1019] "Starting client certificate rotation" Jul 15 13:11:26.885374 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.885316 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 13:11:26.885374 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.885359 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 13:11:26.887891 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.887877 2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 13:11:26.891696 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.891680 2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 13:11:26.902460 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.902441 2554 log.go:25] "Validated CRI v1 runtime API" Jul 15 13:11:26.904520 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.904508 2554 log.go:25] "Validated CRI v1 image API" Jul 15 13:11:26.906665 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.906641 2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 15 13:11:26.909400 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.909382 2554 fs.go:135] Filesystem UUIDs: map[6dbd59dd-7d38-4610-bf94-eb8df8e82d49:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 972e0242-8007-4ed7-a611-baa2527b811b:/dev/nvme0n1p4] Jul 15 13:11:26.909447 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.909400 2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 15 13:11:26.916083 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.915958 2554 manager.go:216] Machine: {Timestamp:2026-07-15 13:11:26.914412173 +0000 UTC m=+0.345221738 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:2499998 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec211595acc90bac443049672c8c5bef SystemUUID:ec211595-acc9-0bac-4430-49672c8c5bef BootID:70e68af6-a709-4a12-a75d-2eb2e27a6596 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:55:8e:58:a0:87 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:55:8e:58:a0:87 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:9a:81:a2:59:aa Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 15 13:11:26.916083 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.916077 2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 15 13:11:26.916235 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.916164 2554 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 15 13:11:26.919464 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.919437 2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 15 13:11:26.919622 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.919466 2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-114.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 15 13:11:26.920208 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.920198 2554 topology_manager.go:138] "Creating topology manager with none policy" Jul 15 13:11:26.920244 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.920210 2554 container_manager_linux.go:309] "Creating device plugin manager" Jul 15 13:11:26.920244 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.920217 2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 13:11:26.921633 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.921623 2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 13:11:26.923082 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.923073 2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 15 13:11:26.926562 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.926552 2554 state_mem.go:36] "Initialized new in-memory state store" Jul 15 13:11:26.926685 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.926676 2554 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 15 13:11:26.926726 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.926719 2554 kubelet.go:486] "Attempting to sync node with API server" Jul 15 13:11:26.926758 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.926730 2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 15 13:11:26.926758 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.926741 2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 15 13:11:26.926816 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.926771 2554 kubelet.go:398] "Adding apiserver pod source" Jul 15 13:11:26.926816 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.926799 2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 15 13:11:26.927421 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.927404 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 13:11:26.927421 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.927424 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 13:11:26.929763 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.929746 2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 15 13:11:26.934200 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.934181 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 13:11:26.934279 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.934215 2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 15 13:11:26.934279 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.934249 2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 15 13:11:26.934426 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.934415 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 15 13:11:26.934458 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.934431 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 15 13:11:26.934458 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.934437 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 15 13:11:26.934458 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.934442 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 15 13:11:26.934458 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.934450 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 15 13:11:26.934458 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.934456 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 15 13:11:26.934820 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.934811 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 15 13:11:26.934848 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.934820 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 15 13:11:26.934848 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.934827 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 15 13:11:26.934848 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.934833 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 15 13:11:26.934848 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.934842 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 15 13:11:26.934848 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.934849 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 15 13:11:26.936435 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.936425 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 15 13:11:26.936435 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.936435 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 15 13:11:26.939826 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.939811 2554 server.go:1268] "Started kubelet" Jul 15 13:11:26.939927 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.939900 2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 15 13:11:26.939991 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.939895 2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 15 13:11:26.940048 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.939997 2554 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 15 13:11:26.940809 ip-10-0-132-114 systemd[1]: Started Kubernetes Kubelet. Jul 15 13:11:26.940995 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:26.940948 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 15 13:11:26.940995 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.940964 2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-114.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 15 13:11:26.941487 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:26.941285 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-114.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 15 13:11:26.941487 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.941404 2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 15 13:11:26.943202 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.943184 2554 server.go:310] "Adding debug handlers to kubelet server" Jul 15 13:11:26.945570 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:26.945552 2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 15 13:11:26.947434 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.947412 2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 15 13:11:26.947527 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.947415 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 15 13:11:26.947527 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:26.946393 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-114.ec2.internal.18c278ad07545a88 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-114.ec2.internal,UID:ip-10-0-132-114.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-114.ec2.internal,},FirstTimestamp:2026-07-15 13:11:26.939781768 +0000 UTC m=+0.370591332,LastTimestamp:2026-07-15 13:11:26.939781768 +0000 UTC m=+0.370591332,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-114.ec2.internal,}" Jul 15 13:11:26.947650 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:26.947532 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-114.ec2.internal\" not found" Jul 15 13:11:26.948101 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.948081 2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 15 13:11:26.948101 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.948081 2554 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 15 13:11:26.948101 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.948104 2554 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 15 13:11:26.948269 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.948196 2554 factory.go:55] Registering systemd factory Jul 15 13:11:26.948269 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.948200 2554 reconstruct.go:97] "Volume reconstruction finished" Jul 15 13:11:26.948269 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.948208 2554 factory.go:223] Registration of the systemd container factory successfully Jul 15 13:11:26.948269 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.948219 2554 reconciler.go:29] "Reconciler: start to sync state" Jul 15 13:11:26.948439 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.948424 2554 factory.go:153] Registering CRI-O factory Jul 15 13:11:26.948483 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.948443 2554 factory.go:223] Registration of the crio container factory successfully Jul 15 13:11:26.948533 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.948522 2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 15 13:11:26.948578 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.948565 2554 factory.go:103] Registering Raw factory Jul 15 13:11:26.948611 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.948578 2554 manager.go:1196] Started watching for new ooms in manager Jul 15 13:11:26.949240 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.949227 2554 manager.go:349] Starting recovery of all containers Jul 15 13:11:26.956398 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:26.956362 2554 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-114.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 15 13:11:26.956540 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:26.956510 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 15 13:11:26.962735 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.962487 2554 manager.go:354] Recovery completed Jul 15 13:11:26.963967 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.963941 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xt7m5" Jul 15 13:11:26.966922 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.966910 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 13:11:26.968782 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.968762 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-114.ec2.internal" event="NodeHasSufficientMemory" Jul 15 13:11:26.968870 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.968795 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-114.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 13:11:26.968870 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.968808 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-114.ec2.internal" event="NodeHasSufficientPID" Jul 15 13:11:26.969368 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.969354 2554 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 15 13:11:26.969368 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.969366 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 13:11:26.969444 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.969367 2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 15 13:11:26.969444 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.969412 2554 state_mem.go:36] "Initialized new in-memory state store" Jul 15 13:11:26.970045 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.970032 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-114.ec2.internal" event="NodeHasSufficientMemory" Jul 15 13:11:26.970095 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.970057 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-114.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 13:11:26.970095 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.970066 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-114.ec2.internal" event="NodeHasSufficientPID" Jul 15 13:11:26.970643 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.970633 2554 policy_none.go:49] "None policy: Start" Jul 15 13:11:26.970673 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.970647 2554 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 15 13:11:26.970673 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.970656 2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 15 13:11:26.971627 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.971617 2554 policy_none.go:47] "Start" Jul 15 13:11:26.973566 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:26.973496 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-114.ec2.internal.18c278ad090ed600 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-114.ec2.internal,UID:ip-10-0-132-114.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-114.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-114.ec2.internal,},FirstTimestamp:2026-07-15 13:11:26.968780288 +0000 UTC m=+0.399589856,LastTimestamp:2026-07-15 13:11:26.968780288 +0000 UTC m=+0.399589856,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-114.ec2.internal,}" Jul 15 13:11:26.982896 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:26.982880 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xt7m5" Jul 15 13:11:26.985517 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:26.985451 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-114.ec2.internal.18c278ad090f2df0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-114.ec2.internal,UID:ip-10-0-132-114.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-114.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-114.ec2.internal,},FirstTimestamp:2026-07-15 13:11:26.9688028 +0000 UTC m=+0.399612367,LastTimestamp:2026-07-15 13:11:26.9688028 +0000 UTC m=+0.399612367,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-114.ec2.internal,}" Jul 15 13:11:27.010541 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.010525 2554 manager.go:337] "Starting Device Plugin manager" Jul 15 13:11:27.010634 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:27.010556 2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 15 13:11:27.010634 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.010566 2554 server.go:87] "Starting device plugin registration server" Jul 15 13:11:27.010796 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.010782 2554 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 15 13:11:27.010845 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.010797 2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 15 13:11:27.010940 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.010925 2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 15 13:11:27.011138 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.011039 2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 15 13:11:27.011138 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.011056 2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 15 13:11:27.011606 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:27.011585 2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 15 13:11:27.011691 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:27.011645 2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-114.ec2.internal\" not found" Jul 15 13:11:27.111097 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.111026 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 13:11:27.112422 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.112022 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-114.ec2.internal" event="NodeHasSufficientMemory" Jul 15 13:11:27.112422 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.112056 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-114.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 13:11:27.112422 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.112073 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-114.ec2.internal" event="NodeHasSufficientPID" Jul 15 13:11:27.112422 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.112106 2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-114.ec2.internal" Jul 15 13:11:27.126702 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.126683 2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-114.ec2.internal" Jul 15 13:11:27.126753 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:27.126707 2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-114.ec2.internal\": node \"ip-10-0-132-114.ec2.internal\" not found" Jul 15 13:11:27.129678 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.129642 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 15 13:11:27.131005 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.130971 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 15 13:11:27.131089 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.131052 2554 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 15 13:11:27.131132 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.131093 2554 kubelet.go:2448] "Starting kubelet main sync loop" Jul 15 13:11:27.131168 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:27.131142 2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 15 13:11:27.134374 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.134356 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 13:11:27.195092 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:27.195060 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-114.ec2.internal\" not found" Jul 15 13:11:27.232155 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.232129 2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-114.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-114.ec2.internal"] Jul 15 13:11:27.232240 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.232214 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 13:11:27.233277 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.233259 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-114.ec2.internal" event="NodeHasSufficientMemory" Jul 15 13:11:27.233365 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.233287 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-114.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 13:11:27.233365 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.233296 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-114.ec2.internal" event="NodeHasSufficientPID" Jul 15 13:11:27.234680 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.234668 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 13:11:27.234805 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.234792 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-114.ec2.internal" Jul 15 13:11:27.234845 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.234820 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 13:11:27.235444 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.235426 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-114.ec2.internal" event="NodeHasSufficientMemory" Jul 15 13:11:27.235517 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.235457 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-114.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 13:11:27.235517 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.235473 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-114.ec2.internal" event="NodeHasSufficientPID" Jul 15 13:11:27.235609 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.235474 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-114.ec2.internal" event="NodeHasSufficientMemory" Jul 15 13:11:27.235609 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.235568 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-114.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 13:11:27.235609 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.235586 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-114.ec2.internal" event="NodeHasSufficientPID" Jul 15 13:11:27.236781 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.236764 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-114.ec2.internal" Jul 15 13:11:27.236861 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.236793 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 13:11:27.237477 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.237459 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-114.ec2.internal" event="NodeHasSufficientMemory" Jul 15 13:11:27.237556 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.237501 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-114.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 13:11:27.237556 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.237514 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-114.ec2.internal" event="NodeHasSufficientPID" Jul 15 13:11:27.249778 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.249758 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/57fe36e17e0d62c0ab92a0385b50dee2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-114.ec2.internal\" (UID: \"57fe36e17e0d62c0ab92a0385b50dee2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-114.ec2.internal" Jul 15 13:11:27.249833 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.249783 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/57fe36e17e0d62c0ab92a0385b50dee2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-114.ec2.internal\" (UID: \"57fe36e17e0d62c0ab92a0385b50dee2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-114.ec2.internal" Jul 15 13:11:27.249833 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.249799 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0f46c7284547ca7be8cc41585e55dbc6-config\") pod \"kube-apiserver-proxy-ip-10-0-132-114.ec2.internal\" (UID: \"0f46c7284547ca7be8cc41585e55dbc6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-114.ec2.internal" Jul 15 13:11:27.269679 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:27.269653 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-114.ec2.internal\" not found" node="ip-10-0-132-114.ec2.internal" Jul 15 13:11:27.273996 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:27.273970 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-114.ec2.internal\" not found" node="ip-10-0-132-114.ec2.internal" Jul 15 13:11:27.295951 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:27.295931 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-114.ec2.internal\" not found" Jul 15 13:11:27.350764 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.350741 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/57fe36e17e0d62c0ab92a0385b50dee2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-114.ec2.internal\" (UID: \"57fe36e17e0d62c0ab92a0385b50dee2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-114.ec2.internal" Jul 15 13:11:27.350847 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.350769 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/57fe36e17e0d62c0ab92a0385b50dee2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-114.ec2.internal\" (UID: \"57fe36e17e0d62c0ab92a0385b50dee2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-114.ec2.internal" Jul 15 13:11:27.350847 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.350785 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0f46c7284547ca7be8cc41585e55dbc6-config\") pod \"kube-apiserver-proxy-ip-10-0-132-114.ec2.internal\" (UID: \"0f46c7284547ca7be8cc41585e55dbc6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-114.ec2.internal" Jul 15 13:11:27.350847 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.350831 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0f46c7284547ca7be8cc41585e55dbc6-config\") pod \"kube-apiserver-proxy-ip-10-0-132-114.ec2.internal\" (UID: \"0f46c7284547ca7be8cc41585e55dbc6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-114.ec2.internal" Jul 15 13:11:27.350847 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.350842 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/57fe36e17e0d62c0ab92a0385b50dee2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-114.ec2.internal\" (UID: \"57fe36e17e0d62c0ab92a0385b50dee2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-114.ec2.internal" Jul 15 13:11:27.351009 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.350843 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/57fe36e17e0d62c0ab92a0385b50dee2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-114.ec2.internal\" (UID: \"57fe36e17e0d62c0ab92a0385b50dee2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-114.ec2.internal" Jul 15 13:11:27.396942 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:27.396860 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-114.ec2.internal\" not found" Jul 15 13:11:27.497811 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:27.497759 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-114.ec2.internal\" not found" Jul 15 13:11:27.572330 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.572303 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-114.ec2.internal" Jul 15 13:11:27.577505 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.577479 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-114.ec2.internal" Jul 15 13:11:27.598757 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:27.598725 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-114.ec2.internal\" not found" Jul 15 13:11:27.699327 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:27.699235 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-114.ec2.internal\" not found" Jul 15 13:11:27.798245 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.798212 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 13:11:27.799696 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:27.799625 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-114.ec2.internal\" not found" Jul 15 13:11:27.800189 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.800174 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 13:11:27.884160 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.884126 2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 15 13:11:27.884716 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.884300 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 13:11:27.884716 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.884302 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 13:11:27.884716 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.884302 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 13:11:27.900417 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:27.900396 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-114.ec2.internal\" not found" Jul 15 13:11:27.985908 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.985857 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 13:06:26 +0000 UTC" deadline="2028-03-27 18:11:03.676584732 +0000 UTC" Jul 15 13:11:27.985908 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:27.985905 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14908h59m35.690684822s" Jul 15 13:11:28.001010 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:28.000969 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-114.ec2.internal\" not found" Jul 15 13:11:28.065615 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:28.065579 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f46c7284547ca7be8cc41585e55dbc6.slice/crio-b102aaa3f3e1a6f3214a0dacc4db7a48c5126d1374b022e6ec73d5efe61bb406 WatchSource:0}: Error finding container b102aaa3f3e1a6f3214a0dacc4db7a48c5126d1374b022e6ec73d5efe61bb406: Status 404 returned error can't find the container with id b102aaa3f3e1a6f3214a0dacc4db7a48c5126d1374b022e6ec73d5efe61bb406 Jul 15 13:11:28.066076 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:28.066049 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57fe36e17e0d62c0ab92a0385b50dee2.slice/crio-9d6224f4715e4934f132bd4e2e02c0ca97a2a1e6009c32d310323f9389eca7de WatchSource:0}: Error finding container 9d6224f4715e4934f132bd4e2e02c0ca97a2a1e6009c32d310323f9389eca7de: Status 404 returned error can't find the container with id 9d6224f4715e4934f132bd4e2e02c0ca97a2a1e6009c32d310323f9389eca7de Jul 15 13:11:28.071094 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.071076 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 13:11:28.100683 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.100659 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 13:11:28.101058 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:28.101042 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-114.ec2.internal\" not found" Jul 15 13:11:28.102117 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.102101 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-114.ec2.internal" event="NodeHasSufficientMemory" Jul 15 13:11:28.102173 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.102152 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-114.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 13:11:28.102173 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.102165 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-114.ec2.internal" event="NodeHasSufficientPID" Jul 15 13:11:28.135239 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.135200 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-114.ec2.internal" event={"ID":"0f46c7284547ca7be8cc41585e55dbc6","Type":"ContainerStarted","Data":"b102aaa3f3e1a6f3214a0dacc4db7a48c5126d1374b022e6ec73d5efe61bb406"} Jul 15 13:11:28.136248 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.136230 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-114.ec2.internal" event={"ID":"57fe36e17e0d62c0ab92a0385b50dee2","Type":"ContainerStarted","Data":"9d6224f4715e4934f132bd4e2e02c0ca97a2a1e6009c32d310323f9389eca7de"} Jul 15 13:11:28.201651 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:28.201613 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-114.ec2.internal\" not found" Jul 15 13:11:28.302238 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:28.302162 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-114.ec2.internal\" not found" Jul 15 13:11:28.392238 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.392204 2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 13:11:28.447900 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.447863 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-114.ec2.internal" Jul 15 13:11:28.470611 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.470582 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 13:11:28.471737 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.471714 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-114.ec2.internal" Jul 15 13:11:28.485401 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.485376 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 13:11:28.927773 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.927743 2554 apiserver.go:52] "Watching apiserver" Jul 15 13:11:28.937482 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.937315 2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 15 13:11:28.939483 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.939459 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzsd","openshift-cluster-node-tuning-operator/tuned-pckvj","openshift-dns/node-resolver-5qwqm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-114.ec2.internal","openshift-multus/multus-additional-cni-plugins-59k7n","openshift-multus/multus-fvjkn","openshift-ovn-kubernetes/ovnkube-node-lx562","kube-system/global-pull-secret-syncer-54nsh","kube-system/konnectivity-agent-kw8vb","kube-system/kube-apiserver-proxy-ip-10-0-132-114.ec2.internal","openshift-image-registry/node-ca-j4ktm","openshift-multus/network-metrics-daemon-xmbdp","openshift-network-diagnostics/network-check-target-26sn7","openshift-network-operator/iptables-alerter-rmrp8"] Jul 15 13:11:28.941004 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.940966 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26sn7" Jul 15 13:11:28.941106 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:28.941070 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26sn7" podUID="314d5d2f-7548-4a65-955f-e3de73c09f09" Jul 15 13:11:28.942288 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.942265 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:28.943804 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.943564 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5qwqm" Jul 15 13:11:28.946003 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.945816 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzsd" Jul 15 13:11:28.946952 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.946611 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 15 13:11:28.946952 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.946738 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mpqds\"" Jul 15 13:11:28.946952 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.946825 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 15 13:11:28.947451 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.947427 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-59k7n" Jul 15 13:11:28.947811 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.947792 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 15 13:11:28.948095 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.948071 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5b5lh\"" Jul 15 13:11:28.948235 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.948220 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 15 13:11:28.948312 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.948297 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 15 13:11:28.948785 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.948760 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fvjkn" Jul 15 13:11:28.949169 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.949145 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 15 13:11:28.949266 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.949236 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 15 13:11:28.949478 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.949461 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 15 13:11:28.949478 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.949485 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tb46p\"" Jul 15 13:11:28.950303 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.950283 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:28.953499 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.951547 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 15 13:11:28.953499 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.951933 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kc98x\"" Jul 15 13:11:28.953499 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.953268 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 15 13:11:28.953499 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.953328 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 15 13:11:28.953499 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.953489 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 15 13:11:28.954578 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.954519 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:11:28.955530 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:28.955007 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54nsh" podUID="e0fd7f31-732f-4343-8f65-5a00324803b4" Jul 15 13:11:28.955949 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.955888 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kw8vb" Jul 15 13:11:28.958282 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.958209 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rmrp8" Jul 15 13:11:28.960073 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.959451 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-host-var-lib-kubelet\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:28.960073 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.959486 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-hostroot\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:28.960073 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.959512 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-etc-kubernetes\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:28.960073 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.959536 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lv99\" (UniqueName: \"kubernetes.io/projected/871fcafa-ef85-4040-bd74-5756c6ff4c0a-kube-api-access-8lv99\") pod \"node-resolver-5qwqm\" (UID: \"871fcafa-ef85-4040-bd74-5756c6ff4c0a\") " pod="openshift-dns/node-resolver-5qwqm" Jul 15 13:11:28.960073 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.959560 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2e12f9e7-3e8a-44af-8d18-c80534f808f5-socket-dir\") pod \"aws-ebs-csi-driver-node-bwzsd\" (UID: \"2e12f9e7-3e8a-44af-8d18-c80534f808f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzsd" Jul 15 13:11:28.960073 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.959585 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qzrh\" (UniqueName: \"kubernetes.io/projected/2e12f9e7-3e8a-44af-8d18-c80534f808f5-kube-api-access-4qzrh\") pod \"aws-ebs-csi-driver-node-bwzsd\" (UID: \"2e12f9e7-3e8a-44af-8d18-c80534f808f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzsd" Jul 15 13:11:28.960073 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.959610 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cbe28775-a719-4791-8be0-a8b1305a9b6c-system-cni-dir\") pod \"multus-additional-cni-plugins-59k7n\" (UID: \"cbe28775-a719-4791-8be0-a8b1305a9b6c\") " pod="openshift-multus/multus-additional-cni-plugins-59k7n" Jul 15 13:11:28.960073 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.959643 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cbe28775-a719-4791-8be0-a8b1305a9b6c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-59k7n\" (UID: \"cbe28775-a719-4791-8be0-a8b1305a9b6c\") " pod="openshift-multus/multus-additional-cni-plugins-59k7n" Jul 15 13:11:28.960073 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.959670 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-host-var-lib-cni-bin\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:28.960073 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.959693 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-multus-daemon-config\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:28.960073 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.959706 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j4ktm" Jul 15 13:11:28.960073 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.959715 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a42ef311-841b-4667-96d4-79209f599840-host\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:28.960073 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.959738 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a42ef311-841b-4667-96d4-79209f599840-etc-tuned\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:28.960073 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.959761 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2e12f9e7-3e8a-44af-8d18-c80534f808f5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bwzsd\" (UID: \"2e12f9e7-3e8a-44af-8d18-c80534f808f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzsd" Jul 15 13:11:28.960073 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.959783 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2e12f9e7-3e8a-44af-8d18-c80534f808f5-etc-selinux\") pod \"aws-ebs-csi-driver-node-bwzsd\" (UID: \"2e12f9e7-3e8a-44af-8d18-c80534f808f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzsd" Jul 15 13:11:28.960073 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.959809 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-host-run-k8s-cni-cncf-io\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:28.960073 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.959830 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a42ef311-841b-4667-96d4-79209f599840-etc-modprobe-d\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:28.960908 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.959853 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/871fcafa-ef85-4040-bd74-5756c6ff4c0a-hosts-file\") pod \"node-resolver-5qwqm\" (UID: \"871fcafa-ef85-4040-bd74-5756c6ff4c0a\") " pod="openshift-dns/node-resolver-5qwqm" Jul 15 13:11:28.960908 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.959895 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2e12f9e7-3e8a-44af-8d18-c80534f808f5-registration-dir\") pod \"aws-ebs-csi-driver-node-bwzsd\" (UID: \"2e12f9e7-3e8a-44af-8d18-c80534f808f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzsd" Jul 15 13:11:28.960908 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.959921 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2e12f9e7-3e8a-44af-8d18-c80534f808f5-sys-fs\") pod \"aws-ebs-csi-driver-node-bwzsd\" (UID: \"2e12f9e7-3e8a-44af-8d18-c80534f808f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzsd" Jul 15 13:11:28.960908 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.959944 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-host-run-netns\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:28.960908 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.959972 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-host-var-lib-cni-multus\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:28.960908 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960012 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a42ef311-841b-4667-96d4-79209f599840-etc-sysconfig\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:28.960908 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960052 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2e12f9e7-3e8a-44af-8d18-c80534f808f5-device-dir\") pod \"aws-ebs-csi-driver-node-bwzsd\" (UID: \"2e12f9e7-3e8a-44af-8d18-c80534f808f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzsd" Jul 15 13:11:28.960908 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960110 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cbe28775-a719-4791-8be0-a8b1305a9b6c-os-release\") pod \"multus-additional-cni-plugins-59k7n\" (UID: \"cbe28775-a719-4791-8be0-a8b1305a9b6c\") " pod="openshift-multus/multus-additional-cni-plugins-59k7n" Jul 15 13:11:28.960908 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960142 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-system-cni-dir\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:28.960908 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960167 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-cnibin\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:28.960908 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960200 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-multus-conf-dir\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:28.960908 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960244 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a42ef311-841b-4667-96d4-79209f599840-tmp\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:28.960908 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960272 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks27z\" (UniqueName: \"kubernetes.io/projected/a42ef311-841b-4667-96d4-79209f599840-kube-api-access-ks27z\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:28.960908 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960298 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cbe28775-a719-4791-8be0-a8b1305a9b6c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-59k7n\" (UID: \"cbe28775-a719-4791-8be0-a8b1305a9b6c\") " pod="openshift-multus/multus-additional-cni-plugins-59k7n" Jul 15 13:11:28.960908 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960303 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 15 13:11:28.960908 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960335 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnbv9\" (UniqueName: \"kubernetes.io/projected/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-kube-api-access-rnbv9\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:28.960908 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960362 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a42ef311-841b-4667-96d4-79209f599840-etc-sysctl-d\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:28.961705 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960383 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a42ef311-841b-4667-96d4-79209f599840-sys\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:28.961705 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960405 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a42ef311-841b-4667-96d4-79209f599840-var-lib-kubelet\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:28.961705 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960429 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cbe28775-a719-4791-8be0-a8b1305a9b6c-cni-binary-copy\") pod \"multus-additional-cni-plugins-59k7n\" (UID: \"cbe28775-a719-4791-8be0-a8b1305a9b6c\") " pod="openshift-multus/multus-additional-cni-plugins-59k7n" Jul 15 13:11:28.961705 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960453 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-multus-cni-dir\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:28.961705 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960475 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-os-release\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:28.961705 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960489 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 15 13:11:28.961705 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960497 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-cni-binary-copy\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:28.961705 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960520 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh5pl\" (UniqueName: \"kubernetes.io/projected/314d5d2f-7548-4a65-955f-e3de73c09f09-kube-api-access-mh5pl\") pod \"network-check-target-26sn7\" (UID: \"314d5d2f-7548-4a65-955f-e3de73c09f09\") " pod="openshift-network-diagnostics/network-check-target-26sn7" Jul 15 13:11:28.961705 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960529 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 15 13:11:28.961705 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960545 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a42ef311-841b-4667-96d4-79209f599840-etc-systemd\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:28.961705 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960566 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a42ef311-841b-4667-96d4-79209f599840-run\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:28.961705 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960580 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 15 13:11:28.961705 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960588 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cbe28775-a719-4791-8be0-a8b1305a9b6c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-59k7n\" (UID: \"cbe28775-a719-4791-8be0-a8b1305a9b6c\") " pod="openshift-multus/multus-additional-cni-plugins-59k7n" Jul 15 13:11:28.961705 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960613 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwvs4\" (UniqueName: \"kubernetes.io/projected/cbe28775-a719-4791-8be0-a8b1305a9b6c-kube-api-access-hwvs4\") pod \"multus-additional-cni-plugins-59k7n\" (UID: \"cbe28775-a719-4791-8be0-a8b1305a9b6c\") " pod="openshift-multus/multus-additional-cni-plugins-59k7n" Jul 15 13:11:28.961705 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960637 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-multus-socket-dir-parent\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:28.961705 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960534 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 15 13:11:28.961705 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960660 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-host-run-multus-certs\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:28.961705 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960682 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a42ef311-841b-4667-96d4-79209f599840-etc-kubernetes\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:28.961705 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960703 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a42ef311-841b-4667-96d4-79209f599840-etc-sysctl-conf\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:28.962602 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960722 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 15 13:11:28.962602 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960725 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a42ef311-841b-4667-96d4-79209f599840-lib-modules\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:28.962602 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960749 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/871fcafa-ef85-4040-bd74-5756c6ff4c0a-tmp-dir\") pod \"node-resolver-5qwqm\" (UID: \"871fcafa-ef85-4040-bd74-5756c6ff4c0a\") " pod="openshift-dns/node-resolver-5qwqm" Jul 15 13:11:28.962602 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960761 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tnrlc\"" Jul 15 13:11:28.962602 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.960783 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cbe28775-a719-4791-8be0-a8b1305a9b6c-cnibin\") pod \"multus-additional-cni-plugins-59k7n\" (UID: \"cbe28775-a719-4791-8be0-a8b1305a9b6c\") " pod="openshift-multus/multus-additional-cni-plugins-59k7n" Jul 15 13:11:28.962602 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.961535 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:11:28.962602 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:28.961624 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmbdp" podUID="7cfca5b3-c487-470b-b5b1-965339049b4c" Jul 15 13:11:28.962602 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.961970 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tblgr\"" Jul 15 13:11:28.962602 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.962055 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-q6mcc\"" Jul 15 13:11:28.962602 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.962199 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 15 13:11:28.962602 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.962292 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 15 13:11:28.963090 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.963070 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 15 13:11:28.963425 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.963407 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 15 13:11:28.963703 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.963687 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bdmbq\"" Jul 15 13:11:28.964144 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.964079 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 15 13:11:28.964144 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.964135 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 15 13:11:28.964614 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.964361 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-q66df\"" Jul 15 13:11:28.964614 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.964413 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 15 13:11:28.964614 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.964440 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 15 13:11:28.966704 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.966682 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 15 13:11:28.967335 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.967317 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 15 13:11:28.971695 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.971678 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 13:11:28.989089 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:28.989068 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-b8ql6" Jul 15 13:11:29.001542 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.001522 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-b8ql6" Jul 15 13:11:29.049764 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.049735 2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 15 13:11:29.061534 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.061501 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2e12f9e7-3e8a-44af-8d18-c80534f808f5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bwzsd\" (UID: \"2e12f9e7-3e8a-44af-8d18-c80534f808f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzsd" Jul 15 13:11:29.061692 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.061540 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d60f6645-bdeb-4b1f-9580-44b9ee9d0baf-host\") pod \"node-ca-j4ktm\" (UID: \"d60f6645-bdeb-4b1f-9580-44b9ee9d0baf\") " pod="openshift-image-registry/node-ca-j4ktm" Jul 15 13:11:29.061692 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.061599 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a42ef311-841b-4667-96d4-79209f599840-etc-kubernetes\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:29.061692 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.061618 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a42ef311-841b-4667-96d4-79209f599840-lib-modules\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:29.061692 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.061631 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2e12f9e7-3e8a-44af-8d18-c80534f808f5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bwzsd\" (UID: \"2e12f9e7-3e8a-44af-8d18-c80534f808f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzsd" Jul 15 13:11:29.061692 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.061639 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/744aabed-58f6-477a-9ad3-2e934ff268e8-iptables-alerter-script\") pod \"iptables-alerter-rmrp8\" (UID: \"744aabed-58f6-477a-9ad3-2e934ff268e8\") " pod="openshift-network-operator/iptables-alerter-rmrp8" Jul 15 13:11:29.061937 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.061709 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz28l\" (UniqueName: \"kubernetes.io/projected/7cfca5b3-c487-470b-b5b1-965339049b4c-kube-api-access-pz28l\") pod \"network-metrics-daemon-xmbdp\" (UID: \"7cfca5b3-c487-470b-b5b1-965339049b4c\") " pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:11:29.061937 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.061713 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a42ef311-841b-4667-96d4-79209f599840-etc-kubernetes\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:29.061937 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.061740 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-run-systemd\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.061937 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.061767 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.061937 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.061797 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d47sh\" (UniqueName: \"kubernetes.io/projected/83d9c378-e25b-487c-a9be-83e18e37d87f-kube-api-access-d47sh\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.061937 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.061816 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a42ef311-841b-4667-96d4-79209f599840-lib-modules\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:29.061937 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.061820 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e0fd7f31-732f-4343-8f65-5a00324803b4-dbus\") pod \"global-pull-secret-syncer-54nsh\" (UID: \"e0fd7f31-732f-4343-8f65-5a00324803b4\") " pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:11:29.061937 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.061858 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cbe28775-a719-4791-8be0-a8b1305a9b6c-cnibin\") pod \"multus-additional-cni-plugins-59k7n\" (UID: \"cbe28775-a719-4791-8be0-a8b1305a9b6c\") " pod="openshift-multus/multus-additional-cni-plugins-59k7n" Jul 15 13:11:29.061937 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.061896 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-hostroot\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.062377 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.061939 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cbe28775-a719-4791-8be0-a8b1305a9b6c-cnibin\") pod \"multus-additional-cni-plugins-59k7n\" (UID: \"cbe28775-a719-4791-8be0-a8b1305a9b6c\") " pod="openshift-multus/multus-additional-cni-plugins-59k7n" Jul 15 13:11:29.062377 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.061991 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-etc-kubernetes\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.062377 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062015 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-etc-kubernetes\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.062377 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062042 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lv99\" (UniqueName: \"kubernetes.io/projected/871fcafa-ef85-4040-bd74-5756c6ff4c0a-kube-api-access-8lv99\") pod \"node-resolver-5qwqm\" (UID: \"871fcafa-ef85-4040-bd74-5756c6ff4c0a\") " pod="openshift-dns/node-resolver-5qwqm" Jul 15 13:11:29.062377 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062067 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0fd7f31-732f-4343-8f65-5a00324803b4-original-pull-secret\") pod \"global-pull-secret-syncer-54nsh\" (UID: \"e0fd7f31-732f-4343-8f65-5a00324803b4\") " pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:11:29.062377 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062119 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/30096cef-02bd-4d94-912b-2dfbab854767-agent-certs\") pod \"konnectivity-agent-kw8vb\" (UID: \"30096cef-02bd-4d94-912b-2dfbab854767\") " pod="kube-system/konnectivity-agent-kw8vb" Jul 15 13:11:29.062377 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062169 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-hostroot\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.062377 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062164 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/30096cef-02bd-4d94-912b-2dfbab854767-konnectivity-ca\") pod \"konnectivity-agent-kw8vb\" (UID: \"30096cef-02bd-4d94-912b-2dfbab854767\") " pod="kube-system/konnectivity-agent-kw8vb" Jul 15 13:11:29.062377 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062222 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-host-var-lib-cni-bin\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.062377 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062245 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a42ef311-841b-4667-96d4-79209f599840-host\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:29.062377 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062269 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2e12f9e7-3e8a-44af-8d18-c80534f808f5-etc-selinux\") pod \"aws-ebs-csi-driver-node-bwzsd\" (UID: \"2e12f9e7-3e8a-44af-8d18-c80534f808f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzsd" Jul 15 13:11:29.062377 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062293 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-host-var-lib-cni-bin\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.062377 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062295 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfca5b3-c487-470b-b5b1-965339049b4c-metrics-certs\") pod \"network-metrics-daemon-xmbdp\" (UID: \"7cfca5b3-c487-470b-b5b1-965339049b4c\") " pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:11:29.062377 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062332 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a42ef311-841b-4667-96d4-79209f599840-host\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:29.062377 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062353 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a42ef311-841b-4667-96d4-79209f599840-etc-modprobe-d\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:29.062377 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062372 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/871fcafa-ef85-4040-bd74-5756c6ff4c0a-hosts-file\") pod \"node-resolver-5qwqm\" (UID: \"871fcafa-ef85-4040-bd74-5756c6ff4c0a\") " pod="openshift-dns/node-resolver-5qwqm" Jul 15 13:11:29.063052 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062389 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d79g\" (UniqueName: \"kubernetes.io/projected/d60f6645-bdeb-4b1f-9580-44b9ee9d0baf-kube-api-access-5d79g\") pod \"node-ca-j4ktm\" (UID: \"d60f6645-bdeb-4b1f-9580-44b9ee9d0baf\") " pod="openshift-image-registry/node-ca-j4ktm" Jul 15 13:11:29.063052 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062394 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2e12f9e7-3e8a-44af-8d18-c80534f808f5-etc-selinux\") pod \"aws-ebs-csi-driver-node-bwzsd\" (UID: \"2e12f9e7-3e8a-44af-8d18-c80534f808f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzsd" Jul 15 13:11:29.063052 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062415 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-host-run-netns\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.063052 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062440 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2e12f9e7-3e8a-44af-8d18-c80534f808f5-device-dir\") pod \"aws-ebs-csi-driver-node-bwzsd\" (UID: \"2e12f9e7-3e8a-44af-8d18-c80534f808f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzsd" Jul 15 13:11:29.063052 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062464 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/744aabed-58f6-477a-9ad3-2e934ff268e8-host-slash\") pod \"iptables-alerter-rmrp8\" (UID: \"744aabed-58f6-477a-9ad3-2e934ff268e8\") " pod="openshift-network-operator/iptables-alerter-rmrp8" Jul 15 13:11:29.063052 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062468 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-host-run-netns\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.063052 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062489 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-host-run-ovn-kubernetes\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.063052 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062518 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/871fcafa-ef85-4040-bd74-5756c6ff4c0a-hosts-file\") pod \"node-resolver-5qwqm\" (UID: \"871fcafa-ef85-4040-bd74-5756c6ff4c0a\") " pod="openshift-dns/node-resolver-5qwqm" Jul 15 13:11:29.063052 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062540 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-multus-conf-dir\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.063052 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062551 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2e12f9e7-3e8a-44af-8d18-c80534f808f5-device-dir\") pod \"aws-ebs-csi-driver-node-bwzsd\" (UID: \"2e12f9e7-3e8a-44af-8d18-c80534f808f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzsd" Jul 15 13:11:29.063052 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062571 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-host-kubelet\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.063052 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062584 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-multus-conf-dir\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.063052 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062585 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a42ef311-841b-4667-96d4-79209f599840-etc-modprobe-d\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:29.063052 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062594 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-systemd-units\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.063052 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062616 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-log-socket\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.063052 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062641 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-host-cni-netd\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.063052 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062673 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e0fd7f31-732f-4343-8f65-5a00324803b4-kubelet-config\") pod \"global-pull-secret-syncer-54nsh\" (UID: \"e0fd7f31-732f-4343-8f65-5a00324803b4\") " pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:11:29.063777 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062706 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnbv9\" (UniqueName: \"kubernetes.io/projected/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-kube-api-access-rnbv9\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.063777 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062740 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a42ef311-841b-4667-96d4-79209f599840-sys\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:29.063777 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062767 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-run-openvswitch\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.063777 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062790 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-node-log\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.063777 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062833 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-os-release\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.063777 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062856 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a42ef311-841b-4667-96d4-79209f599840-etc-systemd\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:29.063777 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062879 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a42ef311-841b-4667-96d4-79209f599840-run\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:29.063777 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062854 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a42ef311-841b-4667-96d4-79209f599840-sys\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:29.063777 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062903 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-host-run-netns\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.063777 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062906 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-os-release\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.063777 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062938 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a42ef311-841b-4667-96d4-79209f599840-etc-systemd\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:29.063777 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062927 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-etc-openvswitch\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.063777 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.062968 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a42ef311-841b-4667-96d4-79209f599840-run\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:29.063777 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063012 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-host-cni-bin\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.063777 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063044 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cbe28775-a719-4791-8be0-a8b1305a9b6c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-59k7n\" (UID: \"cbe28775-a719-4791-8be0-a8b1305a9b6c\") " pod="openshift-multus/multus-additional-cni-plugins-59k7n" Jul 15 13:11:29.063777 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063068 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwvs4\" (UniqueName: \"kubernetes.io/projected/cbe28775-a719-4791-8be0-a8b1305a9b6c-kube-api-access-hwvs4\") pod \"multus-additional-cni-plugins-59k7n\" (UID: \"cbe28775-a719-4791-8be0-a8b1305a9b6c\") " pod="openshift-multus/multus-additional-cni-plugins-59k7n" Jul 15 13:11:29.063777 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063090 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-multus-socket-dir-parent\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.064566 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063112 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-host-run-multus-certs\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.064566 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063134 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a42ef311-841b-4667-96d4-79209f599840-etc-sysctl-conf\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:29.064566 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063157 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qzrh\" (UniqueName: \"kubernetes.io/projected/2e12f9e7-3e8a-44af-8d18-c80534f808f5-kube-api-access-4qzrh\") pod \"aws-ebs-csi-driver-node-bwzsd\" (UID: \"2e12f9e7-3e8a-44af-8d18-c80534f808f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzsd" Jul 15 13:11:29.064566 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063179 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-host-slash\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.064566 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063200 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/83d9c378-e25b-487c-a9be-83e18e37d87f-ovnkube-config\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.064566 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063196 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-multus-socket-dir-parent\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.064566 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063268 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-host-run-multus-certs\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.064566 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063310 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-host-var-lib-kubelet\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.064566 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063333 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a42ef311-841b-4667-96d4-79209f599840-etc-sysctl-conf\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:29.064566 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063338 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2e12f9e7-3e8a-44af-8d18-c80534f808f5-socket-dir\") pod \"aws-ebs-csi-driver-node-bwzsd\" (UID: \"2e12f9e7-3e8a-44af-8d18-c80534f808f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzsd" Jul 15 13:11:29.064566 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063413 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d60f6645-bdeb-4b1f-9580-44b9ee9d0baf-serviceca\") pod \"node-ca-j4ktm\" (UID: \"d60f6645-bdeb-4b1f-9580-44b9ee9d0baf\") " pod="openshift-image-registry/node-ca-j4ktm" Jul 15 13:11:29.064566 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063456 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/83d9c378-e25b-487c-a9be-83e18e37d87f-ovn-node-metrics-cert\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.064566 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063468 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2e12f9e7-3e8a-44af-8d18-c80534f808f5-socket-dir\") pod \"aws-ebs-csi-driver-node-bwzsd\" (UID: \"2e12f9e7-3e8a-44af-8d18-c80534f808f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzsd" Jul 15 13:11:29.064566 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063491 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cbe28775-a719-4791-8be0-a8b1305a9b6c-system-cni-dir\") pod \"multus-additional-cni-plugins-59k7n\" (UID: \"cbe28775-a719-4791-8be0-a8b1305a9b6c\") " pod="openshift-multus/multus-additional-cni-plugins-59k7n" Jul 15 13:11:29.064566 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063519 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cbe28775-a719-4791-8be0-a8b1305a9b6c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-59k7n\" (UID: \"cbe28775-a719-4791-8be0-a8b1305a9b6c\") " pod="openshift-multus/multus-additional-cni-plugins-59k7n" Jul 15 13:11:29.064566 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063544 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-multus-daemon-config\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.064566 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063567 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a42ef311-841b-4667-96d4-79209f599840-etc-tuned\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:29.065320 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063576 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cbe28775-a719-4791-8be0-a8b1305a9b6c-system-cni-dir\") pod \"multus-additional-cni-plugins-59k7n\" (UID: \"cbe28775-a719-4791-8be0-a8b1305a9b6c\") " pod="openshift-multus/multus-additional-cni-plugins-59k7n" Jul 15 13:11:29.065320 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063667 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2e12f9e7-3e8a-44af-8d18-c80534f808f5-sys-fs\") pod \"aws-ebs-csi-driver-node-bwzsd\" (UID: \"2e12f9e7-3e8a-44af-8d18-c80534f808f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzsd" Jul 15 13:11:29.065320 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063717 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-host-run-k8s-cni-cncf-io\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.065320 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063742 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2e12f9e7-3e8a-44af-8d18-c80534f808f5-registration-dir\") pod \"aws-ebs-csi-driver-node-bwzsd\" (UID: \"2e12f9e7-3e8a-44af-8d18-c80534f808f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzsd" Jul 15 13:11:29.065320 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063762 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cbe28775-a719-4791-8be0-a8b1305a9b6c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-59k7n\" (UID: \"cbe28775-a719-4791-8be0-a8b1305a9b6c\") " pod="openshift-multus/multus-additional-cni-plugins-59k7n" Jul 15 13:11:29.065320 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063822 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2e12f9e7-3e8a-44af-8d18-c80534f808f5-registration-dir\") pod \"aws-ebs-csi-driver-node-bwzsd\" (UID: \"2e12f9e7-3e8a-44af-8d18-c80534f808f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzsd" Jul 15 13:11:29.065320 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063767 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-var-lib-openvswitch\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.065320 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063388 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-host-var-lib-kubelet\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.065320 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063858 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2e12f9e7-3e8a-44af-8d18-c80534f808f5-sys-fs\") pod \"aws-ebs-csi-driver-node-bwzsd\" (UID: \"2e12f9e7-3e8a-44af-8d18-c80534f808f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzsd" Jul 15 13:11:29.065320 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063859 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/83d9c378-e25b-487c-a9be-83e18e37d87f-env-overrides\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.065320 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063890 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-host-var-lib-cni-multus\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.065320 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063894 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-host-run-k8s-cni-cncf-io\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.065320 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063881 2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 15 13:11:29.065320 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063918 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a42ef311-841b-4667-96d4-79209f599840-etc-sysconfig\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:29.065320 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063936 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-host-var-lib-cni-multus\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.065320 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063947 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pttw\" (UniqueName: \"kubernetes.io/projected/744aabed-58f6-477a-9ad3-2e934ff268e8-kube-api-access-8pttw\") pod \"iptables-alerter-rmrp8\" (UID: \"744aabed-58f6-477a-9ad3-2e934ff268e8\") " pod="openshift-network-operator/iptables-alerter-rmrp8" Jul 15 13:11:29.065320 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063973 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-run-ovn\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.066175 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.063999 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a42ef311-841b-4667-96d4-79209f599840-etc-sysconfig\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:29.066175 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.064018 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cbe28775-a719-4791-8be0-a8b1305a9b6c-os-release\") pod \"multus-additional-cni-plugins-59k7n\" (UID: \"cbe28775-a719-4791-8be0-a8b1305a9b6c\") " pod="openshift-multus/multus-additional-cni-plugins-59k7n" Jul 15 13:11:29.066175 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.064044 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-system-cni-dir\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.066175 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.064066 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-cnibin\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.066175 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.064070 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cbe28775-a719-4791-8be0-a8b1305a9b6c-os-release\") pod \"multus-additional-cni-plugins-59k7n\" (UID: \"cbe28775-a719-4791-8be0-a8b1305a9b6c\") " pod="openshift-multus/multus-additional-cni-plugins-59k7n" Jul 15 13:11:29.066175 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.064088 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a42ef311-841b-4667-96d4-79209f599840-tmp\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:29.066175 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.064103 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-system-cni-dir\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.066175 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.064114 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks27z\" (UniqueName: \"kubernetes.io/projected/a42ef311-841b-4667-96d4-79209f599840-kube-api-access-ks27z\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:29.066175 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.064117 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-cnibin\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.066175 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.064121 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cbe28775-a719-4791-8be0-a8b1305a9b6c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-59k7n\" (UID: \"cbe28775-a719-4791-8be0-a8b1305a9b6c\") " pod="openshift-multus/multus-additional-cni-plugins-59k7n" Jul 15 13:11:29.066175 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.064138 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/83d9c378-e25b-487c-a9be-83e18e37d87f-ovnkube-script-lib\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.066175 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.064177 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cbe28775-a719-4791-8be0-a8b1305a9b6c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-59k7n\" (UID: \"cbe28775-a719-4791-8be0-a8b1305a9b6c\") " pod="openshift-multus/multus-additional-cni-plugins-59k7n" Jul 15 13:11:29.066175 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.064206 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a42ef311-841b-4667-96d4-79209f599840-etc-sysctl-d\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:29.066175 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.064229 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a42ef311-841b-4667-96d4-79209f599840-var-lib-kubelet\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:29.066175 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.064282 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cbe28775-a719-4791-8be0-a8b1305a9b6c-cni-binary-copy\") pod \"multus-additional-cni-plugins-59k7n\" (UID: \"cbe28775-a719-4791-8be0-a8b1305a9b6c\") " pod="openshift-multus/multus-additional-cni-plugins-59k7n" Jul 15 13:11:29.066175 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.064299 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cbe28775-a719-4791-8be0-a8b1305a9b6c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-59k7n\" (UID: \"cbe28775-a719-4791-8be0-a8b1305a9b6c\") " pod="openshift-multus/multus-additional-cni-plugins-59k7n" Jul 15 13:11:29.066175 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.064330 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-multus-cni-dir\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.067338 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.064179 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-multus-daemon-config\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.067338 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.064356 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-cni-binary-copy\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.067338 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.064390 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a42ef311-841b-4667-96d4-79209f599840-var-lib-kubelet\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:29.067338 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.064422 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a42ef311-841b-4667-96d4-79209f599840-etc-sysctl-d\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:29.067338 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.064423 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh5pl\" (UniqueName: \"kubernetes.io/projected/314d5d2f-7548-4a65-955f-e3de73c09f09-kube-api-access-mh5pl\") pod \"network-check-target-26sn7\" (UID: \"314d5d2f-7548-4a65-955f-e3de73c09f09\") " pod="openshift-network-diagnostics/network-check-target-26sn7" Jul 15 13:11:29.067338 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.064466 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/871fcafa-ef85-4040-bd74-5756c6ff4c0a-tmp-dir\") pod \"node-resolver-5qwqm\" (UID: \"871fcafa-ef85-4040-bd74-5756c6ff4c0a\") " pod="openshift-dns/node-resolver-5qwqm" Jul 15 13:11:29.067338 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.065101 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/871fcafa-ef85-4040-bd74-5756c6ff4c0a-tmp-dir\") pod \"node-resolver-5qwqm\" (UID: \"871fcafa-ef85-4040-bd74-5756c6ff4c0a\") " pod="openshift-dns/node-resolver-5qwqm" Jul 15 13:11:29.067338 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.065139 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cbe28775-a719-4791-8be0-a8b1305a9b6c-cni-binary-copy\") pod \"multus-additional-cni-plugins-59k7n\" (UID: \"cbe28775-a719-4791-8be0-a8b1305a9b6c\") " pod="openshift-multus/multus-additional-cni-plugins-59k7n" Jul 15 13:11:29.067338 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.065461 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-multus-cni-dir\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.067338 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.066534 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-cni-binary-copy\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.067791 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.067686 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a42ef311-841b-4667-96d4-79209f599840-etc-tuned\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:29.068523 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.068277 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a42ef311-841b-4667-96d4-79209f599840-tmp\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:29.078845 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.078818 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lv99\" (UniqueName: \"kubernetes.io/projected/871fcafa-ef85-4040-bd74-5756c6ff4c0a-kube-api-access-8lv99\") pod \"node-resolver-5qwqm\" (UID: \"871fcafa-ef85-4040-bd74-5756c6ff4c0a\") " pod="openshift-dns/node-resolver-5qwqm" Jul 15 13:11:29.079888 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.079864 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnbv9\" (UniqueName: \"kubernetes.io/projected/d2f4dccb-15a3-4c76-b8c7-0ad01542f33a-kube-api-access-rnbv9\") pod \"multus-fvjkn\" (UID: \"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a\") " pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.090590 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.090544 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks27z\" (UniqueName: \"kubernetes.io/projected/a42ef311-841b-4667-96d4-79209f599840-kube-api-access-ks27z\") pod \"tuned-pckvj\" (UID: \"a42ef311-841b-4667-96d4-79209f599840\") " pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:29.090697 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.090682 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwvs4\" (UniqueName: \"kubernetes.io/projected/cbe28775-a719-4791-8be0-a8b1305a9b6c-kube-api-access-hwvs4\") pod \"multus-additional-cni-plugins-59k7n\" (UID: \"cbe28775-a719-4791-8be0-a8b1305a9b6c\") " pod="openshift-multus/multus-additional-cni-plugins-59k7n" Jul 15 13:11:29.093227 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.093206 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qzrh\" (UniqueName: \"kubernetes.io/projected/2e12f9e7-3e8a-44af-8d18-c80534f808f5-kube-api-access-4qzrh\") pod \"aws-ebs-csi-driver-node-bwzsd\" (UID: \"2e12f9e7-3e8a-44af-8d18-c80534f808f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzsd" Jul 15 13:11:29.093624 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:29.093607 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 13:11:29.093717 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:29.093628 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 13:11:29.093717 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:29.093642 2554 projected.go:196] Error preparing data for projected volume kube-api-access-mh5pl for pod openshift-network-diagnostics/network-check-target-26sn7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:11:29.093800 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:29.093719 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/314d5d2f-7548-4a65-955f-e3de73c09f09-kube-api-access-mh5pl podName:314d5d2f-7548-4a65-955f-e3de73c09f09 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:29.593685949 +0000 UTC m=+3.024495521 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mh5pl" (UniqueName: "kubernetes.io/projected/314d5d2f-7548-4a65-955f-e3de73c09f09-kube-api-access-mh5pl") pod "network-check-target-26sn7" (UID: "314d5d2f-7548-4a65-955f-e3de73c09f09") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:11:29.165644 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.165604 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d60f6645-bdeb-4b1f-9580-44b9ee9d0baf-host\") pod \"node-ca-j4ktm\" (UID: \"d60f6645-bdeb-4b1f-9580-44b9ee9d0baf\") " pod="openshift-image-registry/node-ca-j4ktm" Jul 15 13:11:29.165818 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.165652 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/744aabed-58f6-477a-9ad3-2e934ff268e8-iptables-alerter-script\") pod \"iptables-alerter-rmrp8\" (UID: \"744aabed-58f6-477a-9ad3-2e934ff268e8\") " pod="openshift-network-operator/iptables-alerter-rmrp8" Jul 15 13:11:29.165818 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.165684 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz28l\" (UniqueName: \"kubernetes.io/projected/7cfca5b3-c487-470b-b5b1-965339049b4c-kube-api-access-pz28l\") pod \"network-metrics-daemon-xmbdp\" (UID: \"7cfca5b3-c487-470b-b5b1-965339049b4c\") " pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:11:29.165818 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.165749 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d60f6645-bdeb-4b1f-9580-44b9ee9d0baf-host\") pod \"node-ca-j4ktm\" (UID: \"d60f6645-bdeb-4b1f-9580-44b9ee9d0baf\") " pod="openshift-image-registry/node-ca-j4ktm" Jul 15 13:11:29.166645 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166026 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-run-systemd\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.166645 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166081 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.166645 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166113 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d47sh\" (UniqueName: \"kubernetes.io/projected/83d9c378-e25b-487c-a9be-83e18e37d87f-kube-api-access-d47sh\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.166645 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166114 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-run-systemd\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.166645 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166145 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e0fd7f31-732f-4343-8f65-5a00324803b4-dbus\") pod \"global-pull-secret-syncer-54nsh\" (UID: \"e0fd7f31-732f-4343-8f65-5a00324803b4\") " pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:11:29.166645 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166179 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.166645 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166257 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0fd7f31-732f-4343-8f65-5a00324803b4-original-pull-secret\") pod \"global-pull-secret-syncer-54nsh\" (UID: \"e0fd7f31-732f-4343-8f65-5a00324803b4\") " pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:11:29.166645 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166290 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/30096cef-02bd-4d94-912b-2dfbab854767-agent-certs\") pod \"konnectivity-agent-kw8vb\" (UID: \"30096cef-02bd-4d94-912b-2dfbab854767\") " pod="kube-system/konnectivity-agent-kw8vb" Jul 15 13:11:29.166645 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166300 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e0fd7f31-732f-4343-8f65-5a00324803b4-dbus\") pod \"global-pull-secret-syncer-54nsh\" (UID: \"e0fd7f31-732f-4343-8f65-5a00324803b4\") " pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:11:29.166645 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166345 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/30096cef-02bd-4d94-912b-2dfbab854767-konnectivity-ca\") pod \"konnectivity-agent-kw8vb\" (UID: \"30096cef-02bd-4d94-912b-2dfbab854767\") " pod="kube-system/konnectivity-agent-kw8vb" Jul 15 13:11:29.166645 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166357 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/744aabed-58f6-477a-9ad3-2e934ff268e8-iptables-alerter-script\") pod \"iptables-alerter-rmrp8\" (UID: \"744aabed-58f6-477a-9ad3-2e934ff268e8\") " pod="openshift-network-operator/iptables-alerter-rmrp8" Jul 15 13:11:29.166645 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166373 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfca5b3-c487-470b-b5b1-965339049b4c-metrics-certs\") pod \"network-metrics-daemon-xmbdp\" (UID: \"7cfca5b3-c487-470b-b5b1-965339049b4c\") " pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:11:29.166645 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:29.166397 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 13:11:29.166645 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166414 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d79g\" (UniqueName: \"kubernetes.io/projected/d60f6645-bdeb-4b1f-9580-44b9ee9d0baf-kube-api-access-5d79g\") pod \"node-ca-j4ktm\" (UID: \"d60f6645-bdeb-4b1f-9580-44b9ee9d0baf\") " pod="openshift-image-registry/node-ca-j4ktm" Jul 15 13:11:29.166645 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:29.166436 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:11:29.166645 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166442 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/744aabed-58f6-477a-9ad3-2e934ff268e8-host-slash\") pod \"iptables-alerter-rmrp8\" (UID: \"744aabed-58f6-477a-9ad3-2e934ff268e8\") " pod="openshift-network-operator/iptables-alerter-rmrp8" Jul 15 13:11:29.166645 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166477 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-host-run-ovn-kubernetes\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.167552 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:29.166497 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0fd7f31-732f-4343-8f65-5a00324803b4-original-pull-secret podName:e0fd7f31-732f-4343-8f65-5a00324803b4 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:29.666483453 +0000 UTC m=+3.097293017 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0fd7f31-732f-4343-8f65-5a00324803b4-original-pull-secret") pod "global-pull-secret-syncer-54nsh" (UID: "e0fd7f31-732f-4343-8f65-5a00324803b4") : object "kube-system"/"original-pull-secret" not registered Jul 15 13:11:29.167552 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166523 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/744aabed-58f6-477a-9ad3-2e934ff268e8-host-slash\") pod \"iptables-alerter-rmrp8\" (UID: \"744aabed-58f6-477a-9ad3-2e934ff268e8\") " pod="openshift-network-operator/iptables-alerter-rmrp8" Jul 15 13:11:29.167552 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166525 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-host-kubelet\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.167552 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166551 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-host-kubelet\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.167552 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166563 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-systemd-units\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.167552 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166587 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-log-socket\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.167552 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166609 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-host-cni-netd\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.167552 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166633 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e0fd7f31-732f-4343-8f65-5a00324803b4-kubelet-config\") pod \"global-pull-secret-syncer-54nsh\" (UID: \"e0fd7f31-732f-4343-8f65-5a00324803b4\") " pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:11:29.167552 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:29.166650 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cfca5b3-c487-470b-b5b1-965339049b4c-metrics-certs podName:7cfca5b3-c487-470b-b5b1-965339049b4c nodeName:}" failed. No retries permitted until 2026-07-15 13:11:29.666637029 +0000 UTC m=+3.097446582 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cfca5b3-c487-470b-b5b1-965339049b4c-metrics-certs") pod "network-metrics-daemon-xmbdp" (UID: "7cfca5b3-c487-470b-b5b1-965339049b4c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:11:29.167552 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166658 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-host-run-ovn-kubernetes\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.167552 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166676 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-log-socket\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.167552 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166709 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-systemd-units\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.167552 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166712 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-run-openvswitch\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.167552 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166720 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-host-cni-netd\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.167552 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166674 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e0fd7f31-732f-4343-8f65-5a00324803b4-kubelet-config\") pod \"global-pull-secret-syncer-54nsh\" (UID: \"e0fd7f31-732f-4343-8f65-5a00324803b4\") " pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:11:29.167552 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166749 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-node-log\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.168323 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166762 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-run-openvswitch\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.168323 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166778 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-host-run-netns\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.168323 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166812 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-etc-openvswitch\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.168323 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166816 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-host-run-netns\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.168323 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166819 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-node-log\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.168323 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166833 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-etc-openvswitch\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.168323 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166839 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-host-cni-bin\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.168323 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166870 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-host-cni-bin\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.168323 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166877 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-host-slash\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.168323 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166910 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-host-slash\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.168323 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166903 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/83d9c378-e25b-487c-a9be-83e18e37d87f-ovnkube-config\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.168323 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166948 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d60f6645-bdeb-4b1f-9580-44b9ee9d0baf-serviceca\") pod \"node-ca-j4ktm\" (UID: \"d60f6645-bdeb-4b1f-9580-44b9ee9d0baf\") " pod="openshift-image-registry/node-ca-j4ktm" Jul 15 13:11:29.168323 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166972 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/83d9c378-e25b-487c-a9be-83e18e37d87f-ovn-node-metrics-cert\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.168323 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.166975 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/30096cef-02bd-4d94-912b-2dfbab854767-konnectivity-ca\") pod \"konnectivity-agent-kw8vb\" (UID: \"30096cef-02bd-4d94-912b-2dfbab854767\") " pod="kube-system/konnectivity-agent-kw8vb" Jul 15 13:11:29.168323 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.167118 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-var-lib-openvswitch\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.168323 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.167153 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/83d9c378-e25b-487c-a9be-83e18e37d87f-env-overrides\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.168323 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.167183 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pttw\" (UniqueName: \"kubernetes.io/projected/744aabed-58f6-477a-9ad3-2e934ff268e8-kube-api-access-8pttw\") pod \"iptables-alerter-rmrp8\" (UID: \"744aabed-58f6-477a-9ad3-2e934ff268e8\") " pod="openshift-network-operator/iptables-alerter-rmrp8" Jul 15 13:11:29.168323 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.167209 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-run-ovn\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.169166 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.167238 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/83d9c378-e25b-487c-a9be-83e18e37d87f-ovnkube-script-lib\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.169166 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.167522 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/83d9c378-e25b-487c-a9be-83e18e37d87f-ovnkube-config\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.169166 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.167586 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-var-lib-openvswitch\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.169166 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.167719 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/83d9c378-e25b-487c-a9be-83e18e37d87f-env-overrides\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.169166 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.167783 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/83d9c378-e25b-487c-a9be-83e18e37d87f-run-ovn\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.169166 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.167802 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d60f6645-bdeb-4b1f-9580-44b9ee9d0baf-serviceca\") pod \"node-ca-j4ktm\" (UID: \"d60f6645-bdeb-4b1f-9580-44b9ee9d0baf\") " pod="openshift-image-registry/node-ca-j4ktm" Jul 15 13:11:29.169166 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.167849 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/83d9c378-e25b-487c-a9be-83e18e37d87f-ovnkube-script-lib\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.169460 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.169286 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/30096cef-02bd-4d94-912b-2dfbab854767-agent-certs\") pod \"konnectivity-agent-kw8vb\" (UID: \"30096cef-02bd-4d94-912b-2dfbab854767\") " pod="kube-system/konnectivity-agent-kw8vb" Jul 15 13:11:29.169541 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.169518 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/83d9c378-e25b-487c-a9be-83e18e37d87f-ovn-node-metrics-cert\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.189810 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.189735 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz28l\" (UniqueName: \"kubernetes.io/projected/7cfca5b3-c487-470b-b5b1-965339049b4c-kube-api-access-pz28l\") pod \"network-metrics-daemon-xmbdp\" (UID: \"7cfca5b3-c487-470b-b5b1-965339049b4c\") " pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:11:29.196414 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.196387 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pttw\" (UniqueName: \"kubernetes.io/projected/744aabed-58f6-477a-9ad3-2e934ff268e8-kube-api-access-8pttw\") pod \"iptables-alerter-rmrp8\" (UID: \"744aabed-58f6-477a-9ad3-2e934ff268e8\") " pod="openshift-network-operator/iptables-alerter-rmrp8" Jul 15 13:11:29.196756 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.196733 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d79g\" (UniqueName: \"kubernetes.io/projected/d60f6645-bdeb-4b1f-9580-44b9ee9d0baf-kube-api-access-5d79g\") pod \"node-ca-j4ktm\" (UID: \"d60f6645-bdeb-4b1f-9580-44b9ee9d0baf\") " pod="openshift-image-registry/node-ca-j4ktm" Jul 15 13:11:29.197008 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.196971 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d47sh\" (UniqueName: \"kubernetes.io/projected/83d9c378-e25b-487c-a9be-83e18e37d87f-kube-api-access-d47sh\") pod \"ovnkube-node-lx562\" (UID: \"83d9c378-e25b-487c-a9be-83e18e37d87f\") " pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.264288 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.264260 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pckvj" Jul 15 13:11:29.272526 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.272497 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5qwqm" Jul 15 13:11:29.281403 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.281380 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzsd" Jul 15 13:11:29.286004 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.285972 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-59k7n" Jul 15 13:11:29.293322 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.293300 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fvjkn" Jul 15 13:11:29.300928 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.300911 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:29.308493 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.308465 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kw8vb" Jul 15 13:11:29.318695 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.318675 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rmrp8" Jul 15 13:11:29.324371 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.324346 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j4ktm" Jul 15 13:11:29.482607 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.482531 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 13:11:29.599135 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.599102 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 13:11:29.657726 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.657587 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 13:11:29.670864 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.670825 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh5pl\" (UniqueName: \"kubernetes.io/projected/314d5d2f-7548-4a65-955f-e3de73c09f09-kube-api-access-mh5pl\") pod \"network-check-target-26sn7\" (UID: \"314d5d2f-7548-4a65-955f-e3de73c09f09\") " pod="openshift-network-diagnostics/network-check-target-26sn7" Jul 15 13:11:29.671039 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.670879 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0fd7f31-732f-4343-8f65-5a00324803b4-original-pull-secret\") pod \"global-pull-secret-syncer-54nsh\" (UID: \"e0fd7f31-732f-4343-8f65-5a00324803b4\") " pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:11:29.671039 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:29.670910 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfca5b3-c487-470b-b5b1-965339049b4c-metrics-certs\") pod \"network-metrics-daemon-xmbdp\" (UID: \"7cfca5b3-c487-470b-b5b1-965339049b4c\") " pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:11:29.671148 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:29.671043 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 13:11:29.671148 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:29.671065 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 13:11:29.671148 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:29.671044 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:11:29.671148 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:29.671145 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cfca5b3-c487-470b-b5b1-965339049b4c-metrics-certs podName:7cfca5b3-c487-470b-b5b1-965339049b4c nodeName:}" failed. No retries permitted until 2026-07-15 13:11:30.671122042 +0000 UTC m=+4.101931607 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cfca5b3-c487-470b-b5b1-965339049b4c-metrics-certs") pod "network-metrics-daemon-xmbdp" (UID: "7cfca5b3-c487-470b-b5b1-965339049b4c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:11:29.671341 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:29.671045 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 13:11:29.671341 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:29.671219 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0fd7f31-732f-4343-8f65-5a00324803b4-original-pull-secret podName:e0fd7f31-732f-4343-8f65-5a00324803b4 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:30.671200017 +0000 UTC m=+4.102009585 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0fd7f31-732f-4343-8f65-5a00324803b4-original-pull-secret") pod "global-pull-secret-syncer-54nsh" (UID: "e0fd7f31-732f-4343-8f65-5a00324803b4") : object "kube-system"/"original-pull-secret" not registered Jul 15 13:11:29.671341 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:29.671078 2554 projected.go:196] Error preparing data for projected volume kube-api-access-mh5pl for pod openshift-network-diagnostics/network-check-target-26sn7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:11:29.671341 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:29.671293 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/314d5d2f-7548-4a65-955f-e3de73c09f09-kube-api-access-mh5pl podName:314d5d2f-7548-4a65-955f-e3de73c09f09 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:30.67127753 +0000 UTC m=+4.102087090 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mh5pl" (UniqueName: "kubernetes.io/projected/314d5d2f-7548-4a65-955f-e3de73c09f09-kube-api-access-mh5pl") pod "network-check-target-26sn7" (UID: "314d5d2f-7548-4a65-955f-e3de73c09f09") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:11:29.897024 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:29.896943 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod871fcafa_ef85_4040_bd74_5756c6ff4c0a.slice/crio-2c52aae61642402d913741f2d41616bde8b5c95c34c20b636127ce900060bbec WatchSource:0}: Error finding container 2c52aae61642402d913741f2d41616bde8b5c95c34c20b636127ce900060bbec: Status 404 returned error can't find the container with id 2c52aae61642402d913741f2d41616bde8b5c95c34c20b636127ce900060bbec Jul 15 13:11:29.899203 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:29.899172 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2f4dccb_15a3_4c76_b8c7_0ad01542f33a.slice/crio-46d8061244d6194c42b215fdc9b917b5741d63e1ff202e5d59ef830aca3a43a1 WatchSource:0}: Error finding container 46d8061244d6194c42b215fdc9b917b5741d63e1ff202e5d59ef830aca3a43a1: Status 404 returned error can't find the container with id 46d8061244d6194c42b215fdc9b917b5741d63e1ff202e5d59ef830aca3a43a1 Jul 15 13:11:29.900758 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:29.900738 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod744aabed_58f6_477a_9ad3_2e934ff268e8.slice/crio-f6ae01689e8e97ce547de89af2f401136438b3536b6730492cde695a1e766631 WatchSource:0}: Error finding container f6ae01689e8e97ce547de89af2f401136438b3536b6730492cde695a1e766631: Status 404 returned error can't find the container with id f6ae01689e8e97ce547de89af2f401136438b3536b6730492cde695a1e766631 Jul 15 13:11:29.902238 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:29.902217 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83d9c378_e25b_487c_a9be_83e18e37d87f.slice/crio-32145a71e937ea4ef12ef946a7d56bbfdf9269a6766203d8872119c9c9c29fde WatchSource:0}: Error finding container 32145a71e937ea4ef12ef946a7d56bbfdf9269a6766203d8872119c9c9c29fde: Status 404 returned error can't find the container with id 32145a71e937ea4ef12ef946a7d56bbfdf9269a6766203d8872119c9c9c29fde Jul 15 13:11:29.904923 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:29.904852 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd60f6645_bdeb_4b1f_9580_44b9ee9d0baf.slice/crio-93e079490d4cb80ca0860bbaa77eee1d91ab111a09586fb0a88bd0baef4bcd1b WatchSource:0}: Error finding container 93e079490d4cb80ca0860bbaa77eee1d91ab111a09586fb0a88bd0baef4bcd1b: Status 404 returned error can't find the container with id 93e079490d4cb80ca0860bbaa77eee1d91ab111a09586fb0a88bd0baef4bcd1b Jul 15 13:11:29.907324 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:29.907257 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30096cef_02bd_4d94_912b_2dfbab854767.slice/crio-42a6f992bcccaed26f0977643f056b602cd1a99cd94f9cc53dfda4f0be63db03 WatchSource:0}: Error finding container 42a6f992bcccaed26f0977643f056b602cd1a99cd94f9cc53dfda4f0be63db03: Status 404 returned error can't find the container with id 42a6f992bcccaed26f0977643f056b602cd1a99cd94f9cc53dfda4f0be63db03 Jul 15 13:11:29.907944 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:29.907913 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbe28775_a719_4791_8be0_a8b1305a9b6c.slice/crio-bccc9ef553e22deb68e957479a6f1a8a673fa90bd4e5a4ebb129bceba0b50ef9 WatchSource:0}: Error finding container bccc9ef553e22deb68e957479a6f1a8a673fa90bd4e5a4ebb129bceba0b50ef9: Status 404 returned error can't find the container with id bccc9ef553e22deb68e957479a6f1a8a673fa90bd4e5a4ebb129bceba0b50ef9 Jul 15 13:11:29.909726 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:29.909689 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda42ef311_841b_4667_96d4_79209f599840.slice/crio-56e0ca006fb73c87f5dda0a7ab25a0afd3f3f626138216bd3a441d20c99184a8 WatchSource:0}: Error finding container 56e0ca006fb73c87f5dda0a7ab25a0afd3f3f626138216bd3a441d20c99184a8: Status 404 returned error can't find the container with id 56e0ca006fb73c87f5dda0a7ab25a0afd3f3f626138216bd3a441d20c99184a8 Jul 15 13:11:29.911272 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:11:29.911142 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e12f9e7_3e8a_44af_8d18_c80534f808f5.slice/crio-f87bdfcf19ab7d958e8561a1430aea9ec31c5e4eee507fb6138e78da3092bd59 WatchSource:0}: Error finding container f87bdfcf19ab7d958e8561a1430aea9ec31c5e4eee507fb6138e78da3092bd59: Status 404 returned error can't find the container with id f87bdfcf19ab7d958e8561a1430aea9ec31c5e4eee507fb6138e78da3092bd59 Jul 15 13:11:30.004074 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:30.003872 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 13:06:28 +0000 UTC" deadline="2028-03-16 07:09:37.188422108 +0000 UTC" Jul 15 13:11:30.004074 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:30.004070 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14633h58m7.184356416s" Jul 15 13:11:30.131278 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:30.131250 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:11:30.131375 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:30.131355 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmbdp" podUID="7cfca5b3-c487-470b-b5b1-965339049b4c" Jul 15 13:11:30.140821 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:30.140795 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kw8vb" event={"ID":"30096cef-02bd-4d94-912b-2dfbab854767","Type":"ContainerStarted","Data":"42a6f992bcccaed26f0977643f056b602cd1a99cd94f9cc53dfda4f0be63db03"} Jul 15 13:11:30.141781 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:30.141759 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j4ktm" event={"ID":"d60f6645-bdeb-4b1f-9580-44b9ee9d0baf","Type":"ContainerStarted","Data":"93e079490d4cb80ca0860bbaa77eee1d91ab111a09586fb0a88bd0baef4bcd1b"} Jul 15 13:11:30.142674 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:30.142656 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fvjkn" event={"ID":"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a","Type":"ContainerStarted","Data":"46d8061244d6194c42b215fdc9b917b5741d63e1ff202e5d59ef830aca3a43a1"} Jul 15 13:11:30.143532 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:30.143515 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5qwqm" event={"ID":"871fcafa-ef85-4040-bd74-5756c6ff4c0a","Type":"ContainerStarted","Data":"2c52aae61642402d913741f2d41616bde8b5c95c34c20b636127ce900060bbec"} Jul 15 13:11:30.145036 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:30.145013 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-114.ec2.internal" event={"ID":"0f46c7284547ca7be8cc41585e55dbc6","Type":"ContainerStarted","Data":"82287090e3c4cacb070100d1fe15ed9bf20914c2b77c74c3a17d51ccf83b7435"} Jul 15 13:11:30.146177 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:30.146145 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-114.ec2.internal" event={"ID":"57fe36e17e0d62c0ab92a0385b50dee2","Type":"ContainerStarted","Data":"fe75772053273816c373483838bd026cdad55423091ad9e96ca0eed046b96af2"} Jul 15 13:11:30.147063 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:30.147045 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pckvj" event={"ID":"a42ef311-841b-4667-96d4-79209f599840","Type":"ContainerStarted","Data":"56e0ca006fb73c87f5dda0a7ab25a0afd3f3f626138216bd3a441d20c99184a8"} Jul 15 13:11:30.147964 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:30.147946 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-59k7n" event={"ID":"cbe28775-a719-4791-8be0-a8b1305a9b6c","Type":"ContainerStarted","Data":"bccc9ef553e22deb68e957479a6f1a8a673fa90bd4e5a4ebb129bceba0b50ef9"} Jul 15 13:11:30.148965 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:30.148946 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lx562" event={"ID":"83d9c378-e25b-487c-a9be-83e18e37d87f","Type":"ContainerStarted","Data":"32145a71e937ea4ef12ef946a7d56bbfdf9269a6766203d8872119c9c9c29fde"} Jul 15 13:11:30.150141 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:30.150042 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rmrp8" event={"ID":"744aabed-58f6-477a-9ad3-2e934ff268e8","Type":"ContainerStarted","Data":"f6ae01689e8e97ce547de89af2f401136438b3536b6730492cde695a1e766631"} Jul 15 13:11:30.151119 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:30.151103 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzsd" event={"ID":"2e12f9e7-3e8a-44af-8d18-c80534f808f5","Type":"ContainerStarted","Data":"f87bdfcf19ab7d958e8561a1430aea9ec31c5e4eee507fb6138e78da3092bd59"} Jul 15 13:11:30.162687 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:30.162648 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-114.ec2.internal" podStartSLOduration=2.162635048 podStartE2EDuration="2.162635048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:30.162056469 +0000 UTC m=+3.592866040" watchObservedRunningTime="2026-07-15 13:11:30.162635048 +0000 UTC m=+3.593444622" Jul 15 13:11:30.680598 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:30.680152 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh5pl\" (UniqueName: \"kubernetes.io/projected/314d5d2f-7548-4a65-955f-e3de73c09f09-kube-api-access-mh5pl\") pod \"network-check-target-26sn7\" (UID: \"314d5d2f-7548-4a65-955f-e3de73c09f09\") " pod="openshift-network-diagnostics/network-check-target-26sn7" Jul 15 13:11:30.680598 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:30.680216 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0fd7f31-732f-4343-8f65-5a00324803b4-original-pull-secret\") pod \"global-pull-secret-syncer-54nsh\" (UID: \"e0fd7f31-732f-4343-8f65-5a00324803b4\") " pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:11:30.680598 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:30.680252 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfca5b3-c487-470b-b5b1-965339049b4c-metrics-certs\") pod \"network-metrics-daemon-xmbdp\" (UID: \"7cfca5b3-c487-470b-b5b1-965339049b4c\") " pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:11:30.680598 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:30.680340 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 13:11:30.680598 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:30.680366 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 13:11:30.680598 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:30.680385 2554 projected.go:196] Error preparing data for projected volume kube-api-access-mh5pl for pod openshift-network-diagnostics/network-check-target-26sn7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:11:30.680598 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:30.680397 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:11:30.680598 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:30.680451 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cfca5b3-c487-470b-b5b1-965339049b4c-metrics-certs podName:7cfca5b3-c487-470b-b5b1-965339049b4c nodeName:}" failed. No retries permitted until 2026-07-15 13:11:32.680432732 +0000 UTC m=+6.111242284 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cfca5b3-c487-470b-b5b1-965339049b4c-metrics-certs") pod "network-metrics-daemon-xmbdp" (UID: "7cfca5b3-c487-470b-b5b1-965339049b4c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:11:30.680598 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:30.680470 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/314d5d2f-7548-4a65-955f-e3de73c09f09-kube-api-access-mh5pl podName:314d5d2f-7548-4a65-955f-e3de73c09f09 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:32.680461136 +0000 UTC m=+6.111270688 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mh5pl" (UniqueName: "kubernetes.io/projected/314d5d2f-7548-4a65-955f-e3de73c09f09-kube-api-access-mh5pl") pod "network-check-target-26sn7" (UID: "314d5d2f-7548-4a65-955f-e3de73c09f09") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:11:30.680598 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:30.680534 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 13:11:30.680598 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:30.680569 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0fd7f31-732f-4343-8f65-5a00324803b4-original-pull-secret podName:e0fd7f31-732f-4343-8f65-5a00324803b4 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:32.680559188 +0000 UTC m=+6.111368743 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0fd7f31-732f-4343-8f65-5a00324803b4-original-pull-secret") pod "global-pull-secret-syncer-54nsh" (UID: "e0fd7f31-732f-4343-8f65-5a00324803b4") : object "kube-system"/"original-pull-secret" not registered Jul 15 13:11:31.004558 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:31.004517 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 13:06:28 +0000 UTC" deadline="2027-12-25 15:06:39.631283432 +0000 UTC" Jul 15 13:11:31.004558 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:31.004556 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12673h55m8.626731298s" Jul 15 13:11:31.134312 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:31.134279 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:11:31.134493 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:31.134417 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54nsh" podUID="e0fd7f31-732f-4343-8f65-5a00324803b4" Jul 15 13:11:31.134843 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:31.134822 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26sn7" Jul 15 13:11:31.134939 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:31.134920 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26sn7" podUID="314d5d2f-7548-4a65-955f-e3de73c09f09" Jul 15 13:11:31.170945 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:31.170800 2554 generic.go:356] "Generic (PLEG): container finished" podID="57fe36e17e0d62c0ab92a0385b50dee2" containerID="fe75772053273816c373483838bd026cdad55423091ad9e96ca0eed046b96af2" exitCode=0 Jul 15 13:11:31.170945 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:31.170854 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-114.ec2.internal" event={"ID":"57fe36e17e0d62c0ab92a0385b50dee2","Type":"ContainerDied","Data":"fe75772053273816c373483838bd026cdad55423091ad9e96ca0eed046b96af2"} Jul 15 13:11:32.132147 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:32.131387 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:11:32.132147 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:32.131518 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmbdp" podUID="7cfca5b3-c487-470b-b5b1-965339049b4c" Jul 15 13:11:32.183370 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:32.183332 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-114.ec2.internal" event={"ID":"57fe36e17e0d62c0ab92a0385b50dee2","Type":"ContainerStarted","Data":"6d251db8dd4b554d3091167f34f66a36f56559b5abcc478d4a2626103134cd90"} Jul 15 13:11:32.701600 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:32.701522 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh5pl\" (UniqueName: \"kubernetes.io/projected/314d5d2f-7548-4a65-955f-e3de73c09f09-kube-api-access-mh5pl\") pod \"network-check-target-26sn7\" (UID: \"314d5d2f-7548-4a65-955f-e3de73c09f09\") " pod="openshift-network-diagnostics/network-check-target-26sn7" Jul 15 13:11:32.701600 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:32.701584 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0fd7f31-732f-4343-8f65-5a00324803b4-original-pull-secret\") pod \"global-pull-secret-syncer-54nsh\" (UID: \"e0fd7f31-732f-4343-8f65-5a00324803b4\") " pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:11:32.701855 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:32.701724 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 13:11:32.701855 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:32.701735 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 13:11:32.701855 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:32.701753 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 13:11:32.701855 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:32.701767 2554 projected.go:196] Error preparing data for projected volume kube-api-access-mh5pl for pod openshift-network-diagnostics/network-check-target-26sn7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:11:32.701855 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:32.701796 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfca5b3-c487-470b-b5b1-965339049b4c-metrics-certs\") pod \"network-metrics-daemon-xmbdp\" (UID: \"7cfca5b3-c487-470b-b5b1-965339049b4c\") " pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:11:32.701855 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:32.701822 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/314d5d2f-7548-4a65-955f-e3de73c09f09-kube-api-access-mh5pl podName:314d5d2f-7548-4a65-955f-e3de73c09f09 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:36.701802273 +0000 UTC m=+10.132611847 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mh5pl" (UniqueName: "kubernetes.io/projected/314d5d2f-7548-4a65-955f-e3de73c09f09-kube-api-access-mh5pl") pod "network-check-target-26sn7" (UID: "314d5d2f-7548-4a65-955f-e3de73c09f09") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:11:32.701855 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:32.701850 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0fd7f31-732f-4343-8f65-5a00324803b4-original-pull-secret podName:e0fd7f31-732f-4343-8f65-5a00324803b4 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:36.701838911 +0000 UTC m=+10.132648480 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0fd7f31-732f-4343-8f65-5a00324803b4-original-pull-secret") pod "global-pull-secret-syncer-54nsh" (UID: "e0fd7f31-732f-4343-8f65-5a00324803b4") : object "kube-system"/"original-pull-secret" not registered Jul 15 13:11:32.702370 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:32.701870 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:11:32.702370 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:32.701907 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cfca5b3-c487-470b-b5b1-965339049b4c-metrics-certs podName:7cfca5b3-c487-470b-b5b1-965339049b4c nodeName:}" failed. No retries permitted until 2026-07-15 13:11:36.701896237 +0000 UTC m=+10.132705789 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cfca5b3-c487-470b-b5b1-965339049b4c-metrics-certs") pod "network-metrics-daemon-xmbdp" (UID: "7cfca5b3-c487-470b-b5b1-965339049b4c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:11:33.133192 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:33.133100 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:11:33.133647 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:33.133239 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54nsh" podUID="e0fd7f31-732f-4343-8f65-5a00324803b4" Jul 15 13:11:33.133721 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:33.133709 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26sn7" Jul 15 13:11:33.134839 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:33.133810 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26sn7" podUID="314d5d2f-7548-4a65-955f-e3de73c09f09" Jul 15 13:11:34.132182 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:34.131637 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:11:34.132182 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:34.131788 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmbdp" podUID="7cfca5b3-c487-470b-b5b1-965339049b4c" Jul 15 13:11:35.131995 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:35.131908 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:11:35.132434 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:35.131915 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26sn7" Jul 15 13:11:35.132434 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:35.132055 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54nsh" podUID="e0fd7f31-732f-4343-8f65-5a00324803b4" Jul 15 13:11:35.132434 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:35.132124 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26sn7" podUID="314d5d2f-7548-4a65-955f-e3de73c09f09" Jul 15 13:11:36.131791 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:36.131755 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:11:36.132069 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:36.131902 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmbdp" podUID="7cfca5b3-c487-470b-b5b1-965339049b4c" Jul 15 13:11:36.737503 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:36.737259 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh5pl\" (UniqueName: \"kubernetes.io/projected/314d5d2f-7548-4a65-955f-e3de73c09f09-kube-api-access-mh5pl\") pod \"network-check-target-26sn7\" (UID: \"314d5d2f-7548-4a65-955f-e3de73c09f09\") " pod="openshift-network-diagnostics/network-check-target-26sn7" Jul 15 13:11:36.737503 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:36.737349 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0fd7f31-732f-4343-8f65-5a00324803b4-original-pull-secret\") pod \"global-pull-secret-syncer-54nsh\" (UID: \"e0fd7f31-732f-4343-8f65-5a00324803b4\") " pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:11:36.737503 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:36.737387 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfca5b3-c487-470b-b5b1-965339049b4c-metrics-certs\") pod \"network-metrics-daemon-xmbdp\" (UID: \"7cfca5b3-c487-470b-b5b1-965339049b4c\") " pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:11:36.737503 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:36.737440 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 13:11:36.737503 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:36.737466 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 13:11:36.737503 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:36.737463 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 13:11:36.737503 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:36.737479 2554 projected.go:196] Error preparing data for projected volume kube-api-access-mh5pl for pod openshift-network-diagnostics/network-check-target-26sn7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:11:36.737957 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:36.737531 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0fd7f31-732f-4343-8f65-5a00324803b4-original-pull-secret podName:e0fd7f31-732f-4343-8f65-5a00324803b4 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:44.737510282 +0000 UTC m=+18.168319850 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0fd7f31-732f-4343-8f65-5a00324803b4-original-pull-secret") pod "global-pull-secret-syncer-54nsh" (UID: "e0fd7f31-732f-4343-8f65-5a00324803b4") : object "kube-system"/"original-pull-secret" not registered Jul 15 13:11:36.737957 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:36.737535 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:11:36.737957 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:36.737550 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/314d5d2f-7548-4a65-955f-e3de73c09f09-kube-api-access-mh5pl podName:314d5d2f-7548-4a65-955f-e3de73c09f09 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:44.737540541 +0000 UTC m=+18.168350099 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mh5pl" (UniqueName: "kubernetes.io/projected/314d5d2f-7548-4a65-955f-e3de73c09f09-kube-api-access-mh5pl") pod "network-check-target-26sn7" (UID: "314d5d2f-7548-4a65-955f-e3de73c09f09") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:11:36.737957 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:36.737585 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cfca5b3-c487-470b-b5b1-965339049b4c-metrics-certs podName:7cfca5b3-c487-470b-b5b1-965339049b4c nodeName:}" failed. No retries permitted until 2026-07-15 13:11:44.737567068 +0000 UTC m=+18.168376633 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cfca5b3-c487-470b-b5b1-965339049b4c-metrics-certs") pod "network-metrics-daemon-xmbdp" (UID: "7cfca5b3-c487-470b-b5b1-965339049b4c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:11:37.133535 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:37.133084 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26sn7" Jul 15 13:11:37.133535 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:37.133194 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26sn7" podUID="314d5d2f-7548-4a65-955f-e3de73c09f09" Jul 15 13:11:37.133535 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:37.133349 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:11:37.133535 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:37.133444 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54nsh" podUID="e0fd7f31-732f-4343-8f65-5a00324803b4" Jul 15 13:11:38.132131 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:38.132043 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:11:38.132331 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:38.132185 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmbdp" podUID="7cfca5b3-c487-470b-b5b1-965339049b4c" Jul 15 13:11:39.132126 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:39.132080 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:11:39.132582 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:39.132085 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26sn7" Jul 15 13:11:39.132582 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:39.132225 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54nsh" podUID="e0fd7f31-732f-4343-8f65-5a00324803b4" Jul 15 13:11:39.132582 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:39.132287 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26sn7" podUID="314d5d2f-7548-4a65-955f-e3de73c09f09" Jul 15 13:11:40.131438 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:40.131403 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:11:40.131632 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:40.131536 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmbdp" podUID="7cfca5b3-c487-470b-b5b1-965339049b4c" Jul 15 13:11:41.132217 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:41.132179 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:11:41.132217 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:41.132220 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26sn7" Jul 15 13:11:41.132709 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:41.132312 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54nsh" podUID="e0fd7f31-732f-4343-8f65-5a00324803b4" Jul 15 13:11:41.132709 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:41.132419 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26sn7" podUID="314d5d2f-7548-4a65-955f-e3de73c09f09" Jul 15 13:11:42.131954 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:42.131920 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:11:42.132148 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:42.132082 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmbdp" podUID="7cfca5b3-c487-470b-b5b1-965339049b4c" Jul 15 13:11:43.135028 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:43.134997 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26sn7" Jul 15 13:11:43.135028 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:43.135012 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:11:43.135485 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:43.135094 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26sn7" podUID="314d5d2f-7548-4a65-955f-e3de73c09f09" Jul 15 13:11:43.135485 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:43.135226 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54nsh" podUID="e0fd7f31-732f-4343-8f65-5a00324803b4" Jul 15 13:11:44.131510 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:44.131472 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:11:44.131803 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:44.131610 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmbdp" podUID="7cfca5b3-c487-470b-b5b1-965339049b4c" Jul 15 13:11:44.794520 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:44.794481 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfca5b3-c487-470b-b5b1-965339049b4c-metrics-certs\") pod \"network-metrics-daemon-xmbdp\" (UID: \"7cfca5b3-c487-470b-b5b1-965339049b4c\") " pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:11:44.795036 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:44.794563 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh5pl\" (UniqueName: \"kubernetes.io/projected/314d5d2f-7548-4a65-955f-e3de73c09f09-kube-api-access-mh5pl\") pod \"network-check-target-26sn7\" (UID: \"314d5d2f-7548-4a65-955f-e3de73c09f09\") " pod="openshift-network-diagnostics/network-check-target-26sn7" Jul 15 13:11:44.795036 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:44.794598 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0fd7f31-732f-4343-8f65-5a00324803b4-original-pull-secret\") pod \"global-pull-secret-syncer-54nsh\" (UID: \"e0fd7f31-732f-4343-8f65-5a00324803b4\") " pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:11:44.795036 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:44.794649 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:11:44.795036 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:44.794664 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 13:11:44.795036 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:44.794680 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 13:11:44.795036 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:44.794693 2554 projected.go:196] Error preparing data for projected volume kube-api-access-mh5pl for pod openshift-network-diagnostics/network-check-target-26sn7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:11:44.795036 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:44.794700 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 13:11:44.795036 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:44.794724 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cfca5b3-c487-470b-b5b1-965339049b4c-metrics-certs podName:7cfca5b3-c487-470b-b5b1-965339049b4c nodeName:}" failed. No retries permitted until 2026-07-15 13:12:00.794705601 +0000 UTC m=+34.225515168 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cfca5b3-c487-470b-b5b1-965339049b4c-metrics-certs") pod "network-metrics-daemon-xmbdp" (UID: "7cfca5b3-c487-470b-b5b1-965339049b4c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:11:44.795036 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:44.794743 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/314d5d2f-7548-4a65-955f-e3de73c09f09-kube-api-access-mh5pl podName:314d5d2f-7548-4a65-955f-e3de73c09f09 nodeName:}" failed. No retries permitted until 2026-07-15 13:12:00.794734472 +0000 UTC m=+34.225544023 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mh5pl" (UniqueName: "kubernetes.io/projected/314d5d2f-7548-4a65-955f-e3de73c09f09-kube-api-access-mh5pl") pod "network-check-target-26sn7" (UID: "314d5d2f-7548-4a65-955f-e3de73c09f09") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:11:44.795036 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:44.794757 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0fd7f31-732f-4343-8f65-5a00324803b4-original-pull-secret podName:e0fd7f31-732f-4343-8f65-5a00324803b4 nodeName:}" failed. No retries permitted until 2026-07-15 13:12:00.794750157 +0000 UTC m=+34.225559709 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0fd7f31-732f-4343-8f65-5a00324803b4-original-pull-secret") pod "global-pull-secret-syncer-54nsh" (UID: "e0fd7f31-732f-4343-8f65-5a00324803b4") : object "kube-system"/"original-pull-secret" not registered Jul 15 13:11:45.132030 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:45.131937 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:11:45.132192 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:45.132084 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54nsh" podUID="e0fd7f31-732f-4343-8f65-5a00324803b4" Jul 15 13:11:45.132192 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:45.132140 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26sn7" Jul 15 13:11:45.132305 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:45.132264 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26sn7" podUID="314d5d2f-7548-4a65-955f-e3de73c09f09" Jul 15 13:11:46.132240 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:46.132202 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:11:46.132663 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:46.132322 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmbdp" podUID="7cfca5b3-c487-470b-b5b1-965339049b4c" Jul 15 13:11:47.132819 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:47.132784 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:11:47.133282 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:47.132902 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54nsh" podUID="e0fd7f31-732f-4343-8f65-5a00324803b4" Jul 15 13:11:47.133282 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:47.132997 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26sn7" Jul 15 13:11:47.133282 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:47.133107 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26sn7" podUID="314d5d2f-7548-4a65-955f-e3de73c09f09" Jul 15 13:11:48.131846 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:48.131756 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:11:48.132009 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:48.131874 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmbdp" podUID="7cfca5b3-c487-470b-b5b1-965339049b4c" Jul 15 13:11:49.131997 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:49.131672 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:11:49.132552 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:49.131729 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26sn7" Jul 15 13:11:49.132552 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:49.132083 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54nsh" podUID="e0fd7f31-732f-4343-8f65-5a00324803b4" Jul 15 13:11:49.132552 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:49.132130 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26sn7" podUID="314d5d2f-7548-4a65-955f-e3de73c09f09" Jul 15 13:11:49.216161 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:49.216125 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzsd" event={"ID":"2e12f9e7-3e8a-44af-8d18-c80534f808f5","Type":"ContainerStarted","Data":"9349fdf78419f5f5e3ff49d9a2fc44dd08061c5d7b79b9900acf9ce31e7015d2"} Jul 15 13:11:49.217411 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:49.217383 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kw8vb" event={"ID":"30096cef-02bd-4d94-912b-2dfbab854767","Type":"ContainerStarted","Data":"e4f438a75b7e690eedaf93b97389a79dbf7d028cd22b9d7d3b02312a2af49201"} Jul 15 13:11:49.218724 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:49.218693 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j4ktm" event={"ID":"d60f6645-bdeb-4b1f-9580-44b9ee9d0baf","Type":"ContainerStarted","Data":"a47b0937fdf393d7f90ed06deb11271fd40d655c553210ebcede30b0cf6602e8"} Jul 15 13:11:49.220016 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:49.219975 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fvjkn" event={"ID":"d2f4dccb-15a3-4c76-b8c7-0ad01542f33a","Type":"ContainerStarted","Data":"64f38fdd3ea69ef35e3bc9182e4fe08c61bc72bdfab25a4e8a3fd8f79ce4602e"} Jul 15 13:11:49.221593 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:49.221451 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5qwqm" event={"ID":"871fcafa-ef85-4040-bd74-5756c6ff4c0a","Type":"ContainerStarted","Data":"163d3c6bb15111c6a5c46ea6e7627b4e5b39532201bf0a81954e4f55b4f27733"} Jul 15 13:11:49.222868 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:49.222842 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pckvj" event={"ID":"a42ef311-841b-4667-96d4-79209f599840","Type":"ContainerStarted","Data":"ecca896dd9e1974f616aeba544ca4f131faebc1caa911f457e432c15c7737848"} Jul 15 13:11:49.224462 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:49.224440 2554 generic.go:356] "Generic (PLEG): container finished" podID="cbe28775-a719-4791-8be0-a8b1305a9b6c" containerID="1d676421ba00698d47c867306ff46ea8b40d0fc40e6386ea37df5338703f5d48" exitCode=0 Jul 15 13:11:49.224559 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:49.224509 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-59k7n" event={"ID":"cbe28775-a719-4791-8be0-a8b1305a9b6c","Type":"ContainerDied","Data":"1d676421ba00698d47c867306ff46ea8b40d0fc40e6386ea37df5338703f5d48"} Jul 15 13:11:49.227221 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:49.227202 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lx562_83d9c378-e25b-487c-a9be-83e18e37d87f/ovn-acl-logging/0.log" Jul 15 13:11:49.227554 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:49.227535 2554 generic.go:356] "Generic (PLEG): container finished" podID="83d9c378-e25b-487c-a9be-83e18e37d87f" containerID="f19ecae962eda74e632991fcc10d435ae8d1f71cb83785fb3c65b27f47656f1f" exitCode=1 Jul 15 13:11:49.227634 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:49.227564 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lx562" event={"ID":"83d9c378-e25b-487c-a9be-83e18e37d87f","Type":"ContainerStarted","Data":"b49986c6af1ced1c4928fbdf4a6f34c11966c3fc66f65cd3a4a08d9793a470bf"} Jul 15 13:11:49.227634 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:49.227619 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lx562" event={"ID":"83d9c378-e25b-487c-a9be-83e18e37d87f","Type":"ContainerStarted","Data":"ae14f97a58abd5da780b9841cef59433d5e63f2415689907f147c1fa016f4cfb"} Jul 15 13:11:49.227710 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:49.227659 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lx562" event={"ID":"83d9c378-e25b-487c-a9be-83e18e37d87f","Type":"ContainerStarted","Data":"09d890752231259990a725adf45abc16fa308c2744e95ddeecc4a2c1cb19be6f"} Jul 15 13:11:49.227710 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:49.227694 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lx562" event={"ID":"83d9c378-e25b-487c-a9be-83e18e37d87f","Type":"ContainerDied","Data":"f19ecae962eda74e632991fcc10d435ae8d1f71cb83785fb3c65b27f47656f1f"} Jul 15 13:11:49.227794 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:49.227730 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lx562" event={"ID":"83d9c378-e25b-487c-a9be-83e18e37d87f","Type":"ContainerStarted","Data":"b2ebb025c0d97f823ddd23e7ea3ab00504a831a19341109582ea46240ee501ea"} Jul 15 13:11:49.240112 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:49.240075 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kw8vb" podStartSLOduration=8.749882288 podStartE2EDuration="22.240060964s" totalImagesPullingTime="13.490178676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:11:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:49.239833747 +0000 UTC m=+22.670643321" watchObservedRunningTime="2026-07-15 13:11:49.240060964 +0000 UTC m=+22.670870537" Jul 15 13:11:49.240443 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:49.240422 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-114.ec2.internal" podStartSLOduration=21.24041612 podStartE2EDuration="21.24041612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:32.210087067 +0000 UTC m=+5.640896643" watchObservedRunningTime="2026-07-15 13:11:49.24041612 +0000 UTC m=+22.671225694" Jul 15 13:11:49.258720 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:49.258677 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5qwqm" podStartSLOduration=4.180677359 podStartE2EDuration="22.258659361s" totalImagesPullingTime="18.077982002s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:49.25663964 +0000 UTC m=+22.687449213" watchObservedRunningTime="2026-07-15 13:11:49.258659361 +0000 UTC m=+22.689468937" Jul 15 13:11:49.330252 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:49.330204 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fvjkn" podStartSLOduration=3.625928272 podStartE2EDuration="22.330189926s" totalImagesPullingTime="18.704261654s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:49.330110871 +0000 UTC m=+22.760920445" watchObservedRunningTime="2026-07-15 13:11:49.330189926 +0000 UTC m=+22.760999499" Jul 15 13:11:49.405190 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:49.405140 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-j4ktm" podStartSLOduration=3.740828903 podStartE2EDuration="22.40512519s" totalImagesPullingTime="18.664296287s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:49.370112236 +0000 UTC m=+22.800921812" watchObservedRunningTime="2026-07-15 13:11:49.40512519 +0000 UTC m=+22.835934798" Jul 15 13:11:50.131623 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:50.131586 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:11:50.131802 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:50.131720 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmbdp" podUID="7cfca5b3-c487-470b-b5b1-965339049b4c" Jul 15 13:11:50.234253 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:50.234227 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lx562_83d9c378-e25b-487c-a9be-83e18e37d87f/ovn-acl-logging/0.log" Jul 15 13:11:50.234776 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:50.234748 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lx562" event={"ID":"83d9c378-e25b-487c-a9be-83e18e37d87f","Type":"ContainerStarted","Data":"37af7ea45d732589b48f48097af09e029152eda21eb747c0160021bafc5a3b6b"} Jul 15 13:11:50.236513 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:50.236479 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rmrp8" event={"ID":"744aabed-58f6-477a-9ad3-2e934ff268e8","Type":"ContainerStarted","Data":"99ec48a61afecb303c330a90c382cec67b5a7c1d56a7062ea2ce3660707180cc"} Jul 15 13:11:50.255836 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:50.255788 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pckvj" podStartSLOduration=4.639227498 podStartE2EDuration="23.255772358s" totalImagesPullingTime="18.61654486s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:49.405652897 +0000 UTC m=+22.836462475" watchObservedRunningTime="2026-07-15 13:11:50.255772358 +0000 UTC m=+23.686581931" Jul 15 13:11:50.256461 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:50.256432 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rmrp8" podStartSLOduration=4.631206412 podStartE2EDuration="23.256421986s" totalImagesPullingTime="18.625215574s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:50.255900456 +0000 UTC m=+23.686710015" watchObservedRunningTime="2026-07-15 13:11:50.256421986 +0000 UTC m=+23.687231589" Jul 15 13:11:50.306416 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:50.306373 2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 15 13:11:50.378920 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:50.378885 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kw8vb" Jul 15 13:11:50.778832 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:50.778804 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kw8vb" Jul 15 13:11:50.779403 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:50.779375 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kw8vb" Jul 15 13:11:51.021749 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:51.021637 2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T13:11:50.30639104Z","UUID":"67cfdf43-efbc-4d1f-9781-114301a9ee79","Handler":null,"Name":"","Endpoint":""} Jul 15 13:11:51.023324 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:51.023289 2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 15 13:11:51.023454 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:51.023341 2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 15 13:11:51.131783 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:51.131704 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26sn7" Jul 15 13:11:51.131783 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:51.131743 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:11:51.132020 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:51.131839 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26sn7" podUID="314d5d2f-7548-4a65-955f-e3de73c09f09" Jul 15 13:11:51.132020 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:51.131993 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54nsh" podUID="e0fd7f31-732f-4343-8f65-5a00324803b4" Jul 15 13:11:51.241136 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:51.241097 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzsd" event={"ID":"2e12f9e7-3e8a-44af-8d18-c80534f808f5","Type":"ContainerStarted","Data":"4aca4ed0ac0df3a532bb979c351e64bfbea4ddc64bf5c0c27b8520b32be3532a"} Jul 15 13:11:51.241770 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:51.241751 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kw8vb" Jul 15 13:11:52.131883 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:52.131695 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:11:52.132063 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:52.131992 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmbdp" podUID="7cfca5b3-c487-470b-b5b1-965339049b4c" Jul 15 13:11:52.246842 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:52.246815 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lx562_83d9c378-e25b-487c-a9be-83e18e37d87f/ovn-acl-logging/0.log" Jul 15 13:11:52.247306 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:52.247276 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lx562" event={"ID":"83d9c378-e25b-487c-a9be-83e18e37d87f","Type":"ContainerStarted","Data":"74fe1317f5e105c55552144bc744d9ae30242ea4a40757ee8d5875958baa8467"} Jul 15 13:11:53.132349 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:53.132313 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:11:53.132568 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:53.132438 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54nsh" podUID="e0fd7f31-732f-4343-8f65-5a00324803b4" Jul 15 13:11:53.132568 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:53.132503 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26sn7" Jul 15 13:11:53.132689 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:53.132589 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26sn7" podUID="314d5d2f-7548-4a65-955f-e3de73c09f09" Jul 15 13:11:54.132302 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:54.132132 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:11:54.132914 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:54.132407 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmbdp" podUID="7cfca5b3-c487-470b-b5b1-965339049b4c" Jul 15 13:11:54.253269 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:54.253239 2554 generic.go:356] "Generic (PLEG): container finished" podID="cbe28775-a719-4791-8be0-a8b1305a9b6c" containerID="fb418b63f1d374b27ad67d1db562a5f1eef11f6b13658a840a95de56e186eb03" exitCode=0 Jul 15 13:11:54.253479 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:54.253325 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-59k7n" event={"ID":"cbe28775-a719-4791-8be0-a8b1305a9b6c","Type":"ContainerDied","Data":"fb418b63f1d374b27ad67d1db562a5f1eef11f6b13658a840a95de56e186eb03"} Jul 15 13:11:54.256637 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:54.256616 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lx562_83d9c378-e25b-487c-a9be-83e18e37d87f/ovn-acl-logging/0.log" Jul 15 13:11:54.257085 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:54.257011 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lx562" event={"ID":"83d9c378-e25b-487c-a9be-83e18e37d87f","Type":"ContainerStarted","Data":"95aaa60edbd2f74e8ad0d24b566521b80bf7861cf5a8fb9411d89c0528ed8168"} Jul 15 13:11:54.257226 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:54.257205 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:54.257340 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:54.257270 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:54.257463 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:54.257447 2554 scope.go:117] "RemoveContainer" containerID="f19ecae962eda74e632991fcc10d435ae8d1f71cb83785fb3c65b27f47656f1f" Jul 15 13:11:54.259463 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:54.259437 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzsd" event={"ID":"2e12f9e7-3e8a-44af-8d18-c80534f808f5","Type":"ContainerStarted","Data":"e4a9e65bb4f4019b5f09cd90335a79b6f414a37084b243067f16f893bb626dff"} Jul 15 13:11:54.273090 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:54.273067 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:54.320366 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:54.320312 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bwzsd" podStartSLOduration=3.528291753 podStartE2EDuration="27.320296136s" totalImagesPullingTime="23.792004383s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:54.320073096 +0000 UTC m=+27.750882670" watchObservedRunningTime="2026-07-15 13:11:54.320296136 +0000 UTC m=+27.751105713" Jul 15 13:11:55.132160 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:55.132072 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:11:55.132160 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:55.132093 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26sn7" Jul 15 13:11:55.132584 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:55.132189 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54nsh" podUID="e0fd7f31-732f-4343-8f65-5a00324803b4" Jul 15 13:11:55.132584 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:55.132317 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26sn7" podUID="314d5d2f-7548-4a65-955f-e3de73c09f09" Jul 15 13:11:55.267208 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:55.267174 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lx562_83d9c378-e25b-487c-a9be-83e18e37d87f/ovn-acl-logging/0.log" Jul 15 13:11:55.267736 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:55.267685 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lx562" event={"ID":"83d9c378-e25b-487c-a9be-83e18e37d87f","Type":"ContainerStarted","Data":"8410d2593fbb114e4e896bf5e9fdae6384a79fbdb336381c919e54bb4820943c"} Jul 15 13:11:55.268161 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:55.268145 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:55.285704 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:55.285672 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:11:55.311378 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:55.311320 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lx562" podStartSLOduration=9.620233071 podStartE2EDuration="28.311299861s" totalImagesPullingTime="18.69106679s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:55.308560474 +0000 UTC m=+28.739370048" watchObservedRunningTime="2026-07-15 13:11:55.311299861 +0000 UTC m=+28.742109436" Jul 15 13:11:56.044033 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:56.043810 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xmbdp"] Jul 15 13:11:56.044190 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:56.044109 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:11:56.044225 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:56.044194 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmbdp" podUID="7cfca5b3-c487-470b-b5b1-965339049b4c" Jul 15 13:11:56.047715 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:56.047692 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-26sn7"] Jul 15 13:11:56.047819 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:56.047799 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26sn7" Jul 15 13:11:56.047911 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:56.047879 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26sn7" podUID="314d5d2f-7548-4a65-955f-e3de73c09f09" Jul 15 13:11:56.060215 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:56.060191 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-54nsh"] Jul 15 13:11:56.060319 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:56.060285 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:11:56.060383 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:56.060363 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54nsh" podUID="e0fd7f31-732f-4343-8f65-5a00324803b4" Jul 15 13:11:56.272660 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:56.272620 2554 generic.go:356] "Generic (PLEG): container finished" podID="cbe28775-a719-4791-8be0-a8b1305a9b6c" containerID="96be1cd42ef48b2a39316c2848919ee49a555fb55d32d0baad23924c62683399" exitCode=0 Jul 15 13:11:56.273051 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:56.272676 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-59k7n" event={"ID":"cbe28775-a719-4791-8be0-a8b1305a9b6c","Type":"ContainerDied","Data":"96be1cd42ef48b2a39316c2848919ee49a555fb55d32d0baad23924c62683399"} Jul 15 13:11:57.133370 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:57.132854 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:11:57.133370 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:57.133048 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmbdp" podUID="7cfca5b3-c487-470b-b5b1-965339049b4c" Jul 15 13:11:58.131820 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:58.131790 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:11:58.132503 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:58.131790 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26sn7" Jul 15 13:11:58.132503 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:58.131892 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54nsh" podUID="e0fd7f31-732f-4343-8f65-5a00324803b4" Jul 15 13:11:58.132503 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:58.131951 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26sn7" podUID="314d5d2f-7548-4a65-955f-e3de73c09f09" Jul 15 13:11:58.278996 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:58.278903 2554 generic.go:356] "Generic (PLEG): container finished" podID="cbe28775-a719-4791-8be0-a8b1305a9b6c" containerID="d65077690bdc5b159bfb6a5d537734c732b427612afeede64d78191ab4f87a49" exitCode=0 Jul 15 13:11:58.278996 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:58.278962 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-59k7n" event={"ID":"cbe28775-a719-4791-8be0-a8b1305a9b6c","Type":"ContainerDied","Data":"d65077690bdc5b159bfb6a5d537734c732b427612afeede64d78191ab4f87a49"} Jul 15 13:11:59.132069 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:11:59.132035 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:11:59.132532 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:11:59.132182 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmbdp" podUID="7cfca5b3-c487-470b-b5b1-965339049b4c" Jul 15 13:12:00.131678 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:00.131644 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:12:00.131868 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:00.131653 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26sn7" Jul 15 13:12:00.131868 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:12:00.131763 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-54nsh" podUID="e0fd7f31-732f-4343-8f65-5a00324803b4" Jul 15 13:12:00.131868 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:12:00.131807 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26sn7" podUID="314d5d2f-7548-4a65-955f-e3de73c09f09" Jul 15 13:12:00.604070 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:00.603964 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:00.695232 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:00.695195 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:00.764696 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:00.764662 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:00.817577 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:00.817540 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh5pl\" (UniqueName: \"kubernetes.io/projected/314d5d2f-7548-4a65-955f-e3de73c09f09-kube-api-access-mh5pl\") pod \"network-check-target-26sn7\" (UID: \"314d5d2f-7548-4a65-955f-e3de73c09f09\") " pod="openshift-network-diagnostics/network-check-target-26sn7" Jul 15 13:12:00.817745 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:00.817591 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0fd7f31-732f-4343-8f65-5a00324803b4-original-pull-secret\") pod \"global-pull-secret-syncer-54nsh\" (UID: \"e0fd7f31-732f-4343-8f65-5a00324803b4\") " pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:12:00.817745 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:00.817620 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfca5b3-c487-470b-b5b1-965339049b4c-metrics-certs\") pod \"network-metrics-daemon-xmbdp\" (UID: \"7cfca5b3-c487-470b-b5b1-965339049b4c\") " pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:12:00.817745 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:12:00.817716 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 13:12:00.817868 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:12:00.817795 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0fd7f31-732f-4343-8f65-5a00324803b4-original-pull-secret podName:e0fd7f31-732f-4343-8f65-5a00324803b4 nodeName:}" failed. No retries permitted until 2026-07-15 13:12:32.817778658 +0000 UTC m=+66.248588213 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0fd7f31-732f-4343-8f65-5a00324803b4-original-pull-secret") pod "global-pull-secret-syncer-54nsh" (UID: "e0fd7f31-732f-4343-8f65-5a00324803b4") : object "kube-system"/"original-pull-secret" not registered Jul 15 13:12:00.817868 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:12:00.817798 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:12:00.817868 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:12:00.817722 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 13:12:00.817868 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:12:00.817847 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 13:12:00.817868 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:12:00.817865 2554 projected.go:196] Error preparing data for projected volume kube-api-access-mh5pl for pod openshift-network-diagnostics/network-check-target-26sn7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:12:00.818087 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:12:00.817851 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cfca5b3-c487-470b-b5b1-965339049b4c-metrics-certs podName:7cfca5b3-c487-470b-b5b1-965339049b4c nodeName:}" failed. No retries permitted until 2026-07-15 13:12:32.817835627 +0000 UTC m=+66.248645180 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cfca5b3-c487-470b-b5b1-965339049b4c-metrics-certs") pod "network-metrics-daemon-xmbdp" (UID: "7cfca5b3-c487-470b-b5b1-965339049b4c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 13:12:00.818087 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:12:00.817930 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/314d5d2f-7548-4a65-955f-e3de73c09f09-kube-api-access-mh5pl podName:314d5d2f-7548-4a65-955f-e3de73c09f09 nodeName:}" failed. No retries permitted until 2026-07-15 13:12:32.8179132 +0000 UTC m=+66.248722768 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mh5pl" (UniqueName: "kubernetes.io/projected/314d5d2f-7548-4a65-955f-e3de73c09f09-kube-api-access-mh5pl") pod "network-check-target-26sn7" (UID: "314d5d2f-7548-4a65-955f-e3de73c09f09") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 13:12:01.131826 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.131610 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:12:01.131999 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:12:01.131941 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmbdp" podUID="7cfca5b3-c487-470b-b5b1-965339049b4c" Jul 15 13:12:01.417420 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.417347 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-114.ec2.internal" event="NodeReady" Jul 15 13:12:01.417559 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.417513 2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 15 13:12:01.497700 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.497666 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-f8z4j"] Jul 15 13:12:01.500743 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.500716 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f8z4j" Jul 15 13:12:01.505250 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.505225 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bdsl2\"" Jul 15 13:12:01.505385 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.505250 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 15 13:12:01.505448 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.505386 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 15 13:12:01.513240 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.513220 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6bd2c"] Jul 15 13:12:01.515113 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.515095 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6bd2c" Jul 15 13:12:01.519788 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.519772 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jtsrm\"" Jul 15 13:12:01.520460 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.520062 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 15 13:12:01.520460 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.520103 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 15 13:12:01.520709 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.520694 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 15 13:12:01.537690 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.537662 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f8z4j"] Jul 15 13:12:01.558382 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.558343 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6bd2c"] Jul 15 13:12:01.624041 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.624004 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d396aec3-e269-4e9e-8908-ef9b3712ac76-config-volume\") pod \"dns-default-f8z4j\" (UID: \"d396aec3-e269-4e9e-8908-ef9b3712ac76\") " pod="openshift-dns/dns-default-f8z4j" Jul 15 13:12:01.624485 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.624046 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d396aec3-e269-4e9e-8908-ef9b3712ac76-metrics-tls\") pod \"dns-default-f8z4j\" (UID: \"d396aec3-e269-4e9e-8908-ef9b3712ac76\") " pod="openshift-dns/dns-default-f8z4j" Jul 15 13:12:01.624485 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.624089 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xcr2\" (UniqueName: \"kubernetes.io/projected/369753f1-3b74-4d68-9d71-8805808340f0-kube-api-access-5xcr2\") pod \"ingress-canary-6bd2c\" (UID: \"369753f1-3b74-4d68-9d71-8805808340f0\") " pod="openshift-ingress-canary/ingress-canary-6bd2c" Jul 15 13:12:01.624485 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.624125 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d396aec3-e269-4e9e-8908-ef9b3712ac76-tmp-dir\") pod \"dns-default-f8z4j\" (UID: \"d396aec3-e269-4e9e-8908-ef9b3712ac76\") " pod="openshift-dns/dns-default-f8z4j" Jul 15 13:12:01.624485 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.624150 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv4qm\" (UniqueName: \"kubernetes.io/projected/d396aec3-e269-4e9e-8908-ef9b3712ac76-kube-api-access-zv4qm\") pod \"dns-default-f8z4j\" (UID: \"d396aec3-e269-4e9e-8908-ef9b3712ac76\") " pod="openshift-dns/dns-default-f8z4j" Jul 15 13:12:01.624485 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.624213 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/369753f1-3b74-4d68-9d71-8805808340f0-cert\") pod \"ingress-canary-6bd2c\" (UID: \"369753f1-3b74-4d68-9d71-8805808340f0\") " pod="openshift-ingress-canary/ingress-canary-6bd2c" Jul 15 13:12:01.725296 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.725188 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/369753f1-3b74-4d68-9d71-8805808340f0-cert\") pod \"ingress-canary-6bd2c\" (UID: \"369753f1-3b74-4d68-9d71-8805808340f0\") " pod="openshift-ingress-canary/ingress-canary-6bd2c" Jul 15 13:12:01.725296 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.725224 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d396aec3-e269-4e9e-8908-ef9b3712ac76-config-volume\") pod \"dns-default-f8z4j\" (UID: \"d396aec3-e269-4e9e-8908-ef9b3712ac76\") " pod="openshift-dns/dns-default-f8z4j" Jul 15 13:12:01.725296 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.725242 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d396aec3-e269-4e9e-8908-ef9b3712ac76-metrics-tls\") pod \"dns-default-f8z4j\" (UID: \"d396aec3-e269-4e9e-8908-ef9b3712ac76\") " pod="openshift-dns/dns-default-f8z4j" Jul 15 13:12:01.725296 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.725272 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xcr2\" (UniqueName: \"kubernetes.io/projected/369753f1-3b74-4d68-9d71-8805808340f0-kube-api-access-5xcr2\") pod \"ingress-canary-6bd2c\" (UID: \"369753f1-3b74-4d68-9d71-8805808340f0\") " pod="openshift-ingress-canary/ingress-canary-6bd2c" Jul 15 13:12:01.725296 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.725298 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d396aec3-e269-4e9e-8908-ef9b3712ac76-tmp-dir\") pod \"dns-default-f8z4j\" (UID: \"d396aec3-e269-4e9e-8908-ef9b3712ac76\") " pod="openshift-dns/dns-default-f8z4j" Jul 15 13:12:01.725631 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.725319 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv4qm\" (UniqueName: \"kubernetes.io/projected/d396aec3-e269-4e9e-8908-ef9b3712ac76-kube-api-access-zv4qm\") pod \"dns-default-f8z4j\" (UID: \"d396aec3-e269-4e9e-8908-ef9b3712ac76\") " pod="openshift-dns/dns-default-f8z4j" Jul 15 13:12:01.725631 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:12:01.725364 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 13:12:01.725631 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:12:01.725435 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d396aec3-e269-4e9e-8908-ef9b3712ac76-metrics-tls podName:d396aec3-e269-4e9e-8908-ef9b3712ac76 nodeName:}" failed. No retries permitted until 2026-07-15 13:12:02.225415745 +0000 UTC m=+35.656225316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d396aec3-e269-4e9e-8908-ef9b3712ac76-metrics-tls") pod "dns-default-f8z4j" (UID: "d396aec3-e269-4e9e-8908-ef9b3712ac76") : secret "dns-default-metrics-tls" not found Jul 15 13:12:01.725788 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.725719 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d396aec3-e269-4e9e-8908-ef9b3712ac76-tmp-dir\") pod \"dns-default-f8z4j\" (UID: \"d396aec3-e269-4e9e-8908-ef9b3712ac76\") " pod="openshift-dns/dns-default-f8z4j" Jul 15 13:12:01.725914 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.725883 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d396aec3-e269-4e9e-8908-ef9b3712ac76-config-volume\") pod \"dns-default-f8z4j\" (UID: \"d396aec3-e269-4e9e-8908-ef9b3712ac76\") " pod="openshift-dns/dns-default-f8z4j" Jul 15 13:12:01.730140 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.730114 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/369753f1-3b74-4d68-9d71-8805808340f0-cert\") pod \"ingress-canary-6bd2c\" (UID: \"369753f1-3b74-4d68-9d71-8805808340f0\") " pod="openshift-ingress-canary/ingress-canary-6bd2c" Jul 15 13:12:01.748092 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.748062 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv4qm\" (UniqueName: \"kubernetes.io/projected/d396aec3-e269-4e9e-8908-ef9b3712ac76-kube-api-access-zv4qm\") pod \"dns-default-f8z4j\" (UID: \"d396aec3-e269-4e9e-8908-ef9b3712ac76\") " pod="openshift-dns/dns-default-f8z4j" Jul 15 13:12:01.750256 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.750233 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xcr2\" (UniqueName: \"kubernetes.io/projected/369753f1-3b74-4d68-9d71-8805808340f0-kube-api-access-5xcr2\") pod \"ingress-canary-6bd2c\" (UID: \"369753f1-3b74-4d68-9d71-8805808340f0\") " pod="openshift-ingress-canary/ingress-canary-6bd2c" Jul 15 13:12:01.824395 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:01.824351 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6bd2c" Jul 15 13:12:02.131833 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:02.131747 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:12:02.132008 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:02.131747 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26sn7" Jul 15 13:12:02.135898 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:02.135871 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 13:12:02.136043 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:02.135908 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 13:12:02.136547 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:02.136527 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 13:12:02.137695 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:02.137675 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b9szj\"" Jul 15 13:12:02.229113 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:02.229071 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d396aec3-e269-4e9e-8908-ef9b3712ac76-metrics-tls\") pod \"dns-default-f8z4j\" (UID: \"d396aec3-e269-4e9e-8908-ef9b3712ac76\") " pod="openshift-dns/dns-default-f8z4j" Jul 15 13:12:02.229262 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:12:02.229230 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 13:12:02.229319 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:12:02.229306 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d396aec3-e269-4e9e-8908-ef9b3712ac76-metrics-tls podName:d396aec3-e269-4e9e-8908-ef9b3712ac76 nodeName:}" failed. No retries permitted until 2026-07-15 13:12:03.229285002 +0000 UTC m=+36.660094554 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d396aec3-e269-4e9e-8908-ef9b3712ac76-metrics-tls") pod "dns-default-f8z4j" (UID: "d396aec3-e269-4e9e-8908-ef9b3712ac76") : secret "dns-default-metrics-tls" not found Jul 15 13:12:02.472130 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:02.471545 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6bd2c"] Jul 15 13:12:02.479490 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:12:02.479459 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod369753f1_3b74_4d68_9d71_8805808340f0.slice/crio-7b7fbc7dfa48fce6bd2499b6587ebb4914ab22cb1c5f89f96ce37257f897e185 WatchSource:0}: Error finding container 7b7fbc7dfa48fce6bd2499b6587ebb4914ab22cb1c5f89f96ce37257f897e185: Status 404 returned error can't find the container with id 7b7fbc7dfa48fce6bd2499b6587ebb4914ab22cb1c5f89f96ce37257f897e185 Jul 15 13:12:02.816181 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:02.816098 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:03.131723 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:03.131616 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:12:03.136008 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:03.135966 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 13:12:03.136146 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:03.136018 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hh9ms\"" Jul 15 13:12:03.236405 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:03.236363 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d396aec3-e269-4e9e-8908-ef9b3712ac76-metrics-tls\") pod \"dns-default-f8z4j\" (UID: \"d396aec3-e269-4e9e-8908-ef9b3712ac76\") " pod="openshift-dns/dns-default-f8z4j" Jul 15 13:12:03.236555 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:12:03.236507 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 13:12:03.236613 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:12:03.236564 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d396aec3-e269-4e9e-8908-ef9b3712ac76-metrics-tls podName:d396aec3-e269-4e9e-8908-ef9b3712ac76 nodeName:}" failed. No retries permitted until 2026-07-15 13:12:05.236549222 +0000 UTC m=+38.667358774 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d396aec3-e269-4e9e-8908-ef9b3712ac76-metrics-tls") pod "dns-default-f8z4j" (UID: "d396aec3-e269-4e9e-8908-ef9b3712ac76") : secret "dns-default-metrics-tls" not found Jul 15 13:12:03.293202 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:03.293165 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6bd2c" event={"ID":"369753f1-3b74-4d68-9d71-8805808340f0","Type":"ContainerStarted","Data":"7b7fbc7dfa48fce6bd2499b6587ebb4914ab22cb1c5f89f96ce37257f897e185"} Jul 15 13:12:03.296407 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:03.296380 2554 generic.go:356] "Generic (PLEG): container finished" podID="cbe28775-a719-4791-8be0-a8b1305a9b6c" containerID="1e26535c0bbc8e99cfff1a0e7c4b3bcd13b216f566595b5e17b96734f7425c68" exitCode=0 Jul 15 13:12:03.296535 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:03.296425 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-59k7n" event={"ID":"cbe28775-a719-4791-8be0-a8b1305a9b6c","Type":"ContainerDied","Data":"1e26535c0bbc8e99cfff1a0e7c4b3bcd13b216f566595b5e17b96734f7425c68"} Jul 15 13:12:03.356197 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:03.355996 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:04.302674 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:04.302638 2554 generic.go:356] "Generic (PLEG): container finished" podID="cbe28775-a719-4791-8be0-a8b1305a9b6c" containerID="b49345b957356b092777fc3a5201a89de332090f459937bf58dc46e065311c93" exitCode=0 Jul 15 13:12:04.303155 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:04.302691 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-59k7n" event={"ID":"cbe28775-a719-4791-8be0-a8b1305a9b6c","Type":"ContainerDied","Data":"b49345b957356b092777fc3a5201a89de332090f459937bf58dc46e065311c93"} Jul 15 13:12:05.251597 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:05.251565 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d396aec3-e269-4e9e-8908-ef9b3712ac76-metrics-tls\") pod \"dns-default-f8z4j\" (UID: \"d396aec3-e269-4e9e-8908-ef9b3712ac76\") " pod="openshift-dns/dns-default-f8z4j" Jul 15 13:12:05.251742 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:12:05.251685 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 13:12:05.251742 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:12:05.251737 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d396aec3-e269-4e9e-8908-ef9b3712ac76-metrics-tls podName:d396aec3-e269-4e9e-8908-ef9b3712ac76 nodeName:}" failed. No retries permitted until 2026-07-15 13:12:09.251724113 +0000 UTC m=+42.682533668 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d396aec3-e269-4e9e-8908-ef9b3712ac76-metrics-tls") pod "dns-default-f8z4j" (UID: "d396aec3-e269-4e9e-8908-ef9b3712ac76") : secret "dns-default-metrics-tls" not found Jul 15 13:12:05.308375 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:05.308343 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-59k7n" event={"ID":"cbe28775-a719-4791-8be0-a8b1305a9b6c","Type":"ContainerStarted","Data":"26878e6023a461980562bf26682d9e78fb4687322305acc6791e44165ad76c1d"} Jul 15 13:12:05.309825 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:05.309805 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6bd2c" event={"ID":"369753f1-3b74-4d68-9d71-8805808340f0","Type":"ContainerStarted","Data":"57c38330fe1dca58171c97355306c18c77718e1ced88a44467022da83ec38a38"} Jul 15 13:12:05.341506 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:05.341236 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-59k7n" podStartSLOduration=8.911636781 podStartE2EDuration="38.341205209s" totalImagesPullingTime="29.429568428s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:27 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:12:05.338274186 +0000 UTC m=+38.769083760" watchObservedRunningTime="2026-07-15 13:12:05.341205209 +0000 UTC m=+38.772014780" Jul 15 13:12:05.366379 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:05.366327 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6bd2c" podStartSLOduration=1.9771683709999999 podStartE2EDuration="4.366312272s" totalImagesPullingTime="2.389143901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:12:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:12:05.366083857 +0000 UTC m=+38.796893430" watchObservedRunningTime="2026-07-15 13:12:05.366312272 +0000 UTC m=+38.797121845" Jul 15 13:12:05.531270 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:05.531171 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:05.943484 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:05.943409 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:06.049259 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:06.049225 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:07.185606 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:07.185577 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:07.283685 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:07.283652 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:09.280756 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:09.280721 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d396aec3-e269-4e9e-8908-ef9b3712ac76-metrics-tls\") pod \"dns-default-f8z4j\" (UID: \"d396aec3-e269-4e9e-8908-ef9b3712ac76\") " pod="openshift-dns/dns-default-f8z4j" Jul 15 13:12:09.281161 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:12:09.280832 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 13:12:09.281161 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:12:09.280885 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d396aec3-e269-4e9e-8908-ef9b3712ac76-metrics-tls podName:d396aec3-e269-4e9e-8908-ef9b3712ac76 nodeName:}" failed. No retries permitted until 2026-07-15 13:12:17.280871378 +0000 UTC m=+50.711680929 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d396aec3-e269-4e9e-8908-ef9b3712ac76-metrics-tls") pod "dns-default-f8z4j" (UID: "d396aec3-e269-4e9e-8908-ef9b3712ac76") : secret "dns-default-metrics-tls" not found Jul 15 13:12:11.072560 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:11.072521 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:11.133536 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:11.133502 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:17.338765 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:17.338732 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d396aec3-e269-4e9e-8908-ef9b3712ac76-metrics-tls\") pod \"dns-default-f8z4j\" (UID: \"d396aec3-e269-4e9e-8908-ef9b3712ac76\") " pod="openshift-dns/dns-default-f8z4j" Jul 15 13:12:17.339180 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:12:17.338884 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 13:12:17.339180 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:12:17.338956 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d396aec3-e269-4e9e-8908-ef9b3712ac76-metrics-tls podName:d396aec3-e269-4e9e-8908-ef9b3712ac76 nodeName:}" failed. No retries permitted until 2026-07-15 13:12:33.33894054 +0000 UTC m=+66.769750095 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d396aec3-e269-4e9e-8908-ef9b3712ac76-metrics-tls") pod "dns-default-f8z4j" (UID: "d396aec3-e269-4e9e-8908-ef9b3712ac76") : secret "dns-default-metrics-tls" not found Jul 15 13:12:19.425235 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:19.425203 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:19.495586 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:19.495556 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:23.722713 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:23.722671 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:23.826001 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:23.825955 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:27.293386 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:27.293359 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lx562" Jul 15 13:12:27.452822 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:27.452794 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:27.521551 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:27.521522 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:27.611290 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:27.611224 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:32.836187 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:32.836139 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0fd7f31-732f-4343-8f65-5a00324803b4-original-pull-secret\") pod \"global-pull-secret-syncer-54nsh\" (UID: \"e0fd7f31-732f-4343-8f65-5a00324803b4\") " pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:12:32.836187 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:32.836189 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfca5b3-c487-470b-b5b1-965339049b4c-metrics-certs\") pod \"network-metrics-daemon-xmbdp\" (UID: \"7cfca5b3-c487-470b-b5b1-965339049b4c\") " pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:12:32.836717 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:32.836328 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh5pl\" (UniqueName: \"kubernetes.io/projected/314d5d2f-7548-4a65-955f-e3de73c09f09-kube-api-access-mh5pl\") pod \"network-check-target-26sn7\" (UID: \"314d5d2f-7548-4a65-955f-e3de73c09f09\") " pod="openshift-network-diagnostics/network-check-target-26sn7" Jul 15 13:12:32.839433 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:32.839414 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 13:12:32.839559 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:32.839464 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 13:12:32.839606 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:32.839573 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 13:12:32.847341 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:12:32.847323 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 15 13:12:32.847412 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:12:32.847382 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cfca5b3-c487-470b-b5b1-965339049b4c-metrics-certs podName:7cfca5b3-c487-470b-b5b1-965339049b4c nodeName:}" failed. No retries permitted until 2026-07-15 13:13:36.847366322 +0000 UTC m=+130.278175875 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cfca5b3-c487-470b-b5b1-965339049b4c-metrics-certs") pod "network-metrics-daemon-xmbdp" (UID: "7cfca5b3-c487-470b-b5b1-965339049b4c") : secret "metrics-daemon-secret" not found Jul 15 13:12:32.850063 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:32.850049 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 13:12:32.850639 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:32.850619 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0fd7f31-732f-4343-8f65-5a00324803b4-original-pull-secret\") pod \"global-pull-secret-syncer-54nsh\" (UID: \"e0fd7f31-732f-4343-8f65-5a00324803b4\") " pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:12:32.859621 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:32.859593 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh5pl\" (UniqueName: \"kubernetes.io/projected/314d5d2f-7548-4a65-955f-e3de73c09f09-kube-api-access-mh5pl\") pod \"network-check-target-26sn7\" (UID: \"314d5d2f-7548-4a65-955f-e3de73c09f09\") " pod="openshift-network-diagnostics/network-check-target-26sn7" Jul 15 13:12:33.044209 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:33.044177 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-54nsh" Jul 15 13:12:33.052909 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:33.052883 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b9szj\"" Jul 15 13:12:33.060880 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:33.060847 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26sn7" Jul 15 13:12:33.087075 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:33.086999 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:33.168282 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:33.168250 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:33.180217 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:33.180194 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-54nsh"] Jul 15 13:12:33.183181 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:12:33.183156 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0fd7f31_732f_4343_8f65_5a00324803b4.slice/crio-5fe9f8ef524b1c8a6fdce5ec6a0aebde6a72dc5b304944879ec633ae24283f69 WatchSource:0}: Error finding container 5fe9f8ef524b1c8a6fdce5ec6a0aebde6a72dc5b304944879ec633ae24283f69: Status 404 returned error can't find the container with id 5fe9f8ef524b1c8a6fdce5ec6a0aebde6a72dc5b304944879ec633ae24283f69 Jul 15 13:12:33.199767 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:33.199750 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-26sn7"] Jul 15 13:12:33.201950 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:12:33.201923 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod314d5d2f_7548_4a65_955f_e3de73c09f09.slice/crio-36d3e6a456efdc7e6d6ad9ca43a7efbad9ef9680e43d0bbb954ed9493d8815f9 WatchSource:0}: Error finding container 36d3e6a456efdc7e6d6ad9ca43a7efbad9ef9680e43d0bbb954ed9493d8815f9: Status 404 returned error can't find the container with id 36d3e6a456efdc7e6d6ad9ca43a7efbad9ef9680e43d0bbb954ed9493d8815f9 Jul 15 13:12:33.340140 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:33.340071 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d396aec3-e269-4e9e-8908-ef9b3712ac76-metrics-tls\") pod \"dns-default-f8z4j\" (UID: \"d396aec3-e269-4e9e-8908-ef9b3712ac76\") " pod="openshift-dns/dns-default-f8z4j" Jul 15 13:12:33.340258 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:12:33.340172 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 13:12:33.340258 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:12:33.340220 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d396aec3-e269-4e9e-8908-ef9b3712ac76-metrics-tls podName:d396aec3-e269-4e9e-8908-ef9b3712ac76 nodeName:}" failed. No retries permitted until 2026-07-15 13:13:05.340208145 +0000 UTC m=+98.771017701 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d396aec3-e269-4e9e-8908-ef9b3712ac76-metrics-tls") pod "dns-default-f8z4j" (UID: "d396aec3-e269-4e9e-8908-ef9b3712ac76") : secret "dns-default-metrics-tls" not found Jul 15 13:12:33.373158 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:33.373128 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-26sn7" event={"ID":"314d5d2f-7548-4a65-955f-e3de73c09f09","Type":"ContainerStarted","Data":"36d3e6a456efdc7e6d6ad9ca43a7efbad9ef9680e43d0bbb954ed9493d8815f9"} Jul 15 13:12:33.374201 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:33.374179 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-54nsh" event={"ID":"e0fd7f31-732f-4343-8f65-5a00324803b4","Type":"ContainerStarted","Data":"5fe9f8ef524b1c8a6fdce5ec6a0aebde6a72dc5b304944879ec633ae24283f69"} Jul 15 13:12:37.656074 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:37.656039 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:37.721286 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:37.721248 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:12:39.394433 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:39.394393 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-26sn7" event={"ID":"314d5d2f-7548-4a65-955f-e3de73c09f09","Type":"ContainerStarted","Data":"cb19c628c9c61836a90b2639d46dd35703d9e8deeb70db7d67ff77fc6b982ae7"} Jul 15 13:12:39.394894 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:39.394565 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-26sn7" Jul 15 13:12:39.395851 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:39.395826 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-54nsh" event={"ID":"e0fd7f31-732f-4343-8f65-5a00324803b4","Type":"ContainerStarted","Data":"363e99e41ad22fb6def740122bf6f960014db3aec82b21a88e4360d8335c5ce7"} Jul 15 13:12:39.414716 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:39.414668 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-26sn7" podStartSLOduration=67.27855548 podStartE2EDuration="1m12.414654547s" totalImagesPullingTime="5.136099067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:11:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:12:39.413331767 +0000 UTC m=+72.844141341" watchObservedRunningTime="2026-07-15 13:12:39.414654547 +0000 UTC m=+72.845464134" Jul 15 13:12:39.436370 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:12:39.436321 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-54nsh" podStartSLOduration=67.279920134 podStartE2EDuration="1m12.436311905s" totalImagesPullingTime="5.156391771s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:12:39.43389422 +0000 UTC m=+72.864703815" watchObservedRunningTime="2026-07-15 13:12:39.436311905 +0000 UTC m=+72.867121478" Jul 15 13:13:05.351296 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:13:05.351265 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d396aec3-e269-4e9e-8908-ef9b3712ac76-metrics-tls\") pod \"dns-default-f8z4j\" (UID: \"d396aec3-e269-4e9e-8908-ef9b3712ac76\") " pod="openshift-dns/dns-default-f8z4j" Jul 15 13:13:05.351655 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:13:05.351432 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 13:13:05.351655 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:13:05.351512 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d396aec3-e269-4e9e-8908-ef9b3712ac76-metrics-tls podName:d396aec3-e269-4e9e-8908-ef9b3712ac76 nodeName:}" failed. No retries permitted until 2026-07-15 13:14:09.35149504 +0000 UTC m=+162.782304591 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d396aec3-e269-4e9e-8908-ef9b3712ac76-metrics-tls") pod "dns-default-f8z4j" (UID: "d396aec3-e269-4e9e-8908-ef9b3712ac76") : secret "dns-default-metrics-tls" not found Jul 15 13:13:10.400490 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:13:10.400462 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-26sn7" Jul 15 13:13:36.865267 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:13:36.865222 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfca5b3-c487-470b-b5b1-965339049b4c-metrics-certs\") pod \"network-metrics-daemon-xmbdp\" (UID: \"7cfca5b3-c487-470b-b5b1-965339049b4c\") " pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:13:36.865742 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:13:36.865357 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 15 13:13:36.865742 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:13:36.865420 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cfca5b3-c487-470b-b5b1-965339049b4c-metrics-certs podName:7cfca5b3-c487-470b-b5b1-965339049b4c nodeName:}" failed. No retries permitted until 2026-07-15 13:15:38.86540555 +0000 UTC m=+252.296215101 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cfca5b3-c487-470b-b5b1-965339049b4c-metrics-certs") pod "network-metrics-daemon-xmbdp" (UID: "7cfca5b3-c487-470b-b5b1-965339049b4c") : secret "metrics-daemon-secret" not found Jul 15 13:14:04.513633 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:14:04.513576 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-f8z4j" podUID="d396aec3-e269-4e9e-8908-ef9b3712ac76" Jul 15 13:14:04.598815 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:14:04.598788 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f8z4j" Jul 15 13:14:06.143515 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:14:06.143472 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-xmbdp" podUID="7cfca5b3-c487-470b-b5b1-965339049b4c" Jul 15 13:14:09.389927 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:14:09.389877 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d396aec3-e269-4e9e-8908-ef9b3712ac76-metrics-tls\") pod \"dns-default-f8z4j\" (UID: \"d396aec3-e269-4e9e-8908-ef9b3712ac76\") " pod="openshift-dns/dns-default-f8z4j" Jul 15 13:14:09.390352 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:14:09.390027 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 13:14:09.390352 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:14:09.390081 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d396aec3-e269-4e9e-8908-ef9b3712ac76-metrics-tls podName:d396aec3-e269-4e9e-8908-ef9b3712ac76 nodeName:}" failed. No retries permitted until 2026-07-15 13:16:11.390067269 +0000 UTC m=+284.820876822 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d396aec3-e269-4e9e-8908-ef9b3712ac76-metrics-tls") pod "dns-default-f8z4j" (UID: "d396aec3-e269-4e9e-8908-ef9b3712ac76") : secret "dns-default-metrics-tls" not found Jul 15 13:14:17.132817 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:14:17.132779 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:14:37.779661 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:14:37.779584 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:24.691723 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.691683 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-twlf4"] Jul 15 13:15:24.693566 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.693549 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-twlf4" Jul 15 13:15:24.697476 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.697455 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 15 13:15:24.697635 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.697619 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 15 13:15:24.698365 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.698348 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 15 13:15:24.698452 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.698409 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mxbt9\"" Jul 15 13:15:24.704207 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.704187 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7"] Jul 15 13:15:24.706165 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.706147 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7" Jul 15 13:15:24.709057 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.709036 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 15 13:15:24.709144 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.709119 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 15 13:15:24.709827 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.709813 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 15 13:15:24.709871 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.709846 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 15 13:15:24.710902 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.710880 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 15 13:15:24.711022 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.711008 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 15 13:15:24.711690 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.711659 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 15 13:15:24.719265 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.719244 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-twlf4"] Jul 15 13:15:24.734955 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.734923 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7"] Jul 15 13:15:24.798773 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.798736 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0eac4c8c-fc00-48e1-a420-e944097e774d-hub\") pod \"cluster-proxy-proxy-agent-69b66cfbd-gp7c7\" (UID: \"0eac4c8c-fc00-48e1-a420-e944097e774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7" Jul 15 13:15:24.798773 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.798777 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s85ht\" (UniqueName: \"kubernetes.io/projected/0eac4c8c-fc00-48e1-a420-e944097e774d-kube-api-access-s85ht\") pod \"cluster-proxy-proxy-agent-69b66cfbd-gp7c7\" (UID: \"0eac4c8c-fc00-48e1-a420-e944097e774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7" Jul 15 13:15:24.799045 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.798801 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0eac4c8c-fc00-48e1-a420-e944097e774d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-69b66cfbd-gp7c7\" (UID: \"0eac4c8c-fc00-48e1-a420-e944097e774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7" Jul 15 13:15:24.799045 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.798848 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0eac4c8c-fc00-48e1-a420-e944097e774d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-69b66cfbd-gp7c7\" (UID: \"0eac4c8c-fc00-48e1-a420-e944097e774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7" Jul 15 13:15:24.799045 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.798941 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt8jb\" (UniqueName: \"kubernetes.io/projected/95fd6da1-f84a-4824-b407-7c26a6a5e3f7-kube-api-access-xt8jb\") pod \"cluster-samples-operator-65db858894-twlf4\" (UID: \"95fd6da1-f84a-4824-b407-7c26a6a5e3f7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-twlf4" Jul 15 13:15:24.799045 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.799001 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0eac4c8c-fc00-48e1-a420-e944097e774d-ca\") pod \"cluster-proxy-proxy-agent-69b66cfbd-gp7c7\" (UID: \"0eac4c8c-fc00-48e1-a420-e944097e774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7" Jul 15 13:15:24.799194 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.799054 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0eac4c8c-fc00-48e1-a420-e944097e774d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-69b66cfbd-gp7c7\" (UID: \"0eac4c8c-fc00-48e1-a420-e944097e774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7" Jul 15 13:15:24.799194 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.799076 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/95fd6da1-f84a-4824-b407-7c26a6a5e3f7-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-twlf4\" (UID: \"95fd6da1-f84a-4824-b407-7c26a6a5e3f7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-twlf4" Jul 15 13:15:24.899690 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.899654 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt8jb\" (UniqueName: \"kubernetes.io/projected/95fd6da1-f84a-4824-b407-7c26a6a5e3f7-kube-api-access-xt8jb\") pod \"cluster-samples-operator-65db858894-twlf4\" (UID: \"95fd6da1-f84a-4824-b407-7c26a6a5e3f7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-twlf4" Jul 15 13:15:24.899690 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.899690 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0eac4c8c-fc00-48e1-a420-e944097e774d-ca\") pod \"cluster-proxy-proxy-agent-69b66cfbd-gp7c7\" (UID: \"0eac4c8c-fc00-48e1-a420-e944097e774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7" Jul 15 13:15:24.899911 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.899739 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0eac4c8c-fc00-48e1-a420-e944097e774d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-69b66cfbd-gp7c7\" (UID: \"0eac4c8c-fc00-48e1-a420-e944097e774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7" Jul 15 13:15:24.899911 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.899760 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/95fd6da1-f84a-4824-b407-7c26a6a5e3f7-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-twlf4\" (UID: \"95fd6da1-f84a-4824-b407-7c26a6a5e3f7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-twlf4" Jul 15 13:15:24.899911 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.899788 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0eac4c8c-fc00-48e1-a420-e944097e774d-hub\") pod \"cluster-proxy-proxy-agent-69b66cfbd-gp7c7\" (UID: \"0eac4c8c-fc00-48e1-a420-e944097e774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7" Jul 15 13:15:24.899911 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.899814 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s85ht\" (UniqueName: \"kubernetes.io/projected/0eac4c8c-fc00-48e1-a420-e944097e774d-kube-api-access-s85ht\") pod \"cluster-proxy-proxy-agent-69b66cfbd-gp7c7\" (UID: \"0eac4c8c-fc00-48e1-a420-e944097e774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7" Jul 15 13:15:24.899911 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.899841 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0eac4c8c-fc00-48e1-a420-e944097e774d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-69b66cfbd-gp7c7\" (UID: \"0eac4c8c-fc00-48e1-a420-e944097e774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7" Jul 15 13:15:24.899911 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.899867 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0eac4c8c-fc00-48e1-a420-e944097e774d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-69b66cfbd-gp7c7\" (UID: \"0eac4c8c-fc00-48e1-a420-e944097e774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7" Jul 15 13:15:24.900217 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:15:24.900041 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 13:15:24.900217 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:15:24.900131 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95fd6da1-f84a-4824-b407-7c26a6a5e3f7-samples-operator-tls podName:95fd6da1-f84a-4824-b407-7c26a6a5e3f7 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:25.400108469 +0000 UTC m=+238.830918024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/95fd6da1-f84a-4824-b407-7c26a6a5e3f7-samples-operator-tls") pod "cluster-samples-operator-65db858894-twlf4" (UID: "95fd6da1-f84a-4824-b407-7c26a6a5e3f7") : secret "samples-operator-tls" not found Jul 15 13:15:24.900649 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.900625 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0eac4c8c-fc00-48e1-a420-e944097e774d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-69b66cfbd-gp7c7\" (UID: \"0eac4c8c-fc00-48e1-a420-e944097e774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7" Jul 15 13:15:24.902327 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.902297 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0eac4c8c-fc00-48e1-a420-e944097e774d-hub\") pod \"cluster-proxy-proxy-agent-69b66cfbd-gp7c7\" (UID: \"0eac4c8c-fc00-48e1-a420-e944097e774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7" Jul 15 13:15:24.902429 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.902354 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0eac4c8c-fc00-48e1-a420-e944097e774d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-69b66cfbd-gp7c7\" (UID: \"0eac4c8c-fc00-48e1-a420-e944097e774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7" Jul 15 13:15:24.902429 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.902360 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0eac4c8c-fc00-48e1-a420-e944097e774d-ca\") pod \"cluster-proxy-proxy-agent-69b66cfbd-gp7c7\" (UID: \"0eac4c8c-fc00-48e1-a420-e944097e774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7" Jul 15 13:15:24.902534 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.902517 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0eac4c8c-fc00-48e1-a420-e944097e774d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-69b66cfbd-gp7c7\" (UID: \"0eac4c8c-fc00-48e1-a420-e944097e774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7" Jul 15 13:15:24.923267 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.923226 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt8jb\" (UniqueName: \"kubernetes.io/projected/95fd6da1-f84a-4824-b407-7c26a6a5e3f7-kube-api-access-xt8jb\") pod \"cluster-samples-operator-65db858894-twlf4\" (UID: \"95fd6da1-f84a-4824-b407-7c26a6a5e3f7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-twlf4" Jul 15 13:15:24.924176 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:24.924155 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s85ht\" (UniqueName: \"kubernetes.io/projected/0eac4c8c-fc00-48e1-a420-e944097e774d-kube-api-access-s85ht\") pod \"cluster-proxy-proxy-agent-69b66cfbd-gp7c7\" (UID: \"0eac4c8c-fc00-48e1-a420-e944097e774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7" Jul 15 13:15:25.022058 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:25.022021 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7" Jul 15 13:15:25.149447 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:25.149423 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7"] Jul 15 13:15:25.151504 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:15:25.151478 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0eac4c8c_fc00_48e1_a420_e944097e774d.slice/crio-d3fb63ef2b7e9ca7578257a2a3fadd7617251e5450c3dd7ed75afbb464dd6756 WatchSource:0}: Error finding container d3fb63ef2b7e9ca7578257a2a3fadd7617251e5450c3dd7ed75afbb464dd6756: Status 404 returned error can't find the container with id d3fb63ef2b7e9ca7578257a2a3fadd7617251e5450c3dd7ed75afbb464dd6756 Jul 15 13:15:25.199541 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:25.199502 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:25.261736 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:25.261707 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:25.403722 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:25.403618 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/95fd6da1-f84a-4824-b407-7c26a6a5e3f7-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-twlf4\" (UID: \"95fd6da1-f84a-4824-b407-7c26a6a5e3f7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-twlf4" Jul 15 13:15:25.403882 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:15:25.403753 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 13:15:25.403882 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:15:25.403810 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95fd6da1-f84a-4824-b407-7c26a6a5e3f7-samples-operator-tls podName:95fd6da1-f84a-4824-b407-7c26a6a5e3f7 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:26.403795428 +0000 UTC m=+239.834604983 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/95fd6da1-f84a-4824-b407-7c26a6a5e3f7-samples-operator-tls") pod "cluster-samples-operator-65db858894-twlf4" (UID: "95fd6da1-f84a-4824-b407-7c26a6a5e3f7") : secret "samples-operator-tls" not found Jul 15 13:15:25.789864 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:25.789824 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7" event={"ID":"0eac4c8c-fc00-48e1-a420-e944097e774d","Type":"ContainerStarted","Data":"d3fb63ef2b7e9ca7578257a2a3fadd7617251e5450c3dd7ed75afbb464dd6756"} Jul 15 13:15:26.411760 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:26.411724 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/95fd6da1-f84a-4824-b407-7c26a6a5e3f7-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-twlf4\" (UID: \"95fd6da1-f84a-4824-b407-7c26a6a5e3f7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-twlf4" Jul 15 13:15:26.411948 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:15:26.411869 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 13:15:26.411948 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:15:26.411927 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95fd6da1-f84a-4824-b407-7c26a6a5e3f7-samples-operator-tls podName:95fd6da1-f84a-4824-b407-7c26a6a5e3f7 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:28.411911822 +0000 UTC m=+241.842721398 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/95fd6da1-f84a-4824-b407-7c26a6a5e3f7-samples-operator-tls") pod "cluster-samples-operator-65db858894-twlf4" (UID: "95fd6da1-f84a-4824-b407-7c26a6a5e3f7") : secret "samples-operator-tls" not found Jul 15 13:15:27.171678 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:27.171638 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:27.224477 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:27.224440 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:28.430665 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:28.430646 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/95fd6da1-f84a-4824-b407-7c26a6a5e3f7-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-twlf4\" (UID: \"95fd6da1-f84a-4824-b407-7c26a6a5e3f7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-twlf4" Jul 15 13:15:28.430909 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:15:28.430767 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 13:15:28.430909 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:15:28.430822 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95fd6da1-f84a-4824-b407-7c26a6a5e3f7-samples-operator-tls podName:95fd6da1-f84a-4824-b407-7c26a6a5e3f7 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:32.430803859 +0000 UTC m=+245.861613420 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/95fd6da1-f84a-4824-b407-7c26a6a5e3f7-samples-operator-tls") pod "cluster-samples-operator-65db858894-twlf4" (UID: "95fd6da1-f84a-4824-b407-7c26a6a5e3f7") : secret "samples-operator-tls" not found Jul 15 13:15:28.803519 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:28.803474 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7" event={"ID":"0eac4c8c-fc00-48e1-a420-e944097e774d","Type":"ContainerStarted","Data":"3a4dc3632589885ad9860da5718aa5be4aa42f12e61b905834df0cb3d694b49d"} Jul 15 13:15:28.803714 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:28.803526 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7" event={"ID":"0eac4c8c-fc00-48e1-a420-e944097e774d","Type":"ContainerStarted","Data":"581a79bdbf6113042f47f73437cefa31a2118af09e42fb66d4bdc169521ee7da"} Jul 15 13:15:28.803714 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:28.803546 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7" event={"ID":"0eac4c8c-fc00-48e1-a420-e944097e774d","Type":"ContainerStarted","Data":"ff78f25f0dcd811fba66e0ee15d739770fec1d91da6d5227c5900db642ad3c5a"} Jul 15 13:15:28.824384 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:28.824338 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7" podStartSLOduration=1.5543784619999998 podStartE2EDuration="4.8243235s" totalImagesPullingTime="3.269945038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:15:28.823118308 +0000 UTC m=+242.253927881" watchObservedRunningTime="2026-07-15 13:15:28.8243235 +0000 UTC m=+242.255133073" Jul 15 13:15:30.631331 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:30.631299 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:30.738098 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:30.738065 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:30.777344 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:30.777314 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nsptb"] Jul 15 13:15:30.781105 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:30.781083 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nsptb" Jul 15 13:15:30.788735 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:30.788710 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-k8phr\"" Jul 15 13:15:30.788837 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:30.788745 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 15 13:15:30.788837 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:30.788782 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 15 13:15:30.788837 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:30.788792 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 15 13:15:30.788837 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:30.788812 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 15 13:15:30.794275 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:30.794255 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nsptb"] Jul 15 13:15:30.822267 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:30.822232 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:30.848764 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:30.848739 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv5pv\" (UniqueName: \"kubernetes.io/projected/cff04da2-b78c-4cb1-a533-25927065561a-kube-api-access-gv5pv\") pod \"insights-runtime-extractor-nsptb\" (UID: \"cff04da2-b78c-4cb1-a533-25927065561a\") " pod="openshift-insights/insights-runtime-extractor-nsptb" Jul 15 13:15:30.848861 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:30.848771 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cff04da2-b78c-4cb1-a533-25927065561a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nsptb\" (UID: \"cff04da2-b78c-4cb1-a533-25927065561a\") " pod="openshift-insights/insights-runtime-extractor-nsptb" Jul 15 13:15:30.848861 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:30.848801 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cff04da2-b78c-4cb1-a533-25927065561a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nsptb\" (UID: \"cff04da2-b78c-4cb1-a533-25927065561a\") " pod="openshift-insights/insights-runtime-extractor-nsptb" Jul 15 13:15:30.848929 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:30.848866 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cff04da2-b78c-4cb1-a533-25927065561a-crio-socket\") pod \"insights-runtime-extractor-nsptb\" (UID: \"cff04da2-b78c-4cb1-a533-25927065561a\") " pod="openshift-insights/insights-runtime-extractor-nsptb" Jul 15 13:15:30.848929 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:30.848896 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cff04da2-b78c-4cb1-a533-25927065561a-data-volume\") pod \"insights-runtime-extractor-nsptb\" (UID: \"cff04da2-b78c-4cb1-a533-25927065561a\") " pod="openshift-insights/insights-runtime-extractor-nsptb" Jul 15 13:15:30.949536 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:30.949457 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cff04da2-b78c-4cb1-a533-25927065561a-data-volume\") pod \"insights-runtime-extractor-nsptb\" (UID: \"cff04da2-b78c-4cb1-a533-25927065561a\") " pod="openshift-insights/insights-runtime-extractor-nsptb" Jul 15 13:15:30.949536 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:30.949504 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv5pv\" (UniqueName: \"kubernetes.io/projected/cff04da2-b78c-4cb1-a533-25927065561a-kube-api-access-gv5pv\") pod \"insights-runtime-extractor-nsptb\" (UID: \"cff04da2-b78c-4cb1-a533-25927065561a\") " pod="openshift-insights/insights-runtime-extractor-nsptb" Jul 15 13:15:30.949536 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:30.949529 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cff04da2-b78c-4cb1-a533-25927065561a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nsptb\" (UID: \"cff04da2-b78c-4cb1-a533-25927065561a\") " pod="openshift-insights/insights-runtime-extractor-nsptb" Jul 15 13:15:30.949703 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:30.949553 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cff04da2-b78c-4cb1-a533-25927065561a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nsptb\" (UID: \"cff04da2-b78c-4cb1-a533-25927065561a\") " pod="openshift-insights/insights-runtime-extractor-nsptb" Jul 15 13:15:30.949703 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:30.949589 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cff04da2-b78c-4cb1-a533-25927065561a-crio-socket\") pod \"insights-runtime-extractor-nsptb\" (UID: \"cff04da2-b78c-4cb1-a533-25927065561a\") " pod="openshift-insights/insights-runtime-extractor-nsptb" Jul 15 13:15:30.949703 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:15:30.949668 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 13:15:30.949703 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:30.949689 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cff04da2-b78c-4cb1-a533-25927065561a-crio-socket\") pod \"insights-runtime-extractor-nsptb\" (UID: \"cff04da2-b78c-4cb1-a533-25927065561a\") " pod="openshift-insights/insights-runtime-extractor-nsptb" Jul 15 13:15:30.949821 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:15:30.949717 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 13:15:30.949821 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:15:30.949745 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cff04da2-b78c-4cb1-a533-25927065561a-kube-rbac-proxy-cm podName:cff04da2-b78c-4cb1-a533-25927065561a nodeName:}" failed. No retries permitted until 2026-07-15 13:15:31.449725285 +0000 UTC m=+244.880534842 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cff04da2-b78c-4cb1-a533-25927065561a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nsptb" (UID: "cff04da2-b78c-4cb1-a533-25927065561a") : configmap "kube-rbac-proxy" not found Jul 15 13:15:30.949821 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:15:30.949764 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cff04da2-b78c-4cb1-a533-25927065561a-insights-runtime-extractor-tls podName:cff04da2-b78c-4cb1-a533-25927065561a nodeName:}" failed. No retries permitted until 2026-07-15 13:15:31.449753263 +0000 UTC m=+244.880562819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cff04da2-b78c-4cb1-a533-25927065561a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nsptb" (UID: "cff04da2-b78c-4cb1-a533-25927065561a") : secret "insights-runtime-extractor-tls" not found Jul 15 13:15:30.949821 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:30.949799 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cff04da2-b78c-4cb1-a533-25927065561a-data-volume\") pod \"insights-runtime-extractor-nsptb\" (UID: \"cff04da2-b78c-4cb1-a533-25927065561a\") " pod="openshift-insights/insights-runtime-extractor-nsptb" Jul 15 13:15:30.973527 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:30.973501 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv5pv\" (UniqueName: \"kubernetes.io/projected/cff04da2-b78c-4cb1-a533-25927065561a-kube-api-access-gv5pv\") pod \"insights-runtime-extractor-nsptb\" (UID: \"cff04da2-b78c-4cb1-a533-25927065561a\") " pod="openshift-insights/insights-runtime-extractor-nsptb" Jul 15 13:15:31.112079 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:31.112046 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:31.453094 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:31.453054 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cff04da2-b78c-4cb1-a533-25927065561a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nsptb\" (UID: \"cff04da2-b78c-4cb1-a533-25927065561a\") " pod="openshift-insights/insights-runtime-extractor-nsptb" Jul 15 13:15:31.453094 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:31.453100 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cff04da2-b78c-4cb1-a533-25927065561a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nsptb\" (UID: \"cff04da2-b78c-4cb1-a533-25927065561a\") " pod="openshift-insights/insights-runtime-extractor-nsptb" Jul 15 13:15:31.453293 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:15:31.453189 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 13:15:31.453293 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:15:31.453227 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 13:15:31.453293 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:15:31.453265 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cff04da2-b78c-4cb1-a533-25927065561a-kube-rbac-proxy-cm podName:cff04da2-b78c-4cb1-a533-25927065561a nodeName:}" failed. No retries permitted until 2026-07-15 13:15:32.453248944 +0000 UTC m=+245.884058496 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cff04da2-b78c-4cb1-a533-25927065561a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nsptb" (UID: "cff04da2-b78c-4cb1-a533-25927065561a") : configmap "kube-rbac-proxy" not found Jul 15 13:15:31.453293 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:15:31.453281 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cff04da2-b78c-4cb1-a533-25927065561a-insights-runtime-extractor-tls podName:cff04da2-b78c-4cb1-a533-25927065561a nodeName:}" failed. No retries permitted until 2026-07-15 13:15:32.453274557 +0000 UTC m=+245.884084108 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cff04da2-b78c-4cb1-a533-25927065561a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nsptb" (UID: "cff04da2-b78c-4cb1-a533-25927065561a") : secret "insights-runtime-extractor-tls" not found Jul 15 13:15:32.461921 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:32.461880 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cff04da2-b78c-4cb1-a533-25927065561a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nsptb\" (UID: \"cff04da2-b78c-4cb1-a533-25927065561a\") " pod="openshift-insights/insights-runtime-extractor-nsptb" Jul 15 13:15:32.462324 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:32.461935 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/95fd6da1-f84a-4824-b407-7c26a6a5e3f7-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-twlf4\" (UID: \"95fd6da1-f84a-4824-b407-7c26a6a5e3f7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-twlf4" Jul 15 13:15:32.462324 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:32.461999 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cff04da2-b78c-4cb1-a533-25927065561a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nsptb\" (UID: \"cff04da2-b78c-4cb1-a533-25927065561a\") " pod="openshift-insights/insights-runtime-extractor-nsptb" Jul 15 13:15:32.462324 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:15:32.462051 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 13:15:32.462324 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:15:32.462066 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 13:15:32.462324 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:15:32.462090 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 13:15:32.462324 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:15:32.462123 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cff04da2-b78c-4cb1-a533-25927065561a-insights-runtime-extractor-tls podName:cff04da2-b78c-4cb1-a533-25927065561a nodeName:}" failed. No retries permitted until 2026-07-15 13:15:34.462103623 +0000 UTC m=+247.892913174 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cff04da2-b78c-4cb1-a533-25927065561a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nsptb" (UID: "cff04da2-b78c-4cb1-a533-25927065561a") : secret "insights-runtime-extractor-tls" not found Jul 15 13:15:32.462324 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:15:32.462141 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95fd6da1-f84a-4824-b407-7c26a6a5e3f7-samples-operator-tls podName:95fd6da1-f84a-4824-b407-7c26a6a5e3f7 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:40.462133203 +0000 UTC m=+253.892942755 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/95fd6da1-f84a-4824-b407-7c26a6a5e3f7-samples-operator-tls") pod "cluster-samples-operator-65db858894-twlf4" (UID: "95fd6da1-f84a-4824-b407-7c26a6a5e3f7") : secret "samples-operator-tls" not found Jul 15 13:15:32.462324 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:15:32.462155 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cff04da2-b78c-4cb1-a533-25927065561a-kube-rbac-proxy-cm podName:cff04da2-b78c-4cb1-a533-25927065561a nodeName:}" failed. No retries permitted until 2026-07-15 13:15:34.462147212 +0000 UTC m=+247.892956769 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cff04da2-b78c-4cb1-a533-25927065561a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nsptb" (UID: "cff04da2-b78c-4cb1-a533-25927065561a") : configmap "kube-rbac-proxy" not found Jul 15 13:15:32.585172 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:32.585135 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:32.685227 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:32.685192 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:32.736131 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:32.736111 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5qwqm_871fcafa-ef85-4040-bd74-5756c6ff4c0a/dns-node-resolver/0.log" Jul 15 13:15:33.735816 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:33.735788 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j4ktm_d60f6645-bdeb-4b1f-9580-44b9ee9d0baf/node-ca/0.log" Jul 15 13:15:33.854463 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:33.854430 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:33.957955 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:33.957919 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:34.063929 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:34.063829 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:34.341154 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:34.341077 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6bd2c_369753f1-3b74-4d68-9d71-8805808340f0/serve-healthcheck-canary/0.log" Jul 15 13:15:34.479878 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:34.479845 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cff04da2-b78c-4cb1-a533-25927065561a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nsptb\" (UID: \"cff04da2-b78c-4cb1-a533-25927065561a\") " pod="openshift-insights/insights-runtime-extractor-nsptb" Jul 15 13:15:34.480010 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:34.479933 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cff04da2-b78c-4cb1-a533-25927065561a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nsptb\" (UID: \"cff04da2-b78c-4cb1-a533-25927065561a\") " pod="openshift-insights/insights-runtime-extractor-nsptb" Jul 15 13:15:34.480055 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:15:34.480019 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 13:15:34.480089 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:15:34.480068 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cff04da2-b78c-4cb1-a533-25927065561a-kube-rbac-proxy-cm podName:cff04da2-b78c-4cb1-a533-25927065561a nodeName:}" failed. No retries permitted until 2026-07-15 13:15:38.480054274 +0000 UTC m=+251.910863826 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cff04da2-b78c-4cb1-a533-25927065561a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nsptb" (UID: "cff04da2-b78c-4cb1-a533-25927065561a") : configmap "kube-rbac-proxy" not found Jul 15 13:15:34.480146 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:15:34.480019 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 13:15:34.480179 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:15:34.480160 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cff04da2-b78c-4cb1-a533-25927065561a-insights-runtime-extractor-tls podName:cff04da2-b78c-4cb1-a533-25927065561a nodeName:}" failed. No retries permitted until 2026-07-15 13:15:38.4801463 +0000 UTC m=+251.910955855 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cff04da2-b78c-4cb1-a533-25927065561a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nsptb" (UID: "cff04da2-b78c-4cb1-a533-25927065561a") : secret "insights-runtime-extractor-tls" not found Jul 15 13:15:36.743904 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:36.743867 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:36.848286 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:36.848258 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:36.947517 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:36.947488 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:37.063096 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:37.063021 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:38.507655 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:38.507621 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cff04da2-b78c-4cb1-a533-25927065561a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nsptb\" (UID: \"cff04da2-b78c-4cb1-a533-25927065561a\") " pod="openshift-insights/insights-runtime-extractor-nsptb" Jul 15 13:15:38.507655 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:38.507660 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cff04da2-b78c-4cb1-a533-25927065561a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nsptb\" (UID: \"cff04da2-b78c-4cb1-a533-25927065561a\") " pod="openshift-insights/insights-runtime-extractor-nsptb" Jul 15 13:15:38.508103 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:15:38.507743 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 13:15:38.508103 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:15:38.507775 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 13:15:38.508103 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:15:38.507814 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cff04da2-b78c-4cb1-a533-25927065561a-kube-rbac-proxy-cm podName:cff04da2-b78c-4cb1-a533-25927065561a nodeName:}" failed. No retries permitted until 2026-07-15 13:15:46.507797634 +0000 UTC m=+259.938607186 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cff04da2-b78c-4cb1-a533-25927065561a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nsptb" (UID: "cff04da2-b78c-4cb1-a533-25927065561a") : configmap "kube-rbac-proxy" not found Jul 15 13:15:38.508103 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:15:38.507829 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cff04da2-b78c-4cb1-a533-25927065561a-insights-runtime-extractor-tls podName:cff04da2-b78c-4cb1-a533-25927065561a nodeName:}" failed. No retries permitted until 2026-07-15 13:15:46.507822672 +0000 UTC m=+259.938632223 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cff04da2-b78c-4cb1-a533-25927065561a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nsptb" (UID: "cff04da2-b78c-4cb1-a533-25927065561a") : secret "insights-runtime-extractor-tls" not found Jul 15 13:15:38.726654 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:38.726615 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:38.910565 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:38.910489 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfca5b3-c487-470b-b5b1-965339049b4c-metrics-certs\") pod \"network-metrics-daemon-xmbdp\" (UID: \"7cfca5b3-c487-470b-b5b1-965339049b4c\") " pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:15:38.910691 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:15:38.910627 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 15 13:15:38.910691 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:15:38.910685 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cfca5b3-c487-470b-b5b1-965339049b4c-metrics-certs podName:7cfca5b3-c487-470b-b5b1-965339049b4c nodeName:}" failed. No retries permitted until 2026-07-15 13:17:40.910669757 +0000 UTC m=+374.341479309 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7cfca5b3-c487-470b-b5b1-965339049b4c-metrics-certs") pod "network-metrics-daemon-xmbdp" (UID: "7cfca5b3-c487-470b-b5b1-965339049b4c") : secret "metrics-daemon-secret" not found Jul 15 13:15:40.448178 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:40.448147 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:40.516464 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:40.516435 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:40.523566 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:40.523532 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/95fd6da1-f84a-4824-b407-7c26a6a5e3f7-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-twlf4\" (UID: \"95fd6da1-f84a-4824-b407-7c26a6a5e3f7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-twlf4" Jul 15 13:15:40.525811 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:40.525781 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/95fd6da1-f84a-4824-b407-7c26a6a5e3f7-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-twlf4\" (UID: \"95fd6da1-f84a-4824-b407-7c26a6a5e3f7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-twlf4" Jul 15 13:15:40.604622 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:40.604591 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mxbt9\"" Jul 15 13:15:40.612952 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:40.612930 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-twlf4" Jul 15 13:15:40.652271 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:40.652233 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:40.743067 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:40.743039 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-twlf4"] Jul 15 13:15:40.748109 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:40.748082 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:40.836598 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:40.836561 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:40.839224 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:40.839198 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-twlf4" event={"ID":"95fd6da1-f84a-4824-b407-7c26a6a5e3f7","Type":"ContainerStarted","Data":"fe26246688b89b88058b85717e0aeba00154a9d3c4ca25570407da3f01a7d610"} Jul 15 13:15:41.237719 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:41.237684 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:41.441130 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:41.441099 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:41.635278 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:41.635202 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:41.840918 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:41.840874 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:42.894640 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:42.894588 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:43.054352 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:43.054313 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:43.153438 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:43.153344 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:43.253552 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:43.253524 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:43.436959 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:43.436864 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:43.646591 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:43.646554 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:43.834128 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:43.834101 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:43.849150 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:43.849121 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-twlf4" event={"ID":"95fd6da1-f84a-4824-b407-7c26a6a5e3f7","Type":"ContainerStarted","Data":"2d954c57d76461bac690d99985637b31040ba63b3cfdf79a2741c9769c668085"} Jul 15 13:15:44.038466 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:44.038389 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:44.830297 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:44.830266 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:44.853942 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:44.853911 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-twlf4" event={"ID":"95fd6da1-f84a-4824-b407-7c26a6a5e3f7","Type":"ContainerStarted","Data":"10c2f9a321fcec33b34325d27b171c19b28b6b61c7f0e39514b3ad771e02f27a"} Jul 15 13:15:44.875166 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:44.875120 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-twlf4" podStartSLOduration=17.928833669 podStartE2EDuration="20.87510601s" totalImagesPullingTime="2.946272341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:15:44.874328862 +0000 UTC m=+258.305138435" watchObservedRunningTime="2026-07-15 13:15:44.87510601 +0000 UTC m=+258.305915583" Jul 15 13:15:45.233691 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:45.233661 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:45.445044 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:45.445013 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:45.556246 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:45.556167 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:45.661477 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:45.661442 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:46.571795 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:46.571761 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cff04da2-b78c-4cb1-a533-25927065561a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nsptb\" (UID: \"cff04da2-b78c-4cb1-a533-25927065561a\") " pod="openshift-insights/insights-runtime-extractor-nsptb" Jul 15 13:15:46.571795 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:46.571802 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cff04da2-b78c-4cb1-a533-25927065561a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nsptb\" (UID: \"cff04da2-b78c-4cb1-a533-25927065561a\") " pod="openshift-insights/insights-runtime-extractor-nsptb" Jul 15 13:15:46.572349 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:46.572330 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cff04da2-b78c-4cb1-a533-25927065561a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nsptb\" (UID: \"cff04da2-b78c-4cb1-a533-25927065561a\") " pod="openshift-insights/insights-runtime-extractor-nsptb" Jul 15 13:15:46.574086 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:46.574061 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cff04da2-b78c-4cb1-a533-25927065561a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nsptb\" (UID: \"cff04da2-b78c-4cb1-a533-25927065561a\") " pod="openshift-insights/insights-runtime-extractor-nsptb" Jul 15 13:15:46.689516 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:46.689477 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nsptb" Jul 15 13:15:46.816381 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:46.816349 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nsptb"] Jul 15 13:15:46.820109 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:15:46.820086 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcff04da2_b78c_4cb1_a533_25927065561a.slice/crio-540641e269a36938bac0cb5217ee170a9ad35d88dae056dc4be9a5df0ca081ec WatchSource:0}: Error finding container 540641e269a36938bac0cb5217ee170a9ad35d88dae056dc4be9a5df0ca081ec: Status 404 returned error can't find the container with id 540641e269a36938bac0cb5217ee170a9ad35d88dae056dc4be9a5df0ca081ec Jul 15 13:15:46.860816 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:46.860779 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nsptb" event={"ID":"cff04da2-b78c-4cb1-a533-25927065561a","Type":"ContainerStarted","Data":"540641e269a36938bac0cb5217ee170a9ad35d88dae056dc4be9a5df0ca081ec"} Jul 15 13:15:47.291063 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:47.291026 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:47.396026 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:47.395992 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:47.497545 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:47.497514 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:52.880478 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:52.880443 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nsptb" event={"ID":"cff04da2-b78c-4cb1-a533-25927065561a","Type":"ContainerStarted","Data":"99e20fb4dc1c9200ea2223dd0be19f921caaa19d2c05a4503b73c82f3f703f18"} Jul 15 13:15:54.424803 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:54.424420 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:54.528144 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:54.528102 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:54.627238 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:54.627204 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:54.727289 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:54.727263 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:54.965675 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:54.965631 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-945tm"] Jul 15 13:15:54.978231 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:54.978130 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-945tm" Jul 15 13:15:54.981201 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:54.981171 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 15 13:15:54.981367 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:54.981224 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 15 13:15:54.981367 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:54.981342 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-5z6nl\"" Jul 15 13:15:54.986908 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:54.986638 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-945tm"] Jul 15 13:15:55.024365 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:55.024334 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:55.127325 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:55.127286 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:55.141222 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:55.141191 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bztx\" (UniqueName: \"kubernetes.io/projected/dbe3a9c0-b369-4faf-8629-062dd853c5d8-kube-api-access-7bztx\") pod \"downloads-68c9cbb497-945tm\" (UID: \"dbe3a9c0-b369-4faf-8629-062dd853c5d8\") " pod="openshift-console/downloads-68c9cbb497-945tm" Jul 15 13:15:55.221932 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:55.221889 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:55.242404 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:55.242324 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bztx\" (UniqueName: \"kubernetes.io/projected/dbe3a9c0-b369-4faf-8629-062dd853c5d8-kube-api-access-7bztx\") pod \"downloads-68c9cbb497-945tm\" (UID: \"dbe3a9c0-b369-4faf-8629-062dd853c5d8\") " pod="openshift-console/downloads-68c9cbb497-945tm" Jul 15 13:15:55.252919 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:55.252888 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bztx\" (UniqueName: \"kubernetes.io/projected/dbe3a9c0-b369-4faf-8629-062dd853c5d8-kube-api-access-7bztx\") pod \"downloads-68c9cbb497-945tm\" (UID: \"dbe3a9c0-b369-4faf-8629-062dd853c5d8\") " pod="openshift-console/downloads-68c9cbb497-945tm" Jul 15 13:15:55.290509 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:55.290476 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-945tm" Jul 15 13:15:55.328168 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:55.328133 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:55.422049 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:55.422013 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:55.528259 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:55.528176 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:55.597046 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:55.597011 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:55.923347 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:55.923243 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:56.168005 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:56.167949 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:56.261026 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:56.260995 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:56.373483 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:56.373423 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:15:56.417389 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:56.417362 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-945tm"] Jul 15 13:15:56.420793 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:15:56.420770 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbe3a9c0_b369_4faf_8629_062dd853c5d8.slice/crio-6d212978b8940bba7814c741e8fb6c6825a9a7c546ba25b96fef7250186cc4ac WatchSource:0}: Error finding container 6d212978b8940bba7814c741e8fb6c6825a9a7c546ba25b96fef7250186cc4ac: Status 404 returned error can't find the container with id 6d212978b8940bba7814c741e8fb6c6825a9a7c546ba25b96fef7250186cc4ac Jul 15 13:15:56.894310 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:56.894275 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nsptb" event={"ID":"cff04da2-b78c-4cb1-a533-25927065561a","Type":"ContainerStarted","Data":"3835ffd9d4f128a53c30bb3261c7f3b5c20bb686362f1e0416cf3a838013916c"} Jul 15 13:15:56.895328 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:56.895307 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-945tm" event={"ID":"dbe3a9c0-b369-4faf-8629-062dd853c5d8","Type":"ContainerStarted","Data":"6d212978b8940bba7814c741e8fb6c6825a9a7c546ba25b96fef7250186cc4ac"} Jul 15 13:15:57.326084 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:15:57.326054 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:00.910126 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:00.910097 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nsptb" event={"ID":"cff04da2-b78c-4cb1-a533-25927065561a","Type":"ContainerStarted","Data":"249eda41384d934e9b967ccaf512d53eb4d97fd9ed99a0378229aa455e28de97"} Jul 15 13:16:00.929995 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:00.929936 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nsptb" podStartSLOduration=17.819017217 podStartE2EDuration="30.929920456s" totalImagesPullingTime="13.110903239s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:15:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:16:00.929082869 +0000 UTC m=+274.359892460" watchObservedRunningTime="2026-07-15 13:16:00.929920456 +0000 UTC m=+274.360730052" Jul 15 13:16:01.758890 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:01.758841 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:01.929869 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:01.929826 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:01.951920 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:01.951885 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hl9ds"] Jul 15 13:16:01.954773 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:01.954751 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hl9ds" Jul 15 13:16:01.957492 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:01.957471 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 15 13:16:01.957913 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:01.957896 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-97zlf\"" Jul 15 13:16:01.967533 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:01.967510 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hl9ds"] Jul 15 13:16:01.993683 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:01.993645 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a478f11b-c1e5-4b03-b02a-b02a0b266f4a-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-hl9ds\" (UID: \"a478f11b-c1e5-4b03-b02a-b02a0b266f4a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hl9ds" Jul 15 13:16:02.094607 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:02.094516 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a478f11b-c1e5-4b03-b02a-b02a0b266f4a-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-hl9ds\" (UID: \"a478f11b-c1e5-4b03-b02a-b02a0b266f4a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hl9ds" Jul 15 13:16:02.097365 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:02.097336 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a478f11b-c1e5-4b03-b02a-b02a0b266f4a-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-hl9ds\" (UID: \"a478f11b-c1e5-4b03-b02a-b02a0b266f4a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hl9ds" Jul 15 13:16:02.121648 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:02.121617 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:02.265147 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:02.265112 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hl9ds" Jul 15 13:16:02.343782 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:02.343752 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:02.401423 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:02.401390 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hl9ds"] Jul 15 13:16:02.404582 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:16:02.404549 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda478f11b_c1e5_4b03_b02a_b02a0b266f4a.slice/crio-fc5ceb04f81165b4eff115aafcb9ed6cd19f283d8c839f845903453855b8d06e WatchSource:0}: Error finding container fc5ceb04f81165b4eff115aafcb9ed6cd19f283d8c839f845903453855b8d06e: Status 404 returned error can't find the container with id fc5ceb04f81165b4eff115aafcb9ed6cd19f283d8c839f845903453855b8d06e Jul 15 13:16:02.406351 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:02.406295 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:02.917082 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:02.917045 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hl9ds" event={"ID":"a478f11b-c1e5-4b03-b02a-b02a0b266f4a","Type":"ContainerStarted","Data":"fc5ceb04f81165b4eff115aafcb9ed6cd19f283d8c839f845903453855b8d06e"} Jul 15 13:16:02.924497 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:02.924465 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:03.025818 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:03.025761 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:03.922155 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:03.922053 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hl9ds" event={"ID":"a478f11b-c1e5-4b03-b02a-b02a0b266f4a","Type":"ContainerStarted","Data":"88853a0904246913206036fa18ddd6d563cd1fe626e3718fdc4349f1c53a36c2"} Jul 15 13:16:03.922324 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:03.922216 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hl9ds" Jul 15 13:16:03.927474 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:03.927450 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hl9ds" Jul 15 13:16:03.942210 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:03.942027 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hl9ds" podStartSLOduration=1.7478133329999999 podStartE2EDuration="2.942008295s" totalImagesPullingTime="1.194194962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:16:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:16:03.941850567 +0000 UTC m=+277.372660142" watchObservedRunningTime="2026-07-15 13:16:03.942008295 +0000 UTC m=+277.372817847" Jul 15 13:16:04.341819 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:04.341784 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cdb477b5b-mwpxz"] Jul 15 13:16:04.345031 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:04.345010 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cdb477b5b-mwpxz" Jul 15 13:16:04.347459 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:16:04.347428 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"console-serving-cert\" is forbidden: User \"system:node:ip-10-0-132-114.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-132-114.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"console-serving-cert\"" type="*v1.Secret" Jul 15 13:16:04.348210 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:16:04.348182 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"console-cdb477b5b-mwpxz\" is forbidden: User \"system:node:ip-10-0-132-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-132-114.ec2.internal' and this object" podUID="dd1ff280-e5e4-4ed0-8895-f5b998f59185" pod="openshift-console/console-cdb477b5b-mwpxz" Jul 15 13:16:04.348210 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:16:04.348190 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"console-dockercfg-dhdpv\" is forbidden: User \"system:node:ip-10-0-132-114.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-132-114.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"console-dockercfg-dhdpv\"" type="*v1.Secret" Jul 15 13:16:04.348358 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:16:04.348213 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"service-ca\" is forbidden: User \"system:node:ip-10-0-132-114.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-132-114.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"service-ca\"" type="*v1.ConfigMap" Jul 15 13:16:04.348447 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:16:04.348414 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"console-config\" is forbidden: User \"system:node:ip-10-0-132-114.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-132-114.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"console-config\"" type="*v1.ConfigMap" Jul 15 13:16:04.348447 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:16:04.348416 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"oauth-serving-cert\" is forbidden: User \"system:node:ip-10-0-132-114.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-132-114.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" type="*v1.ConfigMap" Jul 15 13:16:04.348852 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:16:04.348826 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"console-oauth-config\" is forbidden: User \"system:node:ip-10-0-132-114.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-132-114.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"console-oauth-config\"" type="*v1.Secret" Jul 15 13:16:04.367339 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:04.367308 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cdb477b5b-mwpxz"] Jul 15 13:16:04.412170 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:04.412130 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd1ff280-e5e4-4ed0-8895-f5b998f59185-console-serving-cert\") pod \"console-cdb477b5b-mwpxz\" (UID: \"dd1ff280-e5e4-4ed0-8895-f5b998f59185\") " pod="openshift-console/console-cdb477b5b-mwpxz" Jul 15 13:16:04.412318 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:04.412182 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd1ff280-e5e4-4ed0-8895-f5b998f59185-console-config\") pod \"console-cdb477b5b-mwpxz\" (UID: \"dd1ff280-e5e4-4ed0-8895-f5b998f59185\") " pod="openshift-console/console-cdb477b5b-mwpxz" Jul 15 13:16:04.412318 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:04.412201 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6dbg\" (UniqueName: \"kubernetes.io/projected/dd1ff280-e5e4-4ed0-8895-f5b998f59185-kube-api-access-d6dbg\") pod \"console-cdb477b5b-mwpxz\" (UID: \"dd1ff280-e5e4-4ed0-8895-f5b998f59185\") " pod="openshift-console/console-cdb477b5b-mwpxz" Jul 15 13:16:04.412318 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:04.412241 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd1ff280-e5e4-4ed0-8895-f5b998f59185-service-ca\") pod \"console-cdb477b5b-mwpxz\" (UID: \"dd1ff280-e5e4-4ed0-8895-f5b998f59185\") " pod="openshift-console/console-cdb477b5b-mwpxz" Jul 15 13:16:04.412318 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:04.412297 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd1ff280-e5e4-4ed0-8895-f5b998f59185-console-oauth-config\") pod \"console-cdb477b5b-mwpxz\" (UID: \"dd1ff280-e5e4-4ed0-8895-f5b998f59185\") " pod="openshift-console/console-cdb477b5b-mwpxz" Jul 15 13:16:04.412461 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:04.412344 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd1ff280-e5e4-4ed0-8895-f5b998f59185-oauth-serving-cert\") pod \"console-cdb477b5b-mwpxz\" (UID: \"dd1ff280-e5e4-4ed0-8895-f5b998f59185\") " pod="openshift-console/console-cdb477b5b-mwpxz" Jul 15 13:16:04.512737 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:04.512704 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd1ff280-e5e4-4ed0-8895-f5b998f59185-console-serving-cert\") pod \"console-cdb477b5b-mwpxz\" (UID: \"dd1ff280-e5e4-4ed0-8895-f5b998f59185\") " pod="openshift-console/console-cdb477b5b-mwpxz" Jul 15 13:16:04.512906 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:04.512766 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd1ff280-e5e4-4ed0-8895-f5b998f59185-console-config\") pod \"console-cdb477b5b-mwpxz\" (UID: \"dd1ff280-e5e4-4ed0-8895-f5b998f59185\") " pod="openshift-console/console-cdb477b5b-mwpxz" Jul 15 13:16:04.512906 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:04.512791 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6dbg\" (UniqueName: \"kubernetes.io/projected/dd1ff280-e5e4-4ed0-8895-f5b998f59185-kube-api-access-d6dbg\") pod \"console-cdb477b5b-mwpxz\" (UID: \"dd1ff280-e5e4-4ed0-8895-f5b998f59185\") " pod="openshift-console/console-cdb477b5b-mwpxz" Jul 15 13:16:04.512906 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:04.512813 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd1ff280-e5e4-4ed0-8895-f5b998f59185-service-ca\") pod \"console-cdb477b5b-mwpxz\" (UID: \"dd1ff280-e5e4-4ed0-8895-f5b998f59185\") " pod="openshift-console/console-cdb477b5b-mwpxz" Jul 15 13:16:04.512906 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:04.512859 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd1ff280-e5e4-4ed0-8895-f5b998f59185-console-oauth-config\") pod \"console-cdb477b5b-mwpxz\" (UID: \"dd1ff280-e5e4-4ed0-8895-f5b998f59185\") " pod="openshift-console/console-cdb477b5b-mwpxz" Jul 15 13:16:04.512906 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:04.512889 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd1ff280-e5e4-4ed0-8895-f5b998f59185-oauth-serving-cert\") pod \"console-cdb477b5b-mwpxz\" (UID: \"dd1ff280-e5e4-4ed0-8895-f5b998f59185\") " pod="openshift-console/console-cdb477b5b-mwpxz" Jul 15 13:16:04.522876 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:04.522842 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6dbg\" (UniqueName: \"kubernetes.io/projected/dd1ff280-e5e4-4ed0-8895-f5b998f59185-kube-api-access-d6dbg\") pod \"console-cdb477b5b-mwpxz\" (UID: \"dd1ff280-e5e4-4ed0-8895-f5b998f59185\") " pod="openshift-console/console-cdb477b5b-mwpxz" Jul 15 13:16:04.984754 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:04.984721 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:05.063393 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:05.063365 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:05.214737 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:05.214703 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 15 13:16:05.221158 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:05.221131 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 15 13:16:05.223846 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:05.223825 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd1ff280-e5e4-4ed0-8895-f5b998f59185-service-ca\") pod \"console-cdb477b5b-mwpxz\" (UID: \"dd1ff280-e5e4-4ed0-8895-f5b998f59185\") " pod="openshift-console/console-cdb477b5b-mwpxz" Jul 15 13:16:05.225735 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:05.225703 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd1ff280-e5e4-4ed0-8895-f5b998f59185-console-oauth-config\") pod \"console-cdb477b5b-mwpxz\" (UID: \"dd1ff280-e5e4-4ed0-8895-f5b998f59185\") " pod="openshift-console/console-cdb477b5b-mwpxz" Jul 15 13:16:05.240085 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:05.239920 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 15 13:16:05.245576 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:05.245550 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd1ff280-e5e4-4ed0-8895-f5b998f59185-console-serving-cert\") pod \"console-cdb477b5b-mwpxz\" (UID: \"dd1ff280-e5e4-4ed0-8895-f5b998f59185\") " pod="openshift-console/console-cdb477b5b-mwpxz" Jul 15 13:16:05.513145 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:16:05.513054 2554 configmap.go:193] Couldn't get configMap openshift-console/oauth-serving-cert: failed to sync configmap cache: timed out waiting for the condition Jul 15 13:16:05.513145 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:16:05.513134 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd1ff280-e5e4-4ed0-8895-f5b998f59185-oauth-serving-cert podName:dd1ff280-e5e4-4ed0-8895-f5b998f59185 nodeName:}" failed. No retries permitted until 2026-07-15 13:16:06.013117827 +0000 UTC m=+279.443927383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "oauth-serving-cert" (UniqueName: "kubernetes.io/configmap/dd1ff280-e5e4-4ed0-8895-f5b998f59185-oauth-serving-cert") pod "console-cdb477b5b-mwpxz" (UID: "dd1ff280-e5e4-4ed0-8895-f5b998f59185") : failed to sync configmap cache: timed out waiting for the condition Jul 15 13:16:05.513667 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:16:05.513069 2554 configmap.go:193] Couldn't get configMap openshift-console/console-config: failed to sync configmap cache: timed out waiting for the condition Jul 15 13:16:05.513667 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:16:05.513231 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd1ff280-e5e4-4ed0-8895-f5b998f59185-console-config podName:dd1ff280-e5e4-4ed0-8895-f5b998f59185 nodeName:}" failed. No retries permitted until 2026-07-15 13:16:06.013211622 +0000 UTC m=+279.444021195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "console-config" (UniqueName: "kubernetes.io/configmap/dd1ff280-e5e4-4ed0-8895-f5b998f59185-console-config") pod "console-cdb477b5b-mwpxz" (UID: "dd1ff280-e5e4-4ed0-8895-f5b998f59185") : failed to sync configmap cache: timed out waiting for the condition Jul 15 13:16:05.569569 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:05.569535 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:05.582671 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:05.582646 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 15 13:16:05.694462 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:05.694423 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dhdpv\"" Jul 15 13:16:05.876874 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:05.876797 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 15 13:16:06.026762 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:06.026728 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd1ff280-e5e4-4ed0-8895-f5b998f59185-oauth-serving-cert\") pod \"console-cdb477b5b-mwpxz\" (UID: \"dd1ff280-e5e4-4ed0-8895-f5b998f59185\") " pod="openshift-console/console-cdb477b5b-mwpxz" Jul 15 13:16:06.026955 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:06.026800 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd1ff280-e5e4-4ed0-8895-f5b998f59185-console-config\") pod \"console-cdb477b5b-mwpxz\" (UID: \"dd1ff280-e5e4-4ed0-8895-f5b998f59185\") " pod="openshift-console/console-cdb477b5b-mwpxz" Jul 15 13:16:06.027378 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:06.027359 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd1ff280-e5e4-4ed0-8895-f5b998f59185-oauth-serving-cert\") pod \"console-cdb477b5b-mwpxz\" (UID: \"dd1ff280-e5e4-4ed0-8895-f5b998f59185\") " pod="openshift-console/console-cdb477b5b-mwpxz" Jul 15 13:16:06.027433 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:06.027385 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd1ff280-e5e4-4ed0-8895-f5b998f59185-console-config\") pod \"console-cdb477b5b-mwpxz\" (UID: \"dd1ff280-e5e4-4ed0-8895-f5b998f59185\") " pod="openshift-console/console-cdb477b5b-mwpxz" Jul 15 13:16:06.155132 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:06.155036 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cdb477b5b-mwpxz" Jul 15 13:16:06.290844 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:06.290800 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cdb477b5b-mwpxz"] Jul 15 13:16:06.292534 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:16:06.292495 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd1ff280_e5e4_4ed0_8895_f5b998f59185.slice/crio-d603e5e5b071244bce2df7a89d5976149ae5195e4568bcda82882002c39d4da6 WatchSource:0}: Error finding container d603e5e5b071244bce2df7a89d5976149ae5195e4568bcda82882002c39d4da6: Status 404 returned error can't find the container with id d603e5e5b071244bce2df7a89d5976149ae5195e4568bcda82882002c39d4da6 Jul 15 13:16:06.938338 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:06.938299 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cdb477b5b-mwpxz" event={"ID":"dd1ff280-e5e4-4ed0-8895-f5b998f59185","Type":"ContainerStarted","Data":"d603e5e5b071244bce2df7a89d5976149ae5195e4568bcda82882002c39d4da6"} Jul 15 13:16:07.469205 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:07.469165 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:07.600283 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:16:07.600235 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-f8z4j" podUID="d396aec3-e269-4e9e-8908-ef9b3712ac76" Jul 15 13:16:07.941494 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:07.941467 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f8z4j" Jul 15 13:16:09.949797 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:09.949758 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cdb477b5b-mwpxz" event={"ID":"dd1ff280-e5e4-4ed0-8895-f5b998f59185","Type":"ContainerStarted","Data":"e3fd4dc66965a3d967a0297b29f347cf5a5a0c5db65f44d9a9f52d97df8c682c"} Jul 15 13:16:09.971816 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:09.970443 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cdb477b5b-mwpxz" podStartSLOduration=2.973239707 podStartE2EDuration="5.970421784s" totalImagesPullingTime="2.997182077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:16:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:16:09.969245379 +0000 UTC m=+283.400054956" watchObservedRunningTime="2026-07-15 13:16:09.970421784 +0000 UTC m=+283.401231393" Jul 15 13:16:10.145476 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.145446 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:10.378885 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.378842 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:10.500528 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.500494 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-drnjr"] Jul 15 13:16:10.506693 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.506656 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-drnjr" Jul 15 13:16:10.509667 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.509603 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-ddtjz\"" Jul 15 13:16:10.510916 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.510765 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 15 13:16:10.510916 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.510791 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 15 13:16:10.510916 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.510768 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 15 13:16:10.510916 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.510829 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 15 13:16:10.511700 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.511683 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 15 13:16:10.517630 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.517609 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-drnjr"] Jul 15 13:16:10.564026 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.563992 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-29jdr"] Jul 15 13:16:10.564910 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.564877 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s426\" (UniqueName: \"kubernetes.io/projected/cf8d5cfd-89ac-4c66-a9cc-d11c50406c27-kube-api-access-6s426\") pod \"openshift-state-metrics-84bd68b896-drnjr\" (UID: \"cf8d5cfd-89ac-4c66-a9cc-d11c50406c27\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-drnjr" Jul 15 13:16:10.565081 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.564928 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf8d5cfd-89ac-4c66-a9cc-d11c50406c27-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-drnjr\" (UID: \"cf8d5cfd-89ac-4c66-a9cc-d11c50406c27\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-drnjr" Jul 15 13:16:10.565081 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.565008 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf8d5cfd-89ac-4c66-a9cc-d11c50406c27-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-drnjr\" (UID: \"cf8d5cfd-89ac-4c66-a9cc-d11c50406c27\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-drnjr" Jul 15 13:16:10.565081 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.565051 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf8d5cfd-89ac-4c66-a9cc-d11c50406c27-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-drnjr\" (UID: \"cf8d5cfd-89ac-4c66-a9cc-d11c50406c27\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-drnjr" Jul 15 13:16:10.567472 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.567455 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-29jdr" Jul 15 13:16:10.570836 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.570808 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 15 13:16:10.571643 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.571586 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cqkv2\"" Jul 15 13:16:10.571643 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.571624 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 15 13:16:10.571918 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.571894 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 15 13:16:10.665696 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.665604 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ddfd6211-3fee-4119-b77c-fa00d373f4a7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-29jdr\" (UID: \"ddfd6211-3fee-4119-b77c-fa00d373f4a7\") " pod="openshift-monitoring/node-exporter-29jdr" Jul 15 13:16:10.665696 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.665647 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ddfd6211-3fee-4119-b77c-fa00d373f4a7-node-exporter-textfile\") pod \"node-exporter-29jdr\" (UID: \"ddfd6211-3fee-4119-b77c-fa00d373f4a7\") " pod="openshift-monitoring/node-exporter-29jdr" Jul 15 13:16:10.665696 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.665693 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ddfd6211-3fee-4119-b77c-fa00d373f4a7-node-exporter-wtmp\") pod \"node-exporter-29jdr\" (UID: \"ddfd6211-3fee-4119-b77c-fa00d373f4a7\") " pod="openshift-monitoring/node-exporter-29jdr" Jul 15 13:16:10.665968 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.665732 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddfd6211-3fee-4119-b77c-fa00d373f4a7-metrics-client-ca\") pod \"node-exporter-29jdr\" (UID: \"ddfd6211-3fee-4119-b77c-fa00d373f4a7\") " pod="openshift-monitoring/node-exporter-29jdr" Jul 15 13:16:10.665968 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.665821 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ddfd6211-3fee-4119-b77c-fa00d373f4a7-root\") pod \"node-exporter-29jdr\" (UID: \"ddfd6211-3fee-4119-b77c-fa00d373f4a7\") " pod="openshift-monitoring/node-exporter-29jdr" Jul 15 13:16:10.665968 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.665869 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s426\" (UniqueName: \"kubernetes.io/projected/cf8d5cfd-89ac-4c66-a9cc-d11c50406c27-kube-api-access-6s426\") pod \"openshift-state-metrics-84bd68b896-drnjr\" (UID: \"cf8d5cfd-89ac-4c66-a9cc-d11c50406c27\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-drnjr" Jul 15 13:16:10.665968 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.665927 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rv5d\" (UniqueName: \"kubernetes.io/projected/ddfd6211-3fee-4119-b77c-fa00d373f4a7-kube-api-access-6rv5d\") pod \"node-exporter-29jdr\" (UID: \"ddfd6211-3fee-4119-b77c-fa00d373f4a7\") " pod="openshift-monitoring/node-exporter-29jdr" Jul 15 13:16:10.666199 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.665992 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf8d5cfd-89ac-4c66-a9cc-d11c50406c27-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-drnjr\" (UID: \"cf8d5cfd-89ac-4c66-a9cc-d11c50406c27\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-drnjr" Jul 15 13:16:10.666199 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.666023 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ddfd6211-3fee-4119-b77c-fa00d373f4a7-node-exporter-tls\") pod \"node-exporter-29jdr\" (UID: \"ddfd6211-3fee-4119-b77c-fa00d373f4a7\") " pod="openshift-monitoring/node-exporter-29jdr" Jul 15 13:16:10.666199 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.666052 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ddfd6211-3fee-4119-b77c-fa00d373f4a7-sys\") pod \"node-exporter-29jdr\" (UID: \"ddfd6211-3fee-4119-b77c-fa00d373f4a7\") " pod="openshift-monitoring/node-exporter-29jdr" Jul 15 13:16:10.666199 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.666078 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf8d5cfd-89ac-4c66-a9cc-d11c50406c27-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-drnjr\" (UID: \"cf8d5cfd-89ac-4c66-a9cc-d11c50406c27\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-drnjr" Jul 15 13:16:10.666199 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.666136 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf8d5cfd-89ac-4c66-a9cc-d11c50406c27-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-drnjr\" (UID: \"cf8d5cfd-89ac-4c66-a9cc-d11c50406c27\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-drnjr" Jul 15 13:16:10.666199 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.666189 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ddfd6211-3fee-4119-b77c-fa00d373f4a7-node-exporter-accelerators-collector-config\") pod \"node-exporter-29jdr\" (UID: \"ddfd6211-3fee-4119-b77c-fa00d373f4a7\") " pod="openshift-monitoring/node-exporter-29jdr" Jul 15 13:16:10.666861 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.666835 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf8d5cfd-89ac-4c66-a9cc-d11c50406c27-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-drnjr\" (UID: \"cf8d5cfd-89ac-4c66-a9cc-d11c50406c27\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-drnjr" Jul 15 13:16:10.668696 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.668672 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf8d5cfd-89ac-4c66-a9cc-d11c50406c27-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-drnjr\" (UID: \"cf8d5cfd-89ac-4c66-a9cc-d11c50406c27\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-drnjr" Jul 15 13:16:10.668790 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.668755 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf8d5cfd-89ac-4c66-a9cc-d11c50406c27-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-drnjr\" (UID: \"cf8d5cfd-89ac-4c66-a9cc-d11c50406c27\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-drnjr" Jul 15 13:16:10.683190 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.683155 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s426\" (UniqueName: \"kubernetes.io/projected/cf8d5cfd-89ac-4c66-a9cc-d11c50406c27-kube-api-access-6s426\") pod \"openshift-state-metrics-84bd68b896-drnjr\" (UID: \"cf8d5cfd-89ac-4c66-a9cc-d11c50406c27\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-drnjr" Jul 15 13:16:10.766862 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.766827 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rv5d\" (UniqueName: \"kubernetes.io/projected/ddfd6211-3fee-4119-b77c-fa00d373f4a7-kube-api-access-6rv5d\") pod \"node-exporter-29jdr\" (UID: \"ddfd6211-3fee-4119-b77c-fa00d373f4a7\") " pod="openshift-monitoring/node-exporter-29jdr" Jul 15 13:16:10.767066 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.766872 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ddfd6211-3fee-4119-b77c-fa00d373f4a7-node-exporter-tls\") pod \"node-exporter-29jdr\" (UID: \"ddfd6211-3fee-4119-b77c-fa00d373f4a7\") " pod="openshift-monitoring/node-exporter-29jdr" Jul 15 13:16:10.767066 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.766902 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ddfd6211-3fee-4119-b77c-fa00d373f4a7-sys\") pod \"node-exporter-29jdr\" (UID: \"ddfd6211-3fee-4119-b77c-fa00d373f4a7\") " pod="openshift-monitoring/node-exporter-29jdr" Jul 15 13:16:10.767066 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.766930 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ddfd6211-3fee-4119-b77c-fa00d373f4a7-node-exporter-accelerators-collector-config\") pod \"node-exporter-29jdr\" (UID: \"ddfd6211-3fee-4119-b77c-fa00d373f4a7\") " pod="openshift-monitoring/node-exporter-29jdr" Jul 15 13:16:10.767066 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.766966 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ddfd6211-3fee-4119-b77c-fa00d373f4a7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-29jdr\" (UID: \"ddfd6211-3fee-4119-b77c-fa00d373f4a7\") " pod="openshift-monitoring/node-exporter-29jdr" Jul 15 13:16:10.767066 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.767011 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ddfd6211-3fee-4119-b77c-fa00d373f4a7-node-exporter-textfile\") pod \"node-exporter-29jdr\" (UID: \"ddfd6211-3fee-4119-b77c-fa00d373f4a7\") " pod="openshift-monitoring/node-exporter-29jdr" Jul 15 13:16:10.767066 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.767031 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ddfd6211-3fee-4119-b77c-fa00d373f4a7-sys\") pod \"node-exporter-29jdr\" (UID: \"ddfd6211-3fee-4119-b77c-fa00d373f4a7\") " pod="openshift-monitoring/node-exporter-29jdr" Jul 15 13:16:10.767066 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.767050 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ddfd6211-3fee-4119-b77c-fa00d373f4a7-node-exporter-wtmp\") pod \"node-exporter-29jdr\" (UID: \"ddfd6211-3fee-4119-b77c-fa00d373f4a7\") " pod="openshift-monitoring/node-exporter-29jdr" Jul 15 13:16:10.767414 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.767072 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddfd6211-3fee-4119-b77c-fa00d373f4a7-metrics-client-ca\") pod \"node-exporter-29jdr\" (UID: \"ddfd6211-3fee-4119-b77c-fa00d373f4a7\") " pod="openshift-monitoring/node-exporter-29jdr" Jul 15 13:16:10.767414 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.767100 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ddfd6211-3fee-4119-b77c-fa00d373f4a7-root\") pod \"node-exporter-29jdr\" (UID: \"ddfd6211-3fee-4119-b77c-fa00d373f4a7\") " pod="openshift-monitoring/node-exporter-29jdr" Jul 15 13:16:10.767414 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.767185 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ddfd6211-3fee-4119-b77c-fa00d373f4a7-root\") pod \"node-exporter-29jdr\" (UID: \"ddfd6211-3fee-4119-b77c-fa00d373f4a7\") " pod="openshift-monitoring/node-exporter-29jdr" Jul 15 13:16:10.767414 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.767354 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ddfd6211-3fee-4119-b77c-fa00d373f4a7-node-exporter-wtmp\") pod \"node-exporter-29jdr\" (UID: \"ddfd6211-3fee-4119-b77c-fa00d373f4a7\") " pod="openshift-monitoring/node-exporter-29jdr" Jul 15 13:16:10.767665 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.767566 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ddfd6211-3fee-4119-b77c-fa00d373f4a7-node-exporter-textfile\") pod \"node-exporter-29jdr\" (UID: \"ddfd6211-3fee-4119-b77c-fa00d373f4a7\") " pod="openshift-monitoring/node-exporter-29jdr" Jul 15 13:16:10.767665 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.767636 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ddfd6211-3fee-4119-b77c-fa00d373f4a7-node-exporter-accelerators-collector-config\") pod \"node-exporter-29jdr\" (UID: \"ddfd6211-3fee-4119-b77c-fa00d373f4a7\") " pod="openshift-monitoring/node-exporter-29jdr" Jul 15 13:16:10.767782 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.767707 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddfd6211-3fee-4119-b77c-fa00d373f4a7-metrics-client-ca\") pod \"node-exporter-29jdr\" (UID: \"ddfd6211-3fee-4119-b77c-fa00d373f4a7\") " pod="openshift-monitoring/node-exporter-29jdr" Jul 15 13:16:10.769723 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.769698 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ddfd6211-3fee-4119-b77c-fa00d373f4a7-node-exporter-tls\") pod \"node-exporter-29jdr\" (UID: \"ddfd6211-3fee-4119-b77c-fa00d373f4a7\") " pod="openshift-monitoring/node-exporter-29jdr" Jul 15 13:16:10.769827 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.769778 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ddfd6211-3fee-4119-b77c-fa00d373f4a7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-29jdr\" (UID: \"ddfd6211-3fee-4119-b77c-fa00d373f4a7\") " pod="openshift-monitoring/node-exporter-29jdr" Jul 15 13:16:10.775503 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.775473 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rv5d\" (UniqueName: \"kubernetes.io/projected/ddfd6211-3fee-4119-b77c-fa00d373f4a7-kube-api-access-6rv5d\") pod \"node-exporter-29jdr\" (UID: \"ddfd6211-3fee-4119-b77c-fa00d373f4a7\") " pod="openshift-monitoring/node-exporter-29jdr" Jul 15 13:16:10.818373 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.818337 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-drnjr" Jul 15 13:16:10.877818 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.877787 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-29jdr" Jul 15 13:16:10.890536 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:16:10.890500 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddfd6211_3fee_4119_b77c_fa00d373f4a7.slice/crio-6bfc9ae19a864c0a63f7798a5b56067c142d366ed7242f48351770a56394b469 WatchSource:0}: Error finding container 6bfc9ae19a864c0a63f7798a5b56067c142d366ed7242f48351770a56394b469: Status 404 returned error can't find the container with id 6bfc9ae19a864c0a63f7798a5b56067c142d366ed7242f48351770a56394b469 Jul 15 13:16:10.954963 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.954873 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-29jdr" event={"ID":"ddfd6211-3fee-4119-b77c-fa00d373f4a7","Type":"ContainerStarted","Data":"6bfc9ae19a864c0a63f7798a5b56067c142d366ed7242f48351770a56394b469"} Jul 15 13:16:10.959857 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:10.959816 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-drnjr"] Jul 15 13:16:10.964278 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:16:10.964248 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf8d5cfd_89ac_4c66_a9cc_d11c50406c27.slice/crio-c8537f5f21fc832cb6fc9a66630a12ff69485bb006eb2cef82f9a2e2d3cad846 WatchSource:0}: Error finding container c8537f5f21fc832cb6fc9a66630a12ff69485bb006eb2cef82f9a2e2d3cad846: Status 404 returned error can't find the container with id c8537f5f21fc832cb6fc9a66630a12ff69485bb006eb2cef82f9a2e2d3cad846 Jul 15 13:16:11.473435 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.473399 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d396aec3-e269-4e9e-8908-ef9b3712ac76-metrics-tls\") pod \"dns-default-f8z4j\" (UID: \"d396aec3-e269-4e9e-8908-ef9b3712ac76\") " pod="openshift-dns/dns-default-f8z4j" Jul 15 13:16:11.475880 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.475852 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d396aec3-e269-4e9e-8908-ef9b3712ac76-metrics-tls\") pod \"dns-default-f8z4j\" (UID: \"d396aec3-e269-4e9e-8908-ef9b3712ac76\") " pod="openshift-dns/dns-default-f8z4j" Jul 15 13:16:11.545791 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.545759 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bdsl2\"" Jul 15 13:16:11.547963 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.547936 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 13:16:11.551562 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.551544 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.553168 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.553149 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f8z4j" Jul 15 13:16:11.554683 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.554667 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 15 13:16:11.554781 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.554762 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 15 13:16:11.554975 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.554961 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 15 13:16:11.555064 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.555048 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 15 13:16:11.555445 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.555429 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 15 13:16:11.555495 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.555431 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 15 13:16:11.555959 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.555787 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 15 13:16:11.555959 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.555790 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 15 13:16:11.556127 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.556099 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 15 13:16:11.556191 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.556102 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qql8k\"" Jul 15 13:16:11.568459 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.568436 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 13:16:11.574382 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.574352 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.574495 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.574399 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tb5b\" (UniqueName: \"kubernetes.io/projected/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-kube-api-access-7tb5b\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.574495 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.574432 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.574495 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.574455 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.574613 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.574505 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.574613 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.574563 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.574613 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.574588 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.574613 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.574608 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-config-volume\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.574781 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.574628 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.574781 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.574718 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.574781 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.574758 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-config-out\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.574885 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.574778 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.574885 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.574826 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-web-config\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.675815 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.675744 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-config-out\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.675815 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.675796 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.676057 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.675858 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-web-config\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.676057 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.675914 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.676057 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.676027 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tb5b\" (UniqueName: \"kubernetes.io/projected/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-kube-api-access-7tb5b\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.676212 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.676058 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.676212 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.676081 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.676212 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.676114 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.676212 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.676159 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.676212 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.676190 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.676434 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.676221 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-config-volume\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.676434 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.676247 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.676434 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.676291 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.677551 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:16:11.676906 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-alertmanager-trusted-ca-bundle podName:ba4a6078-cb43-46ac-bd62-ef1796c6fd86 nodeName:}" failed. No retries permitted until 2026-07-15 13:16:12.176877386 +0000 UTC m=+285.607686939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "ba4a6078-cb43-46ac-bd62-ef1796c6fd86") : configmap references non-existent config key: ca-bundle.crt Jul 15 13:16:11.678008 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.677758 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.678856 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.678827 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.679844 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.679800 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-web-config\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.681132 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.681108 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.681740 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.681710 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.681830 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.681816 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.682000 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.681961 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-config-out\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.682369 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.682345 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-config-volume\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.683083 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.683040 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.683653 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.683626 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.684262 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.684239 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.690193 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.690168 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tb5b\" (UniqueName: \"kubernetes.io/projected/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-kube-api-access-7tb5b\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:11.714843 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.714810 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f8z4j"] Jul 15 13:16:11.718673 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:16:11.718645 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd396aec3_e269_4e9e_8908_ef9b3712ac76.slice/crio-4b33f2247b075266eef54e558847c3e716aa4153fb617932859afc9cc2ff8020 WatchSource:0}: Error finding container 4b33f2247b075266eef54e558847c3e716aa4153fb617932859afc9cc2ff8020: Status 404 returned error can't find the container with id 4b33f2247b075266eef54e558847c3e716aa4153fb617932859afc9cc2ff8020 Jul 15 13:16:11.800027 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:16:11.799961 2554 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0292efe5b7f382a7cda01bf7e2181974ab7e5330163dcd3358e0774eb574f065" Jul 15 13:16:11.800224 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:16:11.800114 2554 kuberuntime_manager.go:1459] "Unhandled Error" err="container openshift-state-metrics start failed in pod openshift-state-metrics-84bd68b896-drnjr_openshift-monitoring(cf8d5cfd-89ac-4c66-a9cc-d11c50406c27): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" logger="UnhandledError" Jul 15 13:16:11.800224 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:16:11.800169 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"openshift-state-metrics\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-drnjr" podUID="cf8d5cfd-89ac-4c66-a9cc-d11c50406c27" Jul 15 13:16:11.962361 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.962323 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-drnjr" event={"ID":"cf8d5cfd-89ac-4c66-a9cc-d11c50406c27","Type":"ContainerStarted","Data":"42ad754c18c20143e78dfbb13188ea831c56bbd9baca4c18605ebbe0f9b12e9c"} Jul 15 13:16:11.962826 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.962395 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-drnjr" event={"ID":"cf8d5cfd-89ac-4c66-a9cc-d11c50406c27","Type":"ContainerStarted","Data":"4217ec874800cff33604013b028b4494cfd3259f4ed3bb79873e8a6eeb99e29b"} Jul 15 13:16:11.962826 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.962425 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-drnjr" event={"ID":"cf8d5cfd-89ac-4c66-a9cc-d11c50406c27","Type":"ContainerStarted","Data":"c8537f5f21fc832cb6fc9a66630a12ff69485bb006eb2cef82f9a2e2d3cad846"} Jul 15 13:16:11.963853 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:16:11.963824 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"openshift-state-metrics\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0292efe5b7f382a7cda01bf7e2181974ab7e5330163dcd3358e0774eb574f065\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-drnjr" podUID="cf8d5cfd-89ac-4c66-a9cc-d11c50406c27" Jul 15 13:16:11.963964 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:11.963864 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f8z4j" event={"ID":"d396aec3-e269-4e9e-8908-ef9b3712ac76","Type":"ContainerStarted","Data":"4b33f2247b075266eef54e558847c3e716aa4153fb617932859afc9cc2ff8020"} Jul 15 13:16:12.156853 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:12.156815 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:12.181552 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:12.181526 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:12.182349 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:12.182329 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:12.462973 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:12.462890 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:16:12.612998 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:12.612907 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 13:16:12.615426 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:16:12.615400 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba4a6078_cb43_46ac_bd62_ef1796c6fd86.slice/crio-a7dbfd63038b73997bf26793bfffce43c76767edf790e5749daebdb15720099b WatchSource:0}: Error finding container a7dbfd63038b73997bf26793bfffce43c76767edf790e5749daebdb15720099b: Status 404 returned error can't find the container with id a7dbfd63038b73997bf26793bfffce43c76767edf790e5749daebdb15720099b Jul 15 13:16:12.969732 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:12.969693 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba4a6078-cb43-46ac-bd62-ef1796c6fd86","Type":"ContainerStarted","Data":"a7dbfd63038b73997bf26793bfffce43c76767edf790e5749daebdb15720099b"} Jul 15 13:16:12.971430 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:12.971365 2554 generic.go:356] "Generic (PLEG): container finished" podID="ddfd6211-3fee-4119-b77c-fa00d373f4a7" containerID="c735c87bbf714d533a66e4fc334b8a584f61be7ee1ba93dc6d0e11a7e96d7914" exitCode=0 Jul 15 13:16:12.971564 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:12.971456 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-29jdr" event={"ID":"ddfd6211-3fee-4119-b77c-fa00d373f4a7","Type":"ContainerDied","Data":"c735c87bbf714d533a66e4fc334b8a584f61be7ee1ba93dc6d0e11a7e96d7914"} Jul 15 13:16:12.973079 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:16:12.973043 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"openshift-state-metrics\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0292efe5b7f382a7cda01bf7e2181974ab7e5330163dcd3358e0774eb574f065\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-drnjr" podUID="cf8d5cfd-89ac-4c66-a9cc-d11c50406c27" Jul 15 13:16:13.456805 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:13.456721 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:13.541378 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:13.541348 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:13.726392 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:13.726359 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:13.978038 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:13.977950 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-29jdr" event={"ID":"ddfd6211-3fee-4119-b77c-fa00d373f4a7","Type":"ContainerStarted","Data":"b27d1ee8bacead663f87f1a2871f01c0d23fe94036180d96b4773f1c07f25145"} Jul 15 13:16:14.099966 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:14.099927 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:15.197186 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:15.197148 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:15.256608 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:15.256564 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:15.564562 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:15.564529 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:15.666425 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:15.666396 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:15.864770 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:15.864678 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:16.155369 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.155285 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cdb477b5b-mwpxz" Jul 15 13:16:16.155369 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.155363 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cdb477b5b-mwpxz" Jul 15 13:16:16.156833 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.156801 2554 patch_prober.go:28] interesting pod/console-cdb477b5b-mwpxz container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" start-of-body= Jul 15 13:16:16.156955 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.156853 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-cdb477b5b-mwpxz" podUID="dd1ff280-e5e4-4ed0-8895-f5b998f59185" containerName="console" probeResult="failure" output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" Jul 15 13:16:16.867169 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.867115 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 13:16:16.872938 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.872911 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:16.881065 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.880853 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 15 13:16:16.881065 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.880911 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 15 13:16:16.881065 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.880918 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 15 13:16:16.881545 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.881533 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 15 13:16:16.881937 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.881573 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 15 13:16:16.881937 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.881716 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 15 13:16:16.881937 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.881753 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 15 13:16:16.881937 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.881873 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 15 13:16:16.881937 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.881881 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 15 13:16:16.882327 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.882298 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 15 13:16:16.882408 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.882328 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a80g60ok6rb6e\"" Jul 15 13:16:16.882408 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.882353 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-972mv\"" Jul 15 13:16:16.882965 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.882807 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 15 13:16:16.882965 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.882832 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 15 13:16:16.888000 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.887586 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 15 13:16:16.892976 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.892957 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 15 13:16:16.900308 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.900283 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 13:16:16.924436 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.924396 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/253a7d80-fd15-47b2-aad6-a21b4c313af0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:16.924613 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.924453 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:16.924613 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.924483 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:16.924613 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.924533 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:16.924613 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.924586 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/253a7d80-fd15-47b2-aad6-a21b4c313af0-config-out\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:16.924819 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.924622 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-web-config\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:16.924819 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.924647 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:16.924819 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.924671 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:16.924819 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.924687 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:16.924819 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.924749 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:16.925105 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.924819 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:16.925105 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.924851 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:16.925105 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.924891 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r96s\" (UniqueName: \"kubernetes.io/projected/253a7d80-fd15-47b2-aad6-a21b4c313af0-kube-api-access-8r96s\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:16.925105 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.924918 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:16.925105 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.924942 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:16.925105 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.924970 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/253a7d80-fd15-47b2-aad6-a21b4c313af0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:16.925105 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.925018 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-config\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:16.925105 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.925042 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:16.925105 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.925067 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:16.925105 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.925091 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:16.941160 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:16.941127 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 15 13:16:17.026427 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.026389 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.026623 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.026438 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/253a7d80-fd15-47b2-aad6-a21b4c313af0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.026623 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.026463 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-config\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.026623 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.026515 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.026623 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.026556 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.026623 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.026583 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.026623 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.026620 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/253a7d80-fd15-47b2-aad6-a21b4c313af0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.026918 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.026654 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.026918 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.026675 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.026918 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.026702 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.026918 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.026745 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/253a7d80-fd15-47b2-aad6-a21b4c313af0-config-out\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.026918 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.026794 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-web-config\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.026918 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.026822 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.026918 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.026848 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.026918 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.026873 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.026918 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.026924 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.027459 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.026999 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.027459 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.027026 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.027459 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.027059 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r96s\" (UniqueName: \"kubernetes.io/projected/253a7d80-fd15-47b2-aad6-a21b4c313af0-kube-api-access-8r96s\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.027459 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.027083 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.027459 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.027273 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/253a7d80-fd15-47b2-aad6-a21b4c313af0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.027698 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.027479 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.027923 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.027789 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.028569 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.028547 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.029662 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.029643 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.030127 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.030102 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.030607 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.030434 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-config\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.031273 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.031227 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.031908 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.031878 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.032187 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.032160 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.032328 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.032187 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/253a7d80-fd15-47b2-aad6-a21b4c313af0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.032528 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.032466 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.033100 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.033063 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/253a7d80-fd15-47b2-aad6-a21b4c313af0-config-out\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.034024 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.033964 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.034024 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.034006 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.034318 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.034279 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.034581 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.034559 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.034719 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.034703 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.034844 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.034825 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-web-config\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.045577 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.045544 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r96s\" (UniqueName: \"kubernetes.io/projected/253a7d80-fd15-47b2-aad6-a21b4c313af0-kube-api-access-8r96s\") pod \"prometheus-k8s-0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.124179 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.124062 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:17.185388 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.185350 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:17.758336 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:17.758301 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cdb477b5b-mwpxz"] Jul 15 13:16:18.574531 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:18.574479 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:20.133462 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:16:20.133412 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-xmbdp" podUID="7cfca5b3-c487-470b-b5b1-965339049b4c" Jul 15 13:16:20.284316 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:20.284288 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 13:16:20.401363 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:16:20.401294 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod253a7d80_fd15_47b2_aad6_a21b4c313af0.slice/crio-6c750bfb00ebd929be92efff106a16d22a179f70cf6f57aa84457ae0ab77557a WatchSource:0}: Error finding container 6c750bfb00ebd929be92efff106a16d22a179f70cf6f57aa84457ae0ab77557a: Status 404 returned error can't find the container with id 6c750bfb00ebd929be92efff106a16d22a179f70cf6f57aa84457ae0ab77557a Jul 15 13:16:21.007278 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:21.007203 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-29jdr" event={"ID":"ddfd6211-3fee-4119-b77c-fa00d373f4a7","Type":"ContainerStarted","Data":"d1bf8de5e08d6b639d072b8928fa8b211e1753c42308d8fb2c7edd6a51cde27a"} Jul 15 13:16:21.009052 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:21.009013 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"253a7d80-fd15-47b2-aad6-a21b4c313af0","Type":"ContainerStarted","Data":"6c750bfb00ebd929be92efff106a16d22a179f70cf6f57aa84457ae0ab77557a"} Jul 15 13:16:21.011078 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:21.011044 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-945tm" event={"ID":"dbe3a9c0-b369-4faf-8629-062dd853c5d8","Type":"ContainerStarted","Data":"fa63fb845839b805419bb236c42f7eb9a200b6564d9eaff16eec46e833788f87"} Jul 15 13:16:21.011571 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:21.011545 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-945tm" Jul 15 13:16:21.028894 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:21.028860 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-945tm" Jul 15 13:16:21.046825 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:21.046722 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-29jdr" podStartSLOduration=9.755047988 podStartE2EDuration="11.046699492s" totalImagesPullingTime="1.218706744s" totalInitContainerRuntime="72.94476ms" isStatefulPod=true podCreationTimestamp="2026-07-15 13:16:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:16:21.04634466 +0000 UTC m=+294.477154235" watchObservedRunningTime="2026-07-15 13:16:21.046699492 +0000 UTC m=+294.477509069" Jul 15 13:16:21.079365 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:21.079176 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-945tm" podStartSLOduration=3.0255643 podStartE2EDuration="27.079155345s" totalImagesPullingTime="24.053591045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:15:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:16:21.078399037 +0000 UTC m=+294.509208612" watchObservedRunningTime="2026-07-15 13:16:21.079155345 +0000 UTC m=+294.509964936" Jul 15 13:16:21.880816 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:21.880786 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:22.018230 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:22.018117 2554 generic.go:356] "Generic (PLEG): container finished" podID="253a7d80-fd15-47b2-aad6-a21b4c313af0" containerID="ccc871253699df457ed3bd24dcea2e1ee922ded19b58076a6691c60189ac6ea7" exitCode=0 Jul 15 13:16:22.018484 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:22.018263 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"253a7d80-fd15-47b2-aad6-a21b4c313af0","Type":"ContainerDied","Data":"ccc871253699df457ed3bd24dcea2e1ee922ded19b58076a6691c60189ac6ea7"} Jul 15 13:16:22.021428 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:22.021270 2554 generic.go:356] "Generic (PLEG): container finished" podID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" containerID="f1560129b34fc5d0393710d4db239e7f072f90940442200b0b4dc0a741ddf448" exitCode=0 Jul 15 13:16:22.021428 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:22.021462 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba4a6078-cb43-46ac-bd62-ef1796c6fd86","Type":"ContainerDied","Data":"f1560129b34fc5d0393710d4db239e7f072f90940442200b0b4dc0a741ddf448"} Jul 15 13:16:23.035620 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:23.034464 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f8z4j" event={"ID":"d396aec3-e269-4e9e-8908-ef9b3712ac76","Type":"ContainerStarted","Data":"4e3b66d2ef34ace76d3a6da96483f3861f9fb3b2417c039db837f65ef4acd212"} Jul 15 13:16:24.042556 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:24.042481 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f8z4j" event={"ID":"d396aec3-e269-4e9e-8908-ef9b3712ac76","Type":"ContainerStarted","Data":"252bd21f745487df5fd82082ca0e094b515e932da6031c968190ce4087a41783"} Jul 15 13:16:24.043161 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:24.042642 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-f8z4j" Jul 15 13:16:24.066509 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:24.065767 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-f8z4j" podStartSLOduration=251.944883512 podStartE2EDuration="4m23.065729383s" totalImagesPullingTime="11.120845871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:12:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:16:24.064743557 +0000 UTC m=+297.495553132" watchObservedRunningTime="2026-07-15 13:16:24.065729383 +0000 UTC m=+297.496538958" Jul 15 13:16:25.054709 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:25.054676 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba4a6078-cb43-46ac-bd62-ef1796c6fd86","Type":"ContainerStarted","Data":"3c055c561584a54e9e10d1dbf328d304cd4dd1665fb66278bbd01373fd53d005"} Jul 15 13:16:25.055137 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:25.054755 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba4a6078-cb43-46ac-bd62-ef1796c6fd86","Type":"ContainerStarted","Data":"ff4c171e2dd360118b05415a7581e57f9070de526b708fdea435fe6067e67436"} Jul 15 13:16:25.055137 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:25.054801 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba4a6078-cb43-46ac-bd62-ef1796c6fd86","Type":"ContainerStarted","Data":"cc16238c935ae1fb31e60ff4ffda93a451df0b005fd321c6deb3dd9cba6c8fc7"} Jul 15 13:16:26.063958 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:26.063877 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba4a6078-cb43-46ac-bd62-ef1796c6fd86","Type":"ContainerStarted","Data":"a5088272a97f1716e361f43e266b57c7f7aac68b67c931066783c2b8e3ea7dfa"} Jul 15 13:16:27.013143 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:27.013113 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lx562_83d9c378-e25b-487c-a9be-83e18e37d87f/ovn-acl-logging/0.log" Jul 15 13:16:27.015833 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:27.015764 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lx562_83d9c378-e25b-487c-a9be-83e18e37d87f/ovn-acl-logging/0.log" Jul 15 13:16:27.018331 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:27.018312 2554 kubelet.go:1648] "Image garbage collection succeeded" Jul 15 13:16:27.079208 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:27.079070 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba4a6078-cb43-46ac-bd62-ef1796c6fd86","Type":"ContainerStarted","Data":"139ae77fb290a04d994560f6a46facea96add5a7ef6dd924462b25d03cc95838"} Jul 15 13:16:27.084274 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:27.083935 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"253a7d80-fd15-47b2-aad6-a21b4c313af0","Type":"ContainerStarted","Data":"08fed2e3994c3c9f991416676ed91309e868652e9fca55a07fe40843551c6b1d"} Jul 15 13:16:27.574921 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:27.156696 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:27.679266 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:27.679177 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:27.782619 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:27.782581 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:28.090672 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:28.090637 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"253a7d80-fd15-47b2-aad6-a21b4c313af0","Type":"ContainerStarted","Data":"f2f538b50235d0d02802d2ba5fb9178c13510976fcc6e2e91ea139d0423f95ef"} Jul 15 13:16:28.507585 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:28.507549 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:28.890318 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:28.890260 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:28.989963 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:28.989906 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:29.093469 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:29.093437 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:29.098995 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:29.098914 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-drnjr" event={"ID":"cf8d5cfd-89ac-4c66-a9cc-d11c50406c27","Type":"ContainerStarted","Data":"937a1c7a9e959845d26b53f14aa70eb64845ebe82aac73865494ccc8631080d2"} Jul 15 13:16:29.104345 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:29.104225 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba4a6078-cb43-46ac-bd62-ef1796c6fd86","Type":"ContainerStarted","Data":"b808e4ce9f94df16c9553015a8d9b3c93d528a7d9430019f1e389f707aafbb00"} Jul 15 13:16:29.125903 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:29.125474 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-drnjr" podStartSLOduration=1.8832914010000001 podStartE2EDuration="19.12545113s" totalImagesPullingTime="17.242159729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:16:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-15 13:16:29.123299714 +0000 UTC m=+302.554109290" watchObservedRunningTime="2026-07-15 13:16:29.12545113 +0000 UTC m=+302.556260705" Jul 15 13:16:29.158149 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:29.158042 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.73339055 podStartE2EDuration="18.158020065s" totalImagesPullingTime="13.395021694s" totalInitContainerRuntime="29.607821ms" isStatefulPod=false podCreationTimestamp="2026-07-15 13:16:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:16:29.15762571 +0000 UTC m=+302.588435298" watchObservedRunningTime="2026-07-15 13:16:29.158020065 +0000 UTC m=+302.588829641" Jul 15 13:16:29.172502 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:29.169878 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:31.115360 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:31.115277 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"253a7d80-fd15-47b2-aad6-a21b4c313af0","Type":"ContainerStarted","Data":"29af533b3db1e36a360bbfe42bfe20dee0c92f31ddd58fea1d00ba3159bcd233"} Jul 15 13:16:31.115360 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:31.115341 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"253a7d80-fd15-47b2-aad6-a21b4c313af0","Type":"ContainerStarted","Data":"2eb83d7d372b78e658bbf184a7b80055c746e3e3df60731a14241679af5418cb"} Jul 15 13:16:31.115755 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:31.115371 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"253a7d80-fd15-47b2-aad6-a21b4c313af0","Type":"ContainerStarted","Data":"f3a04a98d73e6bbc89e00cf3c24a4747ba7a1fb6a391f35b736987853196930b"} Jul 15 13:16:31.115755 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:31.115395 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"253a7d80-fd15-47b2-aad6-a21b4c313af0","Type":"ContainerStarted","Data":"6772d5b2d29f7974832135e6d237f250592254d0df6dd80a383ceba982305dec"} Jul 15 13:16:31.156653 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:31.156596 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.681913302 podStartE2EDuration="15.156579096s" totalImagesPullingTime="9.46270003s" totalInitContainerRuntime="11.965764ms" isStatefulPod=false podCreationTimestamp="2026-07-15 13:16:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:16:31.155563184 +0000 UTC m=+304.586372759" watchObservedRunningTime="2026-07-15 13:16:31.156579096 +0000 UTC m=+304.587388670" Jul 15 13:16:31.464738 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:31.464665 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:31.567836 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:31.567801 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:32.132167 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:32.132137 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:16:32.185790 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:32.185757 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:16:33.076446 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:33.076411 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:34.056998 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:34.056950 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-f8z4j" Jul 15 13:16:36.324377 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:36.324344 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:36.386541 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:36.386512 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:41.861148 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:41.861109 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:42.781353 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:42.781311 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-cdb477b5b-mwpxz" podUID="dd1ff280-e5e4-4ed0-8895-f5b998f59185" containerName="console" containerID="cri-o://e3fd4dc66965a3d967a0297b29f347cf5a5a0c5db65f44d9a9f52d97df8c682c" gracePeriod=15 Jul 15 13:16:43.058437 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:43.058365 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cdb477b5b-mwpxz" Jul 15 13:16:43.079687 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:43.079661 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6dbg\" (UniqueName: \"kubernetes.io/projected/dd1ff280-e5e4-4ed0-8895-f5b998f59185-kube-api-access-d6dbg\") pod \"dd1ff280-e5e4-4ed0-8895-f5b998f59185\" (UID: \"dd1ff280-e5e4-4ed0-8895-f5b998f59185\") " Jul 15 13:16:43.079847 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:43.079697 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd1ff280-e5e4-4ed0-8895-f5b998f59185-console-config\") pod \"dd1ff280-e5e4-4ed0-8895-f5b998f59185\" (UID: \"dd1ff280-e5e4-4ed0-8895-f5b998f59185\") " Jul 15 13:16:43.079847 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:43.079718 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd1ff280-e5e4-4ed0-8895-f5b998f59185-service-ca\") pod \"dd1ff280-e5e4-4ed0-8895-f5b998f59185\" (UID: \"dd1ff280-e5e4-4ed0-8895-f5b998f59185\") " Jul 15 13:16:43.079847 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:43.079746 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd1ff280-e5e4-4ed0-8895-f5b998f59185-console-oauth-config\") pod \"dd1ff280-e5e4-4ed0-8895-f5b998f59185\" (UID: \"dd1ff280-e5e4-4ed0-8895-f5b998f59185\") " Jul 15 13:16:43.079847 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:43.079800 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd1ff280-e5e4-4ed0-8895-f5b998f59185-console-serving-cert\") pod \"dd1ff280-e5e4-4ed0-8895-f5b998f59185\" (UID: \"dd1ff280-e5e4-4ed0-8895-f5b998f59185\") " Jul 15 13:16:43.079847 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:43.079827 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd1ff280-e5e4-4ed0-8895-f5b998f59185-oauth-serving-cert\") pod \"dd1ff280-e5e4-4ed0-8895-f5b998f59185\" (UID: \"dd1ff280-e5e4-4ed0-8895-f5b998f59185\") " Jul 15 13:16:43.080230 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:43.080139 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd1ff280-e5e4-4ed0-8895-f5b998f59185-console-config" (OuterVolumeSpecName: "console-config") pod "dd1ff280-e5e4-4ed0-8895-f5b998f59185" (UID: "dd1ff280-e5e4-4ed0-8895-f5b998f59185"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:16:43.080230 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:43.080152 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd1ff280-e5e4-4ed0-8895-f5b998f59185-service-ca" (OuterVolumeSpecName: "service-ca") pod "dd1ff280-e5e4-4ed0-8895-f5b998f59185" (UID: "dd1ff280-e5e4-4ed0-8895-f5b998f59185"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:16:43.080397 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:43.080355 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd1ff280-e5e4-4ed0-8895-f5b998f59185-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dd1ff280-e5e4-4ed0-8895-f5b998f59185" (UID: "dd1ff280-e5e4-4ed0-8895-f5b998f59185"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:16:43.089041 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:43.088968 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd1ff280-e5e4-4ed0-8895-f5b998f59185-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dd1ff280-e5e4-4ed0-8895-f5b998f59185" (UID: "dd1ff280-e5e4-4ed0-8895-f5b998f59185"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:16:43.089160 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:43.089051 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd1ff280-e5e4-4ed0-8895-f5b998f59185-kube-api-access-d6dbg" (OuterVolumeSpecName: "kube-api-access-d6dbg") pod "dd1ff280-e5e4-4ed0-8895-f5b998f59185" (UID: "dd1ff280-e5e4-4ed0-8895-f5b998f59185"). InnerVolumeSpecName "kube-api-access-d6dbg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:16:43.089160 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:43.089073 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd1ff280-e5e4-4ed0-8895-f5b998f59185-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dd1ff280-e5e4-4ed0-8895-f5b998f59185" (UID: "dd1ff280-e5e4-4ed0-8895-f5b998f59185"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:16:43.160925 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:43.160889 2554 generic.go:356] "Generic (PLEG): container finished" podID="dd1ff280-e5e4-4ed0-8895-f5b998f59185" containerID="e3fd4dc66965a3d967a0297b29f347cf5a5a0c5db65f44d9a9f52d97df8c682c" exitCode=0 Jul 15 13:16:43.161085 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:43.160947 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cdb477b5b-mwpxz" Jul 15 13:16:43.161085 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:43.160971 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cdb477b5b-mwpxz" event={"ID":"dd1ff280-e5e4-4ed0-8895-f5b998f59185","Type":"ContainerDied","Data":"e3fd4dc66965a3d967a0297b29f347cf5a5a0c5db65f44d9a9f52d97df8c682c"} Jul 15 13:16:43.161085 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:43.161043 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cdb477b5b-mwpxz" event={"ID":"dd1ff280-e5e4-4ed0-8895-f5b998f59185","Type":"ContainerDied","Data":"d603e5e5b071244bce2df7a89d5976149ae5195e4568bcda82882002c39d4da6"} Jul 15 13:16:43.161085 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:43.161064 2554 scope.go:117] "RemoveContainer" containerID="e3fd4dc66965a3d967a0297b29f347cf5a5a0c5db65f44d9a9f52d97df8c682c" Jul 15 13:16:43.169543 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:43.169527 2554 scope.go:117] "RemoveContainer" containerID="e3fd4dc66965a3d967a0297b29f347cf5a5a0c5db65f44d9a9f52d97df8c682c" Jul 15 13:16:43.169777 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:16:43.169760 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3fd4dc66965a3d967a0297b29f347cf5a5a0c5db65f44d9a9f52d97df8c682c\": container with ID starting with e3fd4dc66965a3d967a0297b29f347cf5a5a0c5db65f44d9a9f52d97df8c682c not found: ID does not exist" containerID="e3fd4dc66965a3d967a0297b29f347cf5a5a0c5db65f44d9a9f52d97df8c682c" Jul 15 13:16:43.169829 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:43.169787 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3fd4dc66965a3d967a0297b29f347cf5a5a0c5db65f44d9a9f52d97df8c682c"} err="failed to get container status \"e3fd4dc66965a3d967a0297b29f347cf5a5a0c5db65f44d9a9f52d97df8c682c\": rpc error: code = NotFound desc = could not find container \"e3fd4dc66965a3d967a0297b29f347cf5a5a0c5db65f44d9a9f52d97df8c682c\": container with ID starting with e3fd4dc66965a3d967a0297b29f347cf5a5a0c5db65f44d9a9f52d97df8c682c not found: ID does not exist" Jul 15 13:16:43.177518 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:43.177494 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cdb477b5b-mwpxz"] Jul 15 13:16:43.180569 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:43.180551 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cdb477b5b-mwpxz"] Jul 15 13:16:43.180904 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:43.180887 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd1ff280-e5e4-4ed0-8895-f5b998f59185-console-config\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:16:43.180945 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:43.180911 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd1ff280-e5e4-4ed0-8895-f5b998f59185-service-ca\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:16:43.180945 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:43.180922 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd1ff280-e5e4-4ed0-8895-f5b998f59185-console-oauth-config\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:16:43.180945 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:43.180932 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd1ff280-e5e4-4ed0-8895-f5b998f59185-console-serving-cert\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:16:43.180945 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:43.180941 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd1ff280-e5e4-4ed0-8895-f5b998f59185-oauth-serving-cert\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:16:43.181089 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:43.180949 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6dbg\" (UniqueName: \"kubernetes.io/projected/dd1ff280-e5e4-4ed0-8895-f5b998f59185-kube-api-access-d6dbg\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:16:45.023843 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:45.023804 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7" podUID="0eac4c8c-fc00-48e1-a420-e944097e774d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 15 13:16:45.136354 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:45.136325 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd1ff280-e5e4-4ed0-8895-f5b998f59185" path="/var/lib/kubelet/pods/dd1ff280-e5e4-4ed0-8895-f5b998f59185/volumes" Jul 15 13:16:45.557173 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:45.557142 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:45.626188 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:45.626159 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:50.859125 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:50.859094 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:50.913127 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:50.913101 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:53.213782 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:53.213754 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:54.035717 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:54.035691 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:54.137299 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:54.137268 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:16:55.023796 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:16:55.023754 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7" podUID="0eac4c8c-fc00-48e1-a420-e944097e774d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 15 13:17:00.576610 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:00.576578 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:17:00.650527 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:00.650492 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:17:05.023745 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:05.023698 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7" podUID="0eac4c8c-fc00-48e1-a420-e944097e774d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 15 13:17:05.024184 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:05.023784 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7" Jul 15 13:17:05.024265 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:05.024248 2554 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"3a4dc3632589885ad9860da5718aa5be4aa42f12e61b905834df0cb3d694b49d"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 15 13:17:05.024300 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:05.024284 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7" podUID="0eac4c8c-fc00-48e1-a420-e944097e774d" containerName="service-proxy" containerID="cri-o://3a4dc3632589885ad9860da5718aa5be4aa42f12e61b905834df0cb3d694b49d" gracePeriod=30 Jul 15 13:17:05.242170 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:05.242134 2554 generic.go:356] "Generic (PLEG): container finished" podID="0eac4c8c-fc00-48e1-a420-e944097e774d" containerID="3a4dc3632589885ad9860da5718aa5be4aa42f12e61b905834df0cb3d694b49d" exitCode=2 Jul 15 13:17:05.242322 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:05.242204 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7" event={"ID":"0eac4c8c-fc00-48e1-a420-e944097e774d","Type":"ContainerDied","Data":"3a4dc3632589885ad9860da5718aa5be4aa42f12e61b905834df0cb3d694b49d"} Jul 15 13:17:06.247708 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:06.247667 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69b66cfbd-gp7c7" event={"ID":"0eac4c8c-fc00-48e1-a420-e944097e774d","Type":"ContainerStarted","Data":"c51855c99e13937c55930b32c58efa0ab748a9c0411a9e34b4c3d38b3bc3070a"} Jul 15 13:17:17.185901 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:17.185849 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:17.206507 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:17.206478 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:17.306290 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:17.306262 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:29.739551 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:29.739517 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:17:30.004701 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:30.004610 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:17:30.798131 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:30.798097 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 13:17:30.798528 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:30.798385 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" containerName="alertmanager" containerID="cri-o://cc16238c935ae1fb31e60ff4ffda93a451df0b005fd321c6deb3dd9cba6c8fc7" gracePeriod=120 Jul 15 13:17:30.798528 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:30.798462 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" containerName="kube-rbac-proxy-web" containerID="cri-o://3c055c561584a54e9e10d1dbf328d304cd4dd1665fb66278bbd01373fd53d005" gracePeriod=120 Jul 15 13:17:30.798528 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:30.798452 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" containerName="kube-rbac-proxy-metric" containerID="cri-o://139ae77fb290a04d994560f6a46facea96add5a7ef6dd924462b25d03cc95838" gracePeriod=120 Jul 15 13:17:30.798695 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:30.798504 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" containerName="kube-rbac-proxy" containerID="cri-o://a5088272a97f1716e361f43e266b57c7f7aac68b67c931066783c2b8e3ea7dfa" gracePeriod=120 Jul 15 13:17:30.798695 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:30.798540 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" containerName="config-reloader" containerID="cri-o://ff4c171e2dd360118b05415a7581e57f9070de526b708fdea435fe6067e67436" gracePeriod=120 Jul 15 13:17:30.798695 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:30.798508 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" containerName="prom-label-proxy" containerID="cri-o://b808e4ce9f94df16c9553015a8d9b3c93d528a7d9430019f1e389f707aafbb00" gracePeriod=120 Jul 15 13:17:31.345237 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:31.345205 2554 generic.go:356] "Generic (PLEG): container finished" podID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" containerID="b808e4ce9f94df16c9553015a8d9b3c93d528a7d9430019f1e389f707aafbb00" exitCode=0 Jul 15 13:17:31.345237 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:31.345229 2554 generic.go:356] "Generic (PLEG): container finished" podID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" containerID="a5088272a97f1716e361f43e266b57c7f7aac68b67c931066783c2b8e3ea7dfa" exitCode=0 Jul 15 13:17:31.345237 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:31.345235 2554 generic.go:356] "Generic (PLEG): container finished" podID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" containerID="ff4c171e2dd360118b05415a7581e57f9070de526b708fdea435fe6067e67436" exitCode=0 Jul 15 13:17:31.345237 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:31.345241 2554 generic.go:356] "Generic (PLEG): container finished" podID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" containerID="cc16238c935ae1fb31e60ff4ffda93a451df0b005fd321c6deb3dd9cba6c8fc7" exitCode=0 Jul 15 13:17:31.345487 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:31.345262 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba4a6078-cb43-46ac-bd62-ef1796c6fd86","Type":"ContainerDied","Data":"b808e4ce9f94df16c9553015a8d9b3c93d528a7d9430019f1e389f707aafbb00"} Jul 15 13:17:31.345487 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:31.345312 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba4a6078-cb43-46ac-bd62-ef1796c6fd86","Type":"ContainerDied","Data":"a5088272a97f1716e361f43e266b57c7f7aac68b67c931066783c2b8e3ea7dfa"} Jul 15 13:17:31.345487 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:31.345337 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba4a6078-cb43-46ac-bd62-ef1796c6fd86","Type":"ContainerDied","Data":"ff4c171e2dd360118b05415a7581e57f9070de526b708fdea435fe6067e67436"} Jul 15 13:17:31.345487 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:31.345362 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba4a6078-cb43-46ac-bd62-ef1796c6fd86","Type":"ContainerDied","Data":"cc16238c935ae1fb31e60ff4ffda93a451df0b005fd321c6deb3dd9cba6c8fc7"} Jul 15 13:17:32.038404 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.038378 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.088962 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.088932 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-config-volume\") pod \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " Jul 15 13:17:32.088962 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.088965 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-secret-alertmanager-kube-rbac-proxy-metric\") pod \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " Jul 15 13:17:32.089222 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.089015 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-alertmanager-trusted-ca-bundle\") pod \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " Jul 15 13:17:32.089222 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.089046 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tb5b\" (UniqueName: \"kubernetes.io/projected/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-kube-api-access-7tb5b\") pod \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " Jul 15 13:17:32.089222 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.089101 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-secret-alertmanager-kube-rbac-proxy-web\") pod \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " Jul 15 13:17:32.089222 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.089133 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-secret-alertmanager-main-tls\") pod \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " Jul 15 13:17:32.089222 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.089163 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-cluster-tls-config\") pod \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " Jul 15 13:17:32.089222 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.089197 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-alertmanager-main-db\") pod \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " Jul 15 13:17:32.089509 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.089242 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-web-config\") pod \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " Jul 15 13:17:32.089509 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.089270 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-metrics-client-ca\") pod \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " Jul 15 13:17:32.089509 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.089302 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-tls-assets\") pod \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " Jul 15 13:17:32.089509 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.089326 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-secret-alertmanager-kube-rbac-proxy\") pod \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " Jul 15 13:17:32.089509 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.089353 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-config-out\") pod \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\" (UID: \"ba4a6078-cb43-46ac-bd62-ef1796c6fd86\") " Jul 15 13:17:32.089509 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.089480 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "ba4a6078-cb43-46ac-bd62-ef1796c6fd86" (UID: "ba4a6078-cb43-46ac-bd62-ef1796c6fd86"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:17:32.089804 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.089625 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "ba4a6078-cb43-46ac-bd62-ef1796c6fd86" (UID: "ba4a6078-cb43-46ac-bd62-ef1796c6fd86"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:17:32.089804 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.089711 2554 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-alertmanager-main-db\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:17:32.089804 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.089710 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "ba4a6078-cb43-46ac-bd62-ef1796c6fd86" (UID: "ba4a6078-cb43-46ac-bd62-ef1796c6fd86"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:17:32.089804 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.089730 2554 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:17:32.092087 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.092055 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "ba4a6078-cb43-46ac-bd62-ef1796c6fd86" (UID: "ba4a6078-cb43-46ac-bd62-ef1796c6fd86"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:17:32.092820 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.092756 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-config-volume" (OuterVolumeSpecName: "config-volume") pod "ba4a6078-cb43-46ac-bd62-ef1796c6fd86" (UID: "ba4a6078-cb43-46ac-bd62-ef1796c6fd86"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:17:32.094674 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.094637 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "ba4a6078-cb43-46ac-bd62-ef1796c6fd86" (UID: "ba4a6078-cb43-46ac-bd62-ef1796c6fd86"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:17:32.094674 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.094664 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-config-out" (OuterVolumeSpecName: "config-out") pod "ba4a6078-cb43-46ac-bd62-ef1796c6fd86" (UID: "ba4a6078-cb43-46ac-bd62-ef1796c6fd86"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:17:32.094836 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.094806 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "ba4a6078-cb43-46ac-bd62-ef1796c6fd86" (UID: "ba4a6078-cb43-46ac-bd62-ef1796c6fd86"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:17:32.094939 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.094917 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "ba4a6078-cb43-46ac-bd62-ef1796c6fd86" (UID: "ba4a6078-cb43-46ac-bd62-ef1796c6fd86"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:17:32.094939 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.094928 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ba4a6078-cb43-46ac-bd62-ef1796c6fd86" (UID: "ba4a6078-cb43-46ac-bd62-ef1796c6fd86"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:17:32.096315 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.096288 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-kube-api-access-7tb5b" (OuterVolumeSpecName: "kube-api-access-7tb5b") pod "ba4a6078-cb43-46ac-bd62-ef1796c6fd86" (UID: "ba4a6078-cb43-46ac-bd62-ef1796c6fd86"). InnerVolumeSpecName "kube-api-access-7tb5b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:17:32.098965 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.098939 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "ba4a6078-cb43-46ac-bd62-ef1796c6fd86" (UID: "ba4a6078-cb43-46ac-bd62-ef1796c6fd86"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:17:32.103670 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.103648 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-web-config" (OuterVolumeSpecName: "web-config") pod "ba4a6078-cb43-46ac-bd62-ef1796c6fd86" (UID: "ba4a6078-cb43-46ac-bd62-ef1796c6fd86"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:17:32.190659 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.190574 2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:17:32.190659 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.190599 2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-secret-alertmanager-main-tls\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:17:32.190659 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.190611 2554 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-cluster-tls-config\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:17:32.190659 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.190620 2554 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-web-config\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:17:32.190659 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.190628 2554 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-metrics-client-ca\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:17:32.190659 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.190637 2554 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-tls-assets\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:17:32.190659 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.190647 2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:17:32.190659 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.190655 2554 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-config-out\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:17:32.190659 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.190664 2554 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-config-volume\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:17:32.191222 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.190671 2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:17:32.191222 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.190680 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tb5b\" (UniqueName: \"kubernetes.io/projected/ba4a6078-cb43-46ac-bd62-ef1796c6fd86-kube-api-access-7tb5b\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:17:32.351802 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.351766 2554 generic.go:356] "Generic (PLEG): container finished" podID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" containerID="139ae77fb290a04d994560f6a46facea96add5a7ef6dd924462b25d03cc95838" exitCode=0 Jul 15 13:17:32.351802 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.351797 2554 generic.go:356] "Generic (PLEG): container finished" podID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" containerID="3c055c561584a54e9e10d1dbf328d304cd4dd1665fb66278bbd01373fd53d005" exitCode=0 Jul 15 13:17:32.352031 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.351817 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba4a6078-cb43-46ac-bd62-ef1796c6fd86","Type":"ContainerDied","Data":"139ae77fb290a04d994560f6a46facea96add5a7ef6dd924462b25d03cc95838"} Jul 15 13:17:32.352031 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.351853 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.352031 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.351908 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba4a6078-cb43-46ac-bd62-ef1796c6fd86","Type":"ContainerDied","Data":"3c055c561584a54e9e10d1dbf328d304cd4dd1665fb66278bbd01373fd53d005"} Jul 15 13:17:32.352031 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.351937 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba4a6078-cb43-46ac-bd62-ef1796c6fd86","Type":"ContainerDied","Data":"a7dbfd63038b73997bf26793bfffce43c76767edf790e5749daebdb15720099b"} Jul 15 13:17:32.352031 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.351971 2554 scope.go:117] "RemoveContainer" containerID="b808e4ce9f94df16c9553015a8d9b3c93d528a7d9430019f1e389f707aafbb00" Jul 15 13:17:32.360088 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.359947 2554 scope.go:117] "RemoveContainer" containerID="139ae77fb290a04d994560f6a46facea96add5a7ef6dd924462b25d03cc95838" Jul 15 13:17:32.367279 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.367260 2554 scope.go:117] "RemoveContainer" containerID="a5088272a97f1716e361f43e266b57c7f7aac68b67c931066783c2b8e3ea7dfa" Jul 15 13:17:32.373791 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.373774 2554 scope.go:117] "RemoveContainer" containerID="3c055c561584a54e9e10d1dbf328d304cd4dd1665fb66278bbd01373fd53d005" Jul 15 13:17:32.378662 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.378627 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 13:17:32.381202 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.381151 2554 scope.go:117] "RemoveContainer" containerID="ff4c171e2dd360118b05415a7581e57f9070de526b708fdea435fe6067e67436" Jul 15 13:17:32.383391 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.383370 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 13:17:32.388562 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.388548 2554 scope.go:117] "RemoveContainer" containerID="cc16238c935ae1fb31e60ff4ffda93a451df0b005fd321c6deb3dd9cba6c8fc7" Jul 15 13:17:32.397489 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.397470 2554 scope.go:117] "RemoveContainer" containerID="f1560129b34fc5d0393710d4db239e7f072f90940442200b0b4dc0a741ddf448" Jul 15 13:17:32.404189 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.404171 2554 scope.go:117] "RemoveContainer" containerID="b808e4ce9f94df16c9553015a8d9b3c93d528a7d9430019f1e389f707aafbb00" Jul 15 13:17:32.404445 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:17:32.404429 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b808e4ce9f94df16c9553015a8d9b3c93d528a7d9430019f1e389f707aafbb00\": container with ID starting with b808e4ce9f94df16c9553015a8d9b3c93d528a7d9430019f1e389f707aafbb00 not found: ID does not exist" containerID="b808e4ce9f94df16c9553015a8d9b3c93d528a7d9430019f1e389f707aafbb00" Jul 15 13:17:32.404495 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.404456 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b808e4ce9f94df16c9553015a8d9b3c93d528a7d9430019f1e389f707aafbb00"} err="failed to get container status \"b808e4ce9f94df16c9553015a8d9b3c93d528a7d9430019f1e389f707aafbb00\": rpc error: code = NotFound desc = could not find container \"b808e4ce9f94df16c9553015a8d9b3c93d528a7d9430019f1e389f707aafbb00\": container with ID starting with b808e4ce9f94df16c9553015a8d9b3c93d528a7d9430019f1e389f707aafbb00 not found: ID does not exist" Jul 15 13:17:32.404495 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.404473 2554 scope.go:117] "RemoveContainer" containerID="139ae77fb290a04d994560f6a46facea96add5a7ef6dd924462b25d03cc95838" Jul 15 13:17:32.404723 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:17:32.404705 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"139ae77fb290a04d994560f6a46facea96add5a7ef6dd924462b25d03cc95838\": container with ID starting with 139ae77fb290a04d994560f6a46facea96add5a7ef6dd924462b25d03cc95838 not found: ID does not exist" containerID="139ae77fb290a04d994560f6a46facea96add5a7ef6dd924462b25d03cc95838" Jul 15 13:17:32.404772 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.404730 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"139ae77fb290a04d994560f6a46facea96add5a7ef6dd924462b25d03cc95838"} err="failed to get container status \"139ae77fb290a04d994560f6a46facea96add5a7ef6dd924462b25d03cc95838\": rpc error: code = NotFound desc = could not find container \"139ae77fb290a04d994560f6a46facea96add5a7ef6dd924462b25d03cc95838\": container with ID starting with 139ae77fb290a04d994560f6a46facea96add5a7ef6dd924462b25d03cc95838 not found: ID does not exist" Jul 15 13:17:32.404772 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.404752 2554 scope.go:117] "RemoveContainer" containerID="a5088272a97f1716e361f43e266b57c7f7aac68b67c931066783c2b8e3ea7dfa" Jul 15 13:17:32.404991 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:17:32.404964 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5088272a97f1716e361f43e266b57c7f7aac68b67c931066783c2b8e3ea7dfa\": container with ID starting with a5088272a97f1716e361f43e266b57c7f7aac68b67c931066783c2b8e3ea7dfa not found: ID does not exist" containerID="a5088272a97f1716e361f43e266b57c7f7aac68b67c931066783c2b8e3ea7dfa" Jul 15 13:17:32.405038 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.404995 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5088272a97f1716e361f43e266b57c7f7aac68b67c931066783c2b8e3ea7dfa"} err="failed to get container status \"a5088272a97f1716e361f43e266b57c7f7aac68b67c931066783c2b8e3ea7dfa\": rpc error: code = NotFound desc = could not find container \"a5088272a97f1716e361f43e266b57c7f7aac68b67c931066783c2b8e3ea7dfa\": container with ID starting with a5088272a97f1716e361f43e266b57c7f7aac68b67c931066783c2b8e3ea7dfa not found: ID does not exist" Jul 15 13:17:32.405038 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.405015 2554 scope.go:117] "RemoveContainer" containerID="3c055c561584a54e9e10d1dbf328d304cd4dd1665fb66278bbd01373fd53d005" Jul 15 13:17:32.405263 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:17:32.405221 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c055c561584a54e9e10d1dbf328d304cd4dd1665fb66278bbd01373fd53d005\": container with ID starting with 3c055c561584a54e9e10d1dbf328d304cd4dd1665fb66278bbd01373fd53d005 not found: ID does not exist" containerID="3c055c561584a54e9e10d1dbf328d304cd4dd1665fb66278bbd01373fd53d005" Jul 15 13:17:32.405309 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.405271 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c055c561584a54e9e10d1dbf328d304cd4dd1665fb66278bbd01373fd53d005"} err="failed to get container status \"3c055c561584a54e9e10d1dbf328d304cd4dd1665fb66278bbd01373fd53d005\": rpc error: code = NotFound desc = could not find container \"3c055c561584a54e9e10d1dbf328d304cd4dd1665fb66278bbd01373fd53d005\": container with ID starting with 3c055c561584a54e9e10d1dbf328d304cd4dd1665fb66278bbd01373fd53d005 not found: ID does not exist" Jul 15 13:17:32.405309 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.405290 2554 scope.go:117] "RemoveContainer" containerID="ff4c171e2dd360118b05415a7581e57f9070de526b708fdea435fe6067e67436" Jul 15 13:17:32.405488 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:17:32.405473 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff4c171e2dd360118b05415a7581e57f9070de526b708fdea435fe6067e67436\": container with ID starting with ff4c171e2dd360118b05415a7581e57f9070de526b708fdea435fe6067e67436 not found: ID does not exist" containerID="ff4c171e2dd360118b05415a7581e57f9070de526b708fdea435fe6067e67436" Jul 15 13:17:32.405527 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.405490 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff4c171e2dd360118b05415a7581e57f9070de526b708fdea435fe6067e67436"} err="failed to get container status \"ff4c171e2dd360118b05415a7581e57f9070de526b708fdea435fe6067e67436\": rpc error: code = NotFound desc = could not find container \"ff4c171e2dd360118b05415a7581e57f9070de526b708fdea435fe6067e67436\": container with ID starting with ff4c171e2dd360118b05415a7581e57f9070de526b708fdea435fe6067e67436 not found: ID does not exist" Jul 15 13:17:32.405527 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.405506 2554 scope.go:117] "RemoveContainer" containerID="cc16238c935ae1fb31e60ff4ffda93a451df0b005fd321c6deb3dd9cba6c8fc7" Jul 15 13:17:32.405724 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:17:32.405709 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc16238c935ae1fb31e60ff4ffda93a451df0b005fd321c6deb3dd9cba6c8fc7\": container with ID starting with cc16238c935ae1fb31e60ff4ffda93a451df0b005fd321c6deb3dd9cba6c8fc7 not found: ID does not exist" containerID="cc16238c935ae1fb31e60ff4ffda93a451df0b005fd321c6deb3dd9cba6c8fc7" Jul 15 13:17:32.405765 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.405727 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc16238c935ae1fb31e60ff4ffda93a451df0b005fd321c6deb3dd9cba6c8fc7"} err="failed to get container status \"cc16238c935ae1fb31e60ff4ffda93a451df0b005fd321c6deb3dd9cba6c8fc7\": rpc error: code = NotFound desc = could not find container \"cc16238c935ae1fb31e60ff4ffda93a451df0b005fd321c6deb3dd9cba6c8fc7\": container with ID starting with cc16238c935ae1fb31e60ff4ffda93a451df0b005fd321c6deb3dd9cba6c8fc7 not found: ID does not exist" Jul 15 13:17:32.405765 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.405740 2554 scope.go:117] "RemoveContainer" containerID="f1560129b34fc5d0393710d4db239e7f072f90940442200b0b4dc0a741ddf448" Jul 15 13:17:32.405962 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:17:32.405946 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1560129b34fc5d0393710d4db239e7f072f90940442200b0b4dc0a741ddf448\": container with ID starting with f1560129b34fc5d0393710d4db239e7f072f90940442200b0b4dc0a741ddf448 not found: ID does not exist" containerID="f1560129b34fc5d0393710d4db239e7f072f90940442200b0b4dc0a741ddf448" Jul 15 13:17:32.406029 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.405966 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1560129b34fc5d0393710d4db239e7f072f90940442200b0b4dc0a741ddf448"} err="failed to get container status \"f1560129b34fc5d0393710d4db239e7f072f90940442200b0b4dc0a741ddf448\": rpc error: code = NotFound desc = could not find container \"f1560129b34fc5d0393710d4db239e7f072f90940442200b0b4dc0a741ddf448\": container with ID starting with f1560129b34fc5d0393710d4db239e7f072f90940442200b0b4dc0a741ddf448 not found: ID does not exist" Jul 15 13:17:32.406029 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.405991 2554 scope.go:117] "RemoveContainer" containerID="b808e4ce9f94df16c9553015a8d9b3c93d528a7d9430019f1e389f707aafbb00" Jul 15 13:17:32.406158 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.406142 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b808e4ce9f94df16c9553015a8d9b3c93d528a7d9430019f1e389f707aafbb00"} err="failed to get container status \"b808e4ce9f94df16c9553015a8d9b3c93d528a7d9430019f1e389f707aafbb00\": rpc error: code = NotFound desc = could not find container \"b808e4ce9f94df16c9553015a8d9b3c93d528a7d9430019f1e389f707aafbb00\": container with ID starting with b808e4ce9f94df16c9553015a8d9b3c93d528a7d9430019f1e389f707aafbb00 not found: ID does not exist" Jul 15 13:17:32.406202 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.406158 2554 scope.go:117] "RemoveContainer" containerID="139ae77fb290a04d994560f6a46facea96add5a7ef6dd924462b25d03cc95838" Jul 15 13:17:32.406342 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.406327 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"139ae77fb290a04d994560f6a46facea96add5a7ef6dd924462b25d03cc95838"} err="failed to get container status \"139ae77fb290a04d994560f6a46facea96add5a7ef6dd924462b25d03cc95838\": rpc error: code = NotFound desc = could not find container \"139ae77fb290a04d994560f6a46facea96add5a7ef6dd924462b25d03cc95838\": container with ID starting with 139ae77fb290a04d994560f6a46facea96add5a7ef6dd924462b25d03cc95838 not found: ID does not exist" Jul 15 13:17:32.406389 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.406342 2554 scope.go:117] "RemoveContainer" containerID="a5088272a97f1716e361f43e266b57c7f7aac68b67c931066783c2b8e3ea7dfa" Jul 15 13:17:32.406569 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.406553 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5088272a97f1716e361f43e266b57c7f7aac68b67c931066783c2b8e3ea7dfa"} err="failed to get container status \"a5088272a97f1716e361f43e266b57c7f7aac68b67c931066783c2b8e3ea7dfa\": rpc error: code = NotFound desc = could not find container \"a5088272a97f1716e361f43e266b57c7f7aac68b67c931066783c2b8e3ea7dfa\": container with ID starting with a5088272a97f1716e361f43e266b57c7f7aac68b67c931066783c2b8e3ea7dfa not found: ID does not exist" Jul 15 13:17:32.406569 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.406569 2554 scope.go:117] "RemoveContainer" containerID="3c055c561584a54e9e10d1dbf328d304cd4dd1665fb66278bbd01373fd53d005" Jul 15 13:17:32.406822 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.406798 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c055c561584a54e9e10d1dbf328d304cd4dd1665fb66278bbd01373fd53d005"} err="failed to get container status \"3c055c561584a54e9e10d1dbf328d304cd4dd1665fb66278bbd01373fd53d005\": rpc error: code = NotFound desc = could not find container \"3c055c561584a54e9e10d1dbf328d304cd4dd1665fb66278bbd01373fd53d005\": container with ID starting with 3c055c561584a54e9e10d1dbf328d304cd4dd1665fb66278bbd01373fd53d005 not found: ID does not exist" Jul 15 13:17:32.406822 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.406821 2554 scope.go:117] "RemoveContainer" containerID="ff4c171e2dd360118b05415a7581e57f9070de526b708fdea435fe6067e67436" Jul 15 13:17:32.407180 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.407153 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff4c171e2dd360118b05415a7581e57f9070de526b708fdea435fe6067e67436"} err="failed to get container status \"ff4c171e2dd360118b05415a7581e57f9070de526b708fdea435fe6067e67436\": rpc error: code = NotFound desc = could not find container \"ff4c171e2dd360118b05415a7581e57f9070de526b708fdea435fe6067e67436\": container with ID starting with ff4c171e2dd360118b05415a7581e57f9070de526b708fdea435fe6067e67436 not found: ID does not exist" Jul 15 13:17:32.407180 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.407180 2554 scope.go:117] "RemoveContainer" containerID="cc16238c935ae1fb31e60ff4ffda93a451df0b005fd321c6deb3dd9cba6c8fc7" Jul 15 13:17:32.407620 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.407594 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc16238c935ae1fb31e60ff4ffda93a451df0b005fd321c6deb3dd9cba6c8fc7"} err="failed to get container status \"cc16238c935ae1fb31e60ff4ffda93a451df0b005fd321c6deb3dd9cba6c8fc7\": rpc error: code = NotFound desc = could not find container \"cc16238c935ae1fb31e60ff4ffda93a451df0b005fd321c6deb3dd9cba6c8fc7\": container with ID starting with cc16238c935ae1fb31e60ff4ffda93a451df0b005fd321c6deb3dd9cba6c8fc7 not found: ID does not exist" Jul 15 13:17:32.407695 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.407623 2554 scope.go:117] "RemoveContainer" containerID="f1560129b34fc5d0393710d4db239e7f072f90940442200b0b4dc0a741ddf448" Jul 15 13:17:32.407855 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.407840 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1560129b34fc5d0393710d4db239e7f072f90940442200b0b4dc0a741ddf448"} err="failed to get container status \"f1560129b34fc5d0393710d4db239e7f072f90940442200b0b4dc0a741ddf448\": rpc error: code = NotFound desc = could not find container \"f1560129b34fc5d0393710d4db239e7f072f90940442200b0b4dc0a741ddf448\": container with ID starting with f1560129b34fc5d0393710d4db239e7f072f90940442200b0b4dc0a741ddf448 not found: ID does not exist" Jul 15 13:17:32.417252 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.417232 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 13:17:32.417487 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.417475 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd1ff280-e5e4-4ed0-8895-f5b998f59185" containerName="console" Jul 15 13:17:32.417536 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.417488 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd1ff280-e5e4-4ed0-8895-f5b998f59185" containerName="console" Jul 15 13:17:32.417536 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.417496 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" containerName="init-config-reloader" Jul 15 13:17:32.417536 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.417501 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" containerName="init-config-reloader" Jul 15 13:17:32.417536 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.417511 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" containerName="prom-label-proxy" Jul 15 13:17:32.417536 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.417517 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" containerName="prom-label-proxy" Jul 15 13:17:32.417536 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.417524 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" containerName="kube-rbac-proxy" Jul 15 13:17:32.417536 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.417529 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" containerName="kube-rbac-proxy" Jul 15 13:17:32.417536 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.417539 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" containerName="config-reloader" Jul 15 13:17:32.417754 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.417544 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" containerName="config-reloader" Jul 15 13:17:32.417754 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.417555 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" containerName="kube-rbac-proxy-metric" Jul 15 13:17:32.417754 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.417560 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" containerName="kube-rbac-proxy-metric" Jul 15 13:17:32.417754 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.417567 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" containerName="kube-rbac-proxy-web" Jul 15 13:17:32.417754 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.417572 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" containerName="kube-rbac-proxy-web" Jul 15 13:17:32.417754 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.417581 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" containerName="alertmanager" Jul 15 13:17:32.417754 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.417585 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" containerName="alertmanager" Jul 15 13:17:32.417754 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.417628 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" containerName="kube-rbac-proxy-metric" Jul 15 13:17:32.417754 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.417636 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" containerName="alertmanager" Jul 15 13:17:32.417754 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.417641 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" containerName="kube-rbac-proxy" Jul 15 13:17:32.417754 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.417646 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" containerName="kube-rbac-proxy-web" Jul 15 13:17:32.417754 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.417652 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" containerName="config-reloader" Jul 15 13:17:32.417754 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.417658 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd1ff280-e5e4-4ed0-8895-f5b998f59185" containerName="console" Jul 15 13:17:32.417754 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.417663 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" containerName="prom-label-proxy" Jul 15 13:17:32.421405 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.421390 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.424099 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.424082 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 15 13:17:32.424099 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.424089 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qql8k\"" Jul 15 13:17:32.424336 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.424320 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 15 13:17:32.424400 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.424339 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 15 13:17:32.424400 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.424321 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 15 13:17:32.424624 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.424609 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 15 13:17:32.424898 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.424882 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 15 13:17:32.424898 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.424895 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 15 13:17:32.425868 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.425848 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 15 13:17:32.429901 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.429869 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 15 13:17:32.441724 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.441666 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 13:17:32.494204 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.494168 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2d18bf33-382d-478f-99db-1536bbcddd41-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.494204 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.494202 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2d18bf33-382d-478f-99db-1536bbcddd41-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.494419 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.494235 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d18bf33-382d-478f-99db-1536bbcddd41-config-out\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.494419 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.494254 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2d18bf33-382d-478f-99db-1536bbcddd41-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.494419 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.494303 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lq58\" (UniqueName: \"kubernetes.io/projected/2d18bf33-382d-478f-99db-1536bbcddd41-kube-api-access-6lq58\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.494419 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.494325 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d18bf33-382d-478f-99db-1536bbcddd41-web-config\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.494419 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.494344 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2d18bf33-382d-478f-99db-1536bbcddd41-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.494419 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.494375 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d18bf33-382d-478f-99db-1536bbcddd41-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.494419 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.494411 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d18bf33-382d-478f-99db-1536bbcddd41-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.494716 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.494472 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2d18bf33-382d-478f-99db-1536bbcddd41-config-volume\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.494716 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.494522 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d18bf33-382d-478f-99db-1536bbcddd41-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.494716 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.494552 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d18bf33-382d-478f-99db-1536bbcddd41-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.494716 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.494580 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d18bf33-382d-478f-99db-1536bbcddd41-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.595116 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.595085 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d18bf33-382d-478f-99db-1536bbcddd41-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.595116 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.595120 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d18bf33-382d-478f-99db-1536bbcddd41-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.595351 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.595137 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2d18bf33-382d-478f-99db-1536bbcddd41-config-volume\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.595351 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.595187 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d18bf33-382d-478f-99db-1536bbcddd41-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.595351 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.595218 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d18bf33-382d-478f-99db-1536bbcddd41-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.595351 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.595239 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d18bf33-382d-478f-99db-1536bbcddd41-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.595351 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.595283 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2d18bf33-382d-478f-99db-1536bbcddd41-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.595602 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.595396 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2d18bf33-382d-478f-99db-1536bbcddd41-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.595602 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.595461 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d18bf33-382d-478f-99db-1536bbcddd41-config-out\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.595602 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.595491 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2d18bf33-382d-478f-99db-1536bbcddd41-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.595602 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.595545 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lq58\" (UniqueName: \"kubernetes.io/projected/2d18bf33-382d-478f-99db-1536bbcddd41-kube-api-access-6lq58\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.595602 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.595567 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d18bf33-382d-478f-99db-1536bbcddd41-web-config\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.595848 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.595607 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2d18bf33-382d-478f-99db-1536bbcddd41-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.596236 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.596210 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d18bf33-382d-478f-99db-1536bbcddd41-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.596826 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.596800 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d18bf33-382d-478f-99db-1536bbcddd41-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.597420 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.597394 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2d18bf33-382d-478f-99db-1536bbcddd41-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.598335 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.598298 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2d18bf33-382d-478f-99db-1536bbcddd41-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.598335 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.598323 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2d18bf33-382d-478f-99db-1536bbcddd41-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.598335 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.598328 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2d18bf33-382d-478f-99db-1536bbcddd41-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.598539 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.598448 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2d18bf33-382d-478f-99db-1536bbcddd41-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.598539 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.598492 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2d18bf33-382d-478f-99db-1536bbcddd41-config-volume\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.598638 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.598534 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2d18bf33-382d-478f-99db-1536bbcddd41-config-out\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.598638 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.598583 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2d18bf33-382d-478f-99db-1536bbcddd41-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.599574 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.599555 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2d18bf33-382d-478f-99db-1536bbcddd41-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.600129 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.600112 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2d18bf33-382d-478f-99db-1536bbcddd41-web-config\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.605921 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.605897 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lq58\" (UniqueName: \"kubernetes.io/projected/2d18bf33-382d-478f-99db-1536bbcddd41-kube-api-access-6lq58\") pod \"alertmanager-main-0\" (UID: \"2d18bf33-382d-478f-99db-1536bbcddd41\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.732781 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.732757 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 13:17:32.865166 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:32.865139 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 13:17:32.868863 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:17:32.868819 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d18bf33_382d_478f_99db_1536bbcddd41.slice/crio-697b4864053fa415c2704db535ba1871d871fff54ffbee698a923a8117a80dea WatchSource:0}: Error finding container 697b4864053fa415c2704db535ba1871d871fff54ffbee698a923a8117a80dea: Status 404 returned error can't find the container with id 697b4864053fa415c2704db535ba1871d871fff54ffbee698a923a8117a80dea Jul 15 13:17:33.136618 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:33.136540 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba4a6078-cb43-46ac-bd62-ef1796c6fd86" path="/var/lib/kubelet/pods/ba4a6078-cb43-46ac-bd62-ef1796c6fd86/volumes" Jul 15 13:17:33.357732 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:33.357698 2554 generic.go:356] "Generic (PLEG): container finished" podID="2d18bf33-382d-478f-99db-1536bbcddd41" containerID="2734269225e37f683b3d003c24468722656be06d44f0fe3f34511fb163cf9c1a" exitCode=0 Jul 15 13:17:33.357914 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:33.357786 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d18bf33-382d-478f-99db-1536bbcddd41","Type":"ContainerDied","Data":"2734269225e37f683b3d003c24468722656be06d44f0fe3f34511fb163cf9c1a"} Jul 15 13:17:33.357914 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:33.357848 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d18bf33-382d-478f-99db-1536bbcddd41","Type":"ContainerStarted","Data":"697b4864053fa415c2704db535ba1871d871fff54ffbee698a923a8117a80dea"} Jul 15 13:17:34.365462 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:34.365428 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d18bf33-382d-478f-99db-1536bbcddd41","Type":"ContainerStarted","Data":"91f86be5f8a169abdefcf8758bfafa7bf43d2c731c6f649e0c33927c339dcbd3"} Jul 15 13:17:34.365803 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:34.365521 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d18bf33-382d-478f-99db-1536bbcddd41","Type":"ContainerStarted","Data":"6d8514aff7c8267b9b984af46414e1948d4d351110219bd43897e00d53eb7307"} Jul 15 13:17:34.365803 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:34.365550 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d18bf33-382d-478f-99db-1536bbcddd41","Type":"ContainerStarted","Data":"4b4c3b5b8783750c0b3f438976f0af26329b5282f33768e113df746c66f3d6cd"} Jul 15 13:17:34.365803 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:34.365584 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d18bf33-382d-478f-99db-1536bbcddd41","Type":"ContainerStarted","Data":"1cefce0aa006269ba80937156a05d73bfc2242e0a118a45ebf8dc8bb462875f2"} Jul 15 13:17:34.365803 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:34.365621 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d18bf33-382d-478f-99db-1536bbcddd41","Type":"ContainerStarted","Data":"d710dba43daa37e096ae405c9dc431d9c730bcf033d1c9ea5b6677d88d1e6abd"} Jul 15 13:17:34.365803 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:34.365647 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2d18bf33-382d-478f-99db-1536bbcddd41","Type":"ContainerStarted","Data":"29d9b7aa5e4c892f1f6c95ff2ee76deed5a0a2ec199b96e595b0fbe479a17dee"} Jul 15 13:17:34.402224 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:34.402170 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.3860773330000002 podStartE2EDuration="2.402154502s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.077169ms" isStatefulPod=false podCreationTimestamp="2026-07-15 13:17:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:17:34.40193091 +0000 UTC m=+367.832740484" watchObservedRunningTime="2026-07-15 13:17:34.402154502 +0000 UTC m=+367.832964076" Jul 15 13:17:35.194445 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:35.194361 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 13:17:35.194663 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:35.194626 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="253a7d80-fd15-47b2-aad6-a21b4c313af0" containerName="prometheus" containerID="cri-o://08fed2e3994c3c9f991416676ed91309e868652e9fca55a07fe40843551c6b1d" gracePeriod=600 Jul 15 13:17:35.194748 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:35.194648 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="253a7d80-fd15-47b2-aad6-a21b4c313af0" containerName="kube-rbac-proxy" containerID="cri-o://2eb83d7d372b78e658bbf184a7b80055c746e3e3df60731a14241679af5418cb" gracePeriod=600 Jul 15 13:17:35.194748 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:35.194681 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="253a7d80-fd15-47b2-aad6-a21b4c313af0" containerName="kube-rbac-proxy-web" containerID="cri-o://f3a04a98d73e6bbc89e00cf3c24a4747ba7a1fb6a391f35b736987853196930b" gracePeriod=600 Jul 15 13:17:35.194748 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:35.194685 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="253a7d80-fd15-47b2-aad6-a21b4c313af0" containerName="config-reloader" containerID="cri-o://f2f538b50235d0d02802d2ba5fb9178c13510976fcc6e2e91ea139d0423f95ef" gracePeriod=600 Jul 15 13:17:35.194893 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:35.194721 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="253a7d80-fd15-47b2-aad6-a21b4c313af0" containerName="thanos-sidecar" containerID="cri-o://6772d5b2d29f7974832135e6d237f250592254d0df6dd80a383ceba982305dec" gracePeriod=600 Jul 15 13:17:35.194893 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:35.194727 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="253a7d80-fd15-47b2-aad6-a21b4c313af0" containerName="kube-rbac-proxy-thanos" containerID="cri-o://29af533b3db1e36a360bbfe42bfe20dee0c92f31ddd58fea1d00ba3159bcd233" gracePeriod=600 Jul 15 13:17:35.373356 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:35.373325 2554 generic.go:356] "Generic (PLEG): container finished" podID="253a7d80-fd15-47b2-aad6-a21b4c313af0" containerID="29af533b3db1e36a360bbfe42bfe20dee0c92f31ddd58fea1d00ba3159bcd233" exitCode=0 Jul 15 13:17:35.373356 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:35.373351 2554 generic.go:356] "Generic (PLEG): container finished" podID="253a7d80-fd15-47b2-aad6-a21b4c313af0" containerID="2eb83d7d372b78e658bbf184a7b80055c746e3e3df60731a14241679af5418cb" exitCode=0 Jul 15 13:17:35.373356 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:35.373360 2554 generic.go:356] "Generic (PLEG): container finished" podID="253a7d80-fd15-47b2-aad6-a21b4c313af0" containerID="6772d5b2d29f7974832135e6d237f250592254d0df6dd80a383ceba982305dec" exitCode=0 Jul 15 13:17:35.373817 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:35.373365 2554 generic.go:356] "Generic (PLEG): container finished" podID="253a7d80-fd15-47b2-aad6-a21b4c313af0" containerID="f2f538b50235d0d02802d2ba5fb9178c13510976fcc6e2e91ea139d0423f95ef" exitCode=0 Jul 15 13:17:35.373817 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:35.373371 2554 generic.go:356] "Generic (PLEG): container finished" podID="253a7d80-fd15-47b2-aad6-a21b4c313af0" containerID="08fed2e3994c3c9f991416676ed91309e868652e9fca55a07fe40843551c6b1d" exitCode=0 Jul 15 13:17:35.373817 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:35.373403 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"253a7d80-fd15-47b2-aad6-a21b4c313af0","Type":"ContainerDied","Data":"29af533b3db1e36a360bbfe42bfe20dee0c92f31ddd58fea1d00ba3159bcd233"} Jul 15 13:17:35.373817 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:35.373491 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"253a7d80-fd15-47b2-aad6-a21b4c313af0","Type":"ContainerDied","Data":"2eb83d7d372b78e658bbf184a7b80055c746e3e3df60731a14241679af5418cb"} Jul 15 13:17:35.373817 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:35.373532 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"253a7d80-fd15-47b2-aad6-a21b4c313af0","Type":"ContainerDied","Data":"6772d5b2d29f7974832135e6d237f250592254d0df6dd80a383ceba982305dec"} Jul 15 13:17:35.373817 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:35.373570 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"253a7d80-fd15-47b2-aad6-a21b4c313af0","Type":"ContainerDied","Data":"f2f538b50235d0d02802d2ba5fb9178c13510976fcc6e2e91ea139d0423f95ef"} Jul 15 13:17:35.373817 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:35.373611 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"253a7d80-fd15-47b2-aad6-a21b4c313af0","Type":"ContainerDied","Data":"08fed2e3994c3c9f991416676ed91309e868652e9fca55a07fe40843551c6b1d"} Jul 15 13:17:36.381797 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.381770 2554 generic.go:356] "Generic (PLEG): container finished" podID="253a7d80-fd15-47b2-aad6-a21b4c313af0" containerID="f3a04a98d73e6bbc89e00cf3c24a4747ba7a1fb6a391f35b736987853196930b" exitCode=0 Jul 15 13:17:36.382153 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.381838 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"253a7d80-fd15-47b2-aad6-a21b4c313af0","Type":"ContainerDied","Data":"f3a04a98d73e6bbc89e00cf3c24a4747ba7a1fb6a391f35b736987853196930b"} Jul 15 13:17:36.442905 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.442879 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:36.527602 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.527515 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-prometheus-k8s-rulefiles-1\") pod \"253a7d80-fd15-47b2-aad6-a21b4c313af0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " Jul 15 13:17:36.527602 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.527552 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-prometheus-k8s-rulefiles-0\") pod \"253a7d80-fd15-47b2-aad6-a21b4c313af0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " Jul 15 13:17:36.527602 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.527573 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-kube-rbac-proxy\") pod \"253a7d80-fd15-47b2-aad6-a21b4c313af0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " Jul 15 13:17:36.527602 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.527597 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/253a7d80-fd15-47b2-aad6-a21b4c313af0-config-out\") pod \"253a7d80-fd15-47b2-aad6-a21b4c313af0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " Jul 15 13:17:36.527927 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.527624 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-configmap-kubelet-serving-ca-bundle\") pod \"253a7d80-fd15-47b2-aad6-a21b4c313af0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " Jul 15 13:17:36.527927 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.527647 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-config\") pod \"253a7d80-fd15-47b2-aad6-a21b4c313af0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " Jul 15 13:17:36.528051 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.527922 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"253a7d80-fd15-47b2-aad6-a21b4c313af0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " Jul 15 13:17:36.528051 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.527966 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-metrics-client-certs\") pod \"253a7d80-fd15-47b2-aad6-a21b4c313af0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " Jul 15 13:17:36.528051 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.527998 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "253a7d80-fd15-47b2-aad6-a21b4c313af0" (UID: "253a7d80-fd15-47b2-aad6-a21b4c313af0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:17:36.528051 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.528010 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/253a7d80-fd15-47b2-aad6-a21b4c313af0-prometheus-k8s-db\") pod \"253a7d80-fd15-47b2-aad6-a21b4c313af0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " Jul 15 13:17:36.528236 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.528068 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-prometheus-k8s-tls\") pod \"253a7d80-fd15-47b2-aad6-a21b4c313af0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " Jul 15 13:17:36.528236 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.528111 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-prometheus-k8s-rulefiles-2\") pod \"253a7d80-fd15-47b2-aad6-a21b4c313af0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " Jul 15 13:17:36.528236 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.528152 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/253a7d80-fd15-47b2-aad6-a21b4c313af0-tls-assets\") pod \"253a7d80-fd15-47b2-aad6-a21b4c313af0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " Jul 15 13:17:36.528379 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.528184 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-web-config\") pod \"253a7d80-fd15-47b2-aad6-a21b4c313af0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " Jul 15 13:17:36.528379 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.528283 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-configmap-serving-certs-ca-bundle\") pod \"253a7d80-fd15-47b2-aad6-a21b4c313af0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " Jul 15 13:17:36.528379 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.528320 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8r96s\" (UniqueName: \"kubernetes.io/projected/253a7d80-fd15-47b2-aad6-a21b4c313af0-kube-api-access-8r96s\") pod \"253a7d80-fd15-47b2-aad6-a21b4c313af0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " Jul 15 13:17:36.528379 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.528352 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"253a7d80-fd15-47b2-aad6-a21b4c313af0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " Jul 15 13:17:36.528567 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.528404 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-configmap-metrics-client-ca\") pod \"253a7d80-fd15-47b2-aad6-a21b4c313af0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " Jul 15 13:17:36.528567 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.528437 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-thanos-prometheus-http-client-file\") pod \"253a7d80-fd15-47b2-aad6-a21b4c313af0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " Jul 15 13:17:36.528567 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.528478 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-prometheus-trusted-ca-bundle\") pod \"253a7d80-fd15-47b2-aad6-a21b4c313af0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " Jul 15 13:17:36.528567 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.528518 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-grpc-tls\") pod \"253a7d80-fd15-47b2-aad6-a21b4c313af0\" (UID: \"253a7d80-fd15-47b2-aad6-a21b4c313af0\") " Jul 15 13:17:36.528939 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.528770 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:17:36.530279 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.529108 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "253a7d80-fd15-47b2-aad6-a21b4c313af0" (UID: "253a7d80-fd15-47b2-aad6-a21b4c313af0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:17:36.530279 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.529146 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "253a7d80-fd15-47b2-aad6-a21b4c313af0" (UID: "253a7d80-fd15-47b2-aad6-a21b4c313af0"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:17:36.530279 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.529596 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "253a7d80-fd15-47b2-aad6-a21b4c313af0" (UID: "253a7d80-fd15-47b2-aad6-a21b4c313af0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:17:36.530279 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.529856 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "253a7d80-fd15-47b2-aad6-a21b4c313af0" (UID: "253a7d80-fd15-47b2-aad6-a21b4c313af0"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:17:36.530279 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.530097 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "253a7d80-fd15-47b2-aad6-a21b4c313af0" (UID: "253a7d80-fd15-47b2-aad6-a21b4c313af0"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:17:36.530279 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.530174 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "253a7d80-fd15-47b2-aad6-a21b4c313af0" (UID: "253a7d80-fd15-47b2-aad6-a21b4c313af0"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:17:36.531541 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.531506 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/253a7d80-fd15-47b2-aad6-a21b4c313af0-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "253a7d80-fd15-47b2-aad6-a21b4c313af0" (UID: "253a7d80-fd15-47b2-aad6-a21b4c313af0"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:17:36.532524 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.532491 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "253a7d80-fd15-47b2-aad6-a21b4c313af0" (UID: "253a7d80-fd15-47b2-aad6-a21b4c313af0"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:17:36.532913 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.532889 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "253a7d80-fd15-47b2-aad6-a21b4c313af0" (UID: "253a7d80-fd15-47b2-aad6-a21b4c313af0"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:17:36.533015 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.532921 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "253a7d80-fd15-47b2-aad6-a21b4c313af0" (UID: "253a7d80-fd15-47b2-aad6-a21b4c313af0"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:17:36.533015 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.532970 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/253a7d80-fd15-47b2-aad6-a21b4c313af0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "253a7d80-fd15-47b2-aad6-a21b4c313af0" (UID: "253a7d80-fd15-47b2-aad6-a21b4c313af0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:17:36.533137 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.533011 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "253a7d80-fd15-47b2-aad6-a21b4c313af0" (UID: "253a7d80-fd15-47b2-aad6-a21b4c313af0"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:17:36.533137 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.533076 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-config" (OuterVolumeSpecName: "config") pod "253a7d80-fd15-47b2-aad6-a21b4c313af0" (UID: "253a7d80-fd15-47b2-aad6-a21b4c313af0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:17:36.533407 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.533381 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "253a7d80-fd15-47b2-aad6-a21b4c313af0" (UID: "253a7d80-fd15-47b2-aad6-a21b4c313af0"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:17:36.533614 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.533588 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/253a7d80-fd15-47b2-aad6-a21b4c313af0-kube-api-access-8r96s" (OuterVolumeSpecName: "kube-api-access-8r96s") pod "253a7d80-fd15-47b2-aad6-a21b4c313af0" (UID: "253a7d80-fd15-47b2-aad6-a21b4c313af0"). InnerVolumeSpecName "kube-api-access-8r96s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:17:36.533750 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.533725 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "253a7d80-fd15-47b2-aad6-a21b4c313af0" (UID: "253a7d80-fd15-47b2-aad6-a21b4c313af0"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:17:36.534102 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.534078 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/253a7d80-fd15-47b2-aad6-a21b4c313af0-config-out" (OuterVolumeSpecName: "config-out") pod "253a7d80-fd15-47b2-aad6-a21b4c313af0" (UID: "253a7d80-fd15-47b2-aad6-a21b4c313af0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:17:36.534102 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.534083 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "253a7d80-fd15-47b2-aad6-a21b4c313af0" (UID: "253a7d80-fd15-47b2-aad6-a21b4c313af0"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:17:36.543779 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.543757 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-web-config" (OuterVolumeSpecName: "web-config") pod "253a7d80-fd15-47b2-aad6-a21b4c313af0" (UID: "253a7d80-fd15-47b2-aad6-a21b4c313af0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 13:17:36.629372 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.629339 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:17:36.629372 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.629365 2554 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-kube-rbac-proxy\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:17:36.629372 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.629375 2554 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/253a7d80-fd15-47b2-aad6-a21b4c313af0-config-out\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:17:36.629586 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.629384 2554 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:17:36.629586 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.629393 2554 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-config\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:17:36.629586 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.629403 2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:17:36.629586 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.629412 2554 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-metrics-client-certs\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:17:36.629586 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.629420 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/253a7d80-fd15-47b2-aad6-a21b4c313af0-prometheus-k8s-db\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:17:36.629586 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.629428 2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:17:36.629586 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.629436 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:17:36.629586 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.629443 2554 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/253a7d80-fd15-47b2-aad6-a21b4c313af0-tls-assets\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:17:36.629586 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.629451 2554 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-web-config\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:17:36.629586 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.629460 2554 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:17:36.629586 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.629469 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8r96s\" (UniqueName: \"kubernetes.io/projected/253a7d80-fd15-47b2-aad6-a21b4c313af0-kube-api-access-8r96s\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:17:36.629586 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.629476 2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:17:36.629586 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.629485 2554 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-configmap-metrics-client-ca\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:17:36.629586 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.629493 2554 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:17:36.629586 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.629503 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/253a7d80-fd15-47b2-aad6-a21b4c313af0-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:17:36.629586 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.629511 2554 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/253a7d80-fd15-47b2-aad6-a21b4c313af0-secret-grpc-tls\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:17:36.732093 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.732060 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:17:36.803089 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:36.803003 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:17:37.388819 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.388783 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"253a7d80-fd15-47b2-aad6-a21b4c313af0","Type":"ContainerDied","Data":"6c750bfb00ebd929be92efff106a16d22a179f70cf6f57aa84457ae0ab77557a"} Jul 15 13:17:37.389213 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.388826 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.389213 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.388855 2554 scope.go:117] "RemoveContainer" containerID="29af533b3db1e36a360bbfe42bfe20dee0c92f31ddd58fea1d00ba3159bcd233" Jul 15 13:17:37.396221 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.396183 2554 scope.go:117] "RemoveContainer" containerID="2eb83d7d372b78e658bbf184a7b80055c746e3e3df60731a14241679af5418cb" Jul 15 13:17:37.402831 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.402798 2554 scope.go:117] "RemoveContainer" containerID="f3a04a98d73e6bbc89e00cf3c24a4747ba7a1fb6a391f35b736987853196930b" Jul 15 13:17:37.411083 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.411063 2554 scope.go:117] "RemoveContainer" containerID="6772d5b2d29f7974832135e6d237f250592254d0df6dd80a383ceba982305dec" Jul 15 13:17:37.417451 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.417434 2554 scope.go:117] "RemoveContainer" containerID="f2f538b50235d0d02802d2ba5fb9178c13510976fcc6e2e91ea139d0423f95ef" Jul 15 13:17:37.420156 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.420132 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 13:17:37.424117 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.424106 2554 scope.go:117] "RemoveContainer" containerID="08fed2e3994c3c9f991416676ed91309e868652e9fca55a07fe40843551c6b1d" Jul 15 13:17:37.429032 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.429012 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 13:17:37.431380 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.431368 2554 scope.go:117] "RemoveContainer" containerID="ccc871253699df457ed3bd24dcea2e1ee922ded19b58076a6691c60189ac6ea7" Jul 15 13:17:37.466317 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.466292 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 13:17:37.466551 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.466541 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="253a7d80-fd15-47b2-aad6-a21b4c313af0" containerName="config-reloader" Jul 15 13:17:37.466605 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.466554 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="253a7d80-fd15-47b2-aad6-a21b4c313af0" containerName="config-reloader" Jul 15 13:17:37.466605 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.466567 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="253a7d80-fd15-47b2-aad6-a21b4c313af0" containerName="init-config-reloader" Jul 15 13:17:37.466605 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.466572 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="253a7d80-fd15-47b2-aad6-a21b4c313af0" containerName="init-config-reloader" Jul 15 13:17:37.466605 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.466586 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="253a7d80-fd15-47b2-aad6-a21b4c313af0" containerName="prometheus" Jul 15 13:17:37.466605 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.466592 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="253a7d80-fd15-47b2-aad6-a21b4c313af0" containerName="prometheus" Jul 15 13:17:37.466605 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.466597 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="253a7d80-fd15-47b2-aad6-a21b4c313af0" containerName="thanos-sidecar" Jul 15 13:17:37.466605 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.466602 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="253a7d80-fd15-47b2-aad6-a21b4c313af0" containerName="thanos-sidecar" Jul 15 13:17:37.466605 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.466607 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="253a7d80-fd15-47b2-aad6-a21b4c313af0" containerName="kube-rbac-proxy" Jul 15 13:17:37.466810 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.466614 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="253a7d80-fd15-47b2-aad6-a21b4c313af0" containerName="kube-rbac-proxy" Jul 15 13:17:37.466810 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.466622 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="253a7d80-fd15-47b2-aad6-a21b4c313af0" containerName="kube-rbac-proxy-thanos" Jul 15 13:17:37.466810 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.466627 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="253a7d80-fd15-47b2-aad6-a21b4c313af0" containerName="kube-rbac-proxy-thanos" Jul 15 13:17:37.466810 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.466633 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="253a7d80-fd15-47b2-aad6-a21b4c313af0" containerName="kube-rbac-proxy-web" Jul 15 13:17:37.466810 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.466638 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="253a7d80-fd15-47b2-aad6-a21b4c313af0" containerName="kube-rbac-proxy-web" Jul 15 13:17:37.466810 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.466679 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="253a7d80-fd15-47b2-aad6-a21b4c313af0" containerName="prometheus" Jul 15 13:17:37.466810 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.466686 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="253a7d80-fd15-47b2-aad6-a21b4c313af0" containerName="config-reloader" Jul 15 13:17:37.466810 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.466691 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="253a7d80-fd15-47b2-aad6-a21b4c313af0" containerName="kube-rbac-proxy" Jul 15 13:17:37.466810 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.466697 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="253a7d80-fd15-47b2-aad6-a21b4c313af0" containerName="thanos-sidecar" Jul 15 13:17:37.466810 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.466702 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="253a7d80-fd15-47b2-aad6-a21b4c313af0" containerName="kube-rbac-proxy-thanos" Jul 15 13:17:37.466810 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.466708 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="253a7d80-fd15-47b2-aad6-a21b4c313af0" containerName="kube-rbac-proxy-web" Jul 15 13:17:37.470280 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.470264 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.475544 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.475501 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 15 13:17:37.475544 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.475526 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-972mv\"" Jul 15 13:17:37.475731 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.475526 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 15 13:17:37.475731 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.475662 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 15 13:17:37.475731 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.475681 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 15 13:17:37.476483 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.476464 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 15 13:17:37.476617 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.476522 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 15 13:17:37.476759 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.476739 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 15 13:17:37.476948 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.476933 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 15 13:17:37.477408 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.477390 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 15 13:17:37.479741 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.479719 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 15 13:17:37.479828 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.479760 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 15 13:17:37.480150 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.480131 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 15 13:17:37.480291 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.480276 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a80g60ok6rb6e\"" Jul 15 13:17:37.480404 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.480388 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 15 13:17:37.481872 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.481856 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 15 13:17:37.485594 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.485578 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 15 13:17:37.495519 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.495497 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 13:17:37.534923 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.534891 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33386959-b02a-4445-a367-a1b3a5ac2509-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.534923 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.534924 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/33386959-b02a-4445-a367-a1b3a5ac2509-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.535110 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.534950 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/33386959-b02a-4445-a367-a1b3a5ac2509-config\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.535110 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.535037 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33386959-b02a-4445-a367-a1b3a5ac2509-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.535110 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.535065 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33386959-b02a-4445-a367-a1b3a5ac2509-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.535110 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.535090 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/33386959-b02a-4445-a367-a1b3a5ac2509-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.535332 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.535134 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlghv\" (UniqueName: \"kubernetes.io/projected/33386959-b02a-4445-a367-a1b3a5ac2509-kube-api-access-vlghv\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.535332 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.535161 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/33386959-b02a-4445-a367-a1b3a5ac2509-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.535332 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.535198 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/33386959-b02a-4445-a367-a1b3a5ac2509-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.535332 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.535226 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/33386959-b02a-4445-a367-a1b3a5ac2509-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.535332 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.535265 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/33386959-b02a-4445-a367-a1b3a5ac2509-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.535332 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.535290 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/33386959-b02a-4445-a367-a1b3a5ac2509-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.535542 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.535341 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33386959-b02a-4445-a367-a1b3a5ac2509-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.535542 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.535360 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/33386959-b02a-4445-a367-a1b3a5ac2509-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.535542 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.535382 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/33386959-b02a-4445-a367-a1b3a5ac2509-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.535542 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.535407 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/33386959-b02a-4445-a367-a1b3a5ac2509-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.535542 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.535422 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/33386959-b02a-4445-a367-a1b3a5ac2509-web-config\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.535542 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.535437 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/33386959-b02a-4445-a367-a1b3a5ac2509-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.535542 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.535454 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/33386959-b02a-4445-a367-a1b3a5ac2509-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.535542 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.535475 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/33386959-b02a-4445-a367-a1b3a5ac2509-config-out\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.636281 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.636231 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33386959-b02a-4445-a367-a1b3a5ac2509-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.636281 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.636287 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/33386959-b02a-4445-a367-a1b3a5ac2509-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.636478 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.636314 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/33386959-b02a-4445-a367-a1b3a5ac2509-config\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.636478 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.636339 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33386959-b02a-4445-a367-a1b3a5ac2509-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.636478 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.636361 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33386959-b02a-4445-a367-a1b3a5ac2509-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.636478 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.636390 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/33386959-b02a-4445-a367-a1b3a5ac2509-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.636478 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.636420 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlghv\" (UniqueName: \"kubernetes.io/projected/33386959-b02a-4445-a367-a1b3a5ac2509-kube-api-access-vlghv\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.636478 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.636449 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/33386959-b02a-4445-a367-a1b3a5ac2509-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.636754 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.636487 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/33386959-b02a-4445-a367-a1b3a5ac2509-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.636754 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.636516 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/33386959-b02a-4445-a367-a1b3a5ac2509-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.636754 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.636560 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/33386959-b02a-4445-a367-a1b3a5ac2509-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.636754 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.636594 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/33386959-b02a-4445-a367-a1b3a5ac2509-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.636754 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.636643 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33386959-b02a-4445-a367-a1b3a5ac2509-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.636754 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.636672 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/33386959-b02a-4445-a367-a1b3a5ac2509-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.636754 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.636698 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/33386959-b02a-4445-a367-a1b3a5ac2509-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.636754 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.636739 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/33386959-b02a-4445-a367-a1b3a5ac2509-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.637227 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.636765 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/33386959-b02a-4445-a367-a1b3a5ac2509-web-config\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.637227 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.636789 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/33386959-b02a-4445-a367-a1b3a5ac2509-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.637227 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.636816 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/33386959-b02a-4445-a367-a1b3a5ac2509-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.637227 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.636828 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/33386959-b02a-4445-a367-a1b3a5ac2509-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.637227 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.636840 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/33386959-b02a-4445-a367-a1b3a5ac2509-config-out\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.637227 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.637141 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33386959-b02a-4445-a367-a1b3a5ac2509-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.637523 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.637402 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33386959-b02a-4445-a367-a1b3a5ac2509-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.637971 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.637924 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33386959-b02a-4445-a367-a1b3a5ac2509-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.639503 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.639475 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/33386959-b02a-4445-a367-a1b3a5ac2509-config\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.639643 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.639619 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/33386959-b02a-4445-a367-a1b3a5ac2509-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.639783 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.639762 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/33386959-b02a-4445-a367-a1b3a5ac2509-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.640103 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.640070 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/33386959-b02a-4445-a367-a1b3a5ac2509-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.640202 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.640080 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/33386959-b02a-4445-a367-a1b3a5ac2509-config-out\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.640202 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.640145 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/33386959-b02a-4445-a367-a1b3a5ac2509-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.640312 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.640261 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/33386959-b02a-4445-a367-a1b3a5ac2509-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.640755 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.640728 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33386959-b02a-4445-a367-a1b3a5ac2509-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.640845 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.640805 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/33386959-b02a-4445-a367-a1b3a5ac2509-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.641242 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.641221 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/33386959-b02a-4445-a367-a1b3a5ac2509-web-config\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.641892 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.641869 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/33386959-b02a-4445-a367-a1b3a5ac2509-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.642331 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.642305 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/33386959-b02a-4445-a367-a1b3a5ac2509-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.642416 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.642338 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/33386959-b02a-4445-a367-a1b3a5ac2509-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.642458 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.642428 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/33386959-b02a-4445-a367-a1b3a5ac2509-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.642794 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.642776 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/33386959-b02a-4445-a367-a1b3a5ac2509-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.650268 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.650219 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlghv\" (UniqueName: \"kubernetes.io/projected/33386959-b02a-4445-a367-a1b3a5ac2509-kube-api-access-vlghv\") pod \"prometheus-k8s-0\" (UID: \"33386959-b02a-4445-a367-a1b3a5ac2509\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.779289 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.779255 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:37.918020 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:37.917974 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 15 13:17:37.919764 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:17:37.919740 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33386959_b02a_4445_a367_a1b3a5ac2509.slice/crio-823e6ca5d024fa47be3a835598713bbd58a802fafa58f8d8fd4eb5a071c5644a WatchSource:0}: Error finding container 823e6ca5d024fa47be3a835598713bbd58a802fafa58f8d8fd4eb5a071c5644a: Status 404 returned error can't find the container with id 823e6ca5d024fa47be3a835598713bbd58a802fafa58f8d8fd4eb5a071c5644a Jul 15 13:17:38.398388 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:38.398353 2554 generic.go:356] "Generic (PLEG): container finished" podID="33386959-b02a-4445-a367-a1b3a5ac2509" containerID="7244ab32365172d1a20e99237e4b883e70ad4d87b2e887d3a8c533a74d4c761e" exitCode=0 Jul 15 13:17:38.398820 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:38.398429 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"33386959-b02a-4445-a367-a1b3a5ac2509","Type":"ContainerDied","Data":"7244ab32365172d1a20e99237e4b883e70ad4d87b2e887d3a8c533a74d4c761e"} Jul 15 13:17:38.398820 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:38.398531 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"33386959-b02a-4445-a367-a1b3a5ac2509","Type":"ContainerStarted","Data":"823e6ca5d024fa47be3a835598713bbd58a802fafa58f8d8fd4eb5a071c5644a"} Jul 15 13:17:39.137088 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:39.137048 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="253a7d80-fd15-47b2-aad6-a21b4c313af0" path="/var/lib/kubelet/pods/253a7d80-fd15-47b2-aad6-a21b4c313af0/volumes" Jul 15 13:17:39.405508 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:39.405423 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"33386959-b02a-4445-a367-a1b3a5ac2509","Type":"ContainerStarted","Data":"d13d425802f755981a0ee45c351522594bc19f5fb6b6510f689c3cf9e59a0386"} Jul 15 13:17:39.405508 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:39.405505 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"33386959-b02a-4445-a367-a1b3a5ac2509","Type":"ContainerStarted","Data":"a4c0e2549ab51286b9057d1d3e22292636095669d6d83a86f89292a162aa0973"} Jul 15 13:17:39.405858 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:39.405546 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"33386959-b02a-4445-a367-a1b3a5ac2509","Type":"ContainerStarted","Data":"e46419f6e18575e00054ab07b0a7ceb6f8030bda94cfb13439addfff98d8ac4f"} Jul 15 13:17:39.405858 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:39.405586 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"33386959-b02a-4445-a367-a1b3a5ac2509","Type":"ContainerStarted","Data":"a1d86f78349764932ed20e03be91bac62c779d5900d66a4ec075ca0cd22ddc45"} Jul 15 13:17:39.405858 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:39.405618 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"33386959-b02a-4445-a367-a1b3a5ac2509","Type":"ContainerStarted","Data":"b1e0989ab8b883152703ec58e194525bb6bc7e8a76d8baefe07101883e7d7404"} Jul 15 13:17:39.405858 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:39.405653 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"33386959-b02a-4445-a367-a1b3a5ac2509","Type":"ContainerStarted","Data":"c9bcc3815d028b6b40e69ff266f4e4c11c228e6f307911d184856df3a9a6383e"} Jul 15 13:17:39.447497 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:39.447446 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.4293030780000002 podStartE2EDuration="2.447430519s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.127441ms" isStatefulPod=false podCreationTimestamp="2026-07-15 13:17:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:17:39.446747375 +0000 UTC m=+372.877556948" watchObservedRunningTime="2026-07-15 13:17:39.447430519 +0000 UTC m=+372.878240092" Jul 15 13:17:40.965335 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:40.965283 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfca5b3-c487-470b-b5b1-965339049b4c-metrics-certs\") pod \"network-metrics-daemon-xmbdp\" (UID: \"7cfca5b3-c487-470b-b5b1-965339049b4c\") " pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:17:40.967620 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:40.967599 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cfca5b3-c487-470b-b5b1-965339049b4c-metrics-certs\") pod \"network-metrics-daemon-xmbdp\" (UID: \"7cfca5b3-c487-470b-b5b1-965339049b4c\") " pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:17:41.135637 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:41.135609 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hh9ms\"" Jul 15 13:17:41.143213 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:41.143192 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmbdp" Jul 15 13:17:41.287793 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:41.287755 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xmbdp"] Jul 15 13:17:41.290908 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:17:41.290883 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cfca5b3_c487_470b_b5b1_965339049b4c.slice/crio-64ac651e1622b882d64d29d8151fa048a24bb5bfa61a59cc7cdba12c21d654bc WatchSource:0}: Error finding container 64ac651e1622b882d64d29d8151fa048a24bb5bfa61a59cc7cdba12c21d654bc: Status 404 returned error can't find the container with id 64ac651e1622b882d64d29d8151fa048a24bb5bfa61a59cc7cdba12c21d654bc Jul 15 13:17:41.292925 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:41.292908 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 13:17:41.421156 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:41.421117 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xmbdp" event={"ID":"7cfca5b3-c487-470b-b5b1-965339049b4c","Type":"ContainerStarted","Data":"64ac651e1622b882d64d29d8151fa048a24bb5bfa61a59cc7cdba12c21d654bc"} Jul 15 13:17:41.833098 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:41.833057 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:17:41.892577 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:41.892538 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:17:42.426768 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:42.426651 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xmbdp" event={"ID":"7cfca5b3-c487-470b-b5b1-965339049b4c","Type":"ContainerStarted","Data":"6df0676edb95f60c32232d0adb9b44d6b6cdd39f5351d4a4b190e9ce24d8ca5c"} Jul 15 13:17:42.426768 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:42.426743 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xmbdp" event={"ID":"7cfca5b3-c487-470b-b5b1-965339049b4c","Type":"ContainerStarted","Data":"e537f40966b2474ce8ed4ff99613357ce931ac2aa7b78afd1e9203723d64297d"} Jul 15 13:17:42.447686 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:42.447632 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xmbdp" podStartSLOduration=374.64916843 podStartE2EDuration="6m15.447616794s" totalImagesPullingTime="798.448364ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:11:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:17:42.445738239 +0000 UTC m=+375.876547812" watchObservedRunningTime="2026-07-15 13:17:42.447616794 +0000 UTC m=+375.878426368" Jul 15 13:17:42.552365 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:42.552331 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:17:42.616712 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:42.616678 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:17:42.780189 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:42.780150 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:17:46.166315 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:46.166263 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:17:46.231185 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:46.231156 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:17:52.664866 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:52.664830 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:17:53.871708 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:53.871673 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:17:53.931600 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:53.931562 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:17:58.242027 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:17:58.242003 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:18:31.072864 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:18:31.072831 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:18:31.138474 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:18:31.138441 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:18:37.779637 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:18:37.779592 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:18:37.794788 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:18:37.794761 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:18:38.429779 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:18:38.429741 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:18:38.659755 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:18:38.659721 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 15 13:18:44.972924 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:18:44.972886 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:18:45.033291 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:18:45.033260 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:18:54.711171 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:18:54.711065 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:18:55.488765 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:18:55.488730 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:18:56.960220 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:18:56.960187 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:18:57.019233 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:18:57.019197 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:19:00.554370 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:19:00.554334 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:19:00.655160 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:19:00.655128 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:19:00.711181 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:19:00.711149 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:19:05.441646 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:19:05.441610 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:19:06.268310 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:19:06.268279 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:19:06.329384 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:19:06.329350 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:19:17.293210 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:19:17.293175 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:19:17.391758 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:19:17.391730 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:19:57.531774 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:19:57.531736 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:19:57.629773 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:19:57.629739 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:20:19.387853 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:20:19.387775 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:20:20.383260 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:20:20.383224 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:20:22.609707 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:20:22.609672 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:20:22.710834 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:20:22.710800 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:20:25.580289 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:20:25.580249 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:20:25.673038 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:20:25.672953 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:20:25.768961 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:20:25.768931 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:20:27.945359 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:20:27.945319 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:20:28.157097 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:20:28.157065 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:20:29.616460 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:20:29.616423 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:20:29.717775 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:20:29.717744 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:20:35.560904 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:20:35.560866 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:20:38.619541 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:20:38.619498 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:20:38.719347 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:20:38.719314 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:20:44.245903 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:20:44.245863 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:20:44.347604 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:20:44.347575 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:20:46.118694 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:20:46.118658 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:20:48.931901 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:20:48.931865 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:20:58.406444 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:20:58.406414 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:20:58.511492 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:20:58.511460 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:00.830303 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:00.830270 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:00.948931 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:00.948900 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:01.451605 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:01.451570 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:01.853542 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:01.853513 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:01.943196 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:01.943161 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:02.075411 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:02.075383 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-lchnm"] Jul 15 13:21:02.078735 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:02.078713 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-lchnm" Jul 15 13:21:02.084524 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:02.084501 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 15 13:21:02.084655 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:02.084511 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 15 13:21:02.084828 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:02.084814 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 15 13:21:02.085312 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:02.085048 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bqztw\"" Jul 15 13:21:02.087494 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:02.087479 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 15 13:21:02.105181 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:02.105105 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-lchnm"] Jul 15 13:21:02.168671 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:02.168640 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bszgj\" (UniqueName: \"kubernetes.io/projected/d0fe6f17-60ec-4264-a076-55c11c249abb-kube-api-access-bszgj\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-lchnm\" (UID: \"d0fe6f17-60ec-4264-a076-55c11c249abb\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-lchnm" Jul 15 13:21:02.168843 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:02.168694 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d0fe6f17-60ec-4264-a076-55c11c249abb-tmp\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-lchnm\" (UID: \"d0fe6f17-60ec-4264-a076-55c11c249abb\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-lchnm" Jul 15 13:21:02.168843 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:02.168814 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d0fe6f17-60ec-4264-a076-55c11c249abb-manifests\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-lchnm\" (UID: \"d0fe6f17-60ec-4264-a076-55c11c249abb\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-lchnm" Jul 15 13:21:02.168958 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:02.168851 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d0fe6f17-60ec-4264-a076-55c11c249abb-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-lchnm\" (UID: \"d0fe6f17-60ec-4264-a076-55c11c249abb\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-lchnm" Jul 15 13:21:02.169039 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:02.168950 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d0fe6f17-60ec-4264-a076-55c11c249abb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-lchnm\" (UID: \"d0fe6f17-60ec-4264-a076-55c11c249abb\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-lchnm" Jul 15 13:21:02.269379 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:02.269346 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d0fe6f17-60ec-4264-a076-55c11c249abb-tmp\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-lchnm\" (UID: \"d0fe6f17-60ec-4264-a076-55c11c249abb\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-lchnm" Jul 15 13:21:02.269570 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:02.269395 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d0fe6f17-60ec-4264-a076-55c11c249abb-manifests\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-lchnm\" (UID: \"d0fe6f17-60ec-4264-a076-55c11c249abb\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-lchnm" Jul 15 13:21:02.269570 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:02.269508 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d0fe6f17-60ec-4264-a076-55c11c249abb-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-lchnm\" (UID: \"d0fe6f17-60ec-4264-a076-55c11c249abb\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-lchnm" Jul 15 13:21:02.269570 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:02.269547 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d0fe6f17-60ec-4264-a076-55c11c249abb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-lchnm\" (UID: \"d0fe6f17-60ec-4264-a076-55c11c249abb\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-lchnm" Jul 15 13:21:02.269728 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:02.269600 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bszgj\" (UniqueName: \"kubernetes.io/projected/d0fe6f17-60ec-4264-a076-55c11c249abb-kube-api-access-bszgj\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-lchnm\" (UID: \"d0fe6f17-60ec-4264-a076-55c11c249abb\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-lchnm" Jul 15 13:21:02.269903 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:02.269863 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d0fe6f17-60ec-4264-a076-55c11c249abb-manifests\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-lchnm\" (UID: \"d0fe6f17-60ec-4264-a076-55c11c249abb\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-lchnm" Jul 15 13:21:02.271786 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:02.271758 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d0fe6f17-60ec-4264-a076-55c11c249abb-tmp\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-lchnm\" (UID: \"d0fe6f17-60ec-4264-a076-55c11c249abb\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-lchnm" Jul 15 13:21:02.271907 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:02.271888 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d0fe6f17-60ec-4264-a076-55c11c249abb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-lchnm\" (UID: \"d0fe6f17-60ec-4264-a076-55c11c249abb\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-lchnm" Jul 15 13:21:02.272067 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:02.272048 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d0fe6f17-60ec-4264-a076-55c11c249abb-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-lchnm\" (UID: \"d0fe6f17-60ec-4264-a076-55c11c249abb\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-lchnm" Jul 15 13:21:02.287731 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:02.287700 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bszgj\" (UniqueName: \"kubernetes.io/projected/d0fe6f17-60ec-4264-a076-55c11c249abb-kube-api-access-bszgj\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-lchnm\" (UID: \"d0fe6f17-60ec-4264-a076-55c11c249abb\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-lchnm" Jul 15 13:21:02.329200 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:02.329162 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:02.388788 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:02.388710 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-lchnm" Jul 15 13:21:02.419632 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:02.419594 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:02.535521 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:02.535338 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:02.535886 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:02.535867 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-lchnm"] Jul 15 13:21:02.538280 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:21:02.538262 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0fe6f17_60ec_4264_a076_55c11c249abb.slice/crio-e72bd8b98481fb037df3d91d098511f3008435e25aff535bacdecf23e8c1e286 WatchSource:0}: Error finding container e72bd8b98481fb037df3d91d098511f3008435e25aff535bacdecf23e8c1e286: Status 404 returned error can't find the container with id e72bd8b98481fb037df3d91d098511f3008435e25aff535bacdecf23e8c1e286 Jul 15 13:21:02.621103 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:02.621068 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:02.722469 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:02.722438 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:02.835569 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:02.835528 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:03.160948 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:03.160867 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-lchnm" event={"ID":"d0fe6f17-60ec-4264-a076-55c11c249abb","Type":"ContainerStarted","Data":"e72bd8b98481fb037df3d91d098511f3008435e25aff535bacdecf23e8c1e286"} Jul 15 13:21:04.323657 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:04.323620 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:04.441787 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:04.441745 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:06.179706 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:06.179665 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-lchnm" event={"ID":"d0fe6f17-60ec-4264-a076-55c11c249abb","Type":"ContainerStarted","Data":"462323f5789c44105a3c575b19974d5eea072883900d689eeaa782a5f836021b"} Jul 15 13:21:07.185015 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:07.184962 2554 generic.go:356] "Generic (PLEG): container finished" podID="d0fe6f17-60ec-4264-a076-55c11c249abb" containerID="462323f5789c44105a3c575b19974d5eea072883900d689eeaa782a5f836021b" exitCode=0 Jul 15 13:21:07.185015 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:07.185008 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-lchnm" event={"ID":"d0fe6f17-60ec-4264-a076-55c11c249abb","Type":"ContainerDied","Data":"462323f5789c44105a3c575b19974d5eea072883900d689eeaa782a5f836021b"} Jul 15 13:21:08.190231 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:08.190194 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-lchnm" event={"ID":"d0fe6f17-60ec-4264-a076-55c11c249abb","Type":"ContainerStarted","Data":"862d4ccafa1e8f6ed4563215d0222eb2b2ef83a2bd579171da77db00cb9dd733"} Jul 15 13:21:08.190607 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:08.190309 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-lchnm" Jul 15 13:21:08.221731 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:08.221683 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-lchnm" podStartSLOduration=1.882255332 podStartE2EDuration="6.22166897s" totalImagesPullingTime="3.254066952s" totalInitContainerRuntime="1.085346686s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:21:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:21:08.221011611 +0000 UTC m=+581.651821175" watchObservedRunningTime="2026-07-15 13:21:08.22166897 +0000 UTC m=+581.652478544" Jul 15 13:21:14.940661 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:14.940626 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:18.262100 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:18.262072 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:19.195252 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:19.195219 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-lchnm" Jul 15 13:21:21.249720 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:21.249694 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:21.445589 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:21.445557 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:23.120811 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:23.120769 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:23.267190 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:23.267157 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:23.391288 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:23.391213 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:23.768412 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:23.768374 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:23.862556 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:23.862522 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:25.336720 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:25.336687 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:27.041724 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:27.041699 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lx562_83d9c378-e25b-487c-a9be-83e18e37d87f/ovn-acl-logging/0.log" Jul 15 13:21:27.042134 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:27.041760 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lx562_83d9c378-e25b-487c-a9be-83e18e37d87f/ovn-acl-logging/0.log" Jul 15 13:21:29.902492 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:29.902458 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:30.008390 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.008366 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:30.294306 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.294277 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm"] Jul 15 13:21:30.297325 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.297309 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" Jul 15 13:21:30.300483 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.300454 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 15 13:21:30.300600 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.300490 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 15 13:21:30.300600 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.300503 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 15 13:21:30.301071 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.301055 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-jc77n\"" Jul 15 13:21:30.312146 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.312125 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm"] Jul 15 13:21:30.321267 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.321226 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:30.411833 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.411802 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b85d7975-1a9e-481d-82b7-ed08006f8074-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-tnbnm\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" Jul 15 13:21:30.411833 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.411837 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b85d7975-1a9e-481d-82b7-ed08006f8074-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-tnbnm\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" Jul 15 13:21:30.412071 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.411860 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b85d7975-1a9e-481d-82b7-ed08006f8074-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-tnbnm\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" Jul 15 13:21:30.412071 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.411877 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jj47\" (UniqueName: \"kubernetes.io/projected/b85d7975-1a9e-481d-82b7-ed08006f8074-kube-api-access-9jj47\") pod \"data-science-gateway-data-science-gateway-class-548557588-tnbnm\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" Jul 15 13:21:30.412071 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.411996 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b85d7975-1a9e-481d-82b7-ed08006f8074-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-tnbnm\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" Jul 15 13:21:30.412071 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.412031 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b85d7975-1a9e-481d-82b7-ed08006f8074-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-tnbnm\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" Jul 15 13:21:30.412071 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.412062 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b85d7975-1a9e-481d-82b7-ed08006f8074-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-tnbnm\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" Jul 15 13:21:30.412222 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.412081 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b85d7975-1a9e-481d-82b7-ed08006f8074-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-tnbnm\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" Jul 15 13:21:30.412222 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.412132 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b85d7975-1a9e-481d-82b7-ed08006f8074-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-tnbnm\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" Jul 15 13:21:30.513149 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.513110 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b85d7975-1a9e-481d-82b7-ed08006f8074-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-tnbnm\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" Jul 15 13:21:30.513339 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.513169 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b85d7975-1a9e-481d-82b7-ed08006f8074-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-tnbnm\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" Jul 15 13:21:30.513339 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.513197 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b85d7975-1a9e-481d-82b7-ed08006f8074-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-tnbnm\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" Jul 15 13:21:30.513339 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.513218 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b85d7975-1a9e-481d-82b7-ed08006f8074-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-tnbnm\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" Jul 15 13:21:30.513339 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.513241 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b85d7975-1a9e-481d-82b7-ed08006f8074-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-tnbnm\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" Jul 15 13:21:30.513339 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.513260 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jj47\" (UniqueName: \"kubernetes.io/projected/b85d7975-1a9e-481d-82b7-ed08006f8074-kube-api-access-9jj47\") pod \"data-science-gateway-data-science-gateway-class-548557588-tnbnm\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" Jul 15 13:21:30.513339 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.513302 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b85d7975-1a9e-481d-82b7-ed08006f8074-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-tnbnm\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" Jul 15 13:21:30.513339 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.513335 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b85d7975-1a9e-481d-82b7-ed08006f8074-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-tnbnm\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" Jul 15 13:21:30.513711 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.513364 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b85d7975-1a9e-481d-82b7-ed08006f8074-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-tnbnm\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" Jul 15 13:21:30.513711 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.513664 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b85d7975-1a9e-481d-82b7-ed08006f8074-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-tnbnm\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" Jul 15 13:21:30.513810 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.513750 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b85d7975-1a9e-481d-82b7-ed08006f8074-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-tnbnm\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" Jul 15 13:21:30.513975 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.513953 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b85d7975-1a9e-481d-82b7-ed08006f8074-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-tnbnm\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" Jul 15 13:21:30.514063 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.513960 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b85d7975-1a9e-481d-82b7-ed08006f8074-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-tnbnm\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" Jul 15 13:21:30.514293 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.514276 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b85d7975-1a9e-481d-82b7-ed08006f8074-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-tnbnm\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" Jul 15 13:21:30.515663 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.515639 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b85d7975-1a9e-481d-82b7-ed08006f8074-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-tnbnm\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" Jul 15 13:21:30.515787 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.515769 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b85d7975-1a9e-481d-82b7-ed08006f8074-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-tnbnm\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" Jul 15 13:21:30.516286 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.516267 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:30.530804 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.530780 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b85d7975-1a9e-481d-82b7-ed08006f8074-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-tnbnm\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" Jul 15 13:21:30.533081 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.533062 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jj47\" (UniqueName: \"kubernetes.io/projected/b85d7975-1a9e-481d-82b7-ed08006f8074-kube-api-access-9jj47\") pod \"data-science-gateway-data-science-gateway-class-548557588-tnbnm\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" Jul 15 13:21:30.607885 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.607785 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" Jul 15 13:21:30.666083 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.666047 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:30.745336 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.745278 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm"] Jul 15 13:21:30.747395 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:21:30.747369 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb85d7975_1a9e_481d_82b7_ed08006f8074.slice/crio-9229ecc4ab550954e71ecc64391b4002b0b5704ca509d924cd2ac9ce7c6feda2 WatchSource:0}: Error finding container 9229ecc4ab550954e71ecc64391b4002b0b5704ca509d924cd2ac9ce7c6feda2: Status 404 returned error can't find the container with id 9229ecc4ab550954e71ecc64391b4002b0b5704ca509d924cd2ac9ce7c6feda2 Jul 15 13:21:30.864433 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.864351 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gtbf9"] Jul 15 13:21:30.868510 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.868493 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gtbf9" Jul 15 13:21:30.885817 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.885787 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 15 13:21:30.886192 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.886165 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 15 13:21:30.886362 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.886346 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dhtw5\"" Jul 15 13:21:30.886449 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.886434 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 15 13:21:30.887959 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:30.887937 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gtbf9"] Jul 15 13:21:31.016756 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:31.016728 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c3588d3-d065-4ce1-8587-5c5dffc80b27-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-gtbf9\" (UID: \"7c3588d3-d065-4ce1-8587-5c5dffc80b27\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gtbf9" Jul 15 13:21:31.016756 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:31.016758 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7c3588d3-d065-4ce1-8587-5c5dffc80b27-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-gtbf9\" (UID: \"7c3588d3-d065-4ce1-8587-5c5dffc80b27\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gtbf9" Jul 15 13:21:31.017241 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:31.016782 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7c3588d3-d065-4ce1-8587-5c5dffc80b27-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-gtbf9\" (UID: \"7c3588d3-d065-4ce1-8587-5c5dffc80b27\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gtbf9" Jul 15 13:21:31.017241 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:31.016842 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c3588d3-d065-4ce1-8587-5c5dffc80b27-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-gtbf9\" (UID: \"7c3588d3-d065-4ce1-8587-5c5dffc80b27\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gtbf9" Jul 15 13:21:31.017241 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:31.016878 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7qkl\" (UniqueName: \"kubernetes.io/projected/7c3588d3-d065-4ce1-8587-5c5dffc80b27-kube-api-access-d7qkl\") pod \"istiod-openshift-gateway-94bb8fbfd-gtbf9\" (UID: \"7c3588d3-d065-4ce1-8587-5c5dffc80b27\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gtbf9" Jul 15 13:21:31.017241 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:31.017013 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7c3588d3-d065-4ce1-8587-5c5dffc80b27-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-gtbf9\" (UID: \"7c3588d3-d065-4ce1-8587-5c5dffc80b27\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gtbf9" Jul 15 13:21:31.017241 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:31.017069 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7c3588d3-d065-4ce1-8587-5c5dffc80b27-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-gtbf9\" (UID: \"7c3588d3-d065-4ce1-8587-5c5dffc80b27\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gtbf9" Jul 15 13:21:31.118488 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:31.118393 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c3588d3-d065-4ce1-8587-5c5dffc80b27-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-gtbf9\" (UID: \"7c3588d3-d065-4ce1-8587-5c5dffc80b27\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gtbf9" Jul 15 13:21:31.118488 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:31.118432 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7c3588d3-d065-4ce1-8587-5c5dffc80b27-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-gtbf9\" (UID: \"7c3588d3-d065-4ce1-8587-5c5dffc80b27\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gtbf9" Jul 15 13:21:31.118488 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:31.118449 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7c3588d3-d065-4ce1-8587-5c5dffc80b27-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-gtbf9\" (UID: \"7c3588d3-d065-4ce1-8587-5c5dffc80b27\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gtbf9" Jul 15 13:21:31.118488 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:31.118484 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c3588d3-d065-4ce1-8587-5c5dffc80b27-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-gtbf9\" (UID: \"7c3588d3-d065-4ce1-8587-5c5dffc80b27\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gtbf9" Jul 15 13:21:31.118822 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:31.118507 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7qkl\" (UniqueName: \"kubernetes.io/projected/7c3588d3-d065-4ce1-8587-5c5dffc80b27-kube-api-access-d7qkl\") pod \"istiod-openshift-gateway-94bb8fbfd-gtbf9\" (UID: \"7c3588d3-d065-4ce1-8587-5c5dffc80b27\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gtbf9" Jul 15 13:21:31.118822 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:31.118567 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7c3588d3-d065-4ce1-8587-5c5dffc80b27-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-gtbf9\" (UID: \"7c3588d3-d065-4ce1-8587-5c5dffc80b27\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gtbf9" Jul 15 13:21:31.118822 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:31.118622 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7c3588d3-d065-4ce1-8587-5c5dffc80b27-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-gtbf9\" (UID: \"7c3588d3-d065-4ce1-8587-5c5dffc80b27\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gtbf9" Jul 15 13:21:31.119327 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:31.119297 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7c3588d3-d065-4ce1-8587-5c5dffc80b27-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-gtbf9\" (UID: \"7c3588d3-d065-4ce1-8587-5c5dffc80b27\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gtbf9" Jul 15 13:21:31.121346 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:31.121329 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7c3588d3-d065-4ce1-8587-5c5dffc80b27-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-gtbf9\" (UID: \"7c3588d3-d065-4ce1-8587-5c5dffc80b27\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gtbf9" Jul 15 13:21:31.121428 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:31.121382 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7c3588d3-d065-4ce1-8587-5c5dffc80b27-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-gtbf9\" (UID: \"7c3588d3-d065-4ce1-8587-5c5dffc80b27\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gtbf9" Jul 15 13:21:31.121428 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:31.121392 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c3588d3-d065-4ce1-8587-5c5dffc80b27-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-gtbf9\" (UID: \"7c3588d3-d065-4ce1-8587-5c5dffc80b27\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gtbf9" Jul 15 13:21:31.121507 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:31.121469 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7c3588d3-d065-4ce1-8587-5c5dffc80b27-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-gtbf9\" (UID: \"7c3588d3-d065-4ce1-8587-5c5dffc80b27\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gtbf9" Jul 15 13:21:31.127731 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:31.127710 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c3588d3-d065-4ce1-8587-5c5dffc80b27-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-gtbf9\" (UID: \"7c3588d3-d065-4ce1-8587-5c5dffc80b27\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gtbf9" Jul 15 13:21:31.130145 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:31.130126 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7qkl\" (UniqueName: \"kubernetes.io/projected/7c3588d3-d065-4ce1-8587-5c5dffc80b27-kube-api-access-d7qkl\") pod \"istiod-openshift-gateway-94bb8fbfd-gtbf9\" (UID: \"7c3588d3-d065-4ce1-8587-5c5dffc80b27\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gtbf9" Jul 15 13:21:31.177608 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:31.177573 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gtbf9" Jul 15 13:21:31.277631 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:31.277601 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" event={"ID":"b85d7975-1a9e-481d-82b7-ed08006f8074","Type":"ContainerStarted","Data":"9229ecc4ab550954e71ecc64391b4002b0b5704ca509d924cd2ac9ce7c6feda2"} Jul 15 13:21:31.333006 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:31.332968 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gtbf9"] Jul 15 13:21:31.335271 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:21:31.335247 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c3588d3_d065_4ce1_8587_5c5dffc80b27.slice/crio-e2e273b39da0eb2eb79dad8030032eda0222cf1f80551fe6414cd11d1b9cf1f9 WatchSource:0}: Error finding container e2e273b39da0eb2eb79dad8030032eda0222cf1f80551fe6414cd11d1b9cf1f9: Status 404 returned error can't find the container with id e2e273b39da0eb2eb79dad8030032eda0222cf1f80551fe6414cd11d1b9cf1f9 Jul 15 13:21:32.283886 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:32.283849 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gtbf9" event={"ID":"7c3588d3-d065-4ce1-8587-5c5dffc80b27","Type":"ContainerStarted","Data":"e2e273b39da0eb2eb79dad8030032eda0222cf1f80551fe6414cd11d1b9cf1f9"} Jul 15 13:21:32.418789 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:32.418759 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7557b79948-trqwv"] Jul 15 13:21:32.422120 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:32.422102 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7557b79948-trqwv" Jul 15 13:21:32.427012 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:32.426962 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 15 13:21:32.427713 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:32.427680 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19d7d639-26e6-480f-bd0e-c0ca3721f792-cert\") pod \"lws-controller-manager-7557b79948-trqwv\" (UID: \"19d7d639-26e6-480f-bd0e-c0ca3721f792\") " pod="openshift-lws-operator/lws-controller-manager-7557b79948-trqwv" Jul 15 13:21:32.427840 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:32.427722 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/19d7d639-26e6-480f-bd0e-c0ca3721f792-metrics-cert\") pod \"lws-controller-manager-7557b79948-trqwv\" (UID: \"19d7d639-26e6-480f-bd0e-c0ca3721f792\") " pod="openshift-lws-operator/lws-controller-manager-7557b79948-trqwv" Jul 15 13:21:32.427840 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:32.427750 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kqgv\" (UniqueName: \"kubernetes.io/projected/19d7d639-26e6-480f-bd0e-c0ca3721f792-kube-api-access-7kqgv\") pod \"lws-controller-manager-7557b79948-trqwv\" (UID: \"19d7d639-26e6-480f-bd0e-c0ca3721f792\") " pod="openshift-lws-operator/lws-controller-manager-7557b79948-trqwv" Jul 15 13:21:32.427938 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:32.427851 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/19d7d639-26e6-480f-bd0e-c0ca3721f792-manager-config\") pod \"lws-controller-manager-7557b79948-trqwv\" (UID: \"19d7d639-26e6-480f-bd0e-c0ca3721f792\") " pod="openshift-lws-operator/lws-controller-manager-7557b79948-trqwv" Jul 15 13:21:32.428845 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:32.428820 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 15 13:21:32.429243 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:32.429221 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 15 13:21:32.429382 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:32.429265 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 15 13:21:32.429550 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:32.429532 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 15 13:21:32.429630 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:32.429614 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gnlqz\"" Jul 15 13:21:32.445587 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:32.445557 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7557b79948-trqwv"] Jul 15 13:21:32.528312 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:32.528277 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19d7d639-26e6-480f-bd0e-c0ca3721f792-cert\") pod \"lws-controller-manager-7557b79948-trqwv\" (UID: \"19d7d639-26e6-480f-bd0e-c0ca3721f792\") " pod="openshift-lws-operator/lws-controller-manager-7557b79948-trqwv" Jul 15 13:21:32.528312 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:32.528323 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/19d7d639-26e6-480f-bd0e-c0ca3721f792-metrics-cert\") pod \"lws-controller-manager-7557b79948-trqwv\" (UID: \"19d7d639-26e6-480f-bd0e-c0ca3721f792\") " pod="openshift-lws-operator/lws-controller-manager-7557b79948-trqwv" Jul 15 13:21:32.528566 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:32.528350 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kqgv\" (UniqueName: \"kubernetes.io/projected/19d7d639-26e6-480f-bd0e-c0ca3721f792-kube-api-access-7kqgv\") pod \"lws-controller-manager-7557b79948-trqwv\" (UID: \"19d7d639-26e6-480f-bd0e-c0ca3721f792\") " pod="openshift-lws-operator/lws-controller-manager-7557b79948-trqwv" Jul 15 13:21:32.528566 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:32.528384 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/19d7d639-26e6-480f-bd0e-c0ca3721f792-manager-config\") pod \"lws-controller-manager-7557b79948-trqwv\" (UID: \"19d7d639-26e6-480f-bd0e-c0ca3721f792\") " pod="openshift-lws-operator/lws-controller-manager-7557b79948-trqwv" Jul 15 13:21:32.529149 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:32.529124 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/19d7d639-26e6-480f-bd0e-c0ca3721f792-manager-config\") pod \"lws-controller-manager-7557b79948-trqwv\" (UID: \"19d7d639-26e6-480f-bd0e-c0ca3721f792\") " pod="openshift-lws-operator/lws-controller-manager-7557b79948-trqwv" Jul 15 13:21:32.531180 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:32.531159 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/19d7d639-26e6-480f-bd0e-c0ca3721f792-metrics-cert\") pod \"lws-controller-manager-7557b79948-trqwv\" (UID: \"19d7d639-26e6-480f-bd0e-c0ca3721f792\") " pod="openshift-lws-operator/lws-controller-manager-7557b79948-trqwv" Jul 15 13:21:32.531375 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:32.531356 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19d7d639-26e6-480f-bd0e-c0ca3721f792-cert\") pod \"lws-controller-manager-7557b79948-trqwv\" (UID: \"19d7d639-26e6-480f-bd0e-c0ca3721f792\") " pod="openshift-lws-operator/lws-controller-manager-7557b79948-trqwv" Jul 15 13:21:32.550397 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:32.550335 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kqgv\" (UniqueName: \"kubernetes.io/projected/19d7d639-26e6-480f-bd0e-c0ca3721f792-kube-api-access-7kqgv\") pod \"lws-controller-manager-7557b79948-trqwv\" (UID: \"19d7d639-26e6-480f-bd0e-c0ca3721f792\") " pod="openshift-lws-operator/lws-controller-manager-7557b79948-trqwv" Jul 15 13:21:32.733866 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:32.733827 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7557b79948-trqwv" Jul 15 13:21:33.452818 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:33.452770 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:21:33.453280 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:33.452872 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:21:33.453280 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:33.452914 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:21:33.580220 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:21:33.580184 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19d7d639_26e6_480f_bd0e_c0ca3721f792.slice/crio-5043ed17880e4ee7889abcb1b4bb9ab59be35d6fa4acd5854e4971e2aa8c4bcd WatchSource:0}: Error finding container 5043ed17880e4ee7889abcb1b4bb9ab59be35d6fa4acd5854e4971e2aa8c4bcd: Status 404 returned error can't find the container with id 5043ed17880e4ee7889abcb1b4bb9ab59be35d6fa4acd5854e4971e2aa8c4bcd Jul 15 13:21:33.580370 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:33.580275 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7557b79948-trqwv"] Jul 15 13:21:34.294009 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:34.293961 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" event={"ID":"b85d7975-1a9e-481d-82b7-ed08006f8074","Type":"ContainerStarted","Data":"434084818e6abd816921e66408f094887284bedbc849e38a1db558db30cbd2a8"} Jul 15 13:21:34.295347 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:34.295317 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7557b79948-trqwv" event={"ID":"19d7d639-26e6-480f-bd0e-c0ca3721f792","Type":"ContainerStarted","Data":"5043ed17880e4ee7889abcb1b4bb9ab59be35d6fa4acd5854e4971e2aa8c4bcd"} Jul 15 13:21:34.344495 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:34.344439 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" podStartSLOduration=1.64150669 podStartE2EDuration="4.344420824s" totalImagesPullingTime="2.702914134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:21:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:21:34.342638464 +0000 UTC m=+607.773448039" watchObservedRunningTime="2026-07-15 13:21:34.344420824 +0000 UTC m=+607.775230397" Jul 15 13:21:34.608805 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:34.608718 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" Jul 15 13:21:34.610402 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:34.610377 2554 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-tnbnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" start-of-body= Jul 15 13:21:34.610526 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:34.610445 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" podUID="b85d7975-1a9e-481d-82b7-ed08006f8074" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" Jul 15 13:21:35.169263 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:35.169230 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:21:35.169325 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:35.169295 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:21:35.301395 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:35.301362 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gtbf9" event={"ID":"7c3588d3-d065-4ce1-8587-5c5dffc80b27","Type":"ContainerStarted","Data":"213a6fc8e7f07eff62b3253626d1bbab6ca3dea434b1fe20c30a22b9040a20e8"} Jul 15 13:21:35.301537 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:35.301459 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gtbf9" Jul 15 13:21:35.365062 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:35.365009 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gtbf9" podStartSLOduration=1.533215083 podStartE2EDuration="5.364968642s" totalImagesPullingTime="3.831753559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:21:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:21:35.363294983 +0000 UTC m=+608.794104550" watchObservedRunningTime="2026-07-15 13:21:35.364968642 +0000 UTC m=+608.795778215" Jul 15 13:21:35.449425 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:35.449337 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:35.609024 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:35.608966 2554 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-tnbnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" start-of-body= Jul 15 13:21:35.609517 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:35.609056 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" podUID="b85d7975-1a9e-481d-82b7-ed08006f8074" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" Jul 15 13:21:35.622404 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:35.622375 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:35.759513 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:35.759477 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:35.843124 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:35.843047 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm"] Jul 15 13:21:36.035527 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:36.035436 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:36.307590 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:36.307503 2554 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-gtbf9 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 13:21:36.307590 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:36.307563 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gtbf9" podUID="7c3588d3-d065-4ce1-8587-5c5dffc80b27" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 13:21:36.320218 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:36.320184 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:36.608585 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:36.608512 2554 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-tnbnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" start-of-body= Jul 15 13:21:36.608735 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:36.608595 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" podUID="b85d7975-1a9e-481d-82b7-ed08006f8074" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.20:15021/healthz/ready\": dial tcp 10.133.0.20:15021: connect: connection refused" Jul 15 13:21:37.104120 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:37.104081 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:37.233396 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:37.233350 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:37.310960 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:37.310919 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" podUID="b85d7975-1a9e-481d-82b7-ed08006f8074" containerName="istio-proxy" containerID="cri-o://434084818e6abd816921e66408f094887284bedbc849e38a1db558db30cbd2a8" gracePeriod=30 Jul 15 13:21:37.360706 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:37.360616 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:38.154271 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:38.154222 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:38.256035 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:38.255999 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:38.316178 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:38.316140 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7557b79948-trqwv" event={"ID":"19d7d639-26e6-480f-bd0e-c0ca3721f792","Type":"ContainerStarted","Data":"385406abafc95dbac1ea4f8b576c2c0ad44ea48e5d387882df81e41a6e914a40"} Jul 15 13:21:38.316366 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:38.316273 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7557b79948-trqwv" Jul 15 13:21:38.358780 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:38.358726 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7557b79948-trqwv" podStartSLOduration=2.500546981 podStartE2EDuration="6.358709857s" totalImagesPullingTime="3.858162876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:21:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:21:38.35825419 +0000 UTC m=+611.789063764" watchObservedRunningTime="2026-07-15 13:21:38.358709857 +0000 UTC m=+611.789519509" Jul 15 13:21:39.307365 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:39.307336 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gtbf9" Jul 15 13:21:42.571250 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:42.571190 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" Jul 15 13:21:42.624150 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:42.624115 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jj47\" (UniqueName: \"kubernetes.io/projected/b85d7975-1a9e-481d-82b7-ed08006f8074-kube-api-access-9jj47\") pod \"b85d7975-1a9e-481d-82b7-ed08006f8074\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " Jul 15 13:21:42.624316 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:42.624183 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b85d7975-1a9e-481d-82b7-ed08006f8074-workload-socket\") pod \"b85d7975-1a9e-481d-82b7-ed08006f8074\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " Jul 15 13:21:42.624316 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:42.624296 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b85d7975-1a9e-481d-82b7-ed08006f8074-istio-token\") pod \"b85d7975-1a9e-481d-82b7-ed08006f8074\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " Jul 15 13:21:42.624427 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:42.624353 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b85d7975-1a9e-481d-82b7-ed08006f8074-credential-socket\") pod \"b85d7975-1a9e-481d-82b7-ed08006f8074\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " Jul 15 13:21:42.624427 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:42.624387 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b85d7975-1a9e-481d-82b7-ed08006f8074-workload-certs\") pod \"b85d7975-1a9e-481d-82b7-ed08006f8074\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " Jul 15 13:21:42.624538 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:42.624441 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b85d7975-1a9e-481d-82b7-ed08006f8074-istiod-ca-cert\") pod \"b85d7975-1a9e-481d-82b7-ed08006f8074\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " Jul 15 13:21:42.624538 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:42.624464 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b85d7975-1a9e-481d-82b7-ed08006f8074-istio-envoy\") pod \"b85d7975-1a9e-481d-82b7-ed08006f8074\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " Jul 15 13:21:42.624538 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:42.624479 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b85d7975-1a9e-481d-82b7-ed08006f8074-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b85d7975-1a9e-481d-82b7-ed08006f8074" (UID: "b85d7975-1a9e-481d-82b7-ed08006f8074"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:21:42.624538 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:42.624506 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b85d7975-1a9e-481d-82b7-ed08006f8074-istio-data\") pod \"b85d7975-1a9e-481d-82b7-ed08006f8074\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " Jul 15 13:21:42.624736 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:42.624547 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b85d7975-1a9e-481d-82b7-ed08006f8074-istio-podinfo\") pod \"b85d7975-1a9e-481d-82b7-ed08006f8074\" (UID: \"b85d7975-1a9e-481d-82b7-ed08006f8074\") " Jul 15 13:21:42.624736 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:42.624615 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b85d7975-1a9e-481d-82b7-ed08006f8074-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b85d7975-1a9e-481d-82b7-ed08006f8074" (UID: "b85d7975-1a9e-481d-82b7-ed08006f8074"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:21:42.624839 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:42.624821 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b85d7975-1a9e-481d-82b7-ed08006f8074-workload-socket\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:21:42.624891 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:42.624841 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b85d7975-1a9e-481d-82b7-ed08006f8074-credential-socket\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:21:42.624891 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:42.624783 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b85d7975-1a9e-481d-82b7-ed08006f8074-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b85d7975-1a9e-481d-82b7-ed08006f8074" (UID: "b85d7975-1a9e-481d-82b7-ed08006f8074"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:21:42.624891 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:42.624863 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b85d7975-1a9e-481d-82b7-ed08006f8074-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b85d7975-1a9e-481d-82b7-ed08006f8074" (UID: "b85d7975-1a9e-481d-82b7-ed08006f8074"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:21:42.625073 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:42.625052 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b85d7975-1a9e-481d-82b7-ed08006f8074-istio-data" (OuterVolumeSpecName: "istio-data") pod "b85d7975-1a9e-481d-82b7-ed08006f8074" (UID: "b85d7975-1a9e-481d-82b7-ed08006f8074"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:21:42.626683 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:42.626658 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b85d7975-1a9e-481d-82b7-ed08006f8074-istio-token" (OuterVolumeSpecName: "istio-token") pod "b85d7975-1a9e-481d-82b7-ed08006f8074" (UID: "b85d7975-1a9e-481d-82b7-ed08006f8074"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:21:42.626817 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:42.626703 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b85d7975-1a9e-481d-82b7-ed08006f8074-kube-api-access-9jj47" (OuterVolumeSpecName: "kube-api-access-9jj47") pod "b85d7975-1a9e-481d-82b7-ed08006f8074" (UID: "b85d7975-1a9e-481d-82b7-ed08006f8074"). InnerVolumeSpecName "kube-api-access-9jj47". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:21:42.627139 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:42.627119 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b85d7975-1a9e-481d-82b7-ed08006f8074-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b85d7975-1a9e-481d-82b7-ed08006f8074" (UID: "b85d7975-1a9e-481d-82b7-ed08006f8074"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:21:42.627284 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:42.627261 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b85d7975-1a9e-481d-82b7-ed08006f8074-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b85d7975-1a9e-481d-82b7-ed08006f8074" (UID: "b85d7975-1a9e-481d-82b7-ed08006f8074"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 13:21:42.726021 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:42.725963 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b85d7975-1a9e-481d-82b7-ed08006f8074-istio-token\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:21:42.726021 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:42.726018 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b85d7975-1a9e-481d-82b7-ed08006f8074-workload-certs\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:21:42.726021 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:42.726028 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b85d7975-1a9e-481d-82b7-ed08006f8074-istiod-ca-cert\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:21:42.726244 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:42.726036 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b85d7975-1a9e-481d-82b7-ed08006f8074-istio-envoy\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:21:42.726244 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:42.726044 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b85d7975-1a9e-481d-82b7-ed08006f8074-istio-data\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:21:42.726244 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:42.726052 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b85d7975-1a9e-481d-82b7-ed08006f8074-istio-podinfo\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:21:42.726244 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:42.726059 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jj47\" (UniqueName: \"kubernetes.io/projected/b85d7975-1a9e-481d-82b7-ed08006f8074-kube-api-access-9jj47\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:21:43.338270 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:43.338235 2554 generic.go:356] "Generic (PLEG): container finished" podID="b85d7975-1a9e-481d-82b7-ed08006f8074" containerID="434084818e6abd816921e66408f094887284bedbc849e38a1db558db30cbd2a8" exitCode=0 Jul 15 13:21:43.338434 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:43.338279 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" Jul 15 13:21:43.338434 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:43.338304 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" event={"ID":"b85d7975-1a9e-481d-82b7-ed08006f8074","Type":"ContainerDied","Data":"434084818e6abd816921e66408f094887284bedbc849e38a1db558db30cbd2a8"} Jul 15 13:21:43.338434 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:43.338345 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm" event={"ID":"b85d7975-1a9e-481d-82b7-ed08006f8074","Type":"ContainerDied","Data":"9229ecc4ab550954e71ecc64391b4002b0b5704ca509d924cd2ac9ce7c6feda2"} Jul 15 13:21:43.338434 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:43.338365 2554 scope.go:117] "RemoveContainer" containerID="434084818e6abd816921e66408f094887284bedbc849e38a1db558db30cbd2a8" Jul 15 13:21:43.346457 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:43.346438 2554 scope.go:117] "RemoveContainer" containerID="434084818e6abd816921e66408f094887284bedbc849e38a1db558db30cbd2a8" Jul 15 13:21:43.346744 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:21:43.346725 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"434084818e6abd816921e66408f094887284bedbc849e38a1db558db30cbd2a8\": container with ID starting with 434084818e6abd816921e66408f094887284bedbc849e38a1db558db30cbd2a8 not found: ID does not exist" containerID="434084818e6abd816921e66408f094887284bedbc849e38a1db558db30cbd2a8" Jul 15 13:21:43.346788 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:43.346753 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"434084818e6abd816921e66408f094887284bedbc849e38a1db558db30cbd2a8"} err="failed to get container status \"434084818e6abd816921e66408f094887284bedbc849e38a1db558db30cbd2a8\": rpc error: code = NotFound desc = could not find container \"434084818e6abd816921e66408f094887284bedbc849e38a1db558db30cbd2a8\": container with ID starting with 434084818e6abd816921e66408f094887284bedbc849e38a1db558db30cbd2a8 not found: ID does not exist" Jul 15 13:21:43.361581 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:43.361552 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm"] Jul 15 13:21:43.364075 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:43.364056 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-tnbnm"] Jul 15 13:21:45.136398 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:45.136365 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b85d7975-1a9e-481d-82b7-ed08006f8074" path="/var/lib/kubelet/pods/b85d7975-1a9e-481d-82b7-ed08006f8074/volumes" Jul 15 13:21:49.322680 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:49.322609 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7557b79948-trqwv" Jul 15 13:21:56.233238 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:56.233202 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:21:56.283696 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:21:56.283658 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:22:22.871051 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:22:22.870974 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:22:23.004447 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:22:23.004416 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:22:23.114760 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:22:23.114729 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:22:51.271537 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:22:51.271502 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:22:51.881947 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:22:51.881917 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:22:52.286133 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:22:52.286095 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:22:55.265829 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:22:55.265797 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:22:55.357239 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:22:55.357208 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:22:55.641289 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:22:55.641205 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:22:55.960818 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:22:55.960735 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:22:56.082148 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:22:56.082119 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:22:56.287081 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:22:56.287046 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:22:58.471488 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:22:58.471450 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:22:59.090465 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:22:59.090433 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:00.311961 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:00.311929 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:02.287588 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:02.287556 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:02.504838 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:02.504798 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:05.528399 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:05.528368 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:05.624839 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:05.624808 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:05.745891 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:05.745861 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:05.833066 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:05.832975 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:07.445206 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:07.445177 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:07.514109 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:07.514072 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:09.530151 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:09.530117 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:09.628370 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:09.628337 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:11.487091 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:11.487058 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:12.380762 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:12.380731 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:12.482868 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:12.482838 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:12.901868 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:12.901839 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:13.819342 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:13.819314 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:13.918262 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:13.918226 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:19.230766 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:19.230685 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:19.336831 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:19.336787 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:22.350774 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:22.350743 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqf79"] Jul 15 13:23:22.351238 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:22.351153 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b85d7975-1a9e-481d-82b7-ed08006f8074" containerName="istio-proxy" Jul 15 13:23:22.351238 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:22.351169 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="b85d7975-1a9e-481d-82b7-ed08006f8074" containerName="istio-proxy" Jul 15 13:23:22.351317 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:22.351265 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="b85d7975-1a9e-481d-82b7-ed08006f8074" containerName="istio-proxy" Jul 15 13:23:22.354122 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:22.354100 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqf79" Jul 15 13:23:22.361428 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:22.361399 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 15 13:23:22.362587 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:22.362560 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 15 13:23:22.362728 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:22.362560 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-v8bhv\"" Jul 15 13:23:22.378618 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:22.378591 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqf79"] Jul 15 13:23:22.471615 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:22.471581 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgvm9\" (UniqueName: \"kubernetes.io/projected/1181339f-5146-4679-90c1-513965d49663-kube-api-access-hgvm9\") pod \"limitador-operator-controller-manager-859d7b78bd-lqf79\" (UID: \"1181339f-5146-4679-90c1-513965d49663\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqf79" Jul 15 13:23:22.572595 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:22.572552 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgvm9\" (UniqueName: \"kubernetes.io/projected/1181339f-5146-4679-90c1-513965d49663-kube-api-access-hgvm9\") pod \"limitador-operator-controller-manager-859d7b78bd-lqf79\" (UID: \"1181339f-5146-4679-90c1-513965d49663\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqf79" Jul 15 13:23:22.581644 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:22.581614 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgvm9\" (UniqueName: \"kubernetes.io/projected/1181339f-5146-4679-90c1-513965d49663-kube-api-access-hgvm9\") pod \"limitador-operator-controller-manager-859d7b78bd-lqf79\" (UID: \"1181339f-5146-4679-90c1-513965d49663\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqf79" Jul 15 13:23:22.665610 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:22.665515 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqf79" Jul 15 13:23:22.813625 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:22.813599 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqf79"] Jul 15 13:23:22.815572 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:23:22.815545 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1181339f_5146_4679_90c1_513965d49663.slice/crio-2ebadf83f1eeeb6310775f2c8225e2738fc5435dc85e9705a801f352d78024cb WatchSource:0}: Error finding container 2ebadf83f1eeeb6310775f2c8225e2738fc5435dc85e9705a801f352d78024cb: Status 404 returned error can't find the container with id 2ebadf83f1eeeb6310775f2c8225e2738fc5435dc85e9705a801f352d78024cb Jul 15 13:23:22.817547 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:22.817528 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 13:23:23.738938 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:23.738907 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqf79" event={"ID":"1181339f-5146-4679-90c1-513965d49663","Type":"ContainerStarted","Data":"2ebadf83f1eeeb6310775f2c8225e2738fc5435dc85e9705a801f352d78024cb"} Jul 15 13:23:24.744147 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:24.744117 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqf79" event={"ID":"1181339f-5146-4679-90c1-513965d49663","Type":"ContainerStarted","Data":"d5ee954b2571e19601d63e01110f21c3f68376507ff2d4b9379fdb7a34e67576"} Jul 15 13:23:24.744574 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:24.744241 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqf79" Jul 15 13:23:24.793461 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:24.793353 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqf79" podStartSLOduration=1.069054173 podStartE2EDuration="2.793338586s" totalImagesPullingTime="1.724284413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:23:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:23:24.79101131 +0000 UTC m=+718.221820887" watchObservedRunningTime="2026-07-15 13:23:24.793338586 +0000 UTC m=+718.224148160" Jul 15 13:23:24.971242 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:24.971209 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:25.100155 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:25.100078 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:25.659191 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:25.659158 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:25.766696 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:25.766667 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:30.103359 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:30.103324 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:30.812556 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:30.812523 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:32.764622 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:32.764591 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:32.905617 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:32.905581 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:35.750866 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:35.750837 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqf79" Jul 15 13:23:38.264365 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:38.264333 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:23:38.334858 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:23:38.334826 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:24:04.990721 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:04.990690 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm"] Jul 15 13:24:04.995715 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:04.995696 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:24:04.998303 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:04.998282 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-dzkgs\"" Jul 15 13:24:05.006277 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.006256 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm"] Jul 15 13:24:05.022602 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.022571 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:24:05.031223 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.031192 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/745be18d-f7b2-44a0-ba7c-33480476a1b3-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mzcfm\" (UID: \"745be18d-f7b2-44a0-ba7c-33480476a1b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:24:05.031350 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.031231 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/745be18d-f7b2-44a0-ba7c-33480476a1b3-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mzcfm\" (UID: \"745be18d-f7b2-44a0-ba7c-33480476a1b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:24:05.031350 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.031268 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/745be18d-f7b2-44a0-ba7c-33480476a1b3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mzcfm\" (UID: \"745be18d-f7b2-44a0-ba7c-33480476a1b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:24:05.031350 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.031313 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/745be18d-f7b2-44a0-ba7c-33480476a1b3-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mzcfm\" (UID: \"745be18d-f7b2-44a0-ba7c-33480476a1b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:24:05.031350 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.031334 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpwx6\" (UniqueName: \"kubernetes.io/projected/745be18d-f7b2-44a0-ba7c-33480476a1b3-kube-api-access-bpwx6\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mzcfm\" (UID: \"745be18d-f7b2-44a0-ba7c-33480476a1b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:24:05.031549 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.031360 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/745be18d-f7b2-44a0-ba7c-33480476a1b3-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mzcfm\" (UID: \"745be18d-f7b2-44a0-ba7c-33480476a1b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:24:05.031549 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.031429 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/745be18d-f7b2-44a0-ba7c-33480476a1b3-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mzcfm\" (UID: \"745be18d-f7b2-44a0-ba7c-33480476a1b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:24:05.031549 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.031502 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/745be18d-f7b2-44a0-ba7c-33480476a1b3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mzcfm\" (UID: \"745be18d-f7b2-44a0-ba7c-33480476a1b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:24:05.031549 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.031536 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/745be18d-f7b2-44a0-ba7c-33480476a1b3-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mzcfm\" (UID: \"745be18d-f7b2-44a0-ba7c-33480476a1b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:24:05.079891 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.079859 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:24:05.132185 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.132155 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/745be18d-f7b2-44a0-ba7c-33480476a1b3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mzcfm\" (UID: \"745be18d-f7b2-44a0-ba7c-33480476a1b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:24:05.132185 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.132191 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/745be18d-f7b2-44a0-ba7c-33480476a1b3-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mzcfm\" (UID: \"745be18d-f7b2-44a0-ba7c-33480476a1b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:24:05.132440 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.132215 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/745be18d-f7b2-44a0-ba7c-33480476a1b3-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mzcfm\" (UID: \"745be18d-f7b2-44a0-ba7c-33480476a1b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:24:05.132440 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.132247 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/745be18d-f7b2-44a0-ba7c-33480476a1b3-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mzcfm\" (UID: \"745be18d-f7b2-44a0-ba7c-33480476a1b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:24:05.132440 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.132279 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/745be18d-f7b2-44a0-ba7c-33480476a1b3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mzcfm\" (UID: \"745be18d-f7b2-44a0-ba7c-33480476a1b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:24:05.132440 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.132310 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/745be18d-f7b2-44a0-ba7c-33480476a1b3-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mzcfm\" (UID: \"745be18d-f7b2-44a0-ba7c-33480476a1b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:24:05.132440 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.132325 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpwx6\" (UniqueName: \"kubernetes.io/projected/745be18d-f7b2-44a0-ba7c-33480476a1b3-kube-api-access-bpwx6\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mzcfm\" (UID: \"745be18d-f7b2-44a0-ba7c-33480476a1b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:24:05.132440 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.132357 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/745be18d-f7b2-44a0-ba7c-33480476a1b3-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mzcfm\" (UID: \"745be18d-f7b2-44a0-ba7c-33480476a1b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:24:05.132440 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.132409 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/745be18d-f7b2-44a0-ba7c-33480476a1b3-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mzcfm\" (UID: \"745be18d-f7b2-44a0-ba7c-33480476a1b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:24:05.132793 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.132630 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/745be18d-f7b2-44a0-ba7c-33480476a1b3-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mzcfm\" (UID: \"745be18d-f7b2-44a0-ba7c-33480476a1b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:24:05.132793 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.132708 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/745be18d-f7b2-44a0-ba7c-33480476a1b3-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mzcfm\" (UID: \"745be18d-f7b2-44a0-ba7c-33480476a1b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:24:05.132905 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.132806 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/745be18d-f7b2-44a0-ba7c-33480476a1b3-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mzcfm\" (UID: \"745be18d-f7b2-44a0-ba7c-33480476a1b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:24:05.132959 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.132917 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/745be18d-f7b2-44a0-ba7c-33480476a1b3-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mzcfm\" (UID: \"745be18d-f7b2-44a0-ba7c-33480476a1b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:24:05.133028 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.132970 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/745be18d-f7b2-44a0-ba7c-33480476a1b3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mzcfm\" (UID: \"745be18d-f7b2-44a0-ba7c-33480476a1b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:24:05.134893 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.134869 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/745be18d-f7b2-44a0-ba7c-33480476a1b3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mzcfm\" (UID: \"745be18d-f7b2-44a0-ba7c-33480476a1b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:24:05.135023 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.134975 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/745be18d-f7b2-44a0-ba7c-33480476a1b3-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mzcfm\" (UID: \"745be18d-f7b2-44a0-ba7c-33480476a1b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:24:05.141269 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.141246 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/745be18d-f7b2-44a0-ba7c-33480476a1b3-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mzcfm\" (UID: \"745be18d-f7b2-44a0-ba7c-33480476a1b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:24:05.141531 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.141510 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpwx6\" (UniqueName: \"kubernetes.io/projected/745be18d-f7b2-44a0-ba7c-33480476a1b3-kube-api-access-bpwx6\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mzcfm\" (UID: \"745be18d-f7b2-44a0-ba7c-33480476a1b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:24:05.306834 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.306748 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:24:05.440630 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.440602 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm"] Jul 15 13:24:05.443189 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:24:05.443157 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745be18d_f7b2_44a0_ba7c_33480476a1b3.slice/crio-9f8f861c24be501935301ce0896002f4f5226b7c3245c610c3f29f32f28b724b WatchSource:0}: Error finding container 9f8f861c24be501935301ce0896002f4f5226b7c3245c610c3f29f32f28b724b: Status 404 returned error can't find the container with id 9f8f861c24be501935301ce0896002f4f5226b7c3245c610c3f29f32f28b724b Jul 15 13:24:05.445262 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.445223 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:24:05.445350 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.445291 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:24:05.445350 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.445323 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:24:05.920492 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.920460 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" event={"ID":"745be18d-f7b2-44a0-ba7c-33480476a1b3","Type":"ContainerStarted","Data":"1deefc7032c4de20832d99782be1150668490b409e293465557eadc8c99bca0b"} Jul 15 13:24:05.920677 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.920515 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" event={"ID":"745be18d-f7b2-44a0-ba7c-33480476a1b3","Type":"ContainerStarted","Data":"9f8f861c24be501935301ce0896002f4f5226b7c3245c610c3f29f32f28b724b"} Jul 15 13:24:05.942975 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:05.942927 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" podStartSLOduration=1.942911106 podStartE2EDuration="1.942911106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:24:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:24:05.941842103 +0000 UTC m=+759.372651679" watchObservedRunningTime="2026-07-15 13:24:05.942911106 +0000 UTC m=+759.373720680" Jul 15 13:24:06.307097 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:06.307063 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:24:06.311649 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:06.311625 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:24:06.925040 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:06.925009 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:24:06.925887 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:06.925870 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:24:18.976677 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:18.976635 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:24:19.091029 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:19.090994 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:24:19.152259 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:19.152228 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:24:19.838637 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:19.838605 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:24:19.893049 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:19.893021 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:24:38.541919 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:38.541883 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:24:38.651785 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:38.651755 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:24:39.038340 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:39.038305 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:24:51.267200 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:51.267122 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:24:51.702005 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:51.701901 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:24:58.748328 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:58.748292 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:24:58.825260 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:58.825228 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:24:58.928393 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:58.928355 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:24:59.025628 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:24:59.025552 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:25:01.613577 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:25:01.613540 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:25:01.722994 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:25:01.722950 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:25:34.705473 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:25:34.705436 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:25:34.768089 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:25:34.768054 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:25:37.355173 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:25:37.355144 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:25:37.455720 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:25:37.455688 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:25:37.942791 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:25:37.942752 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:25:38.488611 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:25:38.488579 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:25:38.584717 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:25:38.584685 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:25:38.661684 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:25:38.661654 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:25:46.354045 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:25:46.353947 2554 generic.go:356] "Generic (PLEG): container finished" podID="745be18d-f7b2-44a0-ba7c-33480476a1b3" containerID="1deefc7032c4de20832d99782be1150668490b409e293465557eadc8c99bca0b" exitCode=0 Jul 15 13:25:46.354045 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:25:46.354025 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" event={"ID":"745be18d-f7b2-44a0-ba7c-33480476a1b3","Type":"ContainerDied","Data":"1deefc7032c4de20832d99782be1150668490b409e293465557eadc8c99bca0b"} Jul 15 13:25:46.354460 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:25:46.354419 2554 scope.go:117] "RemoveContainer" containerID="1deefc7032c4de20832d99782be1150668490b409e293465557eadc8c99bca0b" Jul 15 13:25:46.355407 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:25:46.355379 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:25:46.355481 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:25:46.355464 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:25:46.355531 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:25:46.355516 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:25:47.360633 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:25:47.360592 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" event={"ID":"745be18d-f7b2-44a0-ba7c-33480476a1b3","Type":"ContainerStarted","Data":"67ba37c4007dce8f9ca8606160666ee3afe865854488c340fede4a5351bd91d3"} Jul 15 13:25:48.307205 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:25:48.307174 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:25:48.308419 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:25:48.308385 2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-mzcfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" start-of-body= Jul 15 13:25:48.308567 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:25:48.308463 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" podUID="745be18d-f7b2-44a0-ba7c-33480476a1b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" Jul 15 13:25:49.307502 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:25:49.307459 2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-mzcfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" start-of-body= Jul 15 13:25:49.308141 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:25:49.308101 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" podUID="745be18d-f7b2-44a0-ba7c-33480476a1b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" Jul 15 13:25:49.926255 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:25:49.926215 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:25:50.027949 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:25:50.027917 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:25:50.307545 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:25:50.307503 2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-mzcfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" start-of-body= Jul 15 13:25:50.308153 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:25:50.308119 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" podUID="745be18d-f7b2-44a0-ba7c-33480476a1b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" Jul 15 13:25:51.310760 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:25:51.310730 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:25:51.311140 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:25:51.311008 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:25:51.311783 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:25:51.311766 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mzcfm" Jul 15 13:25:53.915255 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:25:53.915225 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:26:11.595418 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:11.595386 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-8xn2p"] Jul 15 13:26:11.598657 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:11.598636 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xn2p" Jul 15 13:26:11.602832 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:11.602391 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 15 13:26:11.602832 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:11.602433 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 15 13:26:11.602832 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:11.602505 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 15 13:26:11.602832 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:11.602435 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gr4gv\"" Jul 15 13:26:11.607771 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:11.607750 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-8xn2p"] Jul 15 13:26:11.618642 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:11.618619 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:26:11.736542 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:11.736510 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmzhg\" (UniqueName: \"kubernetes.io/projected/fd276172-36a3-4248-8b26-4dcdc0bfde1b-kube-api-access-hmzhg\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xn2p\" (UID: \"fd276172-36a3-4248-8b26-4dcdc0bfde1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xn2p" Jul 15 13:26:11.736664 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:11.736568 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd276172-36a3-4248-8b26-4dcdc0bfde1b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xn2p\" (UID: \"fd276172-36a3-4248-8b26-4dcdc0bfde1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xn2p" Jul 15 13:26:11.736664 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:11.736601 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd276172-36a3-4248-8b26-4dcdc0bfde1b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xn2p\" (UID: \"fd276172-36a3-4248-8b26-4dcdc0bfde1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xn2p" Jul 15 13:26:11.736753 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:11.736687 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd276172-36a3-4248-8b26-4dcdc0bfde1b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xn2p\" (UID: \"fd276172-36a3-4248-8b26-4dcdc0bfde1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xn2p" Jul 15 13:26:11.736753 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:11.736733 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd276172-36a3-4248-8b26-4dcdc0bfde1b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xn2p\" (UID: \"fd276172-36a3-4248-8b26-4dcdc0bfde1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xn2p" Jul 15 13:26:11.736830 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:11.736758 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd276172-36a3-4248-8b26-4dcdc0bfde1b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xn2p\" (UID: \"fd276172-36a3-4248-8b26-4dcdc0bfde1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xn2p" Jul 15 13:26:11.837460 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:11.837423 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd276172-36a3-4248-8b26-4dcdc0bfde1b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xn2p\" (UID: \"fd276172-36a3-4248-8b26-4dcdc0bfde1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xn2p" Jul 15 13:26:11.837460 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:11.837466 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd276172-36a3-4248-8b26-4dcdc0bfde1b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xn2p\" (UID: \"fd276172-36a3-4248-8b26-4dcdc0bfde1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xn2p" Jul 15 13:26:11.837676 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:11.837506 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd276172-36a3-4248-8b26-4dcdc0bfde1b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xn2p\" (UID: \"fd276172-36a3-4248-8b26-4dcdc0bfde1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xn2p" Jul 15 13:26:11.837676 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:11.837541 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd276172-36a3-4248-8b26-4dcdc0bfde1b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xn2p\" (UID: \"fd276172-36a3-4248-8b26-4dcdc0bfde1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xn2p" Jul 15 13:26:11.837676 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:11.837565 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd276172-36a3-4248-8b26-4dcdc0bfde1b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xn2p\" (UID: \"fd276172-36a3-4248-8b26-4dcdc0bfde1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xn2p" Jul 15 13:26:11.837676 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:11.837605 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmzhg\" (UniqueName: \"kubernetes.io/projected/fd276172-36a3-4248-8b26-4dcdc0bfde1b-kube-api-access-hmzhg\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xn2p\" (UID: \"fd276172-36a3-4248-8b26-4dcdc0bfde1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xn2p" Jul 15 13:26:11.838116 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:11.837894 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd276172-36a3-4248-8b26-4dcdc0bfde1b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xn2p\" (UID: \"fd276172-36a3-4248-8b26-4dcdc0bfde1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xn2p" Jul 15 13:26:11.838116 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:11.837939 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd276172-36a3-4248-8b26-4dcdc0bfde1b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xn2p\" (UID: \"fd276172-36a3-4248-8b26-4dcdc0bfde1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xn2p" Jul 15 13:26:11.838116 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:11.837971 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd276172-36a3-4248-8b26-4dcdc0bfde1b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xn2p\" (UID: \"fd276172-36a3-4248-8b26-4dcdc0bfde1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xn2p" Jul 15 13:26:11.840402 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:11.840372 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd276172-36a3-4248-8b26-4dcdc0bfde1b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xn2p\" (UID: \"fd276172-36a3-4248-8b26-4dcdc0bfde1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xn2p" Jul 15 13:26:11.840754 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:11.840735 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd276172-36a3-4248-8b26-4dcdc0bfde1b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xn2p\" (UID: \"fd276172-36a3-4248-8b26-4dcdc0bfde1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xn2p" Jul 15 13:26:11.847394 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:11.847330 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmzhg\" (UniqueName: \"kubernetes.io/projected/fd276172-36a3-4248-8b26-4dcdc0bfde1b-kube-api-access-hmzhg\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8xn2p\" (UID: \"fd276172-36a3-4248-8b26-4dcdc0bfde1b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xn2p" Jul 15 13:26:11.936318 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:11.936282 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xn2p" Jul 15 13:26:12.067833 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:12.067809 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-8xn2p"] Jul 15 13:26:12.068541 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:26:12.068520 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd276172_36a3_4248_8b26_4dcdc0bfde1b.slice/crio-20eeb5f26963145459d337f50db336ae1e1128afbc9fdbbee7e51decf6204ea3 WatchSource:0}: Error finding container 20eeb5f26963145459d337f50db336ae1e1128afbc9fdbbee7e51decf6204ea3: Status 404 returned error can't find the container with id 20eeb5f26963145459d337f50db336ae1e1128afbc9fdbbee7e51decf6204ea3 Jul 15 13:26:12.470755 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:12.470706 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xn2p" event={"ID":"fd276172-36a3-4248-8b26-4dcdc0bfde1b","Type":"ContainerStarted","Data":"20eeb5f26963145459d337f50db336ae1e1128afbc9fdbbee7e51decf6204ea3"} Jul 15 13:26:13.475680 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:13.475651 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xn2p" event={"ID":"fd276172-36a3-4248-8b26-4dcdc0bfde1b","Type":"ContainerStarted","Data":"00126ed329dbe99aed0eec949e045cc2b88bad430287049d5eef86d87541e0c8"} Jul 15 13:26:13.495465 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:13.495419 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xn2p" podStartSLOduration=1.450337154 podStartE2EDuration="2.495405549s" totalImagesPullingTime="1.045068395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:26:13.494278467 +0000 UTC m=+886.925088042" watchObservedRunningTime="2026-07-15 13:26:13.495405549 +0000 UTC m=+886.926215123" Jul 15 13:26:14.030716 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:14.030674 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:26:17.620530 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:17.620478 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:26:17.676425 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:17.676397 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:26:21.936571 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:21.936487 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xn2p" Jul 15 13:26:21.936571 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:21.936548 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xn2p" Jul 15 13:26:21.948632 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:21.948609 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xn2p" Jul 15 13:26:22.523942 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:22.523915 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8xn2p" Jul 15 13:26:27.070291 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:27.070267 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lx562_83d9c378-e25b-487c-a9be-83e18e37d87f/ovn-acl-logging/0.log" Jul 15 13:26:27.070701 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:27.070267 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lx562_83d9c378-e25b-487c-a9be-83e18e37d87f/ovn-acl-logging/0.log" Jul 15 13:26:40.137876 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:40.137844 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:26:56.722362 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:26:56.722317 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:27:03.510438 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:27:03.510379 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:27:15.596875 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:27:15.596839 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:27:16.250383 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:27:16.250348 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:27:24.732797 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:27:24.732759 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:28:15.065847 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:28:15.065818 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:28:15.703829 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:28:15.703791 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:28:15.802560 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:28:15.802523 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:28:16.923219 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:28:16.923185 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:28:17.167579 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:28:17.167550 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:28:18.823341 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:28:18.823302 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:28:18.924955 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:28:18.924911 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:28:45.712353 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:28:45.712318 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:28:45.812782 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:28:45.812749 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:29:28.737656 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:29:28.737568 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:29:30.146328 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:29:30.146291 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:30:00.150380 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:30:00.150342 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735370-2jlk6"] Jul 15 13:30:00.153645 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:30:00.153630 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735370-2jlk6" Jul 15 13:30:00.156862 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:30:00.156843 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpj2c\"" Jul 15 13:30:00.163689 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:30:00.163662 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735370-2jlk6"] Jul 15 13:30:00.163875 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:30:00.163845 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735370-2jlk6" Jul 15 13:30:00.295087 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:30:00.295062 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735370-2jlk6"] Jul 15 13:30:00.300221 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:30:00.300177 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69a53a95_d5f7_48f7_8558_2259fd301a00.slice/crio-65684a323e783fc006483bb5c72af9077b061fdbdc87c2295f0f571dc8baddc9 WatchSource:0}: Error finding container 65684a323e783fc006483bb5c72af9077b061fdbdc87c2295f0f571dc8baddc9: Status 404 returned error can't find the container with id 65684a323e783fc006483bb5c72af9077b061fdbdc87c2295f0f571dc8baddc9 Jul 15 13:30:00.301634 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:30:00.301615 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 13:30:00.452975 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:30:00.452889 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735370-2jlk6" event={"ID":"69a53a95-d5f7-48f7-8558-2259fd301a00","Type":"ContainerStarted","Data":"65684a323e783fc006483bb5c72af9077b061fdbdc87c2295f0f571dc8baddc9"} Jul 15 13:30:03.469522 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:30:03.469485 2554 generic.go:356] "Generic (PLEG): container finished" podID="69a53a95-d5f7-48f7-8558-2259fd301a00" containerID="fb245abe5a887cd54de75887cd0a585ec6083004ca93a651d7f5425e2ac04c69" exitCode=0 Jul 15 13:30:03.469908 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:30:03.469541 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735370-2jlk6" event={"ID":"69a53a95-d5f7-48f7-8558-2259fd301a00","Type":"ContainerDied","Data":"fb245abe5a887cd54de75887cd0a585ec6083004ca93a651d7f5425e2ac04c69"} Jul 15 13:30:04.604856 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:30:04.604831 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735370-2jlk6" Jul 15 13:30:05.479585 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:30:05.479557 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735370-2jlk6" Jul 15 13:30:05.479585 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:30:05.479574 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735370-2jlk6" event={"ID":"69a53a95-d5f7-48f7-8558-2259fd301a00","Type":"ContainerDied","Data":"65684a323e783fc006483bb5c72af9077b061fdbdc87c2295f0f571dc8baddc9"} Jul 15 13:30:05.479806 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:30:05.479625 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65684a323e783fc006483bb5c72af9077b061fdbdc87c2295f0f571dc8baddc9" Jul 15 13:30:16.399065 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:30:16.399011 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:30:16.543372 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:30:16.543335 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:30:16.716462 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:30:16.716365 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:30:24.514084 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:30:24.514039 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:30:24.634670 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:30:24.634639 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:30:24.787670 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:30:24.787580 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:30:24.925106 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:30:24.925064 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:30:25.015462 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:30:25.015430 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:30:31.575514 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:30:31.575478 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:30:31.655218 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:30:31.655190 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:31:27.100670 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:31:27.100641 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lx562_83d9c378-e25b-487c-a9be-83e18e37d87f/ovn-acl-logging/0.log" Jul 15 13:31:27.103178 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:31:27.101689 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lx562_83d9c378-e25b-487c-a9be-83e18e37d87f/ovn-acl-logging/0.log" Jul 15 13:32:44.836072 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:32:44.835994 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:34:54.634057 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:34:54.634008 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:35:16.009244 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:35:16.009196 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:35:32.643041 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:35:32.642901 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:36:27.127088 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:36:27.126965 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lx562_83d9c378-e25b-487c-a9be-83e18e37d87f/ovn-acl-logging/0.log" Jul 15 13:36:27.131033 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:36:27.129718 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lx562_83d9c378-e25b-487c-a9be-83e18e37d87f/ovn-acl-logging/0.log" Jul 15 13:40:49.726711 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:40:49.726671 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:40:55.210672 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:40:55.210636 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:41:27.161274 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:27.161151 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lx562_83d9c378-e25b-487c-a9be-83e18e37d87f/ovn-acl-logging/0.log" Jul 15 13:41:27.162509 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:27.162424 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lx562_83d9c378-e25b-487c-a9be-83e18e37d87f/ovn-acl-logging/0.log" Jul 15 13:41:40.924369 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:40.924323 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:41:41.014128 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:41.014092 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:41:41.395234 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:41.395197 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:41:42.402918 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:42.402871 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:41:42.457510 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:42.457458 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:41:47.799070 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:47.799034 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:41:47.855324 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:47.855283 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:41:47.997031 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:47.996999 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb"] Jul 15 13:41:47.997511 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:47.997496 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69a53a95-d5f7-48f7-8558-2259fd301a00" containerName="cleanup" Jul 15 13:41:47.997568 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:47.997515 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="69a53a95-d5f7-48f7-8558-2259fd301a00" containerName="cleanup" Jul 15 13:41:47.997634 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:47.997623 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="69a53a95-d5f7-48f7-8558-2259fd301a00" containerName="cleanup" Jul 15 13:41:48.000819 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.000799 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:41:48.004993 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.004959 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e43089af-openshift-default-dockercfg-rnjkp\"" Jul 15 13:41:48.032207 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.032173 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb"] Jul 15 13:41:48.032781 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.032752 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:41:48.099998 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.099892 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tkp5\" (UniqueName: \"kubernetes.io/projected/a5cfc4a2-3385-4be1-a984-6b468e876c6a-kube-api-access-4tkp5\") pod \"e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:41:48.099998 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.099929 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5cfc4a2-3385-4be1-a984-6b468e876c6a-istio-data\") pod \"e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:41:48.099998 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.099951 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5cfc4a2-3385-4be1-a984-6b468e876c6a-istio-podinfo\") pod \"e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:41:48.100292 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.100055 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5cfc4a2-3385-4be1-a984-6b468e876c6a-istiod-ca-cert\") pod \"e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:41:48.100292 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.100093 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5cfc4a2-3385-4be1-a984-6b468e876c6a-istio-envoy\") pod \"e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:41:48.100292 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.100146 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5cfc4a2-3385-4be1-a984-6b468e876c6a-workload-socket\") pod \"e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:41:48.100292 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.100186 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5cfc4a2-3385-4be1-a984-6b468e876c6a-credential-socket\") pod \"e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:41:48.100292 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.100215 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5cfc4a2-3385-4be1-a984-6b468e876c6a-workload-certs\") pod \"e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:41:48.100292 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.100261 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5cfc4a2-3385-4be1-a984-6b468e876c6a-istio-token\") pod \"e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:41:48.133870 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.133831 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:41:48.200693 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.200654 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5cfc4a2-3385-4be1-a984-6b468e876c6a-workload-socket\") pod \"e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:41:48.200693 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.200703 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5cfc4a2-3385-4be1-a984-6b468e876c6a-credential-socket\") pod \"e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:41:48.200920 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.200724 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5cfc4a2-3385-4be1-a984-6b468e876c6a-workload-certs\") pod \"e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:41:48.200920 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.200750 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5cfc4a2-3385-4be1-a984-6b468e876c6a-istio-token\") pod \"e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:41:48.200920 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.200776 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tkp5\" (UniqueName: \"kubernetes.io/projected/a5cfc4a2-3385-4be1-a984-6b468e876c6a-kube-api-access-4tkp5\") pod \"e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:41:48.200920 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.200796 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5cfc4a2-3385-4be1-a984-6b468e876c6a-istio-data\") pod \"e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:41:48.200920 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.200813 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5cfc4a2-3385-4be1-a984-6b468e876c6a-istio-podinfo\") pod \"e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:41:48.200920 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.200847 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5cfc4a2-3385-4be1-a984-6b468e876c6a-istiod-ca-cert\") pod \"e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:41:48.200920 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.200873 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5cfc4a2-3385-4be1-a984-6b468e876c6a-istio-envoy\") pod \"e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:41:48.201497 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.201141 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5cfc4a2-3385-4be1-a984-6b468e876c6a-workload-socket\") pod \"e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:41:48.201497 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.201216 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5cfc4a2-3385-4be1-a984-6b468e876c6a-workload-certs\") pod \"e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:41:48.201497 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.201315 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5cfc4a2-3385-4be1-a984-6b468e876c6a-istio-data\") pod \"e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:41:48.201497 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.201375 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5cfc4a2-3385-4be1-a984-6b468e876c6a-credential-socket\") pod \"e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:41:48.201711 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.201636 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5cfc4a2-3385-4be1-a984-6b468e876c6a-istiod-ca-cert\") pod \"e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:41:48.203163 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.203139 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5cfc4a2-3385-4be1-a984-6b468e876c6a-istio-envoy\") pod \"e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:41:48.203392 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.203375 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5cfc4a2-3385-4be1-a984-6b468e876c6a-istio-podinfo\") pod \"e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:41:48.210957 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.210937 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tkp5\" (UniqueName: \"kubernetes.io/projected/a5cfc4a2-3385-4be1-a984-6b468e876c6a-kube-api-access-4tkp5\") pod \"e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:41:48.212346 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.212325 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5cfc4a2-3385-4be1-a984-6b468e876c6a-istio-token\") pod \"e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:41:48.311361 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.311328 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:41:48.445688 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.445660 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb"] Jul 15 13:41:48.448243 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:41:48.448207 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5cfc4a2_3385_4be1_a984_6b468e876c6a.slice/crio-410d0ffeb896869b144dc1dbd3b81fc2feb54134b3407725d526eeb2b6140a77 WatchSource:0}: Error finding container 410d0ffeb896869b144dc1dbd3b81fc2feb54134b3407725d526eeb2b6140a77: Status 404 returned error can't find the container with id 410d0ffeb896869b144dc1dbd3b81fc2feb54134b3407725d526eeb2b6140a77 Jul 15 13:41:48.450434 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.450403 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:41:48.450505 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.450485 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:41:48.450548 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.450517 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:41:48.552266 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.552229 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" event={"ID":"a5cfc4a2-3385-4be1-a984-6b468e876c6a","Type":"ContainerStarted","Data":"c89dd3c856962547b3d94f210e6d6656c0a7ba82ed661d0ae837d6292a7b4538"} Jul 15 13:41:48.552486 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.552283 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" event={"ID":"a5cfc4a2-3385-4be1-a984-6b468e876c6a","Type":"ContainerStarted","Data":"410d0ffeb896869b144dc1dbd3b81fc2feb54134b3407725d526eeb2b6140a77"} Jul 15 13:41:48.576290 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:48.576238 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" podStartSLOduration=1.576220918 podStartE2EDuration="1.576220918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:41:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:41:48.574338854 +0000 UTC m=+1822.005148425" watchObservedRunningTime="2026-07-15 13:41:48.576220918 +0000 UTC m=+1822.007030492" Jul 15 13:41:49.241230 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:49.241198 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:41:49.311590 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:49.311561 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:41:49.316285 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:49.316260 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:41:49.324288 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:49.324262 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:41:49.394125 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:49.394095 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:41:49.556474 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:49.556376 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:41:49.557240 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:49.557218 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:41:49.591712 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:49.591679 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:41:49.944701 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:49.944620 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:41:50.040382 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:50.040350 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:41:51.931295 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:51.931260 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:41:54.306334 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:54.306290 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e43089af-kgdqs"] Jul 15 13:41:54.311369 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:54.311344 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e43089af-kgdqs" Jul 15 13:41:54.316119 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:54.316091 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 13:41:54.318593 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:54.317480 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpj2c\"" Jul 15 13:41:54.318751 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:54.318720 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e43089af-kgdqs"] Jul 15 13:41:54.456966 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:54.456918 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c92164ff-5652-4179-a605-a142f11bf3b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e43089af-kgdqs\" (UID: \"c92164ff-5652-4179-a605-a142f11bf3b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e43089af-kgdqs" Jul 15 13:41:54.558340 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:54.558231 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c92164ff-5652-4179-a605-a142f11bf3b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e43089af-kgdqs\" (UID: \"c92164ff-5652-4179-a605-a142f11bf3b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e43089af-kgdqs" Jul 15 13:41:54.558896 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:54.558874 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c92164ff-5652-4179-a605-a142f11bf3b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e43089af-kgdqs\" (UID: \"c92164ff-5652-4179-a605-a142f11bf3b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e43089af-kgdqs" Jul 15 13:41:54.637698 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:54.637660 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e43089af-kgdqs" Jul 15 13:41:54.790216 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:54.790185 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e43089af-kgdqs"] Jul 15 13:41:54.792343 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:41:54.792315 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc92164ff_5652_4179_a605_a142f11bf3b1.slice/crio-0874a237f24158c8f4c6ea11885053d93293822d14080153242a54cd1e32bed0 WatchSource:0}: Error finding container 0874a237f24158c8f4c6ea11885053d93293822d14080153242a54cd1e32bed0: Status 404 returned error can't find the container with id 0874a237f24158c8f4c6ea11885053d93293822d14080153242a54cd1e32bed0 Jul 15 13:41:55.583495 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:55.583452 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e43089af-kgdqs" event={"ID":"c92164ff-5652-4179-a605-a142f11bf3b1","Type":"ContainerStarted","Data":"04e49870540311045ce519b7d3b76fb272b98d06d24bec767892e3980e38c29e"} Jul 15 13:41:55.583892 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:55.583515 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e43089af-kgdqs" event={"ID":"c92164ff-5652-4179-a605-a142f11bf3b1","Type":"ContainerStarted","Data":"0874a237f24158c8f4c6ea11885053d93293822d14080153242a54cd1e32bed0"} Jul 15 13:41:55.607079 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:55.607013 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e43089af-kgdqs" podStartSLOduration=1.606971626 podStartE2EDuration="1.606971626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:41:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:41:55.605417895 +0000 UTC m=+1829.036227470" watchObservedRunningTime="2026-07-15 13:41:55.606971626 +0000 UTC m=+1829.037781201" Jul 15 13:41:56.589657 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:56.589622 2554 generic.go:356] "Generic (PLEG): container finished" podID="c92164ff-5652-4179-a605-a142f11bf3b1" containerID="04e49870540311045ce519b7d3b76fb272b98d06d24bec767892e3980e38c29e" exitCode=7 Jul 15 13:41:56.590170 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:56.589713 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e43089af-kgdqs" event={"ID":"c92164ff-5652-4179-a605-a142f11bf3b1","Type":"ContainerDied","Data":"04e49870540311045ce519b7d3b76fb272b98d06d24bec767892e3980e38c29e"} Jul 15 13:41:56.590170 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:56.589936 2554 scope.go:117] "RemoveContainer" containerID="04e49870540311045ce519b7d3b76fb272b98d06d24bec767892e3980e38c29e" Jul 15 13:41:57.595580 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:57.595545 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e43089af-kgdqs" event={"ID":"c92164ff-5652-4179-a605-a142f11bf3b1","Type":"ContainerStarted","Data":"30a920401b82bfd2855f63d4541607b83f90b83baabd6fb36d8a4c5966299170"} Jul 15 13:41:58.602890 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:58.602851 2554 generic.go:356] "Generic (PLEG): container finished" podID="c92164ff-5652-4179-a605-a142f11bf3b1" containerID="30a920401b82bfd2855f63d4541607b83f90b83baabd6fb36d8a4c5966299170" exitCode=0 Jul 15 13:41:58.602890 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:58.602887 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e43089af-kgdqs" event={"ID":"c92164ff-5652-4179-a605-a142f11bf3b1","Type":"ContainerDied","Data":"30a920401b82bfd2855f63d4541607b83f90b83baabd6fb36d8a4c5966299170"} Jul 15 13:41:58.603452 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:58.602950 2554 scope.go:117] "RemoveContainer" containerID="04e49870540311045ce519b7d3b76fb272b98d06d24bec767892e3980e38c29e" Jul 15 13:41:59.740313 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:59.740290 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e43089af-kgdqs" Jul 15 13:41:59.908010 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:59.907916 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c92164ff-5652-4179-a605-a142f11bf3b1-maas-api-service-ca\") pod \"c92164ff-5652-4179-a605-a142f11bf3b1\" (UID: \"c92164ff-5652-4179-a605-a142f11bf3b1\") " Jul 15 13:41:59.908381 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:41:59.908353 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c92164ff-5652-4179-a605-a142f11bf3b1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c92164ff-5652-4179-a605-a142f11bf3b1" (UID: "c92164ff-5652-4179-a605-a142f11bf3b1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:42:00.009635 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:00.009601 2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c92164ff-5652-4179-a605-a142f11bf3b1-maas-api-service-ca\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:42:00.619614 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:00.619562 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e43089af-kgdqs" Jul 15 13:42:00.619614 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:00.619602 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e43089af-kgdqs" event={"ID":"c92164ff-5652-4179-a605-a142f11bf3b1","Type":"ContainerDied","Data":"0874a237f24158c8f4c6ea11885053d93293822d14080153242a54cd1e32bed0"} Jul 15 13:42:00.620911 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:00.619648 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0874a237f24158c8f4c6ea11885053d93293822d14080153242a54cd1e32bed0" Jul 15 13:42:01.627230 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:01.627195 2554 generic.go:356] "Generic (PLEG): container finished" podID="a5cfc4a2-3385-4be1-a984-6b468e876c6a" containerID="c89dd3c856962547b3d94f210e6d6656c0a7ba82ed661d0ae837d6292a7b4538" exitCode=0 Jul 15 13:42:01.627712 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:01.627271 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" event={"ID":"a5cfc4a2-3385-4be1-a984-6b468e876c6a","Type":"ContainerDied","Data":"c89dd3c856962547b3d94f210e6d6656c0a7ba82ed661d0ae837d6292a7b4538"} Jul 15 13:42:01.627805 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:01.627770 2554 scope.go:117] "RemoveContainer" containerID="c89dd3c856962547b3d94f210e6d6656c0a7ba82ed661d0ae837d6292a7b4538" Jul 15 13:42:01.628806 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:01.628779 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:42:01.628908 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:01.628847 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:42:01.628908 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:01.628878 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:42:02.633795 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:02.633759 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" event={"ID":"a5cfc4a2-3385-4be1-a984-6b468e876c6a","Type":"ContainerStarted","Data":"3e7e0ece173dbf8de36d36a36a3e01950f904a10c7f0906460824755e3c82faf"} Jul 15 13:42:03.312211 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:03.312177 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:42:03.313288 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:03.313264 2554 patch_prober.go:28] interesting pod/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jul 15 13:42:03.313413 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:03.313319 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" podUID="a5cfc4a2-3385-4be1-a984-6b468e876c6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jul 15 13:42:04.312521 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:04.312488 2554 patch_prober.go:28] interesting pod/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jul 15 13:42:04.312909 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:04.312551 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" podUID="a5cfc4a2-3385-4be1-a984-6b468e876c6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jul 15 13:42:04.556782 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:04.556747 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:42:05.014793 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:05.014757 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:42:05.312814 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:05.312708 2554 patch_prober.go:28] interesting pod/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jul 15 13:42:05.313423 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:05.313384 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" podUID="a5cfc4a2-3385-4be1-a984-6b468e876c6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jul 15 13:42:06.313732 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:06.313691 2554 patch_prober.go:28] interesting pod/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jul 15 13:42:06.314260 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:06.313761 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" podUID="a5cfc4a2-3385-4be1-a984-6b468e876c6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jul 15 13:42:07.312151 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:07.312107 2554 patch_prober.go:28] interesting pod/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jul 15 13:42:07.312368 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:07.312173 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" podUID="a5cfc4a2-3385-4be1-a984-6b468e876c6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jul 15 13:42:08.312586 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:08.312544 2554 patch_prober.go:28] interesting pod/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jul 15 13:42:08.313115 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:08.312614 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" podUID="a5cfc4a2-3385-4be1-a984-6b468e876c6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jul 15 13:42:09.312501 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:09.312463 2554 patch_prober.go:28] interesting pod/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jul 15 13:42:09.312688 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:09.312518 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" podUID="a5cfc4a2-3385-4be1-a984-6b468e876c6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jul 15 13:42:09.412592 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:09.412546 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:42:10.316109 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:10.316081 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:42:10.317062 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:10.317041 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:42:15.231707 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:15.231672 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:42:15.292833 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:15.292802 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:42:19.589330 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:19.589295 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb"] Jul 15 13:42:19.589820 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:19.589568 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" podUID="a5cfc4a2-3385-4be1-a984-6b468e876c6a" containerName="istio-proxy" containerID="cri-o://3e7e0ece173dbf8de36d36a36a3e01950f904a10c7f0906460824755e3c82faf" gracePeriod=30 Jul 15 13:42:19.610395 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:19.610361 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:42:19.989266 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:19.989235 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:42:22.632473 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:22.632435 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:42:22.692937 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:22.692897 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:42:24.733653 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:24.733619 2554 generic.go:356] "Generic (PLEG): container finished" podID="a5cfc4a2-3385-4be1-a984-6b468e876c6a" containerID="3e7e0ece173dbf8de36d36a36a3e01950f904a10c7f0906460824755e3c82faf" exitCode=0 Jul 15 13:42:24.734081 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:24.733699 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" event={"ID":"a5cfc4a2-3385-4be1-a984-6b468e876c6a","Type":"ContainerDied","Data":"3e7e0ece173dbf8de36d36a36a3e01950f904a10c7f0906460824755e3c82faf"} Jul 15 13:42:24.734081 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:24.733779 2554 scope.go:117] "RemoveContainer" containerID="c89dd3c856962547b3d94f210e6d6656c0a7ba82ed661d0ae837d6292a7b4538" Jul 15 13:42:24.841101 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:24.841078 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:42:24.923212 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:24.923185 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4tkp5\" (UniqueName: \"kubernetes.io/projected/a5cfc4a2-3385-4be1-a984-6b468e876c6a-kube-api-access-4tkp5\") pod \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " Jul 15 13:42:24.923347 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:24.923224 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5cfc4a2-3385-4be1-a984-6b468e876c6a-istio-podinfo\") pod \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " Jul 15 13:42:24.923347 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:24.923298 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5cfc4a2-3385-4be1-a984-6b468e876c6a-workload-certs\") pod \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " Jul 15 13:42:24.923347 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:24.923337 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5cfc4a2-3385-4be1-a984-6b468e876c6a-workload-socket\") pod \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " Jul 15 13:42:24.923504 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:24.923360 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5cfc4a2-3385-4be1-a984-6b468e876c6a-istio-token\") pod \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " Jul 15 13:42:24.923504 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:24.923402 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5cfc4a2-3385-4be1-a984-6b468e876c6a-istio-envoy\") pod \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " Jul 15 13:42:24.923504 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:24.923425 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5cfc4a2-3385-4be1-a984-6b468e876c6a-credential-socket\") pod \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " Jul 15 13:42:24.923504 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:24.923453 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5cfc4a2-3385-4be1-a984-6b468e876c6a-istio-data\") pod \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " Jul 15 13:42:24.923693 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:24.923505 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5cfc4a2-3385-4be1-a984-6b468e876c6a-istiod-ca-cert\") pod \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\" (UID: \"a5cfc4a2-3385-4be1-a984-6b468e876c6a\") " Jul 15 13:42:24.923693 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:24.923621 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5cfc4a2-3385-4be1-a984-6b468e876c6a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a5cfc4a2-3385-4be1-a984-6b468e876c6a" (UID: "a5cfc4a2-3385-4be1-a984-6b468e876c6a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:42:24.923809 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:24.923743 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5cfc4a2-3385-4be1-a984-6b468e876c6a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a5cfc4a2-3385-4be1-a984-6b468e876c6a" (UID: "a5cfc4a2-3385-4be1-a984-6b468e876c6a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:42:24.923809 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:24.923796 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5cfc4a2-3385-4be1-a984-6b468e876c6a-workload-socket\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:42:24.924167 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:24.924129 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5cfc4a2-3385-4be1-a984-6b468e876c6a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a5cfc4a2-3385-4be1-a984-6b468e876c6a" (UID: "a5cfc4a2-3385-4be1-a984-6b468e876c6a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:42:24.924667 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:24.924645 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5cfc4a2-3385-4be1-a984-6b468e876c6a-istio-data" (OuterVolumeSpecName: "istio-data") pod "a5cfc4a2-3385-4be1-a984-6b468e876c6a" (UID: "a5cfc4a2-3385-4be1-a984-6b468e876c6a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:42:24.924734 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:24.924717 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5cfc4a2-3385-4be1-a984-6b468e876c6a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a5cfc4a2-3385-4be1-a984-6b468e876c6a" (UID: "a5cfc4a2-3385-4be1-a984-6b468e876c6a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:42:24.925628 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:24.925604 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5cfc4a2-3385-4be1-a984-6b468e876c6a-istio-token" (OuterVolumeSpecName: "istio-token") pod "a5cfc4a2-3385-4be1-a984-6b468e876c6a" (UID: "a5cfc4a2-3385-4be1-a984-6b468e876c6a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:42:24.925853 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:24.925821 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5cfc4a2-3385-4be1-a984-6b468e876c6a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a5cfc4a2-3385-4be1-a984-6b468e876c6a" (UID: "a5cfc4a2-3385-4be1-a984-6b468e876c6a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:42:24.925853 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:24.925830 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5cfc4a2-3385-4be1-a984-6b468e876c6a-kube-api-access-4tkp5" (OuterVolumeSpecName: "kube-api-access-4tkp5") pod "a5cfc4a2-3385-4be1-a984-6b468e876c6a" (UID: "a5cfc4a2-3385-4be1-a984-6b468e876c6a"). InnerVolumeSpecName "kube-api-access-4tkp5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:42:24.926067 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:24.925888 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a5cfc4a2-3385-4be1-a984-6b468e876c6a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a5cfc4a2-3385-4be1-a984-6b468e876c6a" (UID: "a5cfc4a2-3385-4be1-a984-6b468e876c6a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 13:42:25.025171 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:25.025141 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5cfc4a2-3385-4be1-a984-6b468e876c6a-istio-token\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:42:25.025171 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:25.025166 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5cfc4a2-3385-4be1-a984-6b468e876c6a-istio-envoy\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:42:25.025171 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:25.025177 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5cfc4a2-3385-4be1-a984-6b468e876c6a-credential-socket\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:42:25.025393 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:25.025187 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5cfc4a2-3385-4be1-a984-6b468e876c6a-istio-data\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:42:25.025393 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:25.025195 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5cfc4a2-3385-4be1-a984-6b468e876c6a-istiod-ca-cert\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:42:25.025393 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:25.025203 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tkp5\" (UniqueName: \"kubernetes.io/projected/a5cfc4a2-3385-4be1-a984-6b468e876c6a-kube-api-access-4tkp5\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:42:25.025393 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:25.025211 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5cfc4a2-3385-4be1-a984-6b468e876c6a-istio-podinfo\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:42:25.025393 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:25.025219 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5cfc4a2-3385-4be1-a984-6b468e876c6a-workload-certs\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:42:25.739868 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:25.739838 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" Jul 15 13:42:25.739868 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:25.739845 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb" event={"ID":"a5cfc4a2-3385-4be1-a984-6b468e876c6a","Type":"ContainerDied","Data":"410d0ffeb896869b144dc1dbd3b81fc2feb54134b3407725d526eeb2b6140a77"} Jul 15 13:42:25.740406 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:25.739907 2554 scope.go:117] "RemoveContainer" containerID="3e7e0ece173dbf8de36d36a36a3e01950f904a10c7f0906460824755e3c82faf" Jul 15 13:42:25.759092 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:25.759065 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb"] Jul 15 13:42:25.765560 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:25.765528 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e43089af-openshift-default-74f4b9bd9f-brbqb"] Jul 15 13:42:25.959261 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:25.959225 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-g4wwn"] Jul 15 13:42:25.959628 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:25.959610 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c92164ff-5652-4179-a605-a142f11bf3b1" containerName="revoke-keys" Jul 15 13:42:25.959731 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:25.959632 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c92164ff-5652-4179-a605-a142f11bf3b1" containerName="revoke-keys" Jul 15 13:42:25.959731 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:25.959646 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c92164ff-5652-4179-a605-a142f11bf3b1" containerName="revoke-keys" Jul 15 13:42:25.959731 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:25.959654 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c92164ff-5652-4179-a605-a142f11bf3b1" containerName="revoke-keys" Jul 15 13:42:25.959731 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:25.959666 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5cfc4a2-3385-4be1-a984-6b468e876c6a" containerName="istio-proxy" Jul 15 13:42:25.959731 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:25.959674 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5cfc4a2-3385-4be1-a984-6b468e876c6a" containerName="istio-proxy" Jul 15 13:42:25.959731 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:25.959685 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5cfc4a2-3385-4be1-a984-6b468e876c6a" containerName="istio-proxy" Jul 15 13:42:25.959731 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:25.959693 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5cfc4a2-3385-4be1-a984-6b468e876c6a" containerName="istio-proxy" Jul 15 13:42:25.960118 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:25.959776 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5cfc4a2-3385-4be1-a984-6b468e876c6a" containerName="istio-proxy" Jul 15 13:42:25.960118 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:25.959790 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c92164ff-5652-4179-a605-a142f11bf3b1" containerName="revoke-keys" Jul 15 13:42:25.960118 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:25.959804 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c92164ff-5652-4179-a605-a142f11bf3b1" containerName="revoke-keys" Jul 15 13:42:25.962864 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:25.962844 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-g4wwn" Jul 15 13:42:25.965431 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:25.965412 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 13:42:25.965431 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:25.965428 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpj2c\"" Jul 15 13:42:25.970180 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:25.970160 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-g4wwn"] Jul 15 13:42:26.034193 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:26.034099 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/95cf7a7b-50b6-4129-a443-8fa7d10ae898-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-17469591-g4wwn\" (UID: \"95cf7a7b-50b6-4129-a443-8fa7d10ae898\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-g4wwn" Jul 15 13:42:26.134951 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:26.134917 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/95cf7a7b-50b6-4129-a443-8fa7d10ae898-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-17469591-g4wwn\" (UID: \"95cf7a7b-50b6-4129-a443-8fa7d10ae898\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-g4wwn" Jul 15 13:42:26.135504 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:26.135485 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/95cf7a7b-50b6-4129-a443-8fa7d10ae898-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-17469591-g4wwn\" (UID: \"95cf7a7b-50b6-4129-a443-8fa7d10ae898\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-g4wwn" Jul 15 13:42:26.220912 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:26.220878 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:42:26.274899 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:26.274864 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-g4wwn" Jul 15 13:42:26.276632 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:26.276603 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:42:26.402818 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:26.402795 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-g4wwn"] Jul 15 13:42:26.405037 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:42:26.405012 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95cf7a7b_50b6_4129_a443_8fa7d10ae898.slice/crio-69c1820b54c137597db00891341213bb299e85525090666923884786fb24f34b WatchSource:0}: Error finding container 69c1820b54c137597db00891341213bb299e85525090666923884786fb24f34b: Status 404 returned error can't find the container with id 69c1820b54c137597db00891341213bb299e85525090666923884786fb24f34b Jul 15 13:42:26.746607 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:26.746581 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-g4wwn" event={"ID":"95cf7a7b-50b6-4129-a443-8fa7d10ae898","Type":"ContainerStarted","Data":"d014374049e822ba7760550b7a34f274ee478ace515edd4980500b2a778450ca"} Jul 15 13:42:26.746933 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:26.746630 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-g4wwn" event={"ID":"95cf7a7b-50b6-4129-a443-8fa7d10ae898","Type":"ContainerStarted","Data":"69c1820b54c137597db00891341213bb299e85525090666923884786fb24f34b"} Jul 15 13:42:26.762306 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:26.762212 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-g4wwn" podStartSLOduration=1.762195017 podStartE2EDuration="1.762195017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:42:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:42:26.761668262 +0000 UTC m=+1860.192477841" watchObservedRunningTime="2026-07-15 13:42:26.762195017 +0000 UTC m=+1860.193004591" Jul 15 13:42:27.137215 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:27.137185 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5cfc4a2-3385-4be1-a984-6b468e876c6a" path="/var/lib/kubelet/pods/a5cfc4a2-3385-4be1-a984-6b468e876c6a/volumes" Jul 15 13:42:27.752786 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:27.752756 2554 generic.go:356] "Generic (PLEG): container finished" podID="95cf7a7b-50b6-4129-a443-8fa7d10ae898" containerID="d014374049e822ba7760550b7a34f274ee478ace515edd4980500b2a778450ca" exitCode=7 Jul 15 13:42:27.753213 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:27.752793 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-g4wwn" event={"ID":"95cf7a7b-50b6-4129-a443-8fa7d10ae898","Type":"ContainerDied","Data":"d014374049e822ba7760550b7a34f274ee478ace515edd4980500b2a778450ca"} Jul 15 13:42:27.753213 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:27.753044 2554 scope.go:117] "RemoveContainer" containerID="d014374049e822ba7760550b7a34f274ee478ace515edd4980500b2a778450ca" Jul 15 13:42:28.758907 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:28.758872 2554 generic.go:356] "Generic (PLEG): container finished" podID="95cf7a7b-50b6-4129-a443-8fa7d10ae898" containerID="45860843abaf6d5c3a98b26085b1993e48de201a1ae990547fdd0eac4d7fe8b9" exitCode=7 Jul 15 13:42:28.758907 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:28.758910 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-g4wwn" event={"ID":"95cf7a7b-50b6-4129-a443-8fa7d10ae898","Type":"ContainerDied","Data":"45860843abaf6d5c3a98b26085b1993e48de201a1ae990547fdd0eac4d7fe8b9"} Jul 15 13:42:28.759577 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:28.758956 2554 scope.go:117] "RemoveContainer" containerID="d014374049e822ba7760550b7a34f274ee478ace515edd4980500b2a778450ca" Jul 15 13:42:28.759577 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:28.759229 2554 scope.go:117] "RemoveContainer" containerID="45860843abaf6d5c3a98b26085b1993e48de201a1ae990547fdd0eac4d7fe8b9" Jul 15 13:42:28.759577 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:42:28.759453 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-17469591-g4wwn_odh-ai-gateway-infra(95cf7a7b-50b6-4129-a443-8fa7d10ae898)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-g4wwn" podUID="95cf7a7b-50b6-4129-a443-8fa7d10ae898" Jul 15 13:42:29.765313 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:29.765285 2554 scope.go:117] "RemoveContainer" containerID="45860843abaf6d5c3a98b26085b1993e48de201a1ae990547fdd0eac4d7fe8b9" Jul 15 13:42:29.765698 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:42:29.765468 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-17469591-g4wwn_odh-ai-gateway-infra(95cf7a7b-50b6-4129-a443-8fa7d10ae898)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-g4wwn" podUID="95cf7a7b-50b6-4129-a443-8fa7d10ae898" Jul 15 13:42:29.879479 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:29.879437 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:42:43.132254 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:43.132225 2554 scope.go:117] "RemoveContainer" containerID="45860843abaf6d5c3a98b26085b1993e48de201a1ae990547fdd0eac4d7fe8b9" Jul 15 13:42:43.827340 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:43.827308 2554 generic.go:356] "Generic (PLEG): container finished" podID="95cf7a7b-50b6-4129-a443-8fa7d10ae898" containerID="bed78508066fd6f9290bedd617e41186274c59b4ad35d70b33c6c3b8a32e4842" exitCode=0 Jul 15 13:42:43.827458 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:43.827386 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-g4wwn" event={"ID":"95cf7a7b-50b6-4129-a443-8fa7d10ae898","Type":"ContainerDied","Data":"bed78508066fd6f9290bedd617e41186274c59b4ad35d70b33c6c3b8a32e4842"} Jul 15 13:42:43.827458 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:43.827454 2554 scope.go:117] "RemoveContainer" containerID="45860843abaf6d5c3a98b26085b1993e48de201a1ae990547fdd0eac4d7fe8b9" Jul 15 13:42:44.855136 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:44.855104 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-g4wwn"] Jul 15 13:42:44.970731 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:44.970707 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-g4wwn" Jul 15 13:42:45.106153 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:45.106054 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/95cf7a7b-50b6-4129-a443-8fa7d10ae898-maas-api-service-ca\") pod \"95cf7a7b-50b6-4129-a443-8fa7d10ae898\" (UID: \"95cf7a7b-50b6-4129-a443-8fa7d10ae898\") " Jul 15 13:42:45.106499 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:45.106460 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95cf7a7b-50b6-4129-a443-8fa7d10ae898-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "95cf7a7b-50b6-4129-a443-8fa7d10ae898" (UID: "95cf7a7b-50b6-4129-a443-8fa7d10ae898"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:42:45.206953 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:45.206915 2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/95cf7a7b-50b6-4129-a443-8fa7d10ae898-maas-api-service-ca\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:42:45.845497 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:45.845469 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-g4wwn" Jul 15 13:42:45.845497 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:45.845481 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-g4wwn" event={"ID":"95cf7a7b-50b6-4129-a443-8fa7d10ae898","Type":"ContainerDied","Data":"69c1820b54c137597db00891341213bb299e85525090666923884786fb24f34b"} Jul 15 13:42:45.845704 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:45.845527 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="69c1820b54c137597db00891341213bb299e85525090666923884786fb24f34b" Jul 15 13:42:45.879263 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:45.879233 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-g4wwn"] Jul 15 13:42:45.883190 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:45.883164 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-g4wwn"] Jul 15 13:42:47.137240 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:42:47.137212 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95cf7a7b-50b6-4129-a443-8fa7d10ae898" path="/var/lib/kubelet/pods/95cf7a7b-50b6-4129-a443-8fa7d10ae898/volumes" Jul 15 13:43:16.010442 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:16.010405 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-ccpmm"] Jul 15 13:43:16.010899 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:16.010728 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95cf7a7b-50b6-4129-a443-8fa7d10ae898" containerName="revoke-keys" Jul 15 13:43:16.010899 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:16.010739 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="95cf7a7b-50b6-4129-a443-8fa7d10ae898" containerName="revoke-keys" Jul 15 13:43:16.010899 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:16.010747 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95cf7a7b-50b6-4129-a443-8fa7d10ae898" containerName="revoke-keys" Jul 15 13:43:16.010899 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:16.010753 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="95cf7a7b-50b6-4129-a443-8fa7d10ae898" containerName="revoke-keys" Jul 15 13:43:16.010899 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:16.010818 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="95cf7a7b-50b6-4129-a443-8fa7d10ae898" containerName="revoke-keys" Jul 15 13:43:16.010899 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:16.010825 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="95cf7a7b-50b6-4129-a443-8fa7d10ae898" containerName="revoke-keys" Jul 15 13:43:16.010899 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:16.010835 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5cfc4a2-3385-4be1-a984-6b468e876c6a" containerName="istio-proxy" Jul 15 13:43:16.013748 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:16.013732 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-ccpmm" Jul 15 13:43:16.016381 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:16.016362 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 13:43:16.016476 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:16.016407 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpj2c\"" Jul 15 13:43:16.020671 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:16.020644 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-ccpmm"] Jul 15 13:43:16.052460 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:16.052418 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da2db899-4866-4ba9-8f7e-0cd7e826a696-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-17469591-ccpmm\" (UID: \"da2db899-4866-4ba9-8f7e-0cd7e826a696\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-ccpmm" Jul 15 13:43:16.153464 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:16.153429 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da2db899-4866-4ba9-8f7e-0cd7e826a696-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-17469591-ccpmm\" (UID: \"da2db899-4866-4ba9-8f7e-0cd7e826a696\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-ccpmm" Jul 15 13:43:16.154026 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:16.154008 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da2db899-4866-4ba9-8f7e-0cd7e826a696-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-17469591-ccpmm\" (UID: \"da2db899-4866-4ba9-8f7e-0cd7e826a696\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-ccpmm" Jul 15 13:43:16.326117 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:16.326015 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-ccpmm" Jul 15 13:43:16.457599 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:16.457571 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-ccpmm"] Jul 15 13:43:16.459419 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:43:16.459391 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda2db899_4866_4ba9_8f7e_0cd7e826a696.slice/crio-758dde26278eadeac05c4d06d01b2176ee535ee577d70b9533aba2f73cbf234c WatchSource:0}: Error finding container 758dde26278eadeac05c4d06d01b2176ee535ee577d70b9533aba2f73cbf234c: Status 404 returned error can't find the container with id 758dde26278eadeac05c4d06d01b2176ee535ee577d70b9533aba2f73cbf234c Jul 15 13:43:16.987020 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:16.986973 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-ccpmm" event={"ID":"da2db899-4866-4ba9-8f7e-0cd7e826a696","Type":"ContainerStarted","Data":"96ce309b0fb67f74853c427950f417666aa9080ceedf560aaab1f5b41343bcf2"} Jul 15 13:43:16.987191 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:16.987042 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-ccpmm" event={"ID":"da2db899-4866-4ba9-8f7e-0cd7e826a696","Type":"ContainerStarted","Data":"758dde26278eadeac05c4d06d01b2176ee535ee577d70b9533aba2f73cbf234c"} Jul 15 13:43:17.004886 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:17.004834 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-ccpmm" podStartSLOduration=2.004818482 podStartE2EDuration="2.004818482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:43:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:43:17.003518935 +0000 UTC m=+1910.434328510" watchObservedRunningTime="2026-07-15 13:43:17.004818482 +0000 UTC m=+1910.435628056" Jul 15 13:43:17.995669 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:17.995628 2554 generic.go:356] "Generic (PLEG): container finished" podID="da2db899-4866-4ba9-8f7e-0cd7e826a696" containerID="96ce309b0fb67f74853c427950f417666aa9080ceedf560aaab1f5b41343bcf2" exitCode=0 Jul 15 13:43:17.996143 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:17.995713 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-ccpmm" event={"ID":"da2db899-4866-4ba9-8f7e-0cd7e826a696","Type":"ContainerDied","Data":"96ce309b0fb67f74853c427950f417666aa9080ceedf560aaab1f5b41343bcf2"} Jul 15 13:43:19.129116 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:19.129091 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-ccpmm" Jul 15 13:43:19.180197 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:19.180160 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da2db899-4866-4ba9-8f7e-0cd7e826a696-maas-api-service-ca\") pod \"da2db899-4866-4ba9-8f7e-0cd7e826a696\" (UID: \"da2db899-4866-4ba9-8f7e-0cd7e826a696\") " Jul 15 13:43:19.180539 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:19.180517 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da2db899-4866-4ba9-8f7e-0cd7e826a696-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "da2db899-4866-4ba9-8f7e-0cd7e826a696" (UID: "da2db899-4866-4ba9-8f7e-0cd7e826a696"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:43:19.281243 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:19.281161 2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da2db899-4866-4ba9-8f7e-0cd7e826a696-maas-api-service-ca\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:43:20.005925 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:20.005889 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-ccpmm" Jul 15 13:43:20.006116 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:20.005931 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-17469591-ccpmm" event={"ID":"da2db899-4866-4ba9-8f7e-0cd7e826a696","Type":"ContainerDied","Data":"758dde26278eadeac05c4d06d01b2176ee535ee577d70b9533aba2f73cbf234c"} Jul 15 13:43:20.006116 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:20.006016 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="758dde26278eadeac05c4d06d01b2176ee535ee577d70b9533aba2f73cbf234c" Jul 15 13:43:26.112919 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:26.112884 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:43:26.213786 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:26.213756 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:43:26.550732 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:26.550695 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:43:32.378304 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.378266 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:43:32.458213 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.458170 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:43:32.637399 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.637318 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt"] Jul 15 13:43:32.637671 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.637658 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95cf7a7b-50b6-4129-a443-8fa7d10ae898" containerName="revoke-keys" Jul 15 13:43:32.637737 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.637671 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="95cf7a7b-50b6-4129-a443-8fa7d10ae898" containerName="revoke-keys" Jul 15 13:43:32.637737 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.637684 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da2db899-4866-4ba9-8f7e-0cd7e826a696" containerName="revoke-keys" Jul 15 13:43:32.637737 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.637689 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="da2db899-4866-4ba9-8f7e-0cd7e826a696" containerName="revoke-keys" Jul 15 13:43:32.637894 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.637748 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="95cf7a7b-50b6-4129-a443-8fa7d10ae898" containerName="revoke-keys" Jul 15 13:43:32.637894 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.637760 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="da2db899-4866-4ba9-8f7e-0cd7e826a696" containerName="revoke-keys" Jul 15 13:43:32.640683 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.640660 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:32.643392 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.643367 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f2fb3294-openshift-default-dockercfg-f7q2r\"" Jul 15 13:43:32.653599 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.653580 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt"] Jul 15 13:43:32.685680 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.685647 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:43:32.697742 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.697720 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-istio-envoy\") pod \"e2e-ait-f2fb3294-openshift-default-87555955-ftzqt\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:32.697855 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.697796 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-workload-socket\") pod \"e2e-ait-f2fb3294-openshift-default-87555955-ftzqt\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:32.697855 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.697841 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvql4\" (UniqueName: \"kubernetes.io/projected/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-kube-api-access-wvql4\") pod \"e2e-ait-f2fb3294-openshift-default-87555955-ftzqt\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:32.697970 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.697871 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-istio-podinfo\") pod \"e2e-ait-f2fb3294-openshift-default-87555955-ftzqt\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:32.697970 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.697894 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-istio-token\") pod \"e2e-ait-f2fb3294-openshift-default-87555955-ftzqt\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:32.697970 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.697959 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-istio-data\") pod \"e2e-ait-f2fb3294-openshift-default-87555955-ftzqt\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:32.698118 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.698003 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-istiod-ca-cert\") pod \"e2e-ait-f2fb3294-openshift-default-87555955-ftzqt\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:32.698118 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.698031 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-credential-socket\") pod \"e2e-ait-f2fb3294-openshift-default-87555955-ftzqt\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:32.698118 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.698056 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-workload-certs\") pod \"e2e-ait-f2fb3294-openshift-default-87555955-ftzqt\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:32.798722 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.798694 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-credential-socket\") pod \"e2e-ait-f2fb3294-openshift-default-87555955-ftzqt\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:32.798722 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.798724 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-workload-certs\") pod \"e2e-ait-f2fb3294-openshift-default-87555955-ftzqt\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:32.798945 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.798773 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-istio-envoy\") pod \"e2e-ait-f2fb3294-openshift-default-87555955-ftzqt\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:32.798945 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.798809 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-workload-socket\") pod \"e2e-ait-f2fb3294-openshift-default-87555955-ftzqt\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:32.798945 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.798829 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvql4\" (UniqueName: \"kubernetes.io/projected/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-kube-api-access-wvql4\") pod \"e2e-ait-f2fb3294-openshift-default-87555955-ftzqt\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:32.798945 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.798848 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-istio-podinfo\") pod \"e2e-ait-f2fb3294-openshift-default-87555955-ftzqt\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:32.798945 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.798870 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-istio-token\") pod \"e2e-ait-f2fb3294-openshift-default-87555955-ftzqt\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:32.798945 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.798912 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-istio-data\") pod \"e2e-ait-f2fb3294-openshift-default-87555955-ftzqt\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:32.798945 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.798935 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-istiod-ca-cert\") pod \"e2e-ait-f2fb3294-openshift-default-87555955-ftzqt\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:32.799360 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.799129 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-credential-socket\") pod \"e2e-ait-f2fb3294-openshift-default-87555955-ftzqt\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:32.799360 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.799160 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-workload-certs\") pod \"e2e-ait-f2fb3294-openshift-default-87555955-ftzqt\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:32.799360 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.799251 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-workload-socket\") pod \"e2e-ait-f2fb3294-openshift-default-87555955-ftzqt\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:32.799467 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.799389 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-istio-data\") pod \"e2e-ait-f2fb3294-openshift-default-87555955-ftzqt\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:32.799572 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.799556 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-istiod-ca-cert\") pod \"e2e-ait-f2fb3294-openshift-default-87555955-ftzqt\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:32.800880 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.800858 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-istio-envoy\") pod \"e2e-ait-f2fb3294-openshift-default-87555955-ftzqt\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:32.801387 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.801366 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-istio-podinfo\") pod \"e2e-ait-f2fb3294-openshift-default-87555955-ftzqt\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:32.809700 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.809677 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvql4\" (UniqueName: \"kubernetes.io/projected/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-kube-api-access-wvql4\") pod \"e2e-ait-f2fb3294-openshift-default-87555955-ftzqt\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:32.809781 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.809723 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-istio-token\") pod \"e2e-ait-f2fb3294-openshift-default-87555955-ftzqt\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:32.878401 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.878371 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:43:32.950966 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.950884 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:32.978139 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:32.978107 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:43:33.085968 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:33.085947 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt"] Jul 15 13:43:33.087742 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:43:33.087713 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e7034e4_fc35_4ca3_ac20_807b0ff68d8e.slice/crio-c3db5708228450fcf7eea45b32f4e8494dc550a6381eb697384a895c8420e4a4 WatchSource:0}: Error finding container c3db5708228450fcf7eea45b32f4e8494dc550a6381eb697384a895c8420e4a4: Status 404 returned error can't find the container with id c3db5708228450fcf7eea45b32f4e8494dc550a6381eb697384a895c8420e4a4 Jul 15 13:43:33.089786 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:33.089751 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:43:33.089908 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:33.089821 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:43:33.089908 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:33.089855 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:43:33.829756 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:33.829716 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:43:33.935507 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:33.935468 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:43:34.004170 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:34.004139 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:43:34.070540 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:34.070505 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" event={"ID":"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e","Type":"ContainerStarted","Data":"623c46bcfb10c2de683f2c4b59fc9d06fcea37f25dcc881cf632d54a2532372a"} Jul 15 13:43:34.070731 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:34.070554 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" event={"ID":"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e","Type":"ContainerStarted","Data":"c3db5708228450fcf7eea45b32f4e8494dc550a6381eb697384a895c8420e4a4"} Jul 15 13:43:34.094006 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:34.093891 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" podStartSLOduration=2.093874704 podStartE2EDuration="2.093874704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:43:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:43:34.093026042 +0000 UTC m=+1927.523835615" watchObservedRunningTime="2026-07-15 13:43:34.093874704 +0000 UTC m=+1927.524684275" Jul 15 13:43:34.099403 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:34.099374 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:43:34.524672 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:34.524641 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:43:34.596553 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:34.596516 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:43:34.951346 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:34.951263 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:34.955952 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:34.955930 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:35.075537 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:35.075506 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:35.076385 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:35.076366 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:36.145772 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:36.145731 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:43:45.556391 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:45.556356 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:43:49.494020 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:49.493963 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:43:50.077049 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:50.077016 2554 patch_prober.go:28] interesting pod/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 15 13:43:50.077230 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:50.077100 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" podUID="9e7034e4-fc35-4ca3-ac20-807b0ff68d8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 15 13:43:50.154632 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:50.154590 2554 generic.go:356] "Generic (PLEG): container finished" podID="9e7034e4-fc35-4ca3-ac20-807b0ff68d8e" containerID="623c46bcfb10c2de683f2c4b59fc9d06fcea37f25dcc881cf632d54a2532372a" exitCode=0 Jul 15 13:43:50.154795 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:50.154653 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" event={"ID":"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e","Type":"ContainerDied","Data":"623c46bcfb10c2de683f2c4b59fc9d06fcea37f25dcc881cf632d54a2532372a"} Jul 15 13:43:50.155093 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:50.155075 2554 scope.go:117] "RemoveContainer" containerID="623c46bcfb10c2de683f2c4b59fc9d06fcea37f25dcc881cf632d54a2532372a" Jul 15 13:43:50.156004 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:50.155961 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:43:50.156112 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:50.156039 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:43:50.156112 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:50.156071 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:43:51.161499 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:51.161470 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" event={"ID":"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e","Type":"ContainerStarted","Data":"311af47f225de0c81a49c32616022d94f5f7c6ba1f6a4aed6020793e5ac1e049"} Jul 15 13:43:51.952058 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:51.952017 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:51.952275 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:51.952240 2554 patch_prober.go:28] interesting pod/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 15 13:43:51.952360 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:51.952308 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" podUID="9e7034e4-fc35-4ca3-ac20-807b0ff68d8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 15 13:43:52.951965 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:52.951924 2554 patch_prober.go:28] interesting pod/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 15 13:43:52.952565 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:52.952023 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" podUID="9e7034e4-fc35-4ca3-ac20-807b0ff68d8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 15 13:43:53.951778 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:53.951742 2554 patch_prober.go:28] interesting pod/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 15 13:43:53.952011 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:53.951800 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" podUID="9e7034e4-fc35-4ca3-ac20-807b0ff68d8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 15 13:43:54.008839 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:54.008806 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:43:54.952056 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:54.952018 2554 patch_prober.go:28] interesting pod/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 15 13:43:54.952240 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:54.952073 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" podUID="9e7034e4-fc35-4ca3-ac20-807b0ff68d8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 15 13:43:55.955264 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:55.955230 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:55.955673 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:55.955498 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:43:55.956136 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:43:55.956119 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:44:00.353253 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:00.353220 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:44:00.417326 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:00.417288 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:44:05.102351 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.102309 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt"] Jul 15 13:44:05.102850 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.102553 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" podUID="9e7034e4-fc35-4ca3-ac20-807b0ff68d8e" containerName="istio-proxy" containerID="cri-o://311af47f225de0c81a49c32616022d94f5f7c6ba1f6a4aed6020793e5ac1e049" gracePeriod=30 Jul 15 13:44:05.120449 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.120415 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:44:05.499293 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.499262 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86"] Jul 15 13:44:05.502665 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.502639 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:05.505643 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.505620 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-9e5a80bf-openshift-default-dockercfg-cs6ws\"" Jul 15 13:44:05.526679 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.526654 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86"] Jul 15 13:44:05.566846 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.566809 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:44:05.612780 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.612748 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b676dd42-eab7-4eea-961d-3aa32c4b8cac-istio-podinfo\") pod \"e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:05.612907 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.612785 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcrbx\" (UniqueName: \"kubernetes.io/projected/b676dd42-eab7-4eea-961d-3aa32c4b8cac-kube-api-access-wcrbx\") pod \"e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:05.612907 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.612816 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b676dd42-eab7-4eea-961d-3aa32c4b8cac-workload-certs\") pod \"e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:05.612907 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.612894 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b676dd42-eab7-4eea-961d-3aa32c4b8cac-credential-socket\") pod \"e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:05.613107 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.612947 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b676dd42-eab7-4eea-961d-3aa32c4b8cac-istio-data\") pod \"e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:05.613107 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.613004 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b676dd42-eab7-4eea-961d-3aa32c4b8cac-workload-socket\") pod \"e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:05.613107 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.613028 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b676dd42-eab7-4eea-961d-3aa32c4b8cac-istiod-ca-cert\") pod \"e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:05.613107 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.613069 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b676dd42-eab7-4eea-961d-3aa32c4b8cac-istio-token\") pod \"e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:05.613246 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.613110 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b676dd42-eab7-4eea-961d-3aa32c4b8cac-istio-envoy\") pod \"e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:05.714142 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.714088 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b676dd42-eab7-4eea-961d-3aa32c4b8cac-istio-envoy\") pod \"e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:05.714344 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.714196 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b676dd42-eab7-4eea-961d-3aa32c4b8cac-istio-podinfo\") pod \"e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:05.714344 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.714227 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcrbx\" (UniqueName: \"kubernetes.io/projected/b676dd42-eab7-4eea-961d-3aa32c4b8cac-kube-api-access-wcrbx\") pod \"e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:05.714344 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.714255 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b676dd42-eab7-4eea-961d-3aa32c4b8cac-workload-certs\") pod \"e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:05.714344 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.714297 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b676dd42-eab7-4eea-961d-3aa32c4b8cac-credential-socket\") pod \"e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:05.714344 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.714337 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b676dd42-eab7-4eea-961d-3aa32c4b8cac-istio-data\") pod \"e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:05.714616 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.714365 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b676dd42-eab7-4eea-961d-3aa32c4b8cac-workload-socket\") pod \"e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:05.714616 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.714389 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b676dd42-eab7-4eea-961d-3aa32c4b8cac-istiod-ca-cert\") pod \"e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:05.714616 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.714432 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b676dd42-eab7-4eea-961d-3aa32c4b8cac-istio-token\") pod \"e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:05.714763 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.714668 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b676dd42-eab7-4eea-961d-3aa32c4b8cac-workload-certs\") pod \"e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:05.714763 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.714727 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b676dd42-eab7-4eea-961d-3aa32c4b8cac-credential-socket\") pod \"e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:05.714852 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.714789 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b676dd42-eab7-4eea-961d-3aa32c4b8cac-istio-data\") pod \"e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:05.715068 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.715045 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b676dd42-eab7-4eea-961d-3aa32c4b8cac-workload-socket\") pod \"e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:05.715263 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.715150 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b676dd42-eab7-4eea-961d-3aa32c4b8cac-istiod-ca-cert\") pod \"e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:05.716510 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.716487 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b676dd42-eab7-4eea-961d-3aa32c4b8cac-istio-envoy\") pod \"e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:05.716766 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.716749 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b676dd42-eab7-4eea-961d-3aa32c4b8cac-istio-podinfo\") pod \"e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:05.723951 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.723921 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b676dd42-eab7-4eea-961d-3aa32c4b8cac-istio-token\") pod \"e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:05.724157 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.724139 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcrbx\" (UniqueName: \"kubernetes.io/projected/b676dd42-eab7-4eea-961d-3aa32c4b8cac-kube-api-access-wcrbx\") pod \"e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:05.815793 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.815709 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:05.952635 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.952604 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86"] Jul 15 13:44:05.954959 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:44:05.954932 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb676dd42_eab7_4eea_961d_3aa32c4b8cac.slice/crio-0620ed87354d7d9cdb0fa5257ea93744f2ea587a7d31059fd1922c5f851dec1f WatchSource:0}: Error finding container 0620ed87354d7d9cdb0fa5257ea93744f2ea587a7d31059fd1922c5f851dec1f: Status 404 returned error can't find the container with id 0620ed87354d7d9cdb0fa5257ea93744f2ea587a7d31059fd1922c5f851dec1f Jul 15 13:44:05.957199 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.957166 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:44:05.957281 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.957229 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:44:05.957281 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:05.957260 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:44:06.232423 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:06.232390 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" event={"ID":"b676dd42-eab7-4eea-961d-3aa32c4b8cac","Type":"ContainerStarted","Data":"6c44bf6e5c62034e45c9dabcf4bc9b7baba02b4876dd13fc7c0a1c2f41c51cbf"} Jul 15 13:44:06.232883 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:06.232442 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" event={"ID":"b676dd42-eab7-4eea-961d-3aa32c4b8cac","Type":"ContainerStarted","Data":"0620ed87354d7d9cdb0fa5257ea93744f2ea587a7d31059fd1922c5f851dec1f"} Jul 15 13:44:06.696819 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:06.696719 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:44:06.781529 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:06.781485 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:44:06.815932 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:06.815900 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:06.869925 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:06.869888 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:44:07.205143 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:07.205109 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:44:07.577739 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:07.577704 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:44:07.676911 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:07.676878 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:44:07.820919 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:07.820889 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:07.844181 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:07.844076 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" podStartSLOduration=2.844059965 podStartE2EDuration="2.844059965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:44:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:44:06.262684265 +0000 UTC m=+1959.693493838" watchObservedRunningTime="2026-07-15 13:44:07.844059965 +0000 UTC m=+1961.274869872" Jul 15 13:44:08.241482 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:08.241447 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:08.242336 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:08.242317 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:10.252590 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:10.252558 2554 generic.go:356] "Generic (PLEG): container finished" podID="9e7034e4-fc35-4ca3-ac20-807b0ff68d8e" containerID="311af47f225de0c81a49c32616022d94f5f7c6ba1f6a4aed6020793e5ac1e049" exitCode=0 Jul 15 13:44:10.253105 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:10.252626 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" event={"ID":"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e","Type":"ContainerDied","Data":"311af47f225de0c81a49c32616022d94f5f7c6ba1f6a4aed6020793e5ac1e049"} Jul 15 13:44:10.253105 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:10.252681 2554 scope.go:117] "RemoveContainer" containerID="623c46bcfb10c2de683f2c4b59fc9d06fcea37f25dcc881cf632d54a2532372a" Jul 15 13:44:10.344672 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:10.344641 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:44:10.456079 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:10.456047 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-workload-certs\") pod \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " Jul 15 13:44:10.456249 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:10.456091 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvql4\" (UniqueName: \"kubernetes.io/projected/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-kube-api-access-wvql4\") pod \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " Jul 15 13:44:10.456249 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:10.456116 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-istio-data\") pod \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " Jul 15 13:44:10.456249 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:10.456191 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-istiod-ca-cert\") pod \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " Jul 15 13:44:10.456249 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:10.456210 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-istio-token\") pod \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " Jul 15 13:44:10.456249 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:10.456230 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-credential-socket\") pod \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " Jul 15 13:44:10.456514 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:10.456261 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-istio-podinfo\") pod \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " Jul 15 13:44:10.456514 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:10.456306 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-istio-envoy\") pod \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " Jul 15 13:44:10.456514 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:10.456331 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-workload-socket\") pod \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\" (UID: \"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e\") " Jul 15 13:44:10.456514 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:10.456371 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9e7034e4-fc35-4ca3-ac20-807b0ff68d8e" (UID: "9e7034e4-fc35-4ca3-ac20-807b0ff68d8e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:44:10.456724 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:10.456535 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9e7034e4-fc35-4ca3-ac20-807b0ff68d8e" (UID: "9e7034e4-fc35-4ca3-ac20-807b0ff68d8e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:44:10.456724 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:10.456608 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-credential-socket\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:44:10.456724 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:10.456626 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-workload-certs\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:44:10.456724 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:10.456633 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9e7034e4-fc35-4ca3-ac20-807b0ff68d8e" (UID: "9e7034e4-fc35-4ca3-ac20-807b0ff68d8e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:44:10.456724 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:10.456714 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9e7034e4-fc35-4ca3-ac20-807b0ff68d8e" (UID: "9e7034e4-fc35-4ca3-ac20-807b0ff68d8e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:44:10.457169 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:10.457144 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-istio-data" (OuterVolumeSpecName: "istio-data") pod "9e7034e4-fc35-4ca3-ac20-807b0ff68d8e" (UID: "9e7034e4-fc35-4ca3-ac20-807b0ff68d8e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:44:10.458487 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:10.458454 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-istio-token" (OuterVolumeSpecName: "istio-token") pod "9e7034e4-fc35-4ca3-ac20-807b0ff68d8e" (UID: "9e7034e4-fc35-4ca3-ac20-807b0ff68d8e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:44:10.458604 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:10.458570 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-kube-api-access-wvql4" (OuterVolumeSpecName: "kube-api-access-wvql4") pod "9e7034e4-fc35-4ca3-ac20-807b0ff68d8e" (UID: "9e7034e4-fc35-4ca3-ac20-807b0ff68d8e"). InnerVolumeSpecName "kube-api-access-wvql4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:44:10.458875 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:10.458854 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9e7034e4-fc35-4ca3-ac20-807b0ff68d8e" (UID: "9e7034e4-fc35-4ca3-ac20-807b0ff68d8e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:44:10.458875 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:10.458854 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9e7034e4-fc35-4ca3-ac20-807b0ff68d8e" (UID: "9e7034e4-fc35-4ca3-ac20-807b0ff68d8e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 13:44:10.557532 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:10.557495 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-istio-envoy\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:44:10.557532 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:10.557526 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-workload-socket\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:44:10.557532 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:10.557535 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvql4\" (UniqueName: \"kubernetes.io/projected/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-kube-api-access-wvql4\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:44:10.557781 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:10.557545 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-istio-data\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:44:10.557781 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:10.557555 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-istiod-ca-cert\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:44:10.557781 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:10.557563 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-istio-token\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:44:10.557781 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:10.557570 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e-istio-podinfo\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:44:11.258945 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:11.258915 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" Jul 15 13:44:11.258945 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:11.258928 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt" event={"ID":"9e7034e4-fc35-4ca3-ac20-807b0ff68d8e","Type":"ContainerDied","Data":"c3db5708228450fcf7eea45b32f4e8494dc550a6381eb697384a895c8420e4a4"} Jul 15 13:44:11.259495 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:11.259003 2554 scope.go:117] "RemoveContainer" containerID="311af47f225de0c81a49c32616022d94f5f7c6ba1f6a4aed6020793e5ac1e049" Jul 15 13:44:11.277538 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:11.277515 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt"] Jul 15 13:44:11.281668 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:11.281647 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f2fb3294-openshift-default-87555955-ftzqt"] Jul 15 13:44:11.473556 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:11.473524 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:44:11.574402 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:11.574364 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:44:13.137241 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:13.137211 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e7034e4-fc35-4ca3-ac20-807b0ff68d8e" path="/var/lib/kubelet/pods/9e7034e4-fc35-4ca3-ac20-807b0ff68d8e/volumes" Jul 15 13:44:14.876960 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:14.876921 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:44:23.242872 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:23.242836 2554 patch_prober.go:28] interesting pod/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 15 13:44:23.243309 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:23.242902 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" podUID="b676dd42-eab7-4eea-961d-3aa32c4b8cac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 15 13:44:23.317365 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:23.317328 2554 generic.go:356] "Generic (PLEG): container finished" podID="b676dd42-eab7-4eea-961d-3aa32c4b8cac" containerID="6c44bf6e5c62034e45c9dabcf4bc9b7baba02b4876dd13fc7c0a1c2f41c51cbf" exitCode=0 Jul 15 13:44:23.317520 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:23.317399 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" event={"ID":"b676dd42-eab7-4eea-961d-3aa32c4b8cac","Type":"ContainerDied","Data":"6c44bf6e5c62034e45c9dabcf4bc9b7baba02b4876dd13fc7c0a1c2f41c51cbf"} Jul 15 13:44:23.317799 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:23.317785 2554 scope.go:117] "RemoveContainer" containerID="6c44bf6e5c62034e45c9dabcf4bc9b7baba02b4876dd13fc7c0a1c2f41c51cbf" Jul 15 13:44:23.318837 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:23.318810 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:44:23.318895 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:23.318876 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:44:23.318930 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:23.318908 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:44:24.325879 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:24.325842 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" event={"ID":"b676dd42-eab7-4eea-961d-3aa32c4b8cac","Type":"ContainerStarted","Data":"9808006438f2485b8cb8f98e43b81ced4cd26d80fa9a460826dc7ba12ae14a6c"} Jul 15 13:44:24.816995 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:24.816941 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:24.817347 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:24.817325 2554 patch_prober.go:28] interesting pod/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 15 13:44:24.817493 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:24.817470 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" podUID="b676dd42-eab7-4eea-961d-3aa32c4b8cac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 15 13:44:25.817078 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:25.817041 2554 patch_prober.go:28] interesting pod/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 15 13:44:25.817676 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:25.817643 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" podUID="b676dd42-eab7-4eea-961d-3aa32c4b8cac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 15 13:44:26.817072 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:26.817034 2554 patch_prober.go:28] interesting pod/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 15 13:44:26.817776 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:26.817362 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" podUID="b676dd42-eab7-4eea-961d-3aa32c4b8cac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 15 13:44:27.816870 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:27.816823 2554 patch_prober.go:28] interesting pod/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 15 13:44:27.817101 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:27.816904 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" podUID="b676dd42-eab7-4eea-961d-3aa32c4b8cac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 15 13:44:28.820673 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:28.820642 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:28.821050 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:28.820923 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:28.821755 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:28.821739 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:44:52.635290 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:52.635252 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:44:52.748569 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:44:52.748533 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:45:00.144478 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:00.144445 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-9e5a80bf-29735385-7q4lx"] Jul 15 13:45:00.144906 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:00.144777 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e7034e4-fc35-4ca3-ac20-807b0ff68d8e" containerName="istio-proxy" Jul 15 13:45:00.144906 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:00.144788 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e7034e4-fc35-4ca3-ac20-807b0ff68d8e" containerName="istio-proxy" Jul 15 13:45:00.144906 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:00.144800 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e7034e4-fc35-4ca3-ac20-807b0ff68d8e" containerName="istio-proxy" Jul 15 13:45:00.144906 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:00.144806 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e7034e4-fc35-4ca3-ac20-807b0ff68d8e" containerName="istio-proxy" Jul 15 13:45:00.144906 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:00.144865 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e7034e4-fc35-4ca3-ac20-807b0ff68d8e" containerName="istio-proxy" Jul 15 13:45:00.147740 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:00.147718 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-9e5a80bf-29735385-7q4lx" Jul 15 13:45:00.150788 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:00.150767 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpj2c\"" Jul 15 13:45:00.156204 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:00.156181 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-9e5a80bf-29735385-7q4lx"] Jul 15 13:45:00.158856 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:00.158838 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-9e5a80bf-29735385-7q4lx" Jul 15 13:45:00.294122 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:00.294095 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-9e5a80bf-29735385-7q4lx"] Jul 15 13:45:00.295772 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:45:00.295742 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d63b8bd_7397_496c_bbfc_c2d2ac78bbd8.slice/crio-f3468dd0e3a26f70c3b836ae8df4d3de8cf755dd8344fc0fb7cf6d9f5dd90404 WatchSource:0}: Error finding container f3468dd0e3a26f70c3b836ae8df4d3de8cf755dd8344fc0fb7cf6d9f5dd90404: Status 404 returned error can't find the container with id f3468dd0e3a26f70c3b836ae8df4d3de8cf755dd8344fc0fb7cf6d9f5dd90404 Jul 15 13:45:00.497044 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:00.497007 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-9e5a80bf-29735385-7q4lx" event={"ID":"3d63b8bd-7397-496c-bbfc-c2d2ac78bbd8","Type":"ContainerStarted","Data":"f3468dd0e3a26f70c3b836ae8df4d3de8cf755dd8344fc0fb7cf6d9f5dd90404"} Jul 15 13:45:01.502792 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:01.502759 2554 generic.go:356] "Generic (PLEG): container finished" podID="3d63b8bd-7397-496c-bbfc-c2d2ac78bbd8" containerID="02091f5d0f0b7fe607e6417ca0a8a86db003c40d8500a3e829e50fa8ad3ea719" exitCode=0 Jul 15 13:45:01.503209 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:01.502804 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-9e5a80bf-29735385-7q4lx" event={"ID":"3d63b8bd-7397-496c-bbfc-c2d2ac78bbd8","Type":"ContainerDied","Data":"02091f5d0f0b7fe607e6417ca0a8a86db003c40d8500a3e829e50fa8ad3ea719"} Jul 15 13:45:02.643854 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:02.643825 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-9e5a80bf-29735385-7q4lx" Jul 15 13:45:03.513574 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:03.513533 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-9e5a80bf-29735385-7q4lx" event={"ID":"3d63b8bd-7397-496c-bbfc-c2d2ac78bbd8","Type":"ContainerDied","Data":"f3468dd0e3a26f70c3b836ae8df4d3de8cf755dd8344fc0fb7cf6d9f5dd90404"} Jul 15 13:45:03.513574 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:03.513566 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-9e5a80bf-29735385-7q4lx" Jul 15 13:45:03.513784 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:03.513596 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3468dd0e3a26f70c3b836ae8df4d3de8cf755dd8344fc0fb7cf6d9f5dd90404" Jul 15 13:45:11.093328 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:11.093293 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-2s7kg"] Jul 15 13:45:11.093733 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:11.093638 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d63b8bd-7397-496c-bbfc-c2d2ac78bbd8" containerName="cleanup" Jul 15 13:45:11.093733 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:11.093651 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d63b8bd-7397-496c-bbfc-c2d2ac78bbd8" containerName="cleanup" Jul 15 13:45:11.093733 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:11.093714 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d63b8bd-7397-496c-bbfc-c2d2ac78bbd8" containerName="cleanup" Jul 15 13:45:11.093733 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:11.093727 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e7034e4-fc35-4ca3-ac20-807b0ff68d8e" containerName="istio-proxy" Jul 15 13:45:11.096549 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:11.096533 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-2s7kg" Jul 15 13:45:11.100222 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:11.100192 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpj2c\"" Jul 15 13:45:11.100357 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:11.100298 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 13:45:11.111305 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:11.111280 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-2s7kg"] Jul 15 13:45:11.216352 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:11.216311 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b758f92f-5d5d-42e5-8dd7-3c5b1005ad04-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9e5a80bf-2s7kg\" (UID: \"b758f92f-5d5d-42e5-8dd7-3c5b1005ad04\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-2s7kg" Jul 15 13:45:11.317695 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:11.317655 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b758f92f-5d5d-42e5-8dd7-3c5b1005ad04-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9e5a80bf-2s7kg\" (UID: \"b758f92f-5d5d-42e5-8dd7-3c5b1005ad04\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-2s7kg" Jul 15 13:45:11.318410 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:11.318392 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b758f92f-5d5d-42e5-8dd7-3c5b1005ad04-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9e5a80bf-2s7kg\" (UID: \"b758f92f-5d5d-42e5-8dd7-3c5b1005ad04\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-2s7kg" Jul 15 13:45:11.406457 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:11.406368 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-2s7kg" Jul 15 13:45:11.537933 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:11.537848 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-2s7kg"] Jul 15 13:45:11.540274 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:45:11.540232 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb758f92f_5d5d_42e5_8dd7_3c5b1005ad04.slice/crio-8a5413d6e0a224cc5b0eb37dae9da5142b46ff10d518e8cea71993339a2d58e8 WatchSource:0}: Error finding container 8a5413d6e0a224cc5b0eb37dae9da5142b46ff10d518e8cea71993339a2d58e8: Status 404 returned error can't find the container with id 8a5413d6e0a224cc5b0eb37dae9da5142b46ff10d518e8cea71993339a2d58e8 Jul 15 13:45:11.549765 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:11.549741 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-2s7kg" event={"ID":"b758f92f-5d5d-42e5-8dd7-3c5b1005ad04","Type":"ContainerStarted","Data":"8a5413d6e0a224cc5b0eb37dae9da5142b46ff10d518e8cea71993339a2d58e8"} Jul 15 13:45:11.906546 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:11.906510 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:45:12.007292 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:12.007262 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:45:12.555345 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:12.555306 2554 generic.go:356] "Generic (PLEG): container finished" podID="b758f92f-5d5d-42e5-8dd7-3c5b1005ad04" containerID="b53bde8cb7c5532938b684d40aa2d2451a1454e14f6863cb027a66390fa11da6" exitCode=0 Jul 15 13:45:12.555720 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:12.555369 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-2s7kg" event={"ID":"b758f92f-5d5d-42e5-8dd7-3c5b1005ad04","Type":"ContainerDied","Data":"b53bde8cb7c5532938b684d40aa2d2451a1454e14f6863cb027a66390fa11da6"} Jul 15 13:45:13.690088 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:13.690064 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-2s7kg" Jul 15 13:45:13.740110 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:13.740079 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b758f92f-5d5d-42e5-8dd7-3c5b1005ad04-maas-api-service-ca\") pod \"b758f92f-5d5d-42e5-8dd7-3c5b1005ad04\" (UID: \"b758f92f-5d5d-42e5-8dd7-3c5b1005ad04\") " Jul 15 13:45:13.740430 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:13.740408 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b758f92f-5d5d-42e5-8dd7-3c5b1005ad04-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b758f92f-5d5d-42e5-8dd7-3c5b1005ad04" (UID: "b758f92f-5d5d-42e5-8dd7-3c5b1005ad04"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:45:13.840904 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:13.840821 2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b758f92f-5d5d-42e5-8dd7-3c5b1005ad04-maas-api-service-ca\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:45:14.565835 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:14.565808 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-2s7kg" Jul 15 13:45:14.566025 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:14.565832 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-2s7kg" event={"ID":"b758f92f-5d5d-42e5-8dd7-3c5b1005ad04","Type":"ContainerDied","Data":"8a5413d6e0a224cc5b0eb37dae9da5142b46ff10d518e8cea71993339a2d58e8"} Jul 15 13:45:14.566025 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:14.565874 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a5413d6e0a224cc5b0eb37dae9da5142b46ff10d518e8cea71993339a2d58e8" Jul 15 13:45:21.669871 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:21.669837 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:45:21.677391 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:21.677365 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-9e5a80bf-29735385-7q4lx"] Jul 15 13:45:21.679237 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:21.679213 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-9e5a80bf-29735385-7q4lx"] Jul 15 13:45:23.137242 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:23.137209 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d63b8bd-7397-496c-bbfc-c2d2ac78bbd8" path="/var/lib/kubelet/pods/3d63b8bd-7397-496c-bbfc-c2d2ac78bbd8/volumes" Jul 15 13:45:26.189771 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:26.189734 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:45:32.270404 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:32.270366 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:45:32.373113 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:32.373068 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:45:36.369464 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:36.369428 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86"] Jul 15 13:45:36.369868 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:36.369637 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" podUID="b676dd42-eab7-4eea-961d-3aa32c4b8cac" containerName="istio-proxy" containerID="cri-o://9808006438f2485b8cb8f98e43b81ced4cd26d80fa9a460826dc7ba12ae14a6c" gracePeriod=30 Jul 15 13:45:36.416510 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:36.416479 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:45:37.038209 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:37.033257 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:45:37.133265 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:37.133222 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:45:37.235189 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:37.235152 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:45:38.872765 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:38.872733 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:45:41.613355 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.613333 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:45:41.692869 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.692845 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b676dd42-eab7-4eea-961d-3aa32c4b8cac-workload-certs\") pod \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " Jul 15 13:45:41.693041 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.692875 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b676dd42-eab7-4eea-961d-3aa32c4b8cac-istio-token\") pod \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " Jul 15 13:45:41.693041 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.692950 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcrbx\" (UniqueName: \"kubernetes.io/projected/b676dd42-eab7-4eea-961d-3aa32c4b8cac-kube-api-access-wcrbx\") pod \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " Jul 15 13:45:41.693169 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.693053 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b676dd42-eab7-4eea-961d-3aa32c4b8cac-istiod-ca-cert\") pod \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " Jul 15 13:45:41.693169 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.693077 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b676dd42-eab7-4eea-961d-3aa32c4b8cac-credential-socket\") pod \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " Jul 15 13:45:41.693169 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.693103 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b676dd42-eab7-4eea-961d-3aa32c4b8cac-istio-data\") pod \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " Jul 15 13:45:41.693169 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.693133 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b676dd42-eab7-4eea-961d-3aa32c4b8cac-istio-envoy\") pod \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " Jul 15 13:45:41.693169 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.693160 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b676dd42-eab7-4eea-961d-3aa32c4b8cac-workload-socket\") pod \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " Jul 15 13:45:41.693436 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.693198 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b676dd42-eab7-4eea-961d-3aa32c4b8cac-istio-podinfo\") pod \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\" (UID: \"b676dd42-eab7-4eea-961d-3aa32c4b8cac\") " Jul 15 13:45:41.693436 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.693340 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b676dd42-eab7-4eea-961d-3aa32c4b8cac-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b676dd42-eab7-4eea-961d-3aa32c4b8cac" (UID: "b676dd42-eab7-4eea-961d-3aa32c4b8cac"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:45:41.693538 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.693496 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b676dd42-eab7-4eea-961d-3aa32c4b8cac-credential-socket\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:45:41.693684 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.693658 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b676dd42-eab7-4eea-961d-3aa32c4b8cac-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b676dd42-eab7-4eea-961d-3aa32c4b8cac" (UID: "b676dd42-eab7-4eea-961d-3aa32c4b8cac"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:45:41.693797 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.693699 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b676dd42-eab7-4eea-961d-3aa32c4b8cac-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b676dd42-eab7-4eea-961d-3aa32c4b8cac" (UID: "b676dd42-eab7-4eea-961d-3aa32c4b8cac"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:45:41.695238 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.693709 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b676dd42-eab7-4eea-961d-3aa32c4b8cac-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b676dd42-eab7-4eea-961d-3aa32c4b8cac" (UID: "b676dd42-eab7-4eea-961d-3aa32c4b8cac"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:45:41.695238 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.693964 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b676dd42-eab7-4eea-961d-3aa32c4b8cac-istio-data" (OuterVolumeSpecName: "istio-data") pod "b676dd42-eab7-4eea-961d-3aa32c4b8cac" (UID: "b676dd42-eab7-4eea-961d-3aa32c4b8cac"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:45:41.695443 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.695420 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b676dd42-eab7-4eea-961d-3aa32c4b8cac-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b676dd42-eab7-4eea-961d-3aa32c4b8cac" (UID: "b676dd42-eab7-4eea-961d-3aa32c4b8cac"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 13:45:41.695711 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.695681 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b676dd42-eab7-4eea-961d-3aa32c4b8cac-istio-token" (OuterVolumeSpecName: "istio-token") pod "b676dd42-eab7-4eea-961d-3aa32c4b8cac" (UID: "b676dd42-eab7-4eea-961d-3aa32c4b8cac"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:45:41.695888 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.695867 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b676dd42-eab7-4eea-961d-3aa32c4b8cac-kube-api-access-wcrbx" (OuterVolumeSpecName: "kube-api-access-wcrbx") pod "b676dd42-eab7-4eea-961d-3aa32c4b8cac" (UID: "b676dd42-eab7-4eea-961d-3aa32c4b8cac"). InnerVolumeSpecName "kube-api-access-wcrbx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:45:41.695960 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.695914 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b676dd42-eab7-4eea-961d-3aa32c4b8cac-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b676dd42-eab7-4eea-961d-3aa32c4b8cac" (UID: "b676dd42-eab7-4eea-961d-3aa32c4b8cac"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:45:41.698086 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.698052 2554 generic.go:356] "Generic (PLEG): container finished" podID="b676dd42-eab7-4eea-961d-3aa32c4b8cac" containerID="9808006438f2485b8cb8f98e43b81ced4cd26d80fa9a460826dc7ba12ae14a6c" exitCode=0 Jul 15 13:45:41.698176 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.698103 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" event={"ID":"b676dd42-eab7-4eea-961d-3aa32c4b8cac","Type":"ContainerDied","Data":"9808006438f2485b8cb8f98e43b81ced4cd26d80fa9a460826dc7ba12ae14a6c"} Jul 15 13:45:41.698176 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.698111 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" Jul 15 13:45:41.698176 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.698159 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86" event={"ID":"b676dd42-eab7-4eea-961d-3aa32c4b8cac","Type":"ContainerDied","Data":"0620ed87354d7d9cdb0fa5257ea93744f2ea587a7d31059fd1922c5f851dec1f"} Jul 15 13:45:41.698303 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.698189 2554 scope.go:117] "RemoveContainer" containerID="9808006438f2485b8cb8f98e43b81ced4cd26d80fa9a460826dc7ba12ae14a6c" Jul 15 13:45:41.716294 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.716276 2554 scope.go:117] "RemoveContainer" containerID="6c44bf6e5c62034e45c9dabcf4bc9b7baba02b4876dd13fc7c0a1c2f41c51cbf" Jul 15 13:45:41.723925 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.723908 2554 scope.go:117] "RemoveContainer" containerID="9808006438f2485b8cb8f98e43b81ced4cd26d80fa9a460826dc7ba12ae14a6c" Jul 15 13:45:41.724176 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:45:41.724155 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9808006438f2485b8cb8f98e43b81ced4cd26d80fa9a460826dc7ba12ae14a6c\": container with ID starting with 9808006438f2485b8cb8f98e43b81ced4cd26d80fa9a460826dc7ba12ae14a6c not found: ID does not exist" containerID="9808006438f2485b8cb8f98e43b81ced4cd26d80fa9a460826dc7ba12ae14a6c" Jul 15 13:45:41.724240 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.724183 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9808006438f2485b8cb8f98e43b81ced4cd26d80fa9a460826dc7ba12ae14a6c"} err="failed to get container status \"9808006438f2485b8cb8f98e43b81ced4cd26d80fa9a460826dc7ba12ae14a6c\": rpc error: code = NotFound desc = could not find container \"9808006438f2485b8cb8f98e43b81ced4cd26d80fa9a460826dc7ba12ae14a6c\": container with ID starting with 9808006438f2485b8cb8f98e43b81ced4cd26d80fa9a460826dc7ba12ae14a6c not found: ID does not exist" Jul 15 13:45:41.724240 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.724201 2554 scope.go:117] "RemoveContainer" containerID="6c44bf6e5c62034e45c9dabcf4bc9b7baba02b4876dd13fc7c0a1c2f41c51cbf" Jul 15 13:45:41.724439 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:45:41.724423 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c44bf6e5c62034e45c9dabcf4bc9b7baba02b4876dd13fc7c0a1c2f41c51cbf\": container with ID starting with 6c44bf6e5c62034e45c9dabcf4bc9b7baba02b4876dd13fc7c0a1c2f41c51cbf not found: ID does not exist" containerID="6c44bf6e5c62034e45c9dabcf4bc9b7baba02b4876dd13fc7c0a1c2f41c51cbf" Jul 15 13:45:41.724484 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.724445 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c44bf6e5c62034e45c9dabcf4bc9b7baba02b4876dd13fc7c0a1c2f41c51cbf"} err="failed to get container status \"6c44bf6e5c62034e45c9dabcf4bc9b7baba02b4876dd13fc7c0a1c2f41c51cbf\": rpc error: code = NotFound desc = could not find container \"6c44bf6e5c62034e45c9dabcf4bc9b7baba02b4876dd13fc7c0a1c2f41c51cbf\": container with ID starting with 6c44bf6e5c62034e45c9dabcf4bc9b7baba02b4876dd13fc7c0a1c2f41c51cbf not found: ID does not exist" Jul 15 13:45:41.728446 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.728424 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86"] Jul 15 13:45:41.732066 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.732046 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-9e5a80bf-openshift-default-c47b65575-rsg86"] Jul 15 13:45:41.794325 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.794292 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcrbx\" (UniqueName: \"kubernetes.io/projected/b676dd42-eab7-4eea-961d-3aa32c4b8cac-kube-api-access-wcrbx\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:45:41.794325 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.794321 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b676dd42-eab7-4eea-961d-3aa32c4b8cac-istiod-ca-cert\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:45:41.794325 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.794331 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b676dd42-eab7-4eea-961d-3aa32c4b8cac-istio-data\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:45:41.794548 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.794340 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b676dd42-eab7-4eea-961d-3aa32c4b8cac-istio-envoy\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:45:41.794548 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.794348 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b676dd42-eab7-4eea-961d-3aa32c4b8cac-workload-socket\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:45:41.794548 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.794355 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b676dd42-eab7-4eea-961d-3aa32c4b8cac-istio-podinfo\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:45:41.794548 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.794366 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b676dd42-eab7-4eea-961d-3aa32c4b8cac-workload-certs\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:45:41.794548 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:41.794375 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b676dd42-eab7-4eea-961d-3aa32c4b8cac-istio-token\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:45:43.137255 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:43.137219 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b676dd42-eab7-4eea-961d-3aa32c4b8cac" path="/var/lib/kubelet/pods/b676dd42-eab7-4eea-961d-3aa32c4b8cac/volumes" Jul 15 13:45:44.850288 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:44.850255 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:45:44.904186 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:44.904140 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:45:45.156284 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:45.156188 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:45:45.256386 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:45.256348 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:45:45.723311 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:45.723281 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:45:48.893763 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:45:48.893727 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:46:11.779064 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:46:11.779030 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:46:18.027412 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:46:18.027376 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:46:18.089652 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:46:18.089604 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:46:18.179889 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:46:18.179859 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:46:18.278521 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:46:18.278438 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:46:27.190070 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:46:27.190044 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lx562_83d9c378-e25b-487c-a9be-83e18e37d87f/ovn-acl-logging/0.log" Jul 15 13:46:27.192059 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:46:27.192038 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lx562_83d9c378-e25b-487c-a9be-83e18e37d87f/ovn-acl-logging/0.log" Jul 15 13:46:34.292687 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:46:34.292651 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:46:40.091033 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:46:40.090972 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:46:40.197672 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:46:40.197632 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:46:40.291758 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:46:40.291710 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:46:50.852583 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:46:50.852539 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:46:51.670725 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:46:51.670686 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:46:57.459222 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:46:57.459178 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:46:57.521088 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:46:57.521052 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:46:57.606066 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:46:57.606033 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:46:57.705797 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:46:57.705757 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:46:57.807116 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:46:57.807070 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:46:58.596706 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:46:58.596670 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:46:58.695087 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:46:58.695050 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:46:58.796400 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:46:58.796368 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:47:00.655111 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:00.655073 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:47:06.966898 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:06.966847 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:47:07.066188 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:07.066148 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:47:07.681440 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:07.681384 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:47:13.829255 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:13.829203 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:47:13.891296 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:13.891264 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:47:14.095313 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.095223 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:47:14.403375 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.403293 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw"] Jul 15 13:47:14.403677 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.403662 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b676dd42-eab7-4eea-961d-3aa32c4b8cac" containerName="istio-proxy" Jul 15 13:47:14.403732 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.403678 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="b676dd42-eab7-4eea-961d-3aa32c4b8cac" containerName="istio-proxy" Jul 15 13:47:14.403732 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.403696 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b676dd42-eab7-4eea-961d-3aa32c4b8cac" containerName="istio-proxy" Jul 15 13:47:14.403732 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.403704 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="b676dd42-eab7-4eea-961d-3aa32c4b8cac" containerName="istio-proxy" Jul 15 13:47:14.403732 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.403725 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b758f92f-5d5d-42e5-8dd7-3c5b1005ad04" containerName="revoke-keys" Jul 15 13:47:14.403732 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.403733 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="b758f92f-5d5d-42e5-8dd7-3c5b1005ad04" containerName="revoke-keys" Jul 15 13:47:14.403909 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.403799 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="b676dd42-eab7-4eea-961d-3aa32c4b8cac" containerName="istio-proxy" Jul 15 13:47:14.403909 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.403812 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="b758f92f-5d5d-42e5-8dd7-3c5b1005ad04" containerName="revoke-keys" Jul 15 13:47:14.406900 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.406885 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:14.409177 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.409158 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-a566516a-openshift-default-dockercfg-rv9ch\"" Jul 15 13:47:14.420633 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.420608 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:47:14.429345 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.429317 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw"] Jul 15 13:47:14.476104 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.476069 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npk8m\" (UniqueName: \"kubernetes.io/projected/c1a3b05b-811c-4dc6-aaf2-54453200fd98-kube-api-access-npk8m\") pod \"e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:14.476277 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.476123 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a3b05b-811c-4dc6-aaf2-54453200fd98-credential-socket\") pod \"e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:14.476277 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.476172 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1a3b05b-811c-4dc6-aaf2-54453200fd98-istio-envoy\") pod \"e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:14.476277 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.476205 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a3b05b-811c-4dc6-aaf2-54453200fd98-workload-socket\") pod \"e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:14.476277 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.476259 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1a3b05b-811c-4dc6-aaf2-54453200fd98-workload-certs\") pod \"e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:14.476505 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.476302 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1a3b05b-811c-4dc6-aaf2-54453200fd98-istiod-ca-cert\") pod \"e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:14.476505 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.476325 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1a3b05b-811c-4dc6-aaf2-54453200fd98-istio-data\") pod \"e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:14.476505 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.476358 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1a3b05b-811c-4dc6-aaf2-54453200fd98-istio-token\") pod \"e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:14.476505 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.476385 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1a3b05b-811c-4dc6-aaf2-54453200fd98-istio-podinfo\") pod \"e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:14.577546 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.577513 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1a3b05b-811c-4dc6-aaf2-54453200fd98-istio-podinfo\") pod \"e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:14.577709 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.577572 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npk8m\" (UniqueName: \"kubernetes.io/projected/c1a3b05b-811c-4dc6-aaf2-54453200fd98-kube-api-access-npk8m\") pod \"e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:14.577709 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.577617 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a3b05b-811c-4dc6-aaf2-54453200fd98-credential-socket\") pod \"e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:14.577709 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.577632 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1a3b05b-811c-4dc6-aaf2-54453200fd98-istio-envoy\") pod \"e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:14.577709 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.577657 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a3b05b-811c-4dc6-aaf2-54453200fd98-workload-socket\") pod \"e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:14.577709 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.577689 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1a3b05b-811c-4dc6-aaf2-54453200fd98-workload-certs\") pod \"e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:14.577946 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.577724 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1a3b05b-811c-4dc6-aaf2-54453200fd98-istiod-ca-cert\") pod \"e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:14.577946 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.577750 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1a3b05b-811c-4dc6-aaf2-54453200fd98-istio-data\") pod \"e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:14.577946 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.577788 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1a3b05b-811c-4dc6-aaf2-54453200fd98-istio-token\") pod \"e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:14.578105 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.578083 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a3b05b-811c-4dc6-aaf2-54453200fd98-credential-socket\") pod \"e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:14.578322 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.578300 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1a3b05b-811c-4dc6-aaf2-54453200fd98-workload-certs\") pod \"e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:14.578415 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.578368 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a3b05b-811c-4dc6-aaf2-54453200fd98-workload-socket\") pod \"e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:14.578473 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.578422 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1a3b05b-811c-4dc6-aaf2-54453200fd98-istio-data\") pod \"e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:14.578529 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.578496 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1a3b05b-811c-4dc6-aaf2-54453200fd98-istiod-ca-cert\") pod \"e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:14.580071 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.580048 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1a3b05b-811c-4dc6-aaf2-54453200fd98-istio-envoy\") pod \"e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:14.580185 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.580156 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1a3b05b-811c-4dc6-aaf2-54453200fd98-istio-podinfo\") pod \"e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:14.586745 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.586723 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npk8m\" (UniqueName: \"kubernetes.io/projected/c1a3b05b-811c-4dc6-aaf2-54453200fd98-kube-api-access-npk8m\") pod \"e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:14.587077 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.587054 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1a3b05b-811c-4dc6-aaf2-54453200fd98-istio-token\") pod \"e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:14.710235 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.710137 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:47:14.716971 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.716945 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:14.853009 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.852772 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw"] Jul 15 13:47:14.860167 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:47:14.860135 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1a3b05b_811c_4dc6_aaf2_54453200fd98.slice/crio-a6909cc5839c7ea760436160dd34390bacbd64224876680964c9bbcb126bc12f WatchSource:0}: Error finding container a6909cc5839c7ea760436160dd34390bacbd64224876680964c9bbcb126bc12f: Status 404 returned error can't find the container with id a6909cc5839c7ea760436160dd34390bacbd64224876680964c9bbcb126bc12f Jul 15 13:47:14.862757 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.862724 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:47:14.862840 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.862797 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:47:14.862840 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:14.862827 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:47:15.137585 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:15.137549 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" event={"ID":"c1a3b05b-811c-4dc6-aaf2-54453200fd98","Type":"ContainerStarted","Data":"f17e408e476c4ae4634e3c31a829401af9d72fffcd7b9b54cba1bb9ef91b96ba"} Jul 15 13:47:15.137752 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:15.137601 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" event={"ID":"c1a3b05b-811c-4dc6-aaf2-54453200fd98","Type":"ContainerStarted","Data":"a6909cc5839c7ea760436160dd34390bacbd64224876680964c9bbcb126bc12f"} Jul 15 13:47:15.158156 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:15.158108 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" podStartSLOduration=1.1580917259999999 podStartE2EDuration="1.158091726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:47:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:47:15.156115669 +0000 UTC m=+2148.586925253" watchObservedRunningTime="2026-07-15 13:47:15.158091726 +0000 UTC m=+2148.588901300" Jul 15 13:47:15.717750 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:15.717709 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:15.722347 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:15.722319 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:16.141470 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:16.141434 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:16.142335 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:16.142314 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:17.606691 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:17.606638 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:47:17.706078 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:17.706043 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:47:17.809937 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:17.809892 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:47:17.865138 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:17.865043 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:47:18.413794 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:18.413708 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:47:18.515463 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:18.515422 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:47:22.135790 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:22.135752 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:47:22.843360 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:22.843308 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:47:22.926561 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:22.926521 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:47:23.272542 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:23.272504 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:47:29.837854 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:29.837811 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:47:29.903008 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:29.902953 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:47:30.209846 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:30.209748 2554 generic.go:356] "Generic (PLEG): container finished" podID="c1a3b05b-811c-4dc6-aaf2-54453200fd98" containerID="f17e408e476c4ae4634e3c31a829401af9d72fffcd7b9b54cba1bb9ef91b96ba" exitCode=0 Jul 15 13:47:30.209846 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:30.209819 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" event={"ID":"c1a3b05b-811c-4dc6-aaf2-54453200fd98","Type":"ContainerDied","Data":"f17e408e476c4ae4634e3c31a829401af9d72fffcd7b9b54cba1bb9ef91b96ba"} Jul 15 13:47:30.210256 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:30.210241 2554 scope.go:117] "RemoveContainer" containerID="f17e408e476c4ae4634e3c31a829401af9d72fffcd7b9b54cba1bb9ef91b96ba" Jul 15 13:47:30.211373 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:30.211339 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:47:30.211438 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:30.211427 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:47:30.211480 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:30.211465 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:47:30.244164 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:30.244136 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a566516a-pqm59"] Jul 15 13:47:30.244562 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:30.244546 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="b676dd42-eab7-4eea-961d-3aa32c4b8cac" containerName="istio-proxy" Jul 15 13:47:30.247384 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:30.247361 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a566516a-pqm59" Jul 15 13:47:30.250235 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:30.250211 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpj2c\"" Jul 15 13:47:30.250347 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:30.250230 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 13:47:30.255702 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:30.255675 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a566516a-pqm59"] Jul 15 13:47:30.322588 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:30.322549 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcc1c6ff-f746-47aa-bd42-e7cf2cfb6c41-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a566516a-pqm59\" (UID: \"dcc1c6ff-f746-47aa-bd42-e7cf2cfb6c41\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a566516a-pqm59" Jul 15 13:47:30.423704 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:30.423674 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcc1c6ff-f746-47aa-bd42-e7cf2cfb6c41-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a566516a-pqm59\" (UID: \"dcc1c6ff-f746-47aa-bd42-e7cf2cfb6c41\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a566516a-pqm59" Jul 15 13:47:30.424638 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:30.424612 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcc1c6ff-f746-47aa-bd42-e7cf2cfb6c41-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a566516a-pqm59\" (UID: \"dcc1c6ff-f746-47aa-bd42-e7cf2cfb6c41\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a566516a-pqm59" Jul 15 13:47:30.571055 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:30.571022 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a566516a-pqm59" Jul 15 13:47:30.713093 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:30.713067 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a566516a-pqm59"] Jul 15 13:47:30.715555 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:47:30.715527 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcc1c6ff_f746_47aa_bd42_e7cf2cfb6c41.slice/crio-7cdfa88ef68ffdeb24373604d31826d235d32ac201e42d931ad662b9c89f4aa2 WatchSource:0}: Error finding container 7cdfa88ef68ffdeb24373604d31826d235d32ac201e42d931ad662b9c89f4aa2: Status 404 returned error can't find the container with id 7cdfa88ef68ffdeb24373604d31826d235d32ac201e42d931ad662b9c89f4aa2 Jul 15 13:47:31.141744 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:31.141709 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:31.220104 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:31.219159 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a566516a-pqm59" event={"ID":"dcc1c6ff-f746-47aa-bd42-e7cf2cfb6c41","Type":"ContainerStarted","Data":"f61debf230d3c165392c8e3649a49be241aae6c1ad9e8106b35c8cf4c2b06ac1"} Jul 15 13:47:31.220104 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:31.219223 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a566516a-pqm59" event={"ID":"dcc1c6ff-f746-47aa-bd42-e7cf2cfb6c41","Type":"ContainerStarted","Data":"7cdfa88ef68ffdeb24373604d31826d235d32ac201e42d931ad662b9c89f4aa2"} Jul 15 13:47:31.222807 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:31.222770 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" event={"ID":"c1a3b05b-811c-4dc6-aaf2-54453200fd98","Type":"ContainerStarted","Data":"7d0691e840b6605b8c1e448363babf41e91dae318ba0f19bc9d6e0a8e783bc18"} Jul 15 13:47:31.236746 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:31.236587 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a566516a-pqm59" podStartSLOduration=1.236568156 podStartE2EDuration="1.236568156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:47:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:47:31.235625593 +0000 UTC m=+2164.666435168" watchObservedRunningTime="2026-07-15 13:47:31.236568156 +0000 UTC m=+2164.667377730" Jul 15 13:47:31.717829 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:31.717702 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:31.718682 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:31.718650 2554 patch_prober.go:28] interesting pod/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 15 13:47:31.718830 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:31.718714 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" podUID="c1a3b05b-811c-4dc6-aaf2-54453200fd98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 15 13:47:32.229528 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:32.229493 2554 generic.go:356] "Generic (PLEG): container finished" podID="dcc1c6ff-f746-47aa-bd42-e7cf2cfb6c41" containerID="f61debf230d3c165392c8e3649a49be241aae6c1ad9e8106b35c8cf4c2b06ac1" exitCode=0 Jul 15 13:47:32.229934 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:32.229578 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a566516a-pqm59" event={"ID":"dcc1c6ff-f746-47aa-bd42-e7cf2cfb6c41","Type":"ContainerDied","Data":"f61debf230d3c165392c8e3649a49be241aae6c1ad9e8106b35c8cf4c2b06ac1"} Jul 15 13:47:32.717871 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:32.717764 2554 patch_prober.go:28] interesting pod/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 15 13:47:32.717871 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:32.717832 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" podUID="c1a3b05b-811c-4dc6-aaf2-54453200fd98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 15 13:47:33.373329 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:33.373308 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a566516a-pqm59" Jul 15 13:47:33.552599 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:33.552515 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcc1c6ff-f746-47aa-bd42-e7cf2cfb6c41-maas-api-service-ca\") pod \"dcc1c6ff-f746-47aa-bd42-e7cf2cfb6c41\" (UID: \"dcc1c6ff-f746-47aa-bd42-e7cf2cfb6c41\") " Jul 15 13:47:33.552855 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:33.552830 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcc1c6ff-f746-47aa-bd42-e7cf2cfb6c41-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dcc1c6ff-f746-47aa-bd42-e7cf2cfb6c41" (UID: "dcc1c6ff-f746-47aa-bd42-e7cf2cfb6c41"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:47:33.654098 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:33.654065 2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcc1c6ff-f746-47aa-bd42-e7cf2cfb6c41-maas-api-service-ca\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:47:33.718226 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:33.718179 2554 patch_prober.go:28] interesting pod/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 15 13:47:33.718429 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:33.718248 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" podUID="c1a3b05b-811c-4dc6-aaf2-54453200fd98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 15 13:47:34.241109 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:34.241082 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a566516a-pqm59" Jul 15 13:47:34.241109 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:34.241089 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a566516a-pqm59" event={"ID":"dcc1c6ff-f746-47aa-bd42-e7cf2cfb6c41","Type":"ContainerDied","Data":"7cdfa88ef68ffdeb24373604d31826d235d32ac201e42d931ad662b9c89f4aa2"} Jul 15 13:47:34.241317 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:34.241130 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7cdfa88ef68ffdeb24373604d31826d235d32ac201e42d931ad662b9c89f4aa2" Jul 15 13:47:34.718050 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:34.717930 2554 patch_prober.go:28] interesting pod/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 15 13:47:34.719033 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:34.718590 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" podUID="c1a3b05b-811c-4dc6-aaf2-54453200fd98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 15 13:47:35.722068 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:35.722033 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:35.722446 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:35.722411 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:35.723241 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:35.723224 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:47:40.751218 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:40.751185 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:47:45.334468 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:45.334426 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:47:51.301848 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:51.301801 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:47:51.399895 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:51.399866 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:47:56.038353 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:56.038317 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw"] Jul 15 13:47:56.038805 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:56.038537 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" podUID="c1a3b05b-811c-4dc6-aaf2-54453200fd98" containerName="istio-proxy" containerID="cri-o://7d0691e840b6605b8c1e448363babf41e91dae318ba0f19bc9d6e0a8e783bc18" gracePeriod=30 Jul 15 13:47:56.054220 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:56.054192 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:47:56.296274 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:56.296170 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:47:56.407754 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:56.407704 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:47:56.506414 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:56.506380 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:47:56.638201 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:47:56.638110 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:48:01.293556 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.293532 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:48:01.366594 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.366512 2554 generic.go:356] "Generic (PLEG): container finished" podID="c1a3b05b-811c-4dc6-aaf2-54453200fd98" containerID="7d0691e840b6605b8c1e448363babf41e91dae318ba0f19bc9d6e0a8e783bc18" exitCode=0 Jul 15 13:48:01.366594 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.366567 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" Jul 15 13:48:01.366766 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.366600 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" event={"ID":"c1a3b05b-811c-4dc6-aaf2-54453200fd98","Type":"ContainerDied","Data":"7d0691e840b6605b8c1e448363babf41e91dae318ba0f19bc9d6e0a8e783bc18"} Jul 15 13:48:01.366766 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.366652 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw" event={"ID":"c1a3b05b-811c-4dc6-aaf2-54453200fd98","Type":"ContainerDied","Data":"a6909cc5839c7ea760436160dd34390bacbd64224876680964c9bbcb126bc12f"} Jul 15 13:48:01.366766 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.366674 2554 scope.go:117] "RemoveContainer" containerID="7d0691e840b6605b8c1e448363babf41e91dae318ba0f19bc9d6e0a8e783bc18" Jul 15 13:48:01.375025 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.375005 2554 scope.go:117] "RemoveContainer" containerID="f17e408e476c4ae4634e3c31a829401af9d72fffcd7b9b54cba1bb9ef91b96ba" Jul 15 13:48:01.382850 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.382833 2554 scope.go:117] "RemoveContainer" containerID="7d0691e840b6605b8c1e448363babf41e91dae318ba0f19bc9d6e0a8e783bc18" Jul 15 13:48:01.383148 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:48:01.383132 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d0691e840b6605b8c1e448363babf41e91dae318ba0f19bc9d6e0a8e783bc18\": container with ID starting with 7d0691e840b6605b8c1e448363babf41e91dae318ba0f19bc9d6e0a8e783bc18 not found: ID does not exist" containerID="7d0691e840b6605b8c1e448363babf41e91dae318ba0f19bc9d6e0a8e783bc18" Jul 15 13:48:01.383206 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.383157 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d0691e840b6605b8c1e448363babf41e91dae318ba0f19bc9d6e0a8e783bc18"} err="failed to get container status \"7d0691e840b6605b8c1e448363babf41e91dae318ba0f19bc9d6e0a8e783bc18\": rpc error: code = NotFound desc = could not find container \"7d0691e840b6605b8c1e448363babf41e91dae318ba0f19bc9d6e0a8e783bc18\": container with ID starting with 7d0691e840b6605b8c1e448363babf41e91dae318ba0f19bc9d6e0a8e783bc18 not found: ID does not exist" Jul 15 13:48:01.383206 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.383173 2554 scope.go:117] "RemoveContainer" containerID="f17e408e476c4ae4634e3c31a829401af9d72fffcd7b9b54cba1bb9ef91b96ba" Jul 15 13:48:01.383423 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:48:01.383403 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f17e408e476c4ae4634e3c31a829401af9d72fffcd7b9b54cba1bb9ef91b96ba\": container with ID starting with f17e408e476c4ae4634e3c31a829401af9d72fffcd7b9b54cba1bb9ef91b96ba not found: ID does not exist" containerID="f17e408e476c4ae4634e3c31a829401af9d72fffcd7b9b54cba1bb9ef91b96ba" Jul 15 13:48:01.383473 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.383428 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f17e408e476c4ae4634e3c31a829401af9d72fffcd7b9b54cba1bb9ef91b96ba"} err="failed to get container status \"f17e408e476c4ae4634e3c31a829401af9d72fffcd7b9b54cba1bb9ef91b96ba\": rpc error: code = NotFound desc = could not find container \"f17e408e476c4ae4634e3c31a829401af9d72fffcd7b9b54cba1bb9ef91b96ba\": container with ID starting with f17e408e476c4ae4634e3c31a829401af9d72fffcd7b9b54cba1bb9ef91b96ba not found: ID does not exist" Jul 15 13:48:01.386719 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.386700 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1a3b05b-811c-4dc6-aaf2-54453200fd98-istio-envoy\") pod \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " Jul 15 13:48:01.386802 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.386727 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1a3b05b-811c-4dc6-aaf2-54453200fd98-istio-data\") pod \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " Jul 15 13:48:01.386802 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.386781 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1a3b05b-811c-4dc6-aaf2-54453200fd98-istiod-ca-cert\") pod \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " Jul 15 13:48:01.386910 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.386821 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1a3b05b-811c-4dc6-aaf2-54453200fd98-istio-podinfo\") pod \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " Jul 15 13:48:01.386910 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.386848 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a3b05b-811c-4dc6-aaf2-54453200fd98-workload-socket\") pod \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " Jul 15 13:48:01.386910 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.386872 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1a3b05b-811c-4dc6-aaf2-54453200fd98-istio-token\") pod \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " Jul 15 13:48:01.386910 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.386898 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1a3b05b-811c-4dc6-aaf2-54453200fd98-workload-certs\") pod \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " Jul 15 13:48:01.387154 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.386941 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a3b05b-811c-4dc6-aaf2-54453200fd98-credential-socket\") pod \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " Jul 15 13:48:01.387154 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.386968 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npk8m\" (UniqueName: \"kubernetes.io/projected/c1a3b05b-811c-4dc6-aaf2-54453200fd98-kube-api-access-npk8m\") pod \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\" (UID: \"c1a3b05b-811c-4dc6-aaf2-54453200fd98\") " Jul 15 13:48:01.387256 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.387212 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1a3b05b-811c-4dc6-aaf2-54453200fd98-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c1a3b05b-811c-4dc6-aaf2-54453200fd98" (UID: "c1a3b05b-811c-4dc6-aaf2-54453200fd98"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:48:01.387256 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.387237 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1a3b05b-811c-4dc6-aaf2-54453200fd98-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c1a3b05b-811c-4dc6-aaf2-54453200fd98" (UID: "c1a3b05b-811c-4dc6-aaf2-54453200fd98"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:48:01.387440 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.387414 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1a3b05b-811c-4dc6-aaf2-54453200fd98-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c1a3b05b-811c-4dc6-aaf2-54453200fd98" (UID: "c1a3b05b-811c-4dc6-aaf2-54453200fd98"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:48:01.387616 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.387527 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1a3b05b-811c-4dc6-aaf2-54453200fd98-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c1a3b05b-811c-4dc6-aaf2-54453200fd98" (UID: "c1a3b05b-811c-4dc6-aaf2-54453200fd98"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:48:01.387616 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.387601 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1a3b05b-811c-4dc6-aaf2-54453200fd98-istio-data" (OuterVolumeSpecName: "istio-data") pod "c1a3b05b-811c-4dc6-aaf2-54453200fd98" (UID: "c1a3b05b-811c-4dc6-aaf2-54453200fd98"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:48:01.389028 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.388946 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1a3b05b-811c-4dc6-aaf2-54453200fd98-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c1a3b05b-811c-4dc6-aaf2-54453200fd98" (UID: "c1a3b05b-811c-4dc6-aaf2-54453200fd98"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:48:01.389028 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.389008 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c1a3b05b-811c-4dc6-aaf2-54453200fd98-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c1a3b05b-811c-4dc6-aaf2-54453200fd98" (UID: "c1a3b05b-811c-4dc6-aaf2-54453200fd98"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 13:48:01.389160 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.389040 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1a3b05b-811c-4dc6-aaf2-54453200fd98-istio-token" (OuterVolumeSpecName: "istio-token") pod "c1a3b05b-811c-4dc6-aaf2-54453200fd98" (UID: "c1a3b05b-811c-4dc6-aaf2-54453200fd98"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:48:01.389426 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.389413 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1a3b05b-811c-4dc6-aaf2-54453200fd98-kube-api-access-npk8m" (OuterVolumeSpecName: "kube-api-access-npk8m") pod "c1a3b05b-811c-4dc6-aaf2-54453200fd98" (UID: "c1a3b05b-811c-4dc6-aaf2-54453200fd98"). InnerVolumeSpecName "kube-api-access-npk8m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:48:01.488370 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.488316 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1a3b05b-811c-4dc6-aaf2-54453200fd98-istio-envoy\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:48:01.488370 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.488362 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1a3b05b-811c-4dc6-aaf2-54453200fd98-istio-data\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:48:01.488370 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.488375 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1a3b05b-811c-4dc6-aaf2-54453200fd98-istiod-ca-cert\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:48:01.488370 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.488385 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1a3b05b-811c-4dc6-aaf2-54453200fd98-istio-podinfo\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:48:01.488668 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.488396 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a3b05b-811c-4dc6-aaf2-54453200fd98-workload-socket\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:48:01.488668 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.488409 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1a3b05b-811c-4dc6-aaf2-54453200fd98-istio-token\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:48:01.488668 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.488419 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1a3b05b-811c-4dc6-aaf2-54453200fd98-workload-certs\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:48:01.488668 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.488431 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1a3b05b-811c-4dc6-aaf2-54453200fd98-credential-socket\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:48:01.488668 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.488442 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npk8m\" (UniqueName: \"kubernetes.io/projected/c1a3b05b-811c-4dc6-aaf2-54453200fd98-kube-api-access-npk8m\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:48:01.689057 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.689021 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw"] Jul 15 13:48:01.693251 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:01.693225 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-a566516a-openshift-default-5fc457d5f5-2mdnw"] Jul 15 13:48:02.618227 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:02.618192 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:48:02.679066 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:02.679028 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:48:02.759673 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:02.759634 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:48:02.906395 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:02.906299 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:48:03.012355 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:03.012317 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:48:03.138130 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:03.138097 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1a3b05b-811c-4dc6-aaf2-54453200fd98" path="/var/lib/kubelet/pods/c1a3b05b-811c-4dc6-aaf2-54453200fd98/volumes" Jul 15 13:48:08.893019 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:08.892961 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:48:08.995667 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:08.995635 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:48:15.906595 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:15.906555 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:48:16.223213 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.223174 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd"] Jul 15 13:48:16.223531 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.223520 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcc1c6ff-f746-47aa-bd42-e7cf2cfb6c41" containerName="revoke-keys" Jul 15 13:48:16.223575 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.223534 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcc1c6ff-f746-47aa-bd42-e7cf2cfb6c41" containerName="revoke-keys" Jul 15 13:48:16.223575 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.223558 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1a3b05b-811c-4dc6-aaf2-54453200fd98" containerName="istio-proxy" Jul 15 13:48:16.223575 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.223563 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1a3b05b-811c-4dc6-aaf2-54453200fd98" containerName="istio-proxy" Jul 15 13:48:16.223575 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.223570 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1a3b05b-811c-4dc6-aaf2-54453200fd98" containerName="istio-proxy" Jul 15 13:48:16.223575 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.223575 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1a3b05b-811c-4dc6-aaf2-54453200fd98" containerName="istio-proxy" Jul 15 13:48:16.223731 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.223632 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1a3b05b-811c-4dc6-aaf2-54453200fd98" containerName="istio-proxy" Jul 15 13:48:16.223731 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.223640 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1a3b05b-811c-4dc6-aaf2-54453200fd98" containerName="istio-proxy" Jul 15 13:48:16.223731 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.223649 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcc1c6ff-f746-47aa-bd42-e7cf2cfb6c41" containerName="revoke-keys" Jul 15 13:48:16.227726 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.227700 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:16.230301 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.230281 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-954f0f75-openshift-default-dockercfg-l4h8w\"" Jul 15 13:48:16.239800 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.239776 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd"] Jul 15 13:48:16.249010 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.248957 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:48:16.314996 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.314949 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c98x\" (UniqueName: \"kubernetes.io/projected/b9bd7757-813a-410b-bc92-5be066351741-kube-api-access-9c98x\") pod \"e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:16.315135 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.315005 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bd7757-813a-410b-bc92-5be066351741-credential-socket\") pod \"e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:16.315135 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.315050 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9bd7757-813a-410b-bc92-5be066351741-istio-token\") pod \"e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:16.315135 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.315106 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bd7757-813a-410b-bc92-5be066351741-workload-socket\") pod \"e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:16.315135 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.315123 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9bd7757-813a-410b-bc92-5be066351741-istio-envoy\") pod \"e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:16.315330 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.315162 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9bd7757-813a-410b-bc92-5be066351741-istio-data\") pod \"e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:16.315330 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.315191 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9bd7757-813a-410b-bc92-5be066351741-istio-podinfo\") pod \"e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:16.315330 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.315217 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9bd7757-813a-410b-bc92-5be066351741-istiod-ca-cert\") pod \"e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:16.315330 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.315291 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9bd7757-813a-410b-bc92-5be066351741-workload-certs\") pod \"e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:16.416648 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.416613 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9bd7757-813a-410b-bc92-5be066351741-workload-certs\") pod \"e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:16.416838 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.416655 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c98x\" (UniqueName: \"kubernetes.io/projected/b9bd7757-813a-410b-bc92-5be066351741-kube-api-access-9c98x\") pod \"e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:16.416838 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.416701 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bd7757-813a-410b-bc92-5be066351741-credential-socket\") pod \"e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:16.416838 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.416734 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9bd7757-813a-410b-bc92-5be066351741-istio-token\") pod \"e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:16.416838 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.416792 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bd7757-813a-410b-bc92-5be066351741-workload-socket\") pod \"e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:16.416838 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.416821 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9bd7757-813a-410b-bc92-5be066351741-istio-envoy\") pod \"e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:16.417149 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.416858 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9bd7757-813a-410b-bc92-5be066351741-istio-data\") pod \"e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:16.417149 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.416888 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9bd7757-813a-410b-bc92-5be066351741-istio-podinfo\") pod \"e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:16.417149 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.416914 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9bd7757-813a-410b-bc92-5be066351741-istiod-ca-cert\") pod \"e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:16.417302 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.417186 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9bd7757-813a-410b-bc92-5be066351741-workload-certs\") pod \"e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:16.417302 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.417251 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9bd7757-813a-410b-bc92-5be066351741-istio-data\") pod \"e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:16.417404 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.417331 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bd7757-813a-410b-bc92-5be066351741-credential-socket\") pod \"e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:16.417404 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.417361 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bd7757-813a-410b-bc92-5be066351741-workload-socket\") pod \"e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:16.417569 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.417552 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9bd7757-813a-410b-bc92-5be066351741-istiod-ca-cert\") pod \"e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:16.419178 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.419157 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9bd7757-813a-410b-bc92-5be066351741-istio-envoy\") pod \"e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:16.419400 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.419382 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9bd7757-813a-410b-bc92-5be066351741-istio-podinfo\") pod \"e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:16.435031 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.434968 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9bd7757-813a-410b-bc92-5be066351741-istio-token\") pod \"e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:16.435031 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.435015 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c98x\" (UniqueName: \"kubernetes.io/projected/b9bd7757-813a-410b-bc92-5be066351741-kube-api-access-9c98x\") pod \"e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:16.537231 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.537139 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:16.676781 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.676752 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd"] Jul 15 13:48:16.679287 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:48:16.679259 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9bd7757_813a_410b_bc92_5be066351741.slice/crio-8ae558f5f4a9c9ce08362e29b85862be0df0b37815f63584a440caec3773f750 WatchSource:0}: Error finding container 8ae558f5f4a9c9ce08362e29b85862be0df0b37815f63584a440caec3773f750: Status 404 returned error can't find the container with id 8ae558f5f4a9c9ce08362e29b85862be0df0b37815f63584a440caec3773f750 Jul 15 13:48:16.681398 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.681366 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:48:16.681473 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.681425 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:48:16.681473 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.681455 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:48:16.717839 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:16.717807 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:48:17.442839 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:17.442807 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" event={"ID":"b9bd7757-813a-410b-bc92-5be066351741","Type":"ContainerStarted","Data":"de5a34c18bf7b95a8814b90c49ffacb478355cc896034263c50c96ad54c84b49"} Jul 15 13:48:17.443214 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:17.442859 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" event={"ID":"b9bd7757-813a-410b-bc92-5be066351741","Type":"ContainerStarted","Data":"8ae558f5f4a9c9ce08362e29b85862be0df0b37815f63584a440caec3773f750"} Jul 15 13:48:17.467600 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:17.467552 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" podStartSLOduration=1.467535743 podStartE2EDuration="1.467535743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:48:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:48:17.466378333 +0000 UTC m=+2210.897187918" watchObservedRunningTime="2026-07-15 13:48:17.467535743 +0000 UTC m=+2210.898345314" Jul 15 13:48:17.537849 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:17.537815 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:17.542528 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:17.542502 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:18.448358 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:18.448331 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:18.449286 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:18.449264 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:19.409494 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:19.409450 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:48:19.499442 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:19.499406 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:48:19.622528 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:19.622494 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:48:19.838203 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:19.838170 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:48:20.103481 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:20.103385 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:48:20.207102 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:20.207067 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:48:23.922218 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:23.922184 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:48:33.450237 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:33.450202 2554 patch_prober.go:28] interesting pod/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 15 13:48:33.450663 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:33.450257 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" podUID="b9bd7757-813a-410b-bc92-5be066351741" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 15 13:48:33.525379 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:33.525342 2554 generic.go:356] "Generic (PLEG): container finished" podID="b9bd7757-813a-410b-bc92-5be066351741" containerID="de5a34c18bf7b95a8814b90c49ffacb478355cc896034263c50c96ad54c84b49" exitCode=0 Jul 15 13:48:33.525557 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:33.525417 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" event={"ID":"b9bd7757-813a-410b-bc92-5be066351741","Type":"ContainerDied","Data":"de5a34c18bf7b95a8814b90c49ffacb478355cc896034263c50c96ad54c84b49"} Jul 15 13:48:33.525842 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:33.525814 2554 scope.go:117] "RemoveContainer" containerID="de5a34c18bf7b95a8814b90c49ffacb478355cc896034263c50c96ad54c84b49" Jul 15 13:48:33.526884 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:33.526853 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:48:33.526962 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:33.526925 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:48:33.526962 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:33.526957 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:48:34.531850 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:34.531818 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" event={"ID":"b9bd7757-813a-410b-bc92-5be066351741","Type":"ContainerStarted","Data":"9d97a353e039bba1b4ebc921f34bebe59c0c91e3cb306a94b400deeaf2da37b5"} Jul 15 13:48:34.537465 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:34.537446 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:34.537650 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:34.537631 2554 patch_prober.go:28] interesting pod/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 15 13:48:34.537696 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:34.537674 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" podUID="b9bd7757-813a-410b-bc92-5be066351741" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 15 13:48:35.537624 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:35.537587 2554 patch_prober.go:28] interesting pod/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 15 13:48:35.538051 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:35.537641 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" podUID="b9bd7757-813a-410b-bc92-5be066351741" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 15 13:48:36.533234 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:36.533191 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:48:36.538138 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:36.538108 2554 patch_prober.go:28] interesting pod/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 15 13:48:36.538512 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:36.538157 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" podUID="b9bd7757-813a-410b-bc92-5be066351741" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 15 13:48:37.538215 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:37.538176 2554 patch_prober.go:28] interesting pod/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 15 13:48:37.538646 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:37.538244 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" podUID="b9bd7757-813a-410b-bc92-5be066351741" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 15 13:48:38.541293 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:38.541257 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:38.541680 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:38.541621 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:48:38.542402 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:48:38.542383 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:49:02.319034 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:49:02.318927 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-954f0f75-qk45l"] Jul 15 13:49:02.322274 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:49:02.322256 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-954f0f75-qk45l" Jul 15 13:49:02.325110 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:49:02.325085 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 13:49:02.325218 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:49:02.325085 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpj2c\"" Jul 15 13:49:02.330569 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:49:02.330545 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-954f0f75-qk45l"] Jul 15 13:49:02.448727 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:49:02.448692 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0402e829-337f-4c57-b6ba-d3f96d80f902-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-954f0f75-qk45l\" (UID: \"0402e829-337f-4c57-b6ba-d3f96d80f902\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-954f0f75-qk45l" Jul 15 13:49:02.549960 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:49:02.549915 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0402e829-337f-4c57-b6ba-d3f96d80f902-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-954f0f75-qk45l\" (UID: \"0402e829-337f-4c57-b6ba-d3f96d80f902\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-954f0f75-qk45l" Jul 15 13:49:02.550551 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:49:02.550530 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0402e829-337f-4c57-b6ba-d3f96d80f902-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-954f0f75-qk45l\" (UID: \"0402e829-337f-4c57-b6ba-d3f96d80f902\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-954f0f75-qk45l" Jul 15 13:49:02.633872 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:49:02.633787 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-954f0f75-qk45l" Jul 15 13:49:02.763335 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:49:02.763312 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-954f0f75-qk45l"] Jul 15 13:49:02.765654 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:49:02.765630 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0402e829_337f_4c57_b6ba_d3f96d80f902.slice/crio-3c4aa70e488e9f8302ba7d1adff6de03ecce3e8563e2bc14ef21f3d9cc96d50b WatchSource:0}: Error finding container 3c4aa70e488e9f8302ba7d1adff6de03ecce3e8563e2bc14ef21f3d9cc96d50b: Status 404 returned error can't find the container with id 3c4aa70e488e9f8302ba7d1adff6de03ecce3e8563e2bc14ef21f3d9cc96d50b Jul 15 13:49:03.673399 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:49:03.673354 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:49:03.676093 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:49:03.676067 2554 generic.go:356] "Generic (PLEG): container finished" podID="0402e829-337f-4c57-b6ba-d3f96d80f902" containerID="d14671acdf8e2ebad8c9b586bdacb1e4284fa4b3be1eecd4aca81f69acf5cefc" exitCode=0 Jul 15 13:49:03.676239 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:49:03.676138 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-954f0f75-qk45l" event={"ID":"0402e829-337f-4c57-b6ba-d3f96d80f902","Type":"ContainerDied","Data":"d14671acdf8e2ebad8c9b586bdacb1e4284fa4b3be1eecd4aca81f69acf5cefc"} Jul 15 13:49:03.676239 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:49:03.676201 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-954f0f75-qk45l" event={"ID":"0402e829-337f-4c57-b6ba-d3f96d80f902","Type":"ContainerStarted","Data":"3c4aa70e488e9f8302ba7d1adff6de03ecce3e8563e2bc14ef21f3d9cc96d50b"} Jul 15 13:49:04.810486 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:49:04.810461 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-954f0f75-qk45l" Jul 15 13:49:04.968827 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:49:04.968728 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0402e829-337f-4c57-b6ba-d3f96d80f902-maas-api-service-ca\") pod \"0402e829-337f-4c57-b6ba-d3f96d80f902\" (UID: \"0402e829-337f-4c57-b6ba-d3f96d80f902\") " Jul 15 13:49:04.969170 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:49:04.969147 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0402e829-337f-4c57-b6ba-d3f96d80f902-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0402e829-337f-4c57-b6ba-d3f96d80f902" (UID: "0402e829-337f-4c57-b6ba-d3f96d80f902"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:49:05.070168 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:49:05.070129 2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0402e829-337f-4c57-b6ba-d3f96d80f902-maas-api-service-ca\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:49:05.687388 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:49:05.687358 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-954f0f75-qk45l" Jul 15 13:49:05.687563 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:49:05.687357 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-954f0f75-qk45l" event={"ID":"0402e829-337f-4c57-b6ba-d3f96d80f902","Type":"ContainerDied","Data":"3c4aa70e488e9f8302ba7d1adff6de03ecce3e8563e2bc14ef21f3d9cc96d50b"} Jul 15 13:49:05.687563 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:49:05.687481 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c4aa70e488e9f8302ba7d1adff6de03ecce3e8563e2bc14ef21f3d9cc96d50b" Jul 15 13:49:12.872303 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:49:12.872252 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:49:17.435293 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:49:17.435251 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:49:22.512718 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:49:22.512676 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:49:27.231293 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:49:27.231263 2554 scope.go:117] "RemoveContainer" containerID="bed78508066fd6f9290bedd617e41186274c59b4ad35d70b33c6c3b8a32e4842" Jul 15 13:49:45.569087 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:49:45.569052 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:49:53.477016 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:49:53.476957 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:49:53.595732 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:49:53.595694 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:49:58.571049 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:49:58.571016 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:50:00.141143 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:00.141116 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:50:06.377038 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:06.376966 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:50:06.748798 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:06.748762 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:50:09.845103 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:09.845066 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd"] Jul 15 13:50:09.861269 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:09.861214 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:50:09.986721 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:09.986665 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" podUID="b9bd7757-813a-410b-bc92-5be066351741" containerName="istio-proxy" containerID="cri-o://9d97a353e039bba1b4ebc921f34bebe59c0c91e3cb306a94b400deeaf2da37b5" gracePeriod=30 Jul 15 13:50:10.099150 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:10.099069 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:50:11.158506 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:11.158472 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:50:11.251371 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:11.251337 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:50:11.351465 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:11.351425 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:50:12.135082 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:12.135047 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:50:12.223114 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:12.223075 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:50:12.336898 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:12.336871 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:50:13.734838 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:13.734795 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:50:15.239795 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:15.239772 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:50:15.300315 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:15.300238 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bd7757-813a-410b-bc92-5be066351741-workload-socket\") pod \"b9bd7757-813a-410b-bc92-5be066351741\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " Jul 15 13:50:15.300471 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:15.300322 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9bd7757-813a-410b-bc92-5be066351741-workload-certs\") pod \"b9bd7757-813a-410b-bc92-5be066351741\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " Jul 15 13:50:15.300471 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:15.300347 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9bd7757-813a-410b-bc92-5be066351741-istiod-ca-cert\") pod \"b9bd7757-813a-410b-bc92-5be066351741\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " Jul 15 13:50:15.300471 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:15.300370 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9bd7757-813a-410b-bc92-5be066351741-istio-podinfo\") pod \"b9bd7757-813a-410b-bc92-5be066351741\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " Jul 15 13:50:15.300471 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:15.300394 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9bd7757-813a-410b-bc92-5be066351741-istio-envoy\") pod \"b9bd7757-813a-410b-bc92-5be066351741\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " Jul 15 13:50:15.300471 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:15.300415 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9bd7757-813a-410b-bc92-5be066351741-istio-data\") pod \"b9bd7757-813a-410b-bc92-5be066351741\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " Jul 15 13:50:15.300471 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:15.300455 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9c98x\" (UniqueName: \"kubernetes.io/projected/b9bd7757-813a-410b-bc92-5be066351741-kube-api-access-9c98x\") pod \"b9bd7757-813a-410b-bc92-5be066351741\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " Jul 15 13:50:15.300790 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:15.300478 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9bd7757-813a-410b-bc92-5be066351741-istio-token\") pod \"b9bd7757-813a-410b-bc92-5be066351741\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " Jul 15 13:50:15.300790 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:15.300508 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bd7757-813a-410b-bc92-5be066351741-credential-socket\") pod \"b9bd7757-813a-410b-bc92-5be066351741\" (UID: \"b9bd7757-813a-410b-bc92-5be066351741\") " Jul 15 13:50:15.300790 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:15.300509 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9bd7757-813a-410b-bc92-5be066351741-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b9bd7757-813a-410b-bc92-5be066351741" (UID: "b9bd7757-813a-410b-bc92-5be066351741"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:50:15.300790 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:15.300657 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9bd7757-813a-410b-bc92-5be066351741-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b9bd7757-813a-410b-bc92-5be066351741" (UID: "b9bd7757-813a-410b-bc92-5be066351741"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:50:15.301014 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:15.300789 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9bd7757-813a-410b-bc92-5be066351741-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b9bd7757-813a-410b-bc92-5be066351741" (UID: "b9bd7757-813a-410b-bc92-5be066351741"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:50:15.301014 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:15.300948 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9bd7757-813a-410b-bc92-5be066351741-workload-certs\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:50:15.301014 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:15.300966 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9bd7757-813a-410b-bc92-5be066351741-istiod-ca-cert\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:50:15.301014 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:15.301009 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bd7757-813a-410b-bc92-5be066351741-workload-socket\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:50:15.301242 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:15.301026 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9bd7757-813a-410b-bc92-5be066351741-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b9bd7757-813a-410b-bc92-5be066351741" (UID: "b9bd7757-813a-410b-bc92-5be066351741"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:50:15.301555 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:15.301525 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9bd7757-813a-410b-bc92-5be066351741-istio-data" (OuterVolumeSpecName: "istio-data") pod "b9bd7757-813a-410b-bc92-5be066351741" (UID: "b9bd7757-813a-410b-bc92-5be066351741"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:50:15.302575 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:15.302539 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9bd7757-813a-410b-bc92-5be066351741-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b9bd7757-813a-410b-bc92-5be066351741" (UID: "b9bd7757-813a-410b-bc92-5be066351741"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:50:15.302683 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:15.302605 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9bd7757-813a-410b-bc92-5be066351741-kube-api-access-9c98x" (OuterVolumeSpecName: "kube-api-access-9c98x") pod "b9bd7757-813a-410b-bc92-5be066351741" (UID: "b9bd7757-813a-410b-bc92-5be066351741"). InnerVolumeSpecName "kube-api-access-9c98x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:50:15.302683 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:15.302622 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b9bd7757-813a-410b-bc92-5be066351741-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b9bd7757-813a-410b-bc92-5be066351741" (UID: "b9bd7757-813a-410b-bc92-5be066351741"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 13:50:15.302774 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:15.302749 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9bd7757-813a-410b-bc92-5be066351741-istio-token" (OuterVolumeSpecName: "istio-token") pod "b9bd7757-813a-410b-bc92-5be066351741" (UID: "b9bd7757-813a-410b-bc92-5be066351741"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:50:15.401544 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:15.401510 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9c98x\" (UniqueName: \"kubernetes.io/projected/b9bd7757-813a-410b-bc92-5be066351741-kube-api-access-9c98x\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:50:15.401544 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:15.401538 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9bd7757-813a-410b-bc92-5be066351741-istio-token\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:50:15.401544 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:15.401549 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bd7757-813a-410b-bc92-5be066351741-credential-socket\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:50:15.401776 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:15.401557 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9bd7757-813a-410b-bc92-5be066351741-istio-podinfo\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:50:15.401776 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:15.401566 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9bd7757-813a-410b-bc92-5be066351741-istio-envoy\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:50:15.401776 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:15.401573 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9bd7757-813a-410b-bc92-5be066351741-istio-data\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:50:16.023390 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:16.023353 2554 generic.go:356] "Generic (PLEG): container finished" podID="b9bd7757-813a-410b-bc92-5be066351741" containerID="9d97a353e039bba1b4ebc921f34bebe59c0c91e3cb306a94b400deeaf2da37b5" exitCode=0 Jul 15 13:50:16.023588 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:16.023410 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" Jul 15 13:50:16.023588 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:16.023437 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" event={"ID":"b9bd7757-813a-410b-bc92-5be066351741","Type":"ContainerDied","Data":"9d97a353e039bba1b4ebc921f34bebe59c0c91e3cb306a94b400deeaf2da37b5"} Jul 15 13:50:16.023588 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:16.023490 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd" event={"ID":"b9bd7757-813a-410b-bc92-5be066351741","Type":"ContainerDied","Data":"8ae558f5f4a9c9ce08362e29b85862be0df0b37815f63584a440caec3773f750"} Jul 15 13:50:16.023588 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:16.023512 2554 scope.go:117] "RemoveContainer" containerID="9d97a353e039bba1b4ebc921f34bebe59c0c91e3cb306a94b400deeaf2da37b5" Jul 15 13:50:16.032612 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:16.032500 2554 scope.go:117] "RemoveContainer" containerID="de5a34c18bf7b95a8814b90c49ffacb478355cc896034263c50c96ad54c84b49" Jul 15 13:50:16.040111 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:16.040094 2554 scope.go:117] "RemoveContainer" containerID="9d97a353e039bba1b4ebc921f34bebe59c0c91e3cb306a94b400deeaf2da37b5" Jul 15 13:50:16.040361 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:50:16.040342 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d97a353e039bba1b4ebc921f34bebe59c0c91e3cb306a94b400deeaf2da37b5\": container with ID starting with 9d97a353e039bba1b4ebc921f34bebe59c0c91e3cb306a94b400deeaf2da37b5 not found: ID does not exist" containerID="9d97a353e039bba1b4ebc921f34bebe59c0c91e3cb306a94b400deeaf2da37b5" Jul 15 13:50:16.040408 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:16.040370 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d97a353e039bba1b4ebc921f34bebe59c0c91e3cb306a94b400deeaf2da37b5"} err="failed to get container status \"9d97a353e039bba1b4ebc921f34bebe59c0c91e3cb306a94b400deeaf2da37b5\": rpc error: code = NotFound desc = could not find container \"9d97a353e039bba1b4ebc921f34bebe59c0c91e3cb306a94b400deeaf2da37b5\": container with ID starting with 9d97a353e039bba1b4ebc921f34bebe59c0c91e3cb306a94b400deeaf2da37b5 not found: ID does not exist" Jul 15 13:50:16.040408 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:16.040387 2554 scope.go:117] "RemoveContainer" containerID="de5a34c18bf7b95a8814b90c49ffacb478355cc896034263c50c96ad54c84b49" Jul 15 13:50:16.040626 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:50:16.040608 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de5a34c18bf7b95a8814b90c49ffacb478355cc896034263c50c96ad54c84b49\": container with ID starting with de5a34c18bf7b95a8814b90c49ffacb478355cc896034263c50c96ad54c84b49 not found: ID does not exist" containerID="de5a34c18bf7b95a8814b90c49ffacb478355cc896034263c50c96ad54c84b49" Jul 15 13:50:16.040677 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:16.040636 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de5a34c18bf7b95a8814b90c49ffacb478355cc896034263c50c96ad54c84b49"} err="failed to get container status \"de5a34c18bf7b95a8814b90c49ffacb478355cc896034263c50c96ad54c84b49\": rpc error: code = NotFound desc = could not find container \"de5a34c18bf7b95a8814b90c49ffacb478355cc896034263c50c96ad54c84b49\": container with ID starting with de5a34c18bf7b95a8814b90c49ffacb478355cc896034263c50c96ad54c84b49 not found: ID does not exist" Jul 15 13:50:16.045186 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:16.045166 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd"] Jul 15 13:50:16.048818 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:16.048797 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-954f0f75-openshift-default-668647b47f-8q8rd"] Jul 15 13:50:17.137271 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:17.137239 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9bd7757-813a-410b-bc92-5be066351741" path="/var/lib/kubelet/pods/b9bd7757-813a-410b-bc92-5be066351741/volumes" Jul 15 13:50:19.734193 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:19.734103 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:50:19.852436 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:19.852399 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:50:20.468990 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:20.468941 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:50:26.514551 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:26.514513 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:50:26.618777 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:26.618733 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:50:26.714745 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:26.714711 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:50:37.279142 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:37.279103 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:50:37.633204 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:37.633111 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:50:46.650464 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:46.650426 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:50:46.751293 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:46.751260 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:50:58.617263 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:50:58.617223 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:04.344565 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:04.344525 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:04.445002 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:04.444925 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:04.716732 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:04.716631 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:05.046334 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.046303 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g"] Jul 15 13:51:05.046675 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.046661 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9bd7757-813a-410b-bc92-5be066351741" containerName="istio-proxy" Jul 15 13:51:05.046723 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.046677 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9bd7757-813a-410b-bc92-5be066351741" containerName="istio-proxy" Jul 15 13:51:05.046723 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.046695 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0402e829-337f-4c57-b6ba-d3f96d80f902" containerName="revoke-keys" Jul 15 13:51:05.046723 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.046700 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="0402e829-337f-4c57-b6ba-d3f96d80f902" containerName="revoke-keys" Jul 15 13:51:05.046723 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.046711 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9bd7757-813a-410b-bc92-5be066351741" containerName="istio-proxy" Jul 15 13:51:05.046723 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.046717 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9bd7757-813a-410b-bc92-5be066351741" containerName="istio-proxy" Jul 15 13:51:05.046892 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.046768 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9bd7757-813a-410b-bc92-5be066351741" containerName="istio-proxy" Jul 15 13:51:05.046892 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.046775 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="0402e829-337f-4c57-b6ba-d3f96d80f902" containerName="revoke-keys" Jul 15 13:51:05.046892 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.046781 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9bd7757-813a-410b-bc92-5be066351741" containerName="istio-proxy" Jul 15 13:51:05.049372 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.049354 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:05.052070 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.052047 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-d22f29-openshift-default-dockercfg-dgk46\"" Jul 15 13:51:05.062264 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.062238 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g"] Jul 15 13:51:05.065856 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.065828 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:05.115197 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.115174 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12fba9c4-2c23-433c-9dc0-e002f364062b-istio-data\") pod \"e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:05.115347 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.115221 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12fba9c4-2c23-433c-9dc0-e002f364062b-workload-certs\") pod \"e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:05.115347 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.115244 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12fba9c4-2c23-433c-9dc0-e002f364062b-credential-socket\") pod \"e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:05.115347 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.115292 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm9nv\" (UniqueName: \"kubernetes.io/projected/12fba9c4-2c23-433c-9dc0-e002f364062b-kube-api-access-gm9nv\") pod \"e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:05.115450 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.115344 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12fba9c4-2c23-433c-9dc0-e002f364062b-istio-podinfo\") pod \"e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:05.115450 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.115376 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12fba9c4-2c23-433c-9dc0-e002f364062b-istio-envoy\") pod \"e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:05.115450 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.115403 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12fba9c4-2c23-433c-9dc0-e002f364062b-workload-socket\") pod \"e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:05.115450 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.115427 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12fba9c4-2c23-433c-9dc0-e002f364062b-istio-token\") pod \"e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:05.115450 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.115448 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12fba9c4-2c23-433c-9dc0-e002f364062b-istiod-ca-cert\") pod \"e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:05.167600 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.167563 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:05.216687 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.216652 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12fba9c4-2c23-433c-9dc0-e002f364062b-workload-certs\") pod \"e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:05.216687 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.216689 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12fba9c4-2c23-433c-9dc0-e002f364062b-credential-socket\") pod \"e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:05.216915 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.216706 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm9nv\" (UniqueName: \"kubernetes.io/projected/12fba9c4-2c23-433c-9dc0-e002f364062b-kube-api-access-gm9nv\") pod \"e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:05.216915 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.216735 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12fba9c4-2c23-433c-9dc0-e002f364062b-istio-podinfo\") pod \"e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:05.216915 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.216849 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12fba9c4-2c23-433c-9dc0-e002f364062b-istio-envoy\") pod \"e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:05.216915 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.216896 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12fba9c4-2c23-433c-9dc0-e002f364062b-workload-socket\") pod \"e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:05.217219 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.216927 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12fba9c4-2c23-433c-9dc0-e002f364062b-istio-token\") pod \"e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:05.217219 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.216954 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12fba9c4-2c23-433c-9dc0-e002f364062b-istiod-ca-cert\") pod \"e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:05.217219 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.217028 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12fba9c4-2c23-433c-9dc0-e002f364062b-istio-data\") pod \"e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:05.217219 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.217136 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12fba9c4-2c23-433c-9dc0-e002f364062b-workload-certs\") pod \"e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:05.217427 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.217282 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12fba9c4-2c23-433c-9dc0-e002f364062b-workload-socket\") pod \"e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:05.217427 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.217399 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12fba9c4-2c23-433c-9dc0-e002f364062b-istio-data\") pod \"e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:05.217427 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.217420 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12fba9c4-2c23-433c-9dc0-e002f364062b-credential-socket\") pod \"e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:05.217671 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.217652 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12fba9c4-2c23-433c-9dc0-e002f364062b-istiod-ca-cert\") pod \"e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:05.219309 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.219289 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12fba9c4-2c23-433c-9dc0-e002f364062b-istio-podinfo\") pod \"e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:05.219495 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.219476 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12fba9c4-2c23-433c-9dc0-e002f364062b-istio-envoy\") pod \"e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:05.224837 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.224815 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12fba9c4-2c23-433c-9dc0-e002f364062b-istio-token\") pod \"e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:05.225376 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.225355 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm9nv\" (UniqueName: \"kubernetes.io/projected/12fba9c4-2c23-433c-9dc0-e002f364062b-kube-api-access-gm9nv\") pod \"e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:05.359476 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.359385 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:05.510097 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.510072 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g"] Jul 15 13:51:05.511778 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:51:05.511752 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12fba9c4_2c23_433c_9dc0_e002f364062b.slice/crio-6f81fb84ba899b47c372b54822d124beecda04da1031d1ffd16b24d3f57611c8 WatchSource:0}: Error finding container 6f81fb84ba899b47c372b54822d124beecda04da1031d1ffd16b24d3f57611c8: Status 404 returned error can't find the container with id 6f81fb84ba899b47c372b54822d124beecda04da1031d1ffd16b24d3f57611c8 Jul 15 13:51:05.514038 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.513970 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:51:05.514120 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.514084 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:51:05.514159 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:05.514131 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:51:06.256224 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:06.256191 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" event={"ID":"12fba9c4-2c23-433c-9dc0-e002f364062b","Type":"ContainerStarted","Data":"76c14a38444ee8a62b41a3e2112f47689fdbc2e6e30987331f67092cf8ef8779"} Jul 15 13:51:06.256390 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:06.256242 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" event={"ID":"12fba9c4-2c23-433c-9dc0-e002f364062b","Type":"ContainerStarted","Data":"6f81fb84ba899b47c372b54822d124beecda04da1031d1ffd16b24d3f57611c8"} Jul 15 13:51:06.278159 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:06.278112 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" podStartSLOduration=1.278096474 podStartE2EDuration="1.278096474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:51:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:51:06.276157502 +0000 UTC m=+2379.706967074" watchObservedRunningTime="2026-07-15 13:51:06.278096474 +0000 UTC m=+2379.708906047" Jul 15 13:51:06.359915 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:06.359886 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:06.364193 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:06.364170 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:07.267744 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:07.267711 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:07.268824 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:07.268798 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:08.240883 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:08.240844 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:08.328414 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:08.328375 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:08.544258 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:08.544177 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:08.758645 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:08.758607 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:09.074325 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:09.074291 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:09.183594 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:09.183561 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:12.754248 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:12.754217 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:13.138390 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.138269 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:13.437545 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.437466 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44"] Jul 15 13:51:13.441237 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.441216 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:13.443888 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.443869 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-114e4a-openshift-default-dockercfg-cmpss\"" Jul 15 13:51:13.453586 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.453565 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44"] Jul 15 13:51:13.492469 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.492438 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/108d2514-146b-40ad-a176-4486aeaddfb8-workload-certs\") pod \"e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:13.492469 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.492472 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/108d2514-146b-40ad-a176-4486aeaddfb8-istio-envoy\") pod \"e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:13.492708 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.492513 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/108d2514-146b-40ad-a176-4486aeaddfb8-istio-data\") pod \"e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:13.492708 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.492557 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/108d2514-146b-40ad-a176-4486aeaddfb8-credential-socket\") pod \"e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:13.492708 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.492584 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/108d2514-146b-40ad-a176-4486aeaddfb8-istio-podinfo\") pod \"e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:13.492708 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.492643 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx4nj\" (UniqueName: \"kubernetes.io/projected/108d2514-146b-40ad-a176-4486aeaddfb8-kube-api-access-cx4nj\") pod \"e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:13.492708 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.492673 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/108d2514-146b-40ad-a176-4486aeaddfb8-istio-token\") pod \"e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:13.492708 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.492702 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/108d2514-146b-40ad-a176-4486aeaddfb8-istiod-ca-cert\") pod \"e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:13.492939 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.492804 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/108d2514-146b-40ad-a176-4486aeaddfb8-workload-socket\") pod \"e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:13.593475 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.593442 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/108d2514-146b-40ad-a176-4486aeaddfb8-istio-token\") pod \"e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:13.593475 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.593487 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/108d2514-146b-40ad-a176-4486aeaddfb8-istiod-ca-cert\") pod \"e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:13.593741 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.593539 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/108d2514-146b-40ad-a176-4486aeaddfb8-workload-socket\") pod \"e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:13.593741 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.593569 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/108d2514-146b-40ad-a176-4486aeaddfb8-workload-certs\") pod \"e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:13.593741 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.593591 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/108d2514-146b-40ad-a176-4486aeaddfb8-istio-envoy\") pod \"e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:13.593741 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.593629 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/108d2514-146b-40ad-a176-4486aeaddfb8-istio-data\") pod \"e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:13.593741 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.593682 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/108d2514-146b-40ad-a176-4486aeaddfb8-credential-socket\") pod \"e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:13.593741 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.593710 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/108d2514-146b-40ad-a176-4486aeaddfb8-istio-podinfo\") pod \"e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:13.594082 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.593771 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx4nj\" (UniqueName: \"kubernetes.io/projected/108d2514-146b-40ad-a176-4486aeaddfb8-kube-api-access-cx4nj\") pod \"e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:13.594138 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.594080 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/108d2514-146b-40ad-a176-4486aeaddfb8-workload-socket\") pod \"e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:13.594576 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.594549 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/108d2514-146b-40ad-a176-4486aeaddfb8-credential-socket\") pod \"e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:13.594727 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.594586 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/108d2514-146b-40ad-a176-4486aeaddfb8-istio-data\") pod \"e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:13.594727 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.594658 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/108d2514-146b-40ad-a176-4486aeaddfb8-workload-certs\") pod \"e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:13.594941 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.594922 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/108d2514-146b-40ad-a176-4486aeaddfb8-istiod-ca-cert\") pod \"e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:13.601840 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.597296 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/108d2514-146b-40ad-a176-4486aeaddfb8-istio-podinfo\") pod \"e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:13.601993 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.601862 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/108d2514-146b-40ad-a176-4486aeaddfb8-istio-envoy\") pod \"e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:13.603102 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.603079 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/108d2514-146b-40ad-a176-4486aeaddfb8-istio-token\") pod \"e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:13.603214 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.603166 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx4nj\" (UniqueName: \"kubernetes.io/projected/108d2514-146b-40ad-a176-4486aeaddfb8-kube-api-access-cx4nj\") pod \"e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:13.752177 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.752145 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:13.884751 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.884724 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44"] Jul 15 13:51:13.886955 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:51:13.886920 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod108d2514_146b_40ad_a176_4486aeaddfb8.slice/crio-8a7f8cb81ffb50659ba72ae844bee81991cf962072e905798705f8dfa3668988 WatchSource:0}: Error finding container 8a7f8cb81ffb50659ba72ae844bee81991cf962072e905798705f8dfa3668988: Status 404 returned error can't find the container with id 8a7f8cb81ffb50659ba72ae844bee81991cf962072e905798705f8dfa3668988 Jul 15 13:51:13.889017 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.888969 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:51:13.889120 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.889048 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:51:13.889120 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:13.889079 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:51:14.301771 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:14.301738 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" event={"ID":"108d2514-146b-40ad-a176-4486aeaddfb8","Type":"ContainerStarted","Data":"289d1aa3fad449beb170edd29366769a2a2e02dbe72a76ac97691a7184ba7ed8"} Jul 15 13:51:14.301950 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:14.301790 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" event={"ID":"108d2514-146b-40ad-a176-4486aeaddfb8","Type":"ContainerStarted","Data":"8a7f8cb81ffb50659ba72ae844bee81991cf962072e905798705f8dfa3668988"} Jul 15 13:51:14.334801 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:14.334744 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" podStartSLOduration=1.334723695 podStartE2EDuration="1.334723695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:51:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:51:14.334251613 +0000 UTC m=+2387.765061200" watchObservedRunningTime="2026-07-15 13:51:14.334723695 +0000 UTC m=+2387.765533272" Jul 15 13:51:14.753066 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:14.753035 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:14.757913 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:14.757888 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:15.306805 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:15.306776 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:15.307764 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:15.307745 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:15.760492 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:15.760461 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:16.525754 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:16.525700 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:16.622415 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:16.622373 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:17.496943 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:17.496905 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:17.599895 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:17.599854 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:20.834781 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:20.834745 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:23.309172 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:23.309125 2554 patch_prober.go:28] interesting pod/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 15 13:51:23.309684 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:23.309196 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" podUID="12fba9c4-2c23-433c-9dc0-e002f364062b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 15 13:51:25.366015 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:25.365961 2554 generic.go:356] "Generic (PLEG): container finished" podID="12fba9c4-2c23-433c-9dc0-e002f364062b" containerID="76c14a38444ee8a62b41a3e2112f47689fdbc2e6e30987331f67092cf8ef8779" exitCode=0 Jul 15 13:51:25.366460 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:25.366031 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" event={"ID":"12fba9c4-2c23-433c-9dc0-e002f364062b","Type":"ContainerDied","Data":"76c14a38444ee8a62b41a3e2112f47689fdbc2e6e30987331f67092cf8ef8779"} Jul 15 13:51:25.366460 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:25.366438 2554 scope.go:117] "RemoveContainer" containerID="76c14a38444ee8a62b41a3e2112f47689fdbc2e6e30987331f67092cf8ef8779" Jul 15 13:51:25.367531 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:25.367504 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:51:25.367589 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:25.367580 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:51:25.367683 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:25.367634 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:51:26.373335 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:26.373298 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" event={"ID":"12fba9c4-2c23-433c-9dc0-e002f364062b","Type":"ContainerStarted","Data":"098480b3db2be73df2c5d63ea27c7007cb4928202352d802441bb3dda10a1663"} Jul 15 13:51:27.260312 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:27.260272 2554 scope.go:117] "RemoveContainer" containerID="02091f5d0f0b7fe607e6417ca0a8a86db003c40d8500a3e829e50fa8ad3ea719" Jul 15 13:51:27.267165 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:27.267145 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lx562_83d9c378-e25b-487c-a9be-83e18e37d87f/ovn-acl-logging/0.log" Jul 15 13:51:27.268661 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:27.268640 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lx562_83d9c378-e25b-487c-a9be-83e18e37d87f/ovn-acl-logging/0.log" Jul 15 13:51:27.360631 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:27.360540 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:27.360925 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:27.360895 2554 patch_prober.go:28] interesting pod/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 15 13:51:27.361078 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:27.360954 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" podUID="12fba9c4-2c23-433c-9dc0-e002f364062b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 15 13:51:28.114837 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:28.114769 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:28.360685 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:28.360602 2554 patch_prober.go:28] interesting pod/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 15 13:51:28.360685 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:28.360659 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" podUID="12fba9c4-2c23-433c-9dc0-e002f364062b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 15 13:51:29.360025 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:29.359906 2554 patch_prober.go:28] interesting pod/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 15 13:51:29.360025 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:29.360011 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" podUID="12fba9c4-2c23-433c-9dc0-e002f364062b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 15 13:51:30.036147 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:30.036108 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:30.137963 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:30.137925 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:30.359877 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:30.359781 2554 patch_prober.go:28] interesting pod/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 15 13:51:30.359877 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:30.359848 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" podUID="12fba9c4-2c23-433c-9dc0-e002f364062b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 15 13:51:31.349173 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:31.349129 2554 patch_prober.go:28] interesting pod/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 15 13:51:31.350303 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:31.349209 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" podUID="108d2514-146b-40ad-a176-4486aeaddfb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 15 13:51:31.364354 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:31.364330 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:31.364735 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:31.364705 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:31.365361 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:31.365343 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:51:32.402898 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:32.402865 2554 generic.go:356] "Generic (PLEG): container finished" podID="108d2514-146b-40ad-a176-4486aeaddfb8" containerID="289d1aa3fad449beb170edd29366769a2a2e02dbe72a76ac97691a7184ba7ed8" exitCode=0 Jul 15 13:51:32.403385 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:32.402944 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" event={"ID":"108d2514-146b-40ad-a176-4486aeaddfb8","Type":"ContainerDied","Data":"289d1aa3fad449beb170edd29366769a2a2e02dbe72a76ac97691a7184ba7ed8"} Jul 15 13:51:32.403566 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:32.403549 2554 scope.go:117] "RemoveContainer" containerID="289d1aa3fad449beb170edd29366769a2a2e02dbe72a76ac97691a7184ba7ed8" Jul 15 13:51:32.404564 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:32.404540 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:51:32.404640 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:32.404626 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:51:32.404640 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:32.404664 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:51:33.412946 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:33.412909 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" event={"ID":"108d2514-146b-40ad-a176-4486aeaddfb8","Type":"ContainerStarted","Data":"842424ce2c971e5628aa1ba74bf9bf357bde514fa15ea0f63464e4c636c67659"} Jul 15 13:51:33.752802 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:33.752770 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:33.752974 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:33.752960 2554 patch_prober.go:28] interesting pod/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 15 13:51:33.753099 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:33.753034 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" podUID="108d2514-146b-40ad-a176-4486aeaddfb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 15 13:51:34.753129 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:34.753093 2554 patch_prober.go:28] interesting pod/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 15 13:51:34.753520 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:34.753144 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" podUID="108d2514-146b-40ad-a176-4486aeaddfb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 15 13:51:35.753026 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:35.752976 2554 patch_prober.go:28] interesting pod/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 15 13:51:35.753203 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:35.753050 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" podUID="108d2514-146b-40ad-a176-4486aeaddfb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 15 13:51:36.753112 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:36.753080 2554 patch_prober.go:28] interesting pod/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 15 13:51:36.753279 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:36.753131 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" podUID="108d2514-146b-40ad-a176-4486aeaddfb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 15 13:51:37.755813 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:37.755778 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:37.756217 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:37.756152 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:37.756729 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:37.756713 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:51:37.886268 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:37.886229 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:37.986219 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:37.986187 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:42.249267 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:42.249234 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:51:42.301139 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:51:42.301097 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:02.933225 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:02.933130 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:19.454393 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:19.454354 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:20.354249 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:20.354206 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:21.142606 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:21.142570 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:21.242340 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:21.242290 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:31.221198 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:31.221162 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:35.637909 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:35.637871 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:41.534233 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:41.534195 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:41.591897 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:41.591865 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:46.334078 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:46.334044 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g"] Jul 15 13:52:46.334535 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:46.334260 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" podUID="12fba9c4-2c23-433c-9dc0-e002f364062b" containerName="istio-proxy" containerID="cri-o://098480b3db2be73df2c5d63ea27c7007cb4928202352d802441bb3dda10a1663" gracePeriod=30 Jul 15 13:52:46.357589 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:46.357552 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:46.367208 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:46.367182 2554 patch_prober.go:28] interesting pod/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 13:52:46.367344 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:46.367232 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" podUID="12fba9c4-2c23-433c-9dc0-e002f364062b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 13:52:46.582097 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:46.582065 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:47.355617 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:47.355579 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:47.456660 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:47.456622 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:52:51.585377 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.585352 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:52:51.678108 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.678012 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12fba9c4-2c23-433c-9dc0-e002f364062b-workload-certs\") pod \"12fba9c4-2c23-433c-9dc0-e002f364062b\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " Jul 15 13:52:51.678108 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.678070 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12fba9c4-2c23-433c-9dc0-e002f364062b-istio-data\") pod \"12fba9c4-2c23-433c-9dc0-e002f364062b\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " Jul 15 13:52:51.678108 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.678094 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12fba9c4-2c23-433c-9dc0-e002f364062b-istio-token\") pod \"12fba9c4-2c23-433c-9dc0-e002f364062b\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " Jul 15 13:52:51.678399 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.678120 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12fba9c4-2c23-433c-9dc0-e002f364062b-credential-socket\") pod \"12fba9c4-2c23-433c-9dc0-e002f364062b\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " Jul 15 13:52:51.678399 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.678145 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12fba9c4-2c23-433c-9dc0-e002f364062b-workload-socket\") pod \"12fba9c4-2c23-433c-9dc0-e002f364062b\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " Jul 15 13:52:51.678399 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.678171 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12fba9c4-2c23-433c-9dc0-e002f364062b-istiod-ca-cert\") pod \"12fba9c4-2c23-433c-9dc0-e002f364062b\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " Jul 15 13:52:51.678399 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.678215 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12fba9c4-2c23-433c-9dc0-e002f364062b-istio-envoy\") pod \"12fba9c4-2c23-433c-9dc0-e002f364062b\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " Jul 15 13:52:51.678399 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.678246 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12fba9c4-2c23-433c-9dc0-e002f364062b-istio-podinfo\") pod \"12fba9c4-2c23-433c-9dc0-e002f364062b\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " Jul 15 13:52:51.678399 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.678326 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12fba9c4-2c23-433c-9dc0-e002f364062b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "12fba9c4-2c23-433c-9dc0-e002f364062b" (UID: "12fba9c4-2c23-433c-9dc0-e002f364062b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:52:51.678399 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.678347 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gm9nv\" (UniqueName: \"kubernetes.io/projected/12fba9c4-2c23-433c-9dc0-e002f364062b-kube-api-access-gm9nv\") pod \"12fba9c4-2c23-433c-9dc0-e002f364062b\" (UID: \"12fba9c4-2c23-433c-9dc0-e002f364062b\") " Jul 15 13:52:51.678770 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.678629 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12fba9c4-2c23-433c-9dc0-e002f364062b-workload-certs\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:52:51.678770 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.678682 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12fba9c4-2c23-433c-9dc0-e002f364062b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "12fba9c4-2c23-433c-9dc0-e002f364062b" (UID: "12fba9c4-2c23-433c-9dc0-e002f364062b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:52:51.678900 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.678864 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12fba9c4-2c23-433c-9dc0-e002f364062b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "12fba9c4-2c23-433c-9dc0-e002f364062b" (UID: "12fba9c4-2c23-433c-9dc0-e002f364062b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:52:51.679098 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.679075 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12fba9c4-2c23-433c-9dc0-e002f364062b-istio-data" (OuterVolumeSpecName: "istio-data") pod "12fba9c4-2c23-433c-9dc0-e002f364062b" (UID: "12fba9c4-2c23-433c-9dc0-e002f364062b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:52:51.679197 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.679098 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12fba9c4-2c23-433c-9dc0-e002f364062b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "12fba9c4-2c23-433c-9dc0-e002f364062b" (UID: "12fba9c4-2c23-433c-9dc0-e002f364062b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:52:51.680383 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.680357 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12fba9c4-2c23-433c-9dc0-e002f364062b-istio-token" (OuterVolumeSpecName: "istio-token") pod "12fba9c4-2c23-433c-9dc0-e002f364062b" (UID: "12fba9c4-2c23-433c-9dc0-e002f364062b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:52:51.680531 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.680516 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/12fba9c4-2c23-433c-9dc0-e002f364062b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "12fba9c4-2c23-433c-9dc0-e002f364062b" (UID: "12fba9c4-2c23-433c-9dc0-e002f364062b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 13:52:51.680765 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.680747 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12fba9c4-2c23-433c-9dc0-e002f364062b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "12fba9c4-2c23-433c-9dc0-e002f364062b" (UID: "12fba9c4-2c23-433c-9dc0-e002f364062b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:52:51.680837 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.680823 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12fba9c4-2c23-433c-9dc0-e002f364062b-kube-api-access-gm9nv" (OuterVolumeSpecName: "kube-api-access-gm9nv") pod "12fba9c4-2c23-433c-9dc0-e002f364062b" (UID: "12fba9c4-2c23-433c-9dc0-e002f364062b"). InnerVolumeSpecName "kube-api-access-gm9nv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:52:51.779373 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.779335 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gm9nv\" (UniqueName: \"kubernetes.io/projected/12fba9c4-2c23-433c-9dc0-e002f364062b-kube-api-access-gm9nv\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:52:51.779373 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.779365 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12fba9c4-2c23-433c-9dc0-e002f364062b-istio-data\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:52:51.779373 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.779379 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12fba9c4-2c23-433c-9dc0-e002f364062b-istio-token\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:52:51.779613 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.779393 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12fba9c4-2c23-433c-9dc0-e002f364062b-credential-socket\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:52:51.779613 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.779406 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12fba9c4-2c23-433c-9dc0-e002f364062b-workload-socket\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:52:51.779613 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.779417 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12fba9c4-2c23-433c-9dc0-e002f364062b-istiod-ca-cert\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:52:51.779613 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.779428 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12fba9c4-2c23-433c-9dc0-e002f364062b-istio-envoy\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:52:51.779613 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.779438 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12fba9c4-2c23-433c-9dc0-e002f364062b-istio-podinfo\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:52:51.789730 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.789701 2554 generic.go:356] "Generic (PLEG): container finished" podID="12fba9c4-2c23-433c-9dc0-e002f364062b" containerID="098480b3db2be73df2c5d63ea27c7007cb4928202352d802441bb3dda10a1663" exitCode=0 Jul 15 13:52:51.789866 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.789753 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" Jul 15 13:52:51.789866 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.789790 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" event={"ID":"12fba9c4-2c23-433c-9dc0-e002f364062b","Type":"ContainerDied","Data":"098480b3db2be73df2c5d63ea27c7007cb4928202352d802441bb3dda10a1663"} Jul 15 13:52:51.789866 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.789849 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g" event={"ID":"12fba9c4-2c23-433c-9dc0-e002f364062b","Type":"ContainerDied","Data":"6f81fb84ba899b47c372b54822d124beecda04da1031d1ffd16b24d3f57611c8"} Jul 15 13:52:51.790011 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.789879 2554 scope.go:117] "RemoveContainer" containerID="098480b3db2be73df2c5d63ea27c7007cb4928202352d802441bb3dda10a1663" Jul 15 13:52:51.798813 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.798790 2554 scope.go:117] "RemoveContainer" containerID="76c14a38444ee8a62b41a3e2112f47689fdbc2e6e30987331f67092cf8ef8779" Jul 15 13:52:51.806522 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.806501 2554 scope.go:117] "RemoveContainer" containerID="098480b3db2be73df2c5d63ea27c7007cb4928202352d802441bb3dda10a1663" Jul 15 13:52:51.806783 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:52:51.806763 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"098480b3db2be73df2c5d63ea27c7007cb4928202352d802441bb3dda10a1663\": container with ID starting with 098480b3db2be73df2c5d63ea27c7007cb4928202352d802441bb3dda10a1663 not found: ID does not exist" containerID="098480b3db2be73df2c5d63ea27c7007cb4928202352d802441bb3dda10a1663" Jul 15 13:52:51.806822 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.806794 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"098480b3db2be73df2c5d63ea27c7007cb4928202352d802441bb3dda10a1663"} err="failed to get container status \"098480b3db2be73df2c5d63ea27c7007cb4928202352d802441bb3dda10a1663\": rpc error: code = NotFound desc = could not find container \"098480b3db2be73df2c5d63ea27c7007cb4928202352d802441bb3dda10a1663\": container with ID starting with 098480b3db2be73df2c5d63ea27c7007cb4928202352d802441bb3dda10a1663 not found: ID does not exist" Jul 15 13:52:51.806822 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.806817 2554 scope.go:117] "RemoveContainer" containerID="76c14a38444ee8a62b41a3e2112f47689fdbc2e6e30987331f67092cf8ef8779" Jul 15 13:52:51.807068 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:52:51.807048 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76c14a38444ee8a62b41a3e2112f47689fdbc2e6e30987331f67092cf8ef8779\": container with ID starting with 76c14a38444ee8a62b41a3e2112f47689fdbc2e6e30987331f67092cf8ef8779 not found: ID does not exist" containerID="76c14a38444ee8a62b41a3e2112f47689fdbc2e6e30987331f67092cf8ef8779" Jul 15 13:52:51.807135 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.807078 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76c14a38444ee8a62b41a3e2112f47689fdbc2e6e30987331f67092cf8ef8779"} err="failed to get container status \"76c14a38444ee8a62b41a3e2112f47689fdbc2e6e30987331f67092cf8ef8779\": rpc error: code = NotFound desc = could not find container \"76c14a38444ee8a62b41a3e2112f47689fdbc2e6e30987331f67092cf8ef8779\": container with ID starting with 76c14a38444ee8a62b41a3e2112f47689fdbc2e6e30987331f67092cf8ef8779 not found: ID does not exist" Jul 15 13:52:51.811598 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.811576 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g"] Jul 15 13:52:51.814909 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:51.814889 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-d22f29-openshift-default-84665bdf8c-ls86g"] Jul 15 13:52:53.137309 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:53.137276 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12fba9c4-2c23-433c-9dc0-e002f364062b" path="/var/lib/kubelet/pods/12fba9c4-2c23-433c-9dc0-e002f364062b/volumes" Jul 15 13:52:57.196809 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:52:57.196769 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:01.801914 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:01.801873 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:08.338049 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:08.338013 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:08.396918 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:08.396887 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:12.568043 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:12.568011 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44"] Jul 15 13:53:12.568510 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:12.568258 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" podUID="108d2514-146b-40ad-a176-4486aeaddfb8" containerName="istio-proxy" containerID="cri-o://842424ce2c971e5628aa1ba74bf9bf357bde514fa15ea0f63464e4c636c67659" gracePeriod=30 Jul 15 13:53:12.594852 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:12.594815 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:13.573510 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.573478 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb"] Jul 15 13:53:13.573862 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.573823 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12fba9c4-2c23-433c-9dc0-e002f364062b" containerName="istio-proxy" Jul 15 13:53:13.573862 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.573834 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="12fba9c4-2c23-433c-9dc0-e002f364062b" containerName="istio-proxy" Jul 15 13:53:13.573862 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.573851 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12fba9c4-2c23-433c-9dc0-e002f364062b" containerName="istio-proxy" Jul 15 13:53:13.573862 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.573857 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="12fba9c4-2c23-433c-9dc0-e002f364062b" containerName="istio-proxy" Jul 15 13:53:13.574031 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.573909 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="12fba9c4-2c23-433c-9dc0-e002f364062b" containerName="istio-proxy" Jul 15 13:53:13.574031 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.573918 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="12fba9c4-2c23-433c-9dc0-e002f364062b" containerName="istio-proxy" Jul 15 13:53:13.575910 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.575893 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:13.579381 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.579363 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-3b7ec0-openshift-default-dockercfg-wf7kg\"" Jul 15 13:53:13.608241 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.608206 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb"] Jul 15 13:53:13.622510 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.622479 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:13.683413 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.683377 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37a03555-95cc-439a-9513-40009725482a-istio-data\") pod \"e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:13.683592 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.683423 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24plw\" (UniqueName: \"kubernetes.io/projected/37a03555-95cc-439a-9513-40009725482a-kube-api-access-24plw\") pod \"e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:13.683592 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.683504 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37a03555-95cc-439a-9513-40009725482a-istio-podinfo\") pod \"e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:13.683592 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.683539 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37a03555-95cc-439a-9513-40009725482a-istio-envoy\") pod \"e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:13.683592 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.683566 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37a03555-95cc-439a-9513-40009725482a-workload-socket\") pod \"e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:13.683763 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.683631 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37a03555-95cc-439a-9513-40009725482a-istio-token\") pod \"e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:13.683763 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.683663 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37a03555-95cc-439a-9513-40009725482a-istiod-ca-cert\") pod \"e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:13.683763 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.683729 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37a03555-95cc-439a-9513-40009725482a-credential-socket\") pod \"e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:13.683763 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.683755 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37a03555-95cc-439a-9513-40009725482a-workload-certs\") pod \"e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:13.711118 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.711084 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:13.784782 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.784750 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37a03555-95cc-439a-9513-40009725482a-credential-socket\") pod \"e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:13.784782 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.784782 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37a03555-95cc-439a-9513-40009725482a-workload-certs\") pod \"e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:13.785040 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.784802 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37a03555-95cc-439a-9513-40009725482a-istio-data\") pod \"e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:13.785040 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.784831 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24plw\" (UniqueName: \"kubernetes.io/projected/37a03555-95cc-439a-9513-40009725482a-kube-api-access-24plw\") pod \"e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:13.785040 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.784866 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37a03555-95cc-439a-9513-40009725482a-istio-podinfo\") pod \"e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:13.785040 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.784888 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37a03555-95cc-439a-9513-40009725482a-istio-envoy\") pod \"e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:13.785040 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.784908 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37a03555-95cc-439a-9513-40009725482a-workload-socket\") pod \"e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:13.785040 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.784933 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37a03555-95cc-439a-9513-40009725482a-istio-token\") pod \"e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:13.785040 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.784963 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37a03555-95cc-439a-9513-40009725482a-istiod-ca-cert\") pod \"e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:13.785386 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.785220 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37a03555-95cc-439a-9513-40009725482a-credential-socket\") pod \"e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:13.785386 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.785260 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37a03555-95cc-439a-9513-40009725482a-istio-data\") pod \"e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:13.785386 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.785262 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37a03555-95cc-439a-9513-40009725482a-workload-certs\") pod \"e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:13.785537 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.785511 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37a03555-95cc-439a-9513-40009725482a-workload-socket\") pod \"e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:13.785651 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.785635 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37a03555-95cc-439a-9513-40009725482a-istiod-ca-cert\") pod \"e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:13.787316 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.787294 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37a03555-95cc-439a-9513-40009725482a-istio-envoy\") pod \"e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:13.787409 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.787351 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37a03555-95cc-439a-9513-40009725482a-istio-podinfo\") pod \"e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:13.795433 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.795411 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37a03555-95cc-439a-9513-40009725482a-istio-token\") pod \"e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:13.795621 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.795603 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24plw\" (UniqueName: \"kubernetes.io/projected/37a03555-95cc-439a-9513-40009725482a-kube-api-access-24plw\") pod \"e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:13.885821 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.885729 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:13.928787 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:13.928751 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:14.023913 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:14.023890 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb"] Jul 15 13:53:14.025653 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:53:14.025626 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37a03555_95cc_439a_9513_40009725482a.slice/crio-c1a837a49592249756f5558091edb01d83acdebc6a8ac2590aa3c09b5e6816e9 WatchSource:0}: Error finding container c1a837a49592249756f5558091edb01d83acdebc6a8ac2590aa3c09b5e6816e9: Status 404 returned error can't find the container with id c1a837a49592249756f5558091edb01d83acdebc6a8ac2590aa3c09b5e6816e9 Jul 15 13:53:14.027860 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:14.027818 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:53:14.027933 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:14.027883 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:53:14.027933 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:14.027910 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:53:14.904649 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:14.904613 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" event={"ID":"37a03555-95cc-439a-9513-40009725482a","Type":"ContainerStarted","Data":"d7acd623318078ea8a1ca7c3401d96a6f96ff44f2e7716368cc686c99851af9b"} Jul 15 13:53:14.905169 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:14.904666 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" event={"ID":"37a03555-95cc-439a-9513-40009725482a","Type":"ContainerStarted","Data":"c1a837a49592249756f5558091edb01d83acdebc6a8ac2590aa3c09b5e6816e9"} Jul 15 13:53:14.925838 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:14.925773 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" podStartSLOduration=1.925754242 podStartE2EDuration="1.925754242s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:53:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:53:14.925400784 +0000 UTC m=+2508.356210386" watchObservedRunningTime="2026-07-15 13:53:14.925754242 +0000 UTC m=+2508.356563817" Jul 15 13:53:15.886544 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:15.886509 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:15.891336 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:15.891312 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:15.909776 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:15.909752 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:15.910424 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:15.910407 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:16.916948 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:16.916919 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:17.007953 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.007915 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:17.092004 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.091950 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:17.284311 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.284270 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:17.753426 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.753393 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:17.810713 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.810690 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:53:17.840176 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.840096 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:17.918310 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.918280 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/108d2514-146b-40ad-a176-4486aeaddfb8-istio-token\") pod \"108d2514-146b-40ad-a176-4486aeaddfb8\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " Jul 15 13:53:17.918796 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.918333 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/108d2514-146b-40ad-a176-4486aeaddfb8-credential-socket\") pod \"108d2514-146b-40ad-a176-4486aeaddfb8\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " Jul 15 13:53:17.918796 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.918390 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/108d2514-146b-40ad-a176-4486aeaddfb8-istio-podinfo\") pod \"108d2514-146b-40ad-a176-4486aeaddfb8\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " Jul 15 13:53:17.918796 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.918432 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/108d2514-146b-40ad-a176-4486aeaddfb8-istio-data\") pod \"108d2514-146b-40ad-a176-4486aeaddfb8\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " Jul 15 13:53:17.918796 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.918471 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/108d2514-146b-40ad-a176-4486aeaddfb8-workload-socket\") pod \"108d2514-146b-40ad-a176-4486aeaddfb8\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " Jul 15 13:53:17.918796 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.918524 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/108d2514-146b-40ad-a176-4486aeaddfb8-workload-certs\") pod \"108d2514-146b-40ad-a176-4486aeaddfb8\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " Jul 15 13:53:17.918796 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.918557 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/108d2514-146b-40ad-a176-4486aeaddfb8-istiod-ca-cert\") pod \"108d2514-146b-40ad-a176-4486aeaddfb8\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " Jul 15 13:53:17.918796 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.918579 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/108d2514-146b-40ad-a176-4486aeaddfb8-istio-envoy\") pod \"108d2514-146b-40ad-a176-4486aeaddfb8\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " Jul 15 13:53:17.918796 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.918601 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cx4nj\" (UniqueName: \"kubernetes.io/projected/108d2514-146b-40ad-a176-4486aeaddfb8-kube-api-access-cx4nj\") pod \"108d2514-146b-40ad-a176-4486aeaddfb8\" (UID: \"108d2514-146b-40ad-a176-4486aeaddfb8\") " Jul 15 13:53:17.919266 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.918831 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/108d2514-146b-40ad-a176-4486aeaddfb8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "108d2514-146b-40ad-a176-4486aeaddfb8" (UID: "108d2514-146b-40ad-a176-4486aeaddfb8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:53:17.919266 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.919032 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/108d2514-146b-40ad-a176-4486aeaddfb8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "108d2514-146b-40ad-a176-4486aeaddfb8" (UID: "108d2514-146b-40ad-a176-4486aeaddfb8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:53:17.922582 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.920776 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/108d2514-146b-40ad-a176-4486aeaddfb8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "108d2514-146b-40ad-a176-4486aeaddfb8" (UID: "108d2514-146b-40ad-a176-4486aeaddfb8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:53:17.922582 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.921733 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/108d2514-146b-40ad-a176-4486aeaddfb8-istio-token" (OuterVolumeSpecName: "istio-token") pod "108d2514-146b-40ad-a176-4486aeaddfb8" (UID: "108d2514-146b-40ad-a176-4486aeaddfb8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:53:17.922582 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.922177 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/108d2514-146b-40ad-a176-4486aeaddfb8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "108d2514-146b-40ad-a176-4486aeaddfb8" (UID: "108d2514-146b-40ad-a176-4486aeaddfb8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 13:53:17.922839 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.922706 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/108d2514-146b-40ad-a176-4486aeaddfb8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "108d2514-146b-40ad-a176-4486aeaddfb8" (UID: "108d2514-146b-40ad-a176-4486aeaddfb8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:53:17.922898 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.922848 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/108d2514-146b-40ad-a176-4486aeaddfb8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "108d2514-146b-40ad-a176-4486aeaddfb8" (UID: "108d2514-146b-40ad-a176-4486aeaddfb8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:53:17.923301 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.923271 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/108d2514-146b-40ad-a176-4486aeaddfb8-kube-api-access-cx4nj" (OuterVolumeSpecName: "kube-api-access-cx4nj") pod "108d2514-146b-40ad-a176-4486aeaddfb8" (UID: "108d2514-146b-40ad-a176-4486aeaddfb8"). InnerVolumeSpecName "kube-api-access-cx4nj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:53:17.923397 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.923348 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/108d2514-146b-40ad-a176-4486aeaddfb8-istio-data" (OuterVolumeSpecName: "istio-data") pod "108d2514-146b-40ad-a176-4486aeaddfb8" (UID: "108d2514-146b-40ad-a176-4486aeaddfb8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:53:17.926024 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.925809 2554 generic.go:356] "Generic (PLEG): container finished" podID="108d2514-146b-40ad-a176-4486aeaddfb8" containerID="842424ce2c971e5628aa1ba74bf9bf357bde514fa15ea0f63464e4c636c67659" exitCode=0 Jul 15 13:53:17.926024 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.925864 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" event={"ID":"108d2514-146b-40ad-a176-4486aeaddfb8","Type":"ContainerDied","Data":"842424ce2c971e5628aa1ba74bf9bf357bde514fa15ea0f63464e4c636c67659"} Jul 15 13:53:17.926024 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.925910 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" Jul 15 13:53:17.926024 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.926013 2554 scope.go:117] "RemoveContainer" containerID="842424ce2c971e5628aa1ba74bf9bf357bde514fa15ea0f63464e4c636c67659" Jul 15 13:53:17.926519 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.925955 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44" event={"ID":"108d2514-146b-40ad-a176-4486aeaddfb8","Type":"ContainerDied","Data":"8a7f8cb81ffb50659ba72ae844bee81991cf962072e905798705f8dfa3668988"} Jul 15 13:53:17.943596 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.943575 2554 scope.go:117] "RemoveContainer" containerID="289d1aa3fad449beb170edd29366769a2a2e02dbe72a76ac97691a7184ba7ed8" Jul 15 13:53:17.951202 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.951186 2554 scope.go:117] "RemoveContainer" containerID="842424ce2c971e5628aa1ba74bf9bf357bde514fa15ea0f63464e4c636c67659" Jul 15 13:53:17.951455 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:53:17.951436 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"842424ce2c971e5628aa1ba74bf9bf357bde514fa15ea0f63464e4c636c67659\": container with ID starting with 842424ce2c971e5628aa1ba74bf9bf357bde514fa15ea0f63464e4c636c67659 not found: ID does not exist" containerID="842424ce2c971e5628aa1ba74bf9bf357bde514fa15ea0f63464e4c636c67659" Jul 15 13:53:17.951531 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.951467 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"842424ce2c971e5628aa1ba74bf9bf357bde514fa15ea0f63464e4c636c67659"} err="failed to get container status \"842424ce2c971e5628aa1ba74bf9bf357bde514fa15ea0f63464e4c636c67659\": rpc error: code = NotFound desc = could not find container \"842424ce2c971e5628aa1ba74bf9bf357bde514fa15ea0f63464e4c636c67659\": container with ID starting with 842424ce2c971e5628aa1ba74bf9bf357bde514fa15ea0f63464e4c636c67659 not found: ID does not exist" Jul 15 13:53:17.951531 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.951492 2554 scope.go:117] "RemoveContainer" containerID="289d1aa3fad449beb170edd29366769a2a2e02dbe72a76ac97691a7184ba7ed8" Jul 15 13:53:17.951739 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:53:17.951722 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"289d1aa3fad449beb170edd29366769a2a2e02dbe72a76ac97691a7184ba7ed8\": container with ID starting with 289d1aa3fad449beb170edd29366769a2a2e02dbe72a76ac97691a7184ba7ed8 not found: ID does not exist" containerID="289d1aa3fad449beb170edd29366769a2a2e02dbe72a76ac97691a7184ba7ed8" Jul 15 13:53:17.951780 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.951745 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"289d1aa3fad449beb170edd29366769a2a2e02dbe72a76ac97691a7184ba7ed8"} err="failed to get container status \"289d1aa3fad449beb170edd29366769a2a2e02dbe72a76ac97691a7184ba7ed8\": rpc error: code = NotFound desc = could not find container \"289d1aa3fad449beb170edd29366769a2a2e02dbe72a76ac97691a7184ba7ed8\": container with ID starting with 289d1aa3fad449beb170edd29366769a2a2e02dbe72a76ac97691a7184ba7ed8 not found: ID does not exist" Jul 15 13:53:17.954963 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.954943 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44"] Jul 15 13:53:17.961353 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:17.961330 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-114e4a-openshift-default-687bd5df99-hvt44"] Jul 15 13:53:18.019650 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:18.019624 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/108d2514-146b-40ad-a176-4486aeaddfb8-istiod-ca-cert\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:53:18.019650 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:18.019651 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/108d2514-146b-40ad-a176-4486aeaddfb8-istio-envoy\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:53:18.019796 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:18.019664 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cx4nj\" (UniqueName: \"kubernetes.io/projected/108d2514-146b-40ad-a176-4486aeaddfb8-kube-api-access-cx4nj\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:53:18.019796 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:18.019677 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/108d2514-146b-40ad-a176-4486aeaddfb8-istio-token\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:53:18.019796 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:18.019692 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/108d2514-146b-40ad-a176-4486aeaddfb8-credential-socket\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:53:18.019796 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:18.019712 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/108d2514-146b-40ad-a176-4486aeaddfb8-istio-podinfo\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:53:18.019796 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:18.019726 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/108d2514-146b-40ad-a176-4486aeaddfb8-istio-data\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:53:18.019796 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:18.019740 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/108d2514-146b-40ad-a176-4486aeaddfb8-workload-socket\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:53:18.019796 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:18.019755 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/108d2514-146b-40ad-a176-4486aeaddfb8-workload-certs\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:53:19.137525 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:19.137443 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="108d2514-146b-40ad-a176-4486aeaddfb8" path="/var/lib/kubelet/pods/108d2514-146b-40ad-a176-4486aeaddfb8/volumes" Jul 15 13:53:21.440796 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:21.440758 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:21.957024 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:21.956973 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:22.224997 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.224952 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht"] Jul 15 13:53:22.225414 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.225396 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="108d2514-146b-40ad-a176-4486aeaddfb8" containerName="istio-proxy" Jul 15 13:53:22.225504 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.225416 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="108d2514-146b-40ad-a176-4486aeaddfb8" containerName="istio-proxy" Jul 15 13:53:22.225504 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.225447 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="108d2514-146b-40ad-a176-4486aeaddfb8" containerName="istio-proxy" Jul 15 13:53:22.225504 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.225456 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="108d2514-146b-40ad-a176-4486aeaddfb8" containerName="istio-proxy" Jul 15 13:53:22.225650 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.225533 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="108d2514-146b-40ad-a176-4486aeaddfb8" containerName="istio-proxy" Jul 15 13:53:22.225650 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.225547 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="108d2514-146b-40ad-a176-4486aeaddfb8" containerName="istio-proxy" Jul 15 13:53:22.228495 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.228476 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:22.231230 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.231210 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-5dfbdf-openshift-default-dockercfg-5bpz2\"" Jul 15 13:53:22.240165 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.240138 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht"] Jul 15 13:53:22.250958 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.250929 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:22.255123 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.255098 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-istio-data\") pod \"e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:22.255247 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.255137 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-workload-socket\") pod \"e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:22.255247 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.255164 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-istio-podinfo\") pod \"e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:22.255247 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.255202 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-workload-certs\") pod \"e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:22.255247 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.255238 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-istiod-ca-cert\") pod \"e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:22.255435 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.255301 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-istio-token\") pod \"e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:22.255435 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.255345 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-credential-socket\") pod \"e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:22.255435 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.255367 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-istio-envoy\") pod \"e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:22.255435 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.255397 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlj4s\" (UniqueName: \"kubernetes.io/projected/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-kube-api-access-rlj4s\") pod \"e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:22.356643 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.356590 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-workload-certs\") pod \"e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:22.356643 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.356637 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-istiod-ca-cert\") pod \"e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:22.356947 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.356690 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-istio-token\") pod \"e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:22.356947 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.356733 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-credential-socket\") pod \"e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:22.356947 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.356756 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-istio-envoy\") pod \"e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:22.356947 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.356801 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlj4s\" (UniqueName: \"kubernetes.io/projected/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-kube-api-access-rlj4s\") pod \"e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:22.356947 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.356860 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-istio-data\") pod \"e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:22.356947 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.356893 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-workload-socket\") pod \"e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:22.356947 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.356919 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-istio-podinfo\") pod \"e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:22.357339 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.357052 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-workload-certs\") pod \"e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:22.357339 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.357102 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-credential-socket\") pod \"e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:22.357484 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.357459 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-istiod-ca-cert\") pod \"e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:22.357684 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.357523 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-istio-data\") pod \"e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:22.357809 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.357558 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-workload-socket\") pod \"e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:22.359437 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.359406 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-istio-envoy\") pod \"e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:22.359597 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.359564 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-istio-podinfo\") pod \"e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:22.365488 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.365457 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlj4s\" (UniqueName: \"kubernetes.io/projected/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-kube-api-access-rlj4s\") pod \"e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:22.365876 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.365855 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-istio-token\") pod \"e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:22.369328 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.369302 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:22.539275 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.539182 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:22.717006 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.697001 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht"] Jul 15 13:53:22.724070 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:53:22.724033 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod620813ce_3a1a_4620_9a0f_dbfaa8236fb0.slice/crio-43490bcf2d39330f9079452dbe8bb4f8f5966a2acc2419e3adb0809f27025dee WatchSource:0}: Error finding container 43490bcf2d39330f9079452dbe8bb4f8f5966a2acc2419e3adb0809f27025dee: Status 404 returned error can't find the container with id 43490bcf2d39330f9079452dbe8bb4f8f5966a2acc2419e3adb0809f27025dee Jul 15 13:53:22.726845 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.726791 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:53:22.726997 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.726878 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:53:22.726997 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.726928 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:53:22.951751 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.951648 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" event={"ID":"620813ce-3a1a-4620-9a0f-dbfaa8236fb0","Type":"ContainerStarted","Data":"ae29aa1680814f3eee35851edbbd8bd841dcb7c457a0c9b591492a0178065a49"} Jul 15 13:53:22.951751 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.951728 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" event={"ID":"620813ce-3a1a-4620-9a0f-dbfaa8236fb0","Type":"ContainerStarted","Data":"43490bcf2d39330f9079452dbe8bb4f8f5966a2acc2419e3adb0809f27025dee"} Jul 15 13:53:22.976810 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:22.976760 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" podStartSLOduration=0.976739102 podStartE2EDuration="976.739102ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:53:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:53:22.974631697 +0000 UTC m=+2516.405441265" watchObservedRunningTime="2026-07-15 13:53:22.976739102 +0000 UTC m=+2516.407548677" Jul 15 13:53:23.540310 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:23.540270 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:23.545130 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:23.545106 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:23.956181 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:23.956088 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:23.957025 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:23.957000 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:24.897820 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:24.897767 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:24.988452 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:24.988418 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:25.132064 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:25.132024 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:25.288422 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:25.288372 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:25.628642 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:25.628514 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:25.733010 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:25.732948 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:29.479514 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:29.479482 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:29.985756 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:29.985723 2554 generic.go:356] "Generic (PLEG): container finished" podID="37a03555-95cc-439a-9513-40009725482a" containerID="d7acd623318078ea8a1ca7c3401d96a6f96ff44f2e7716368cc686c99851af9b" exitCode=0 Jul 15 13:53:29.985940 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:29.985776 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" event={"ID":"37a03555-95cc-439a-9513-40009725482a","Type":"ContainerDied","Data":"d7acd623318078ea8a1ca7c3401d96a6f96ff44f2e7716368cc686c99851af9b"} Jul 15 13:53:29.986185 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:29.986171 2554 scope.go:117] "RemoveContainer" containerID="d7acd623318078ea8a1ca7c3401d96a6f96ff44f2e7716368cc686c99851af9b" Jul 15 13:53:29.987165 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:29.987137 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:53:29.987236 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:29.987202 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:53:29.987271 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:29.987234 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:53:30.909912 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:30.909869 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:30.993143 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:30.993106 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" event={"ID":"37a03555-95cc-439a-9513-40009725482a","Type":"ContainerStarted","Data":"a30744000190f97608062ee19f5d3f43c8589e94242c38da1f22f322043c479b"} Jul 15 13:53:31.886462 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:31.886424 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:31.887383 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:31.887355 2554 patch_prober.go:28] interesting pod/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 15 13:53:31.887500 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:31.887405 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" podUID="37a03555-95cc-439a-9513-40009725482a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 15 13:53:32.886386 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:32.886351 2554 patch_prober.go:28] interesting pod/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 15 13:53:32.886773 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:32.886407 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" podUID="37a03555-95cc-439a-9513-40009725482a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 15 13:53:33.887188 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:33.887145 2554 patch_prober.go:28] interesting pod/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 15 13:53:33.887596 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:33.887208 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" podUID="37a03555-95cc-439a-9513-40009725482a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 15 13:53:34.953001 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:34.952943 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:34.953529 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:34.953478 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:34.954865 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:34.954841 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:53:38.165380 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:38.165344 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:38.264259 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:38.264219 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:42.069650 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:42.069620 2554 generic.go:356] "Generic (PLEG): container finished" podID="620813ce-3a1a-4620-9a0f-dbfaa8236fb0" containerID="ae29aa1680814f3eee35851edbbd8bd841dcb7c457a0c9b591492a0178065a49" exitCode=0 Jul 15 13:53:42.070108 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:42.069703 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" event={"ID":"620813ce-3a1a-4620-9a0f-dbfaa8236fb0","Type":"ContainerDied","Data":"ae29aa1680814f3eee35851edbbd8bd841dcb7c457a0c9b591492a0178065a49"} Jul 15 13:53:42.070108 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:42.070104 2554 scope.go:117] "RemoveContainer" containerID="ae29aa1680814f3eee35851edbbd8bd841dcb7c457a0c9b591492a0178065a49" Jul 15 13:53:42.071099 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:42.071071 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:53:42.071177 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:42.071140 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:53:42.071221 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:42.071180 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:53:43.076737 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:43.076700 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" event={"ID":"620813ce-3a1a-4620-9a0f-dbfaa8236fb0","Type":"ContainerStarted","Data":"3a92edb1078ca950607f658812880c6ad2b06c3b6736d6ba21b6d9b6fa892688"} Jul 15 13:53:43.539828 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:43.539791 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:43.540019 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:43.539967 2554 patch_prober.go:28] interesting pod/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 15 13:53:43.540075 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:43.540038 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" podUID="620813ce-3a1a-4620-9a0f-dbfaa8236fb0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 15 13:53:44.540270 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:44.540239 2554 patch_prober.go:28] interesting pod/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 15 13:53:44.540652 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:44.540292 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" podUID="620813ce-3a1a-4620-9a0f-dbfaa8236fb0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 15 13:53:45.539959 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:45.539926 2554 patch_prober.go:28] interesting pod/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 15 13:53:45.540160 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:45.540006 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" podUID="620813ce-3a1a-4620-9a0f-dbfaa8236fb0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 15 13:53:46.539911 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:46.539877 2554 patch_prober.go:28] interesting pod/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 15 13:53:46.540325 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:46.539926 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" podUID="620813ce-3a1a-4620-9a0f-dbfaa8236fb0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 15 13:53:47.542839 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:47.542812 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:47.543261 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:47.543238 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:47.543939 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:47.543919 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:53:47.753132 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:47.753099 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:47.852389 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:47.852277 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:48.100266 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:48.100225 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:52.710588 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:52.710547 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:58.625936 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:58.625890 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:53:58.678663 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:53:58.678622 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:03.470222 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:03.470180 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb"] Jul 15 13:54:03.470689 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:03.470394 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" podUID="37a03555-95cc-439a-9513-40009725482a" containerName="istio-proxy" containerID="cri-o://a30744000190f97608062ee19f5d3f43c8589e94242c38da1f22f322043c479b" gracePeriod=30 Jul 15 13:54:03.482333 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:03.482298 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:03.716315 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:03.716270 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:04.956052 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:04.956004 2554 patch_prober.go:28] interesting pod/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused Jul 15 13:54:04.956444 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:04.956098 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" podUID="37a03555-95cc-439a-9513-40009725482a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 13:54:08.714301 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:08.714270 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:54:08.785008 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:08.784910 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37a03555-95cc-439a-9513-40009725482a-istio-token\") pod \"37a03555-95cc-439a-9513-40009725482a\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " Jul 15 13:54:08.785008 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:08.784954 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37a03555-95cc-439a-9513-40009725482a-istio-data\") pod \"37a03555-95cc-439a-9513-40009725482a\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " Jul 15 13:54:08.785236 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:08.785008 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24plw\" (UniqueName: \"kubernetes.io/projected/37a03555-95cc-439a-9513-40009725482a-kube-api-access-24plw\") pod \"37a03555-95cc-439a-9513-40009725482a\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " Jul 15 13:54:08.785236 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:08.785042 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37a03555-95cc-439a-9513-40009725482a-workload-socket\") pod \"37a03555-95cc-439a-9513-40009725482a\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " Jul 15 13:54:08.785236 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:08.785065 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37a03555-95cc-439a-9513-40009725482a-credential-socket\") pod \"37a03555-95cc-439a-9513-40009725482a\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " Jul 15 13:54:08.785236 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:08.785097 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37a03555-95cc-439a-9513-40009725482a-istiod-ca-cert\") pod \"37a03555-95cc-439a-9513-40009725482a\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " Jul 15 13:54:08.785236 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:08.785133 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37a03555-95cc-439a-9513-40009725482a-istio-envoy\") pod \"37a03555-95cc-439a-9513-40009725482a\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " Jul 15 13:54:08.785236 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:08.785213 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37a03555-95cc-439a-9513-40009725482a-workload-certs\") pod \"37a03555-95cc-439a-9513-40009725482a\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " Jul 15 13:54:08.785539 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:08.785266 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37a03555-95cc-439a-9513-40009725482a-istio-podinfo\") pod \"37a03555-95cc-439a-9513-40009725482a\" (UID: \"37a03555-95cc-439a-9513-40009725482a\") " Jul 15 13:54:08.785539 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:08.785415 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37a03555-95cc-439a-9513-40009725482a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "37a03555-95cc-439a-9513-40009725482a" (UID: "37a03555-95cc-439a-9513-40009725482a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:54:08.785539 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:08.785425 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37a03555-95cc-439a-9513-40009725482a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "37a03555-95cc-439a-9513-40009725482a" (UID: "37a03555-95cc-439a-9513-40009725482a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:54:08.785692 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:08.785536 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37a03555-95cc-439a-9513-40009725482a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "37a03555-95cc-439a-9513-40009725482a" (UID: "37a03555-95cc-439a-9513-40009725482a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:54:08.785692 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:08.785643 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37a03555-95cc-439a-9513-40009725482a-workload-socket\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:54:08.785692 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:08.785654 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37a03555-95cc-439a-9513-40009725482a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "37a03555-95cc-439a-9513-40009725482a" (UID: "37a03555-95cc-439a-9513-40009725482a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:54:08.785692 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:08.785667 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37a03555-95cc-439a-9513-40009725482a-credential-socket\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:54:08.785692 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:08.785682 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37a03555-95cc-439a-9513-40009725482a-istiod-ca-cert\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:54:08.786069 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:08.786048 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37a03555-95cc-439a-9513-40009725482a-istio-data" (OuterVolumeSpecName: "istio-data") pod "37a03555-95cc-439a-9513-40009725482a" (UID: "37a03555-95cc-439a-9513-40009725482a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:54:08.787258 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:08.787239 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37a03555-95cc-439a-9513-40009725482a-kube-api-access-24plw" (OuterVolumeSpecName: "kube-api-access-24plw") pod "37a03555-95cc-439a-9513-40009725482a" (UID: "37a03555-95cc-439a-9513-40009725482a"). InnerVolumeSpecName "kube-api-access-24plw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:54:08.787419 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:08.787398 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37a03555-95cc-439a-9513-40009725482a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "37a03555-95cc-439a-9513-40009725482a" (UID: "37a03555-95cc-439a-9513-40009725482a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:54:08.787763 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:08.787747 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/37a03555-95cc-439a-9513-40009725482a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "37a03555-95cc-439a-9513-40009725482a" (UID: "37a03555-95cc-439a-9513-40009725482a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 13:54:08.787808 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:08.787778 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37a03555-95cc-439a-9513-40009725482a-istio-token" (OuterVolumeSpecName: "istio-token") pod "37a03555-95cc-439a-9513-40009725482a" (UID: "37a03555-95cc-439a-9513-40009725482a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:54:08.886615 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:08.886580 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37a03555-95cc-439a-9513-40009725482a-workload-certs\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:54:08.886615 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:08.886610 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37a03555-95cc-439a-9513-40009725482a-istio-podinfo\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:54:08.886615 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:08.886618 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37a03555-95cc-439a-9513-40009725482a-istio-token\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:54:08.886615 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:08.886628 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37a03555-95cc-439a-9513-40009725482a-istio-data\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:54:08.886877 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:08.886636 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24plw\" (UniqueName: \"kubernetes.io/projected/37a03555-95cc-439a-9513-40009725482a-kube-api-access-24plw\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:54:08.886877 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:08.886646 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37a03555-95cc-439a-9513-40009725482a-istio-envoy\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:54:09.202965 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:09.202933 2554 generic.go:356] "Generic (PLEG): container finished" podID="37a03555-95cc-439a-9513-40009725482a" containerID="a30744000190f97608062ee19f5d3f43c8589e94242c38da1f22f322043c479b" exitCode=0 Jul 15 13:54:09.203174 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:09.203004 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" Jul 15 13:54:09.203174 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:09.203014 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" event={"ID":"37a03555-95cc-439a-9513-40009725482a","Type":"ContainerDied","Data":"a30744000190f97608062ee19f5d3f43c8589e94242c38da1f22f322043c479b"} Jul 15 13:54:09.203174 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:09.203081 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb" event={"ID":"37a03555-95cc-439a-9513-40009725482a","Type":"ContainerDied","Data":"c1a837a49592249756f5558091edb01d83acdebc6a8ac2590aa3c09b5e6816e9"} Jul 15 13:54:09.203174 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:09.203114 2554 scope.go:117] "RemoveContainer" containerID="a30744000190f97608062ee19f5d3f43c8589e94242c38da1f22f322043c479b" Jul 15 13:54:09.213787 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:09.213771 2554 scope.go:117] "RemoveContainer" containerID="d7acd623318078ea8a1ca7c3401d96a6f96ff44f2e7716368cc686c99851af9b" Jul 15 13:54:09.222134 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:09.222117 2554 scope.go:117] "RemoveContainer" containerID="a30744000190f97608062ee19f5d3f43c8589e94242c38da1f22f322043c479b" Jul 15 13:54:09.222389 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:54:09.222372 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a30744000190f97608062ee19f5d3f43c8589e94242c38da1f22f322043c479b\": container with ID starting with a30744000190f97608062ee19f5d3f43c8589e94242c38da1f22f322043c479b not found: ID does not exist" containerID="a30744000190f97608062ee19f5d3f43c8589e94242c38da1f22f322043c479b" Jul 15 13:54:09.222447 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:09.222396 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a30744000190f97608062ee19f5d3f43c8589e94242c38da1f22f322043c479b"} err="failed to get container status \"a30744000190f97608062ee19f5d3f43c8589e94242c38da1f22f322043c479b\": rpc error: code = NotFound desc = could not find container \"a30744000190f97608062ee19f5d3f43c8589e94242c38da1f22f322043c479b\": container with ID starting with a30744000190f97608062ee19f5d3f43c8589e94242c38da1f22f322043c479b not found: ID does not exist" Jul 15 13:54:09.222447 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:09.222411 2554 scope.go:117] "RemoveContainer" containerID="d7acd623318078ea8a1ca7c3401d96a6f96ff44f2e7716368cc686c99851af9b" Jul 15 13:54:09.222607 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:54:09.222590 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7acd623318078ea8a1ca7c3401d96a6f96ff44f2e7716368cc686c99851af9b\": container with ID starting with d7acd623318078ea8a1ca7c3401d96a6f96ff44f2e7716368cc686c99851af9b not found: ID does not exist" containerID="d7acd623318078ea8a1ca7c3401d96a6f96ff44f2e7716368cc686c99851af9b" Jul 15 13:54:09.222666 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:09.222610 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7acd623318078ea8a1ca7c3401d96a6f96ff44f2e7716368cc686c99851af9b"} err="failed to get container status \"d7acd623318078ea8a1ca7c3401d96a6f96ff44f2e7716368cc686c99851af9b\": rpc error: code = NotFound desc = could not find container \"d7acd623318078ea8a1ca7c3401d96a6f96ff44f2e7716368cc686c99851af9b\": container with ID starting with d7acd623318078ea8a1ca7c3401d96a6f96ff44f2e7716368cc686c99851af9b not found: ID does not exist" Jul 15 13:54:09.229127 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:09.229105 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb"] Jul 15 13:54:09.236081 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:09.236059 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-3b7ec0-openshift-default-6f8f5974bc-whssb"] Jul 15 13:54:11.137360 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:11.137328 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37a03555-95cc-439a-9513-40009725482a" path="/var/lib/kubelet/pods/37a03555-95cc-439a-9513-40009725482a/volumes" Jul 15 13:54:14.701746 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:14.701684 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:17.694835 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:17.694797 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:18.992163 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:18.992122 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:24.970902 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:24.970865 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:25.053155 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:25.053117 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:29.738963 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:29.738930 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht"] Jul 15 13:54:29.739489 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:29.739175 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" podUID="620813ce-3a1a-4620-9a0f-dbfaa8236fb0" containerName="istio-proxy" containerID="cri-o://3a92edb1078ca950607f658812880c6ad2b06c3b6736d6ba21b6d9b6fa892688" gracePeriod=30 Jul 15 13:54:29.769340 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:29.769306 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:30.001919 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:30.001823 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:30.379818 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:30.379715 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:30.902347 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:30.902304 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:31.177133 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:31.177027 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:32.545463 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:32.545429 2554 patch_prober.go:28] interesting pod/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 13:54:32.545824 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:32.545495 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" podUID="620813ce-3a1a-4620-9a0f-dbfaa8236fb0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 13:54:33.992540 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:33.992500 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:34.094593 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:34.094551 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:34.164544 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:34.164511 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:34.261128 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:34.261047 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:34.669230 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:34.669140 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:34.769879 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:34.769849 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:34.993956 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:34.993931 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:54:35.118074 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.118032 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-workload-socket\") pod \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " Jul 15 13:54:35.118074 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.118074 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-istio-data\") pod \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " Jul 15 13:54:35.118330 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.118092 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-istio-podinfo\") pod \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " Jul 15 13:54:35.118330 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.118133 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-istio-token\") pod \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " Jul 15 13:54:35.118330 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.118164 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-workload-certs\") pod \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " Jul 15 13:54:35.118330 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.118186 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rlj4s\" (UniqueName: \"kubernetes.io/projected/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-kube-api-access-rlj4s\") pod \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " Jul 15 13:54:35.118330 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.118220 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-credential-socket\") pod \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " Jul 15 13:54:35.118330 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.118250 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-istio-envoy\") pod \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " Jul 15 13:54:35.118330 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.118274 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-istiod-ca-cert\") pod \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\" (UID: \"620813ce-3a1a-4620-9a0f-dbfaa8236fb0\") " Jul 15 13:54:35.118687 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.118379 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "620813ce-3a1a-4620-9a0f-dbfaa8236fb0" (UID: "620813ce-3a1a-4620-9a0f-dbfaa8236fb0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:54:35.118687 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.118550 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "620813ce-3a1a-4620-9a0f-dbfaa8236fb0" (UID: "620813ce-3a1a-4620-9a0f-dbfaa8236fb0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:54:35.118687 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.118565 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "620813ce-3a1a-4620-9a0f-dbfaa8236fb0" (UID: "620813ce-3a1a-4620-9a0f-dbfaa8236fb0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:54:35.118845 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.118703 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "620813ce-3a1a-4620-9a0f-dbfaa8236fb0" (UID: "620813ce-3a1a-4620-9a0f-dbfaa8236fb0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 13:54:35.118845 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.118713 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-workload-socket\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:54:35.118845 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.118733 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-workload-certs\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:54:35.118845 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.118747 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-credential-socket\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:54:35.119083 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.119037 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-istio-data" (OuterVolumeSpecName: "istio-data") pod "620813ce-3a1a-4620-9a0f-dbfaa8236fb0" (UID: "620813ce-3a1a-4620-9a0f-dbfaa8236fb0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:54:35.120436 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.120404 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "620813ce-3a1a-4620-9a0f-dbfaa8236fb0" (UID: "620813ce-3a1a-4620-9a0f-dbfaa8236fb0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 13:54:35.120569 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.120550 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-istio-token" (OuterVolumeSpecName: "istio-token") pod "620813ce-3a1a-4620-9a0f-dbfaa8236fb0" (UID: "620813ce-3a1a-4620-9a0f-dbfaa8236fb0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:54:35.120824 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.120797 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-kube-api-access-rlj4s" (OuterVolumeSpecName: "kube-api-access-rlj4s") pod "620813ce-3a1a-4620-9a0f-dbfaa8236fb0" (UID: "620813ce-3a1a-4620-9a0f-dbfaa8236fb0"). InnerVolumeSpecName "kube-api-access-rlj4s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 13:54:35.120919 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.120796 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "620813ce-3a1a-4620-9a0f-dbfaa8236fb0" (UID: "620813ce-3a1a-4620-9a0f-dbfaa8236fb0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 13:54:35.219795 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.219765 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlj4s\" (UniqueName: \"kubernetes.io/projected/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-kube-api-access-rlj4s\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:54:35.219795 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.219795 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-istio-envoy\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:54:35.219795 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.219804 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-istiod-ca-cert\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:54:35.220053 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.219812 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-istio-data\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:54:35.220053 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.219820 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-istio-podinfo\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:54:35.220053 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.219827 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/620813ce-3a1a-4620-9a0f-dbfaa8236fb0-istio-token\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 13:54:35.326473 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.326394 2554 generic.go:356] "Generic (PLEG): container finished" podID="620813ce-3a1a-4620-9a0f-dbfaa8236fb0" containerID="3a92edb1078ca950607f658812880c6ad2b06c3b6736d6ba21b6d9b6fa892688" exitCode=0 Jul 15 13:54:35.326473 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.326446 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" Jul 15 13:54:35.326647 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.326484 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" event={"ID":"620813ce-3a1a-4620-9a0f-dbfaa8236fb0","Type":"ContainerDied","Data":"3a92edb1078ca950607f658812880c6ad2b06c3b6736d6ba21b6d9b6fa892688"} Jul 15 13:54:35.326647 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.326541 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht" event={"ID":"620813ce-3a1a-4620-9a0f-dbfaa8236fb0","Type":"ContainerDied","Data":"43490bcf2d39330f9079452dbe8bb4f8f5966a2acc2419e3adb0809f27025dee"} Jul 15 13:54:35.326647 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.326571 2554 scope.go:117] "RemoveContainer" containerID="3a92edb1078ca950607f658812880c6ad2b06c3b6736d6ba21b6d9b6fa892688" Jul 15 13:54:35.335035 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.335017 2554 scope.go:117] "RemoveContainer" containerID="ae29aa1680814f3eee35851edbbd8bd841dcb7c457a0c9b591492a0178065a49" Jul 15 13:54:35.342726 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.342701 2554 scope.go:117] "RemoveContainer" containerID="3a92edb1078ca950607f658812880c6ad2b06c3b6736d6ba21b6d9b6fa892688" Jul 15 13:54:35.343001 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:54:35.342964 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a92edb1078ca950607f658812880c6ad2b06c3b6736d6ba21b6d9b6fa892688\": container with ID starting with 3a92edb1078ca950607f658812880c6ad2b06c3b6736d6ba21b6d9b6fa892688 not found: ID does not exist" containerID="3a92edb1078ca950607f658812880c6ad2b06c3b6736d6ba21b6d9b6fa892688" Jul 15 13:54:35.343097 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.343079 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a92edb1078ca950607f658812880c6ad2b06c3b6736d6ba21b6d9b6fa892688"} err="failed to get container status \"3a92edb1078ca950607f658812880c6ad2b06c3b6736d6ba21b6d9b6fa892688\": rpc error: code = NotFound desc = could not find container \"3a92edb1078ca950607f658812880c6ad2b06c3b6736d6ba21b6d9b6fa892688\": container with ID starting with 3a92edb1078ca950607f658812880c6ad2b06c3b6736d6ba21b6d9b6fa892688 not found: ID does not exist" Jul 15 13:54:35.343144 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.343099 2554 scope.go:117] "RemoveContainer" containerID="ae29aa1680814f3eee35851edbbd8bd841dcb7c457a0c9b591492a0178065a49" Jul 15 13:54:35.343328 ip-10-0-132-114 kubenswrapper[2554]: E0715 13:54:35.343314 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae29aa1680814f3eee35851edbbd8bd841dcb7c457a0c9b591492a0178065a49\": container with ID starting with ae29aa1680814f3eee35851edbbd8bd841dcb7c457a0c9b591492a0178065a49 not found: ID does not exist" containerID="ae29aa1680814f3eee35851edbbd8bd841dcb7c457a0c9b591492a0178065a49" Jul 15 13:54:35.343365 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.343332 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae29aa1680814f3eee35851edbbd8bd841dcb7c457a0c9b591492a0178065a49"} err="failed to get container status \"ae29aa1680814f3eee35851edbbd8bd841dcb7c457a0c9b591492a0178065a49\": rpc error: code = NotFound desc = could not find container \"ae29aa1680814f3eee35851edbbd8bd841dcb7c457a0c9b591492a0178065a49\": container with ID starting with ae29aa1680814f3eee35851edbbd8bd841dcb7c457a0c9b591492a0178065a49 not found: ID does not exist" Jul 15 13:54:35.346553 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.346528 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht"] Jul 15 13:54:35.350379 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:35.350360 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-5dfbdf-openshift-default-dcdd5b587-jj4ht"] Jul 15 13:54:37.137139 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:37.137099 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="620813ce-3a1a-4620-9a0f-dbfaa8236fb0" path="/var/lib/kubelet/pods/620813ce-3a1a-4620-9a0f-dbfaa8236fb0/volumes" Jul 15 13:54:38.531484 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:38.531446 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:38.930276 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:38.930191 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:39.230844 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.230804 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd"] Jul 15 13:54:39.231331 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.231310 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="620813ce-3a1a-4620-9a0f-dbfaa8236fb0" containerName="istio-proxy" Jul 15 13:54:39.231331 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.231331 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="620813ce-3a1a-4620-9a0f-dbfaa8236fb0" containerName="istio-proxy" Jul 15 13:54:39.231533 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.231362 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37a03555-95cc-439a-9513-40009725482a" containerName="istio-proxy" Jul 15 13:54:39.231533 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.231370 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="37a03555-95cc-439a-9513-40009725482a" containerName="istio-proxy" Jul 15 13:54:39.231533 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.231392 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37a03555-95cc-439a-9513-40009725482a" containerName="istio-proxy" Jul 15 13:54:39.231533 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.231400 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="37a03555-95cc-439a-9513-40009725482a" containerName="istio-proxy" Jul 15 13:54:39.231533 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.231469 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="620813ce-3a1a-4620-9a0f-dbfaa8236fb0" containerName="istio-proxy" Jul 15 13:54:39.231533 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.231479 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="37a03555-95cc-439a-9513-40009725482a" containerName="istio-proxy" Jul 15 13:54:39.231533 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.231489 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="620813ce-3a1a-4620-9a0f-dbfaa8236fb0" containerName="istio-proxy" Jul 15 13:54:39.236795 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.236773 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:39.241322 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.241302 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-7746ae-openshift-default-dockercfg-lj4t4\"" Jul 15 13:54:39.244377 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.244342 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:39.249395 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.249371 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd"] Jul 15 13:54:39.357055 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.357021 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-istio-token\") pod \"e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:39.357055 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.357058 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg4k5\" (UniqueName: \"kubernetes.io/projected/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-kube-api-access-qg4k5\") pod \"e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:39.357286 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.357094 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-credential-socket\") pod \"e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:39.357286 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.357142 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-workload-certs\") pod \"e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:39.357286 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.357178 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-istio-envoy\") pod \"e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:39.357286 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.357199 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-istio-podinfo\") pod \"e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:39.357286 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.357258 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-istiod-ca-cert\") pod \"e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:39.357454 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.357311 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-istio-data\") pod \"e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:39.357454 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.357331 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-workload-socket\") pod \"e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:39.458187 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.458148 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-istiod-ca-cert\") pod \"e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:39.458187 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.458192 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-istio-data\") pod \"e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:39.458368 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.458211 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-workload-socket\") pod \"e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:39.458368 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.458284 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-istio-token\") pod \"e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:39.458368 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.458314 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg4k5\" (UniqueName: \"kubernetes.io/projected/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-kube-api-access-qg4k5\") pod \"e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:39.458368 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.458364 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-credential-socket\") pod \"e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:39.458568 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.458385 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-workload-certs\") pod \"e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:39.458568 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.458412 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-istio-envoy\") pod \"e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:39.458568 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.458437 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-istio-podinfo\") pod \"e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:39.458763 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.458647 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-istio-data\") pod \"e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:39.458763 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.458710 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-workload-socket\") pod \"e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:39.458878 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.458858 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-credential-socket\") pod \"e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:39.458957 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.458937 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-istiod-ca-cert\") pod \"e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:39.459038 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.459024 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-workload-certs\") pod \"e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:39.460652 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.460628 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-istio-envoy\") pod \"e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:39.460854 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.460836 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-istio-podinfo\") pod \"e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:39.473910 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.473890 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-istio-token\") pod \"e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:39.474046 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.473931 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg4k5\" (UniqueName: \"kubernetes.io/projected/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-kube-api-access-qg4k5\") pod \"e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:39.548144 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.548067 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:39.681600 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.681575 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd"] Jul 15 13:54:39.683957 ip-10-0-132-114 kubenswrapper[2554]: W0715 13:54:39.683933 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53835d9e_7b4a_4a17_bd8c_1f8fcdaed4f9.slice/crio-e63cce3b4bdfc1cdf9089c1a2e6fb6ba9b8b6074c66197428960b6e3862a8eac WatchSource:0}: Error finding container e63cce3b4bdfc1cdf9089c1a2e6fb6ba9b8b6074c66197428960b6e3862a8eac: Status 404 returned error can't find the container with id e63cce3b4bdfc1cdf9089c1a2e6fb6ba9b8b6074c66197428960b6e3862a8eac Jul 15 13:54:39.686076 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.686043 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:54:39.686159 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.686105 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:54:39.686159 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.686132 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:54:39.990047 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:39.990006 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:40.359321 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:40.359233 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" event={"ID":"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9","Type":"ContainerStarted","Data":"408fa8ff0fee75c1678dc1d6a75322f5cd8aa169974c2a5ab90eadfd3c59b3cd"} Jul 15 13:54:40.359321 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:40.359284 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" event={"ID":"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9","Type":"ContainerStarted","Data":"e63cce3b4bdfc1cdf9089c1a2e6fb6ba9b8b6074c66197428960b6e3862a8eac"} Jul 15 13:54:40.382442 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:40.382382 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" podStartSLOduration=1.382367367 podStartE2EDuration="1.382367367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:54:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:54:40.38133717 +0000 UTC m=+2593.812146743" watchObservedRunningTime="2026-07-15 13:54:40.382367367 +0000 UTC m=+2593.813176940" Jul 15 13:54:40.548973 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:40.548936 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:40.553622 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:40.553594 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:41.364177 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:41.364150 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:41.365150 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:41.365130 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:42.411018 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:42.410961 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:42.506302 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:42.506231 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:42.574752 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:42.574722 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:42.714346 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:42.714247 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:43.557653 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:43.557613 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:43.656465 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:43.656433 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:46.943130 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:46.943098 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:54.602761 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:54.602629 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:54.698082 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:54.698048 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:55.648576 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:55.648534 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:55.747069 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:55.747028 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:57.406192 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:57.406152 2554 patch_prober.go:28] interesting pod/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 15 13:54:57.406637 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:57.406220 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" podUID="53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 15 13:54:58.143976 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:58.143938 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:54:58.451487 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:58.451401 2554 generic.go:356] "Generic (PLEG): container finished" podID="53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9" containerID="408fa8ff0fee75c1678dc1d6a75322f5cd8aa169974c2a5ab90eadfd3c59b3cd" exitCode=0 Jul 15 13:54:58.451487 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:58.451470 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" event={"ID":"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9","Type":"ContainerDied","Data":"408fa8ff0fee75c1678dc1d6a75322f5cd8aa169974c2a5ab90eadfd3c59b3cd"} Jul 15 13:54:58.451924 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:58.451908 2554 scope.go:117] "RemoveContainer" containerID="408fa8ff0fee75c1678dc1d6a75322f5cd8aa169974c2a5ab90eadfd3c59b3cd" Jul 15 13:54:58.452915 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:58.452882 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:54:58.453030 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:58.453011 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:54:58.453103 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:58.453065 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 15 13:54:59.458487 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:59.458453 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" event={"ID":"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9","Type":"ContainerStarted","Data":"f0a8a4775064434965ad44b378d0c27bd4d81299126a48a6af279874def515d1"} Jul 15 13:54:59.548499 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:59.548471 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:54:59.548700 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:59.548679 2554 patch_prober.go:28] interesting pod/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 15 13:54:59.548781 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:54:59.548732 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" podUID="53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 15 13:55:00.548475 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:55:00.548437 2554 patch_prober.go:28] interesting pod/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 15 13:55:00.548869 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:55:00.548495 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" podUID="53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 15 13:55:01.549025 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:55:01.548957 2554 patch_prober.go:28] interesting pod/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 15 13:55:01.549577 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:55:01.549049 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" podUID="53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 15 13:55:02.549284 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:55:02.549241 2554 patch_prober.go:28] interesting pod/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 15 13:55:02.549681 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:55:02.549299 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" podUID="53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 15 13:55:03.549386 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:55:03.549342 2554 patch_prober.go:28] interesting pod/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 15 13:55:03.549776 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:55:03.549420 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" podUID="53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 15 13:55:04.551844 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:55:04.551816 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:55:04.552233 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:55:04.552103 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:55:04.552739 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:55:04.552723 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 13:55:05.914997 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:55:05.914954 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:55:06.015554 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:55:06.015503 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:55:18.819782 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:55:18.819732 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:55:21.250556 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:55:21.250512 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:55:22.936641 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:55:22.936608 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:55:40.437351 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:55:40.437309 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:56:27.300778 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:56:27.300747 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lx562_83d9c378-e25b-487c-a9be-83e18e37d87f/ovn-acl-logging/0.log" Jul 15 13:56:27.302063 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:56:27.302040 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lx562_83d9c378-e25b-487c-a9be-83e18e37d87f/ovn-acl-logging/0.log" Jul 15 13:56:49.218909 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:56:49.218876 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:57:26.490079 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:57:26.490034 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:57:27.529053 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:57:27.529011 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:57:43.090754 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:57:43.090717 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:57:43.143350 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:57:43.143313 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:57:47.530304 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:57:47.530267 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:58:25.743027 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:58:25.742991 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:59:04.095999 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:59:04.095946 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:59:05.125860 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:59:05.125825 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:59:18.349584 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:59:18.349507 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:59:51.714284 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:59:51.714247 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:59:55.769521 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:59:55.769473 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:59:55.866346 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:59:55.866306 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:59:56.673400 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:59:56.673362 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 13:59:56.769813 ip-10-0-132-114 kubenswrapper[2554]: I0715 13:59:56.769773 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 14:00:00.149548 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:00.149514 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7746ae-29735400-pdqz9"] Jul 15 14:00:00.152008 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:00.149883 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="620813ce-3a1a-4620-9a0f-dbfaa8236fb0" containerName="istio-proxy" Jul 15 14:00:00.152008 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:00.149896 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="620813ce-3a1a-4620-9a0f-dbfaa8236fb0" containerName="istio-proxy" Jul 15 14:00:00.152008 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:00.149951 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="37a03555-95cc-439a-9513-40009725482a" containerName="istio-proxy" Jul 15 14:00:00.152921 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:00.152904 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7746ae-29735400-pdqz9" Jul 15 14:00:00.153616 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:00.153590 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8c00d1-29735400-nd6mt"] Jul 15 14:00:00.155457 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:00.155437 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpj2c\"" Jul 15 14:00:00.157243 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:00.157226 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735400-nlxzw"] Jul 15 14:00:00.157340 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:00.157290 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8c00d1-29735400-nd6mt" Jul 15 14:00:00.160647 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:00.160624 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735400-nlxzw" Jul 15 14:00:00.163572 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:00.163554 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7746ae-29735400-pdqz9" Jul 15 14:00:00.169457 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:00.169217 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7746ae-29735400-pdqz9"] Jul 15 14:00:00.171515 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:00.171490 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735400-nlxzw"] Jul 15 14:00:00.173857 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:00.173700 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8c00d1-29735400-nd6mt" Jul 15 14:00:00.174189 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:00.174168 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8c00d1-29735400-nd6mt"] Jul 15 14:00:00.215892 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:00.215863 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735400-nlxzw" Jul 15 14:00:00.329849 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:00.329823 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7746ae-29735400-pdqz9"] Jul 15 14:00:00.330753 ip-10-0-132-114 kubenswrapper[2554]: W0715 14:00:00.330727 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bf9ecd7_487d_4074_873a_b466210493ce.slice/crio-757eac30bbbe3e7c38c52022a0a834680323f861c8e951ae816a30e2e8f191c7 WatchSource:0}: Error finding container 757eac30bbbe3e7c38c52022a0a834680323f861c8e951ae816a30e2e8f191c7: Status 404 returned error can't find the container with id 757eac30bbbe3e7c38c52022a0a834680323f861c8e951ae816a30e2e8f191c7 Jul 15 14:00:00.398939 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:00.398896 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735400-nlxzw"] Jul 15 14:00:00.399345 ip-10-0-132-114 kubenswrapper[2554]: W0715 14:00:00.399311 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1500fbd_6026_46f7_929c_e84be919d3cd.slice/crio-8042c844e6eedec71d8d81e0246bab439352d3bbcc3429566d8e7abb076360b2 WatchSource:0}: Error finding container 8042c844e6eedec71d8d81e0246bab439352d3bbcc3429566d8e7abb076360b2: Status 404 returned error can't find the container with id 8042c844e6eedec71d8d81e0246bab439352d3bbcc3429566d8e7abb076360b2 Jul 15 14:00:00.564171 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:00.564147 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8c00d1-29735400-nd6mt"] Jul 15 14:00:00.566379 ip-10-0-132-114 kubenswrapper[2554]: W0715 14:00:00.566350 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0068f79_81f2_4834_973b_444d995252b7.slice/crio-65a46f074dcbe7bd495b3c6014bd511c7cbb45ad11c5e8cd05db968962f526c3 WatchSource:0}: Error finding container 65a46f074dcbe7bd495b3c6014bd511c7cbb45ad11c5e8cd05db968962f526c3: Status 404 returned error can't find the container with id 65a46f074dcbe7bd495b3c6014bd511c7cbb45ad11c5e8cd05db968962f526c3 Jul 15 14:00:00.873241 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:00.873208 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735400-nlxzw" event={"ID":"d1500fbd-6026-46f7-929c-e84be919d3cd","Type":"ContainerStarted","Data":"94e44695a59919dc8271f925e9ef27a1a3ed5f2b1ca3264d9f85551d8d03cc8a"} Jul 15 14:00:00.873457 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:00.873258 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735400-nlxzw" event={"ID":"d1500fbd-6026-46f7-929c-e84be919d3cd","Type":"ContainerStarted","Data":"8042c844e6eedec71d8d81e0246bab439352d3bbcc3429566d8e7abb076360b2"} Jul 15 14:00:00.874788 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:00.874757 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8c00d1-29735400-nd6mt" event={"ID":"c0068f79-81f2-4834-973b-444d995252b7","Type":"ContainerStarted","Data":"1c78dc583e86070dcce9248c87427cc2a468eea18faf28eac31a2b83e4c26e66"} Jul 15 14:00:00.874902 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:00.874814 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8c00d1-29735400-nd6mt" event={"ID":"c0068f79-81f2-4834-973b-444d995252b7","Type":"ContainerStarted","Data":"65a46f074dcbe7bd495b3c6014bd511c7cbb45ad11c5e8cd05db968962f526c3"} Jul 15 14:00:00.876058 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:00.876034 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7746ae-29735400-pdqz9" event={"ID":"4bf9ecd7-487d-4074-873a-b466210493ce","Type":"ContainerStarted","Data":"3fb5e39ab6bc82f792db2ce58b834d9ce68cba45c4d76e5d09d559ce3b01b71b"} Jul 15 14:00:00.876154 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:00.876081 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7746ae-29735400-pdqz9" event={"ID":"4bf9ecd7-487d-4074-873a-b466210493ce","Type":"ContainerStarted","Data":"757eac30bbbe3e7c38c52022a0a834680323f861c8e951ae816a30e2e8f191c7"} Jul 15 14:00:00.897991 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:00.897928 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735400-nlxzw" podStartSLOduration=0.897910775 podStartE2EDuration="897.910775ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:00:00.894673516 +0000 UTC m=+2914.325483090" watchObservedRunningTime="2026-07-15 14:00:00.897910775 +0000 UTC m=+2914.328720351" Jul 15 14:00:00.921256 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:00.921215 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7746ae-29735400-pdqz9" podStartSLOduration=0.92119991 podStartE2EDuration="921.19991ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:00:00.91752177 +0000 UTC m=+2914.348331410" watchObservedRunningTime="2026-07-15 14:00:00.92119991 +0000 UTC m=+2914.352009484" Jul 15 14:00:00.947655 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:00.947599 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8c00d1-29735400-nd6mt" podStartSLOduration=0.947587408 podStartE2EDuration="947.587408ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:00:00.947121949 +0000 UTC m=+2914.377931523" watchObservedRunningTime="2026-07-15 14:00:00.947587408 +0000 UTC m=+2914.378396981" Jul 15 14:00:01.881955 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:01.881920 2554 generic.go:356] "Generic (PLEG): container finished" podID="d1500fbd-6026-46f7-929c-e84be919d3cd" containerID="94e44695a59919dc8271f925e9ef27a1a3ed5f2b1ca3264d9f85551d8d03cc8a" exitCode=0 Jul 15 14:00:01.882423 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:01.882011 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735400-nlxzw" event={"ID":"d1500fbd-6026-46f7-929c-e84be919d3cd","Type":"ContainerDied","Data":"94e44695a59919dc8271f925e9ef27a1a3ed5f2b1ca3264d9f85551d8d03cc8a"} Jul 15 14:00:01.883452 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:01.883428 2554 generic.go:356] "Generic (PLEG): container finished" podID="c0068f79-81f2-4834-973b-444d995252b7" containerID="1c78dc583e86070dcce9248c87427cc2a468eea18faf28eac31a2b83e4c26e66" exitCode=0 Jul 15 14:00:01.883546 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:01.883503 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8c00d1-29735400-nd6mt" event={"ID":"c0068f79-81f2-4834-973b-444d995252b7","Type":"ContainerDied","Data":"1c78dc583e86070dcce9248c87427cc2a468eea18faf28eac31a2b83e4c26e66"} Jul 15 14:00:01.884905 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:01.884885 2554 generic.go:356] "Generic (PLEG): container finished" podID="4bf9ecd7-487d-4074-873a-b466210493ce" containerID="3fb5e39ab6bc82f792db2ce58b834d9ce68cba45c4d76e5d09d559ce3b01b71b" exitCode=0 Jul 15 14:00:01.885023 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:01.884929 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7746ae-29735400-pdqz9" event={"ID":"4bf9ecd7-487d-4074-873a-b466210493ce","Type":"ContainerDied","Data":"3fb5e39ab6bc82f792db2ce58b834d9ce68cba45c4d76e5d09d559ce3b01b71b"} Jul 15 14:00:03.028499 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:03.028467 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8c00d1-29735400-nd6mt" Jul 15 14:00:03.081165 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:03.081138 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735400-nlxzw" Jul 15 14:00:03.084122 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:03.084101 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7746ae-29735400-pdqz9" Jul 15 14:00:03.896794 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:03.896767 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735400-nlxzw" Jul 15 14:00:03.897012 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:03.896767 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735400-nlxzw" event={"ID":"d1500fbd-6026-46f7-929c-e84be919d3cd","Type":"ContainerDied","Data":"8042c844e6eedec71d8d81e0246bab439352d3bbcc3429566d8e7abb076360b2"} Jul 15 14:00:03.897012 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:03.896903 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8042c844e6eedec71d8d81e0246bab439352d3bbcc3429566d8e7abb076360b2" Jul 15 14:00:03.898015 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:03.897996 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8c00d1-29735400-nd6mt" Jul 15 14:00:03.898134 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:03.898016 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8c00d1-29735400-nd6mt" event={"ID":"c0068f79-81f2-4834-973b-444d995252b7","Type":"ContainerDied","Data":"65a46f074dcbe7bd495b3c6014bd511c7cbb45ad11c5e8cd05db968962f526c3"} Jul 15 14:00:03.898134 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:03.898065 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65a46f074dcbe7bd495b3c6014bd511c7cbb45ad11c5e8cd05db968962f526c3" Jul 15 14:00:03.899454 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:03.899434 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7746ae-29735400-pdqz9" event={"ID":"4bf9ecd7-487d-4074-873a-b466210493ce","Type":"ContainerDied","Data":"757eac30bbbe3e7c38c52022a0a834680323f861c8e951ae816a30e2e8f191c7"} Jul 15 14:00:03.899571 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:03.899465 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="757eac30bbbe3e7c38c52022a0a834680323f861c8e951ae816a30e2e8f191c7" Jul 15 14:00:03.899571 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:03.899471 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7746ae-29735400-pdqz9" Jul 15 14:00:06.949378 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:06.949346 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 14:00:07.056347 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:07.056291 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 14:00:55.084419 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:55.084332 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 14:00:56.056919 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:00:56.056860 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 14:01:15.928959 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:15.928917 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8c00d1-mxnpd"] Jul 15 14:01:15.929574 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:15.929430 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1500fbd-6026-46f7-929c-e84be919d3cd" containerName="cleanup" Jul 15 14:01:15.929574 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:15.929450 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1500fbd-6026-46f7-929c-e84be919d3cd" containerName="cleanup" Jul 15 14:01:15.929574 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:15.929476 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bf9ecd7-487d-4074-873a-b466210493ce" containerName="cleanup" Jul 15 14:01:15.929574 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:15.929485 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bf9ecd7-487d-4074-873a-b466210493ce" containerName="cleanup" Jul 15 14:01:15.929574 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:15.929510 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0068f79-81f2-4834-973b-444d995252b7" containerName="cleanup" Jul 15 14:01:15.929574 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:15.929519 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0068f79-81f2-4834-973b-444d995252b7" containerName="cleanup" Jul 15 14:01:15.929872 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:15.929629 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bf9ecd7-487d-4074-873a-b466210493ce" containerName="cleanup" Jul 15 14:01:15.929872 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:15.929644 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1500fbd-6026-46f7-929c-e84be919d3cd" containerName="cleanup" Jul 15 14:01:15.929872 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:15.929656 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0068f79-81f2-4834-973b-444d995252b7" containerName="cleanup" Jul 15 14:01:15.933510 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:15.933484 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8c00d1-mxnpd" Jul 15 14:01:15.937103 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:15.937087 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpj2c\"" Jul 15 14:01:15.937350 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:15.937337 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 14:01:15.960604 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:15.960574 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8c00d1-mxnpd"] Jul 15 14:01:16.077241 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:16.077205 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa0283a8-af88-424d-962c-8e5af12aa68f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-8c00d1-mxnpd\" (UID: \"fa0283a8-af88-424d-962c-8e5af12aa68f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8c00d1-mxnpd" Jul 15 14:01:16.178186 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:16.178154 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa0283a8-af88-424d-962c-8e5af12aa68f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-8c00d1-mxnpd\" (UID: \"fa0283a8-af88-424d-962c-8e5af12aa68f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8c00d1-mxnpd" Jul 15 14:01:16.178759 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:16.178742 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa0283a8-af88-424d-962c-8e5af12aa68f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-8c00d1-mxnpd\" (UID: \"fa0283a8-af88-424d-962c-8e5af12aa68f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8c00d1-mxnpd" Jul 15 14:01:16.242971 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:16.242938 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8c00d1-mxnpd" Jul 15 14:01:16.378342 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:16.378314 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8c00d1-mxnpd"] Jul 15 14:01:16.378478 ip-10-0-132-114 kubenswrapper[2554]: W0715 14:01:16.378460 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa0283a8_af88_424d_962c_8e5af12aa68f.slice/crio-abeb16a1f7149fc1572b33493e6b4b95235ec85032219f5b546a98bde3c893e6 WatchSource:0}: Error finding container abeb16a1f7149fc1572b33493e6b4b95235ec85032219f5b546a98bde3c893e6: Status 404 returned error can't find the container with id abeb16a1f7149fc1572b33493e6b4b95235ec85032219f5b546a98bde3c893e6 Jul 15 14:01:16.566724 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:16.566639 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 14:01:16.666872 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:16.666830 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 14:01:17.271112 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:17.271079 2554 generic.go:356] "Generic (PLEG): container finished" podID="fa0283a8-af88-424d-962c-8e5af12aa68f" containerID="89dbbeb0eabcd516949fb9c387467783d63be03813f8bb1c146006f567ea4834" exitCode=0 Jul 15 14:01:17.271493 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:17.271140 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8c00d1-mxnpd" event={"ID":"fa0283a8-af88-424d-962c-8e5af12aa68f","Type":"ContainerDied","Data":"89dbbeb0eabcd516949fb9c387467783d63be03813f8bb1c146006f567ea4834"} Jul 15 14:01:17.271493 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:17.271184 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8c00d1-mxnpd" event={"ID":"fa0283a8-af88-424d-962c-8e5af12aa68f","Type":"ContainerStarted","Data":"abeb16a1f7149fc1572b33493e6b4b95235ec85032219f5b546a98bde3c893e6"} Jul 15 14:01:18.411113 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:18.411090 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8c00d1-mxnpd" Jul 15 14:01:18.497352 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:18.497321 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa0283a8-af88-424d-962c-8e5af12aa68f-maas-api-service-ca\") pod \"fa0283a8-af88-424d-962c-8e5af12aa68f\" (UID: \"fa0283a8-af88-424d-962c-8e5af12aa68f\") " Jul 15 14:01:18.497687 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:18.497666 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa0283a8-af88-424d-962c-8e5af12aa68f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fa0283a8-af88-424d-962c-8e5af12aa68f" (UID: "fa0283a8-af88-424d-962c-8e5af12aa68f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 14:01:18.598835 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:18.598751 2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa0283a8-af88-424d-962c-8e5af12aa68f-maas-api-service-ca\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 14:01:19.282627 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:19.282593 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8c00d1-mxnpd" event={"ID":"fa0283a8-af88-424d-962c-8e5af12aa68f","Type":"ContainerDied","Data":"abeb16a1f7149fc1572b33493e6b4b95235ec85032219f5b546a98bde3c893e6"} Jul 15 14:01:19.282627 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:19.282613 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8c00d1-mxnpd" Jul 15 14:01:19.282848 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:19.282641 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="abeb16a1f7149fc1572b33493e6b4b95235ec85032219f5b546a98bde3c893e6" Jul 15 14:01:26.726653 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:26.726618 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 14:01:26.740626 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:26.740602 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8c00d1-29735400-nd6mt"] Jul 15 14:01:26.746783 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:26.746763 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-8c00d1-29735400-nd6mt"] Jul 15 14:01:27.136826 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:27.136744 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0068f79-81f2-4834-973b-444d995252b7" path="/var/lib/kubelet/pods/c0068f79-81f2-4834-973b-444d995252b7/volumes" Jul 15 14:01:27.331641 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:27.331606 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lx562_83d9c378-e25b-487c-a9be-83e18e37d87f/ovn-acl-logging/0.log" Jul 15 14:01:27.333157 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:27.333125 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lx562_83d9c378-e25b-487c-a9be-83e18e37d87f/ovn-acl-logging/0.log" Jul 15 14:01:31.070629 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:31.070593 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 14:01:38.095360 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:38.095322 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 14:01:38.192580 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:38.192540 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 14:01:41.911858 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:41.911821 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 14:01:42.162621 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:42.162532 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 14:01:42.284159 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:42.284127 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7746ae-m9bm4"] Jul 15 14:01:42.284460 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:42.284448 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa0283a8-af88-424d-962c-8e5af12aa68f" containerName="revoke-keys" Jul 15 14:01:42.284506 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:42.284461 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa0283a8-af88-424d-962c-8e5af12aa68f" containerName="revoke-keys" Jul 15 14:01:42.284537 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:42.284529 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa0283a8-af88-424d-962c-8e5af12aa68f" containerName="revoke-keys" Jul 15 14:01:42.287351 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:42.287335 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7746ae-m9bm4" Jul 15 14:01:42.290726 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:42.290699 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 14:01:42.291321 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:42.291305 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpj2c\"" Jul 15 14:01:42.304680 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:42.304651 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7746ae-m9bm4"] Jul 15 14:01:42.394415 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:42.394381 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/745c32e6-1cb3-4959-b8d6-dfbdabe39e3f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-7746ae-m9bm4\" (UID: \"745c32e6-1cb3-4959-b8d6-dfbdabe39e3f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7746ae-m9bm4" Jul 15 14:01:42.495244 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:42.495205 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/745c32e6-1cb3-4959-b8d6-dfbdabe39e3f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-7746ae-m9bm4\" (UID: \"745c32e6-1cb3-4959-b8d6-dfbdabe39e3f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7746ae-m9bm4" Jul 15 14:01:42.495867 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:42.495849 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/745c32e6-1cb3-4959-b8d6-dfbdabe39e3f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-7746ae-m9bm4\" (UID: \"745c32e6-1cb3-4959-b8d6-dfbdabe39e3f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7746ae-m9bm4" Jul 15 14:01:42.597397 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:42.597363 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7746ae-m9bm4" Jul 15 14:01:42.755955 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:42.755900 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7746ae-m9bm4"] Jul 15 14:01:42.758197 ip-10-0-132-114 kubenswrapper[2554]: W0715 14:01:42.758168 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745c32e6_1cb3_4959_b8d6_dfbdabe39e3f.slice/crio-8e3e70485b572361ce380e9e4c55628eea08418d6339c15b112cf9f4e4bcec3b WatchSource:0}: Error finding container 8e3e70485b572361ce380e9e4c55628eea08418d6339c15b112cf9f4e4bcec3b: Status 404 returned error can't find the container with id 8e3e70485b572361ce380e9e4c55628eea08418d6339c15b112cf9f4e4bcec3b Jul 15 14:01:43.148790 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:43.148756 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 14:01:43.302170 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:43.302079 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 14:01:43.397923 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:43.397880 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7746ae-m9bm4" event={"ID":"745c32e6-1cb3-4959-b8d6-dfbdabe39e3f","Type":"ContainerStarted","Data":"85feb6acede8ad0aa17f3749b5b3c869b829dff1fa9a3ab1ecac88062c805cfa"} Jul 15 14:01:43.398110 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:43.397940 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7746ae-m9bm4" event={"ID":"745c32e6-1cb3-4959-b8d6-dfbdabe39e3f","Type":"ContainerStarted","Data":"8e3e70485b572361ce380e9e4c55628eea08418d6339c15b112cf9f4e4bcec3b"} Jul 15 14:01:43.425439 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:43.425396 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7746ae-m9bm4" podStartSLOduration=1.425380869 podStartE2EDuration="1.425380869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:01:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:01:43.424909566 +0000 UTC m=+3016.855719140" watchObservedRunningTime="2026-07-15 14:01:43.425380869 +0000 UTC m=+3016.856190443" Jul 15 14:01:44.403843 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:44.403804 2554 generic.go:356] "Generic (PLEG): container finished" podID="745c32e6-1cb3-4959-b8d6-dfbdabe39e3f" containerID="85feb6acede8ad0aa17f3749b5b3c869b829dff1fa9a3ab1ecac88062c805cfa" exitCode=0 Jul 15 14:01:44.404271 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:44.403848 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7746ae-m9bm4" event={"ID":"745c32e6-1cb3-4959-b8d6-dfbdabe39e3f","Type":"ContainerDied","Data":"85feb6acede8ad0aa17f3749b5b3c869b829dff1fa9a3ab1ecac88062c805cfa"} Jul 15 14:01:45.541868 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:45.541843 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7746ae-m9bm4" Jul 15 14:01:45.622630 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:45.622602 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/745c32e6-1cb3-4959-b8d6-dfbdabe39e3f-maas-api-service-ca\") pod \"745c32e6-1cb3-4959-b8d6-dfbdabe39e3f\" (UID: \"745c32e6-1cb3-4959-b8d6-dfbdabe39e3f\") " Jul 15 14:01:45.622959 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:45.622938 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/745c32e6-1cb3-4959-b8d6-dfbdabe39e3f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "745c32e6-1cb3-4959-b8d6-dfbdabe39e3f" (UID: "745c32e6-1cb3-4959-b8d6-dfbdabe39e3f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 14:01:45.724063 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:45.724033 2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/745c32e6-1cb3-4959-b8d6-dfbdabe39e3f-maas-api-service-ca\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 14:01:46.414313 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:46.414285 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7746ae-m9bm4" Jul 15 14:01:46.414488 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:46.414331 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7746ae-m9bm4" event={"ID":"745c32e6-1cb3-4959-b8d6-dfbdabe39e3f","Type":"ContainerDied","Data":"8e3e70485b572361ce380e9e4c55628eea08418d6339c15b112cf9f4e4bcec3b"} Jul 15 14:01:46.414488 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:46.414376 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8e3e70485b572361ce380e9e4c55628eea08418d6339c15b112cf9f4e4bcec3b" Jul 15 14:01:52.924271 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:52.924232 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7746ae-29735400-pdqz9"] Jul 15 14:01:52.926634 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:52.926608 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7746ae-29735400-pdqz9"] Jul 15 14:01:52.947698 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:52.947668 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 14:01:53.137577 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:53.137548 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bf9ecd7-487d-4074-873a-b466210493ce" path="/var/lib/kubelet/pods/4bf9ecd7-487d-4074-873a-b466210493ce/volumes" Jul 15 14:01:57.391586 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:01:57.391543 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 14:02:03.993966 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:03.993929 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 14:02:04.109288 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:04.109251 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 14:02:08.162773 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:08.162740 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd"] Jul 15 14:02:08.163242 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:08.163003 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" podUID="53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9" containerName="istio-proxy" containerID="cri-o://f0a8a4775064434965ad44b378d0c27bd4d81299126a48a6af279874def515d1" gracePeriod=30 Jul 15 14:02:08.194139 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:08.194103 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 14:02:08.479673 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:08.479644 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 14:02:13.409231 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.409204 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 14:02:13.544759 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.544725 2554 generic.go:356] "Generic (PLEG): container finished" podID="53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9" containerID="f0a8a4775064434965ad44b378d0c27bd4d81299126a48a6af279874def515d1" exitCode=0 Jul 15 14:02:13.544953 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.544774 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" Jul 15 14:02:13.544953 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.544802 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" event={"ID":"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9","Type":"ContainerDied","Data":"f0a8a4775064434965ad44b378d0c27bd4d81299126a48a6af279874def515d1"} Jul 15 14:02:13.544953 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.544856 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd" event={"ID":"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9","Type":"ContainerDied","Data":"e63cce3b4bdfc1cdf9089c1a2e6fb6ba9b8b6074c66197428960b6e3862a8eac"} Jul 15 14:02:13.544953 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.544880 2554 scope.go:117] "RemoveContainer" containerID="f0a8a4775064434965ad44b378d0c27bd4d81299126a48a6af279874def515d1" Jul 15 14:02:13.554321 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.554303 2554 scope.go:117] "RemoveContainer" containerID="408fa8ff0fee75c1678dc1d6a75322f5cd8aa169974c2a5ab90eadfd3c59b3cd" Jul 15 14:02:13.561950 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.561932 2554 scope.go:117] "RemoveContainer" containerID="f0a8a4775064434965ad44b378d0c27bd4d81299126a48a6af279874def515d1" Jul 15 14:02:13.562224 ip-10-0-132-114 kubenswrapper[2554]: E0715 14:02:13.562207 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0a8a4775064434965ad44b378d0c27bd4d81299126a48a6af279874def515d1\": container with ID starting with f0a8a4775064434965ad44b378d0c27bd4d81299126a48a6af279874def515d1 not found: ID does not exist" containerID="f0a8a4775064434965ad44b378d0c27bd4d81299126a48a6af279874def515d1" Jul 15 14:02:13.562280 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.562235 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0a8a4775064434965ad44b378d0c27bd4d81299126a48a6af279874def515d1"} err="failed to get container status \"f0a8a4775064434965ad44b378d0c27bd4d81299126a48a6af279874def515d1\": rpc error: code = NotFound desc = could not find container \"f0a8a4775064434965ad44b378d0c27bd4d81299126a48a6af279874def515d1\": container with ID starting with f0a8a4775064434965ad44b378d0c27bd4d81299126a48a6af279874def515d1 not found: ID does not exist" Jul 15 14:02:13.562280 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.562252 2554 scope.go:117] "RemoveContainer" containerID="408fa8ff0fee75c1678dc1d6a75322f5cd8aa169974c2a5ab90eadfd3c59b3cd" Jul 15 14:02:13.562505 ip-10-0-132-114 kubenswrapper[2554]: E0715 14:02:13.562487 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"408fa8ff0fee75c1678dc1d6a75322f5cd8aa169974c2a5ab90eadfd3c59b3cd\": container with ID starting with 408fa8ff0fee75c1678dc1d6a75322f5cd8aa169974c2a5ab90eadfd3c59b3cd not found: ID does not exist" containerID="408fa8ff0fee75c1678dc1d6a75322f5cd8aa169974c2a5ab90eadfd3c59b3cd" Jul 15 14:02:13.562555 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.562514 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"408fa8ff0fee75c1678dc1d6a75322f5cd8aa169974c2a5ab90eadfd3c59b3cd"} err="failed to get container status \"408fa8ff0fee75c1678dc1d6a75322f5cd8aa169974c2a5ab90eadfd3c59b3cd\": rpc error: code = NotFound desc = could not find container \"408fa8ff0fee75c1678dc1d6a75322f5cd8aa169974c2a5ab90eadfd3c59b3cd\": container with ID starting with 408fa8ff0fee75c1678dc1d6a75322f5cd8aa169974c2a5ab90eadfd3c59b3cd not found: ID does not exist" Jul 15 14:02:13.568802 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.568784 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-istio-data\") pod \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " Jul 15 14:02:13.568877 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.568841 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qg4k5\" (UniqueName: \"kubernetes.io/projected/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-kube-api-access-qg4k5\") pod \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " Jul 15 14:02:13.568877 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.568863 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-istio-podinfo\") pod \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " Jul 15 14:02:13.568947 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.568880 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-workload-socket\") pod \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " Jul 15 14:02:13.568947 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.568899 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-istiod-ca-cert\") pod \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " Jul 15 14:02:13.568947 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.568936 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-workload-certs\") pod \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " Jul 15 14:02:13.569107 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.568970 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-credential-socket\") pod \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " Jul 15 14:02:13.569107 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.569054 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-istio-token\") pod \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " Jul 15 14:02:13.569107 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.569078 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-istio-envoy\") pod \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\" (UID: \"53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9\") " Jul 15 14:02:13.569271 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.569247 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9" (UID: "53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:02:13.569331 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.569266 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9" (UID: "53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:02:13.569451 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.569387 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-workload-socket\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 14:02:13.569451 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.569411 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-workload-certs\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 14:02:13.569555 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.569456 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9" (UID: "53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:02:13.569555 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.569465 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9" (UID: "53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 14:02:13.569706 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.569682 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-istio-data" (OuterVolumeSpecName: "istio-data") pod "53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9" (UID: "53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:02:13.571150 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.571121 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9" (UID: "53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 14:02:13.571249 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.571203 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-kube-api-access-qg4k5" (OuterVolumeSpecName: "kube-api-access-qg4k5") pod "53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9" (UID: "53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9"). InnerVolumeSpecName "kube-api-access-qg4k5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 14:02:13.571249 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.571237 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-istio-token" (OuterVolumeSpecName: "istio-token") pod "53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9" (UID: "53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 14:02:13.571329 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.571278 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9" (UID: "53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 14:02:13.670265 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.670221 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-credential-socket\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 14:02:13.670265 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.670259 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-istio-token\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 14:02:13.670265 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.670269 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-istio-envoy\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 14:02:13.670265 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.670277 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-istio-data\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 14:02:13.670536 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.670285 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qg4k5\" (UniqueName: \"kubernetes.io/projected/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-kube-api-access-qg4k5\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 14:02:13.670536 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.670295 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-istio-podinfo\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 14:02:13.670536 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.670303 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9-istiod-ca-cert\") on node \"ip-10-0-132-114.ec2.internal\" DevicePath \"\"" Jul 15 14:02:13.872355 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.872328 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd"] Jul 15 14:02:13.876114 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:13.876092 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-7746ae-openshift-default-7c856748dc-h8csd"] Jul 15 14:02:14.895292 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:14.895267 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f7f774c7f-lchnm_d0fe6f17-60ec-4264-a076-55c11c249abb/copy-manifests/0.log" Jul 15 14:02:14.904093 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:14.904072 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f7f774c7f-lchnm_d0fe6f17-60ec-4264-a076-55c11c249abb/manager/0.log" Jul 15 14:02:15.138109 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:15.138073 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9" path="/var/lib/kubelet/pods/53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9/volumes" Jul 15 14:02:15.396928 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:15.396901 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735370-2jlk6_69a53a95-d5f7-48f7-8558-2259fd301a00/cleanup/0.log" Jul 15 14:02:15.639213 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:15.639183 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735400-nlxzw_d1500fbd-6026-46f7-929c-e84be919d3cd/cleanup/0.log" Jul 15 14:02:15.750059 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:15.750031 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-e43089af-kgdqs_c92164ff-5652-4179-a605-a142f11bf3b1/revoke-keys/1.log" Jul 15 14:02:16.212291 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:16.212206 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-9e5a80bf-2s7kg_b758f92f-5d5d-42e5-8dd7-3c5b1005ad04/revoke-keys/0.log" Jul 15 14:02:16.554599 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:16.554568 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-17469591-ccpmm_da2db899-4866-4ba9-8f7e-0cd7e826a696/revoke-keys/0.log" Jul 15 14:02:16.664911 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:16.664881 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-954f0f75-qk45l_0402e829-337f-4c57-b6ba-d3f96d80f902/revoke-keys/0.log" Jul 15 14:02:16.780091 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:16.780063 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-a566516a-pqm59_dcc1c6ff-f746-47aa-bd42-e7cf2cfb6c41/revoke-keys/0.log" Jul 15 14:02:16.891722 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:16.891632 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-8c00d1-mxnpd_fa0283a8-af88-424d-962c-8e5af12aa68f/revoke-keys/0.log" Jul 15 14:02:17.007792 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:17.007759 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-7746ae-m9bm4_745c32e6-1cb3-4959-b8d6-dfbdabe39e3f/revoke-keys/0.log" Jul 15 14:02:17.484732 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:17.484693 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 14:02:19.279234 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:19.279144 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-lqf79_1181339f-5146-4679-90c1-513965d49663/manager/0.log" Jul 15 14:02:19.794559 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:19.794528 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-gtbf9_7c3588d3-d065-4ce1-8587-5c5dffc80b27/discovery/0.log" Jul 15 14:02:20.143425 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:20.143341 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-mzcfm_745be18d-f7b2-44a0-ba7c-33480476a1b3/istio-proxy/1.log" Jul 15 14:02:20.995380 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:20.995350 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-8xn2p_fd276172-36a3-4248-8b26-4dcdc0bfde1b/main/0.log" Jul 15 14:02:25.858138 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:25.858095 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 14:02:25.958087 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:25.958053 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" limit=1024 Jul 15 14:02:29.137689 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:29.137660 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-54nsh_e0fd7f31-732f-4343-8f65-5a00324803b4/global-pull-secret-syncer/0.log" Jul 15 14:02:29.312129 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:29.312097 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kw8vb_30096cef-02bd-4d94-912b-2dfbab854767/konnectivity-agent/0.log" Jul 15 14:02:29.544296 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:29.544266 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-114.ec2.internal_0f46c7284547ca7be8cc41585e55dbc6/haproxy/0.log" Jul 15 14:02:35.411257 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:35.411221 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-lqf79_1181339f-5146-4679-90c1-513965d49663/manager/0.log" Jul 15 14:02:37.089583 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:37.089511 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2d18bf33-382d-478f-99db-1536bbcddd41/alertmanager/0.log" Jul 15 14:02:37.116454 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:37.116427 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2d18bf33-382d-478f-99db-1536bbcddd41/config-reloader/0.log" Jul 15 14:02:37.145270 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:37.145248 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2d18bf33-382d-478f-99db-1536bbcddd41/kube-rbac-proxy-web/0.log" Jul 15 14:02:37.173242 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:37.173217 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2d18bf33-382d-478f-99db-1536bbcddd41/kube-rbac-proxy/0.log" Jul 15 14:02:37.205562 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:37.205532 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2d18bf33-382d-478f-99db-1536bbcddd41/kube-rbac-proxy-metric/0.log" Jul 15 14:02:37.240864 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:37.240839 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2d18bf33-382d-478f-99db-1536bbcddd41/prom-label-proxy/0.log" Jul 15 14:02:37.275261 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:37.275218 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2d18bf33-382d-478f-99db-1536bbcddd41/init-config-reloader/0.log" Jul 15 14:02:37.549963 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:37.549933 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-29jdr_ddfd6211-3fee-4119-b77c-fa00d373f4a7/node-exporter/0.log" Jul 15 14:02:37.577940 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:37.577918 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-29jdr_ddfd6211-3fee-4119-b77c-fa00d373f4a7/kube-rbac-proxy/0.log" Jul 15 14:02:37.603706 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:37.603681 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-29jdr_ddfd6211-3fee-4119-b77c-fa00d373f4a7/init-textfile/0.log" Jul 15 14:02:37.808867 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:37.808769 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-drnjr_cf8d5cfd-89ac-4c66-a9cc-d11c50406c27/kube-rbac-proxy-main/0.log" Jul 15 14:02:37.834657 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:37.834634 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-drnjr_cf8d5cfd-89ac-4c66-a9cc-d11c50406c27/kube-rbac-proxy-self/0.log" Jul 15 14:02:37.860938 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:37.860916 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-drnjr_cf8d5cfd-89ac-4c66-a9cc-d11c50406c27/openshift-state-metrics/0.log" Jul 15 14:02:37.898675 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:37.898650 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_33386959-b02a-4445-a367-a1b3a5ac2509/prometheus/0.log" Jul 15 14:02:37.926011 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:37.925972 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_33386959-b02a-4445-a367-a1b3a5ac2509/config-reloader/0.log" Jul 15 14:02:37.958236 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:37.958212 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_33386959-b02a-4445-a367-a1b3a5ac2509/thanos-sidecar/0.log" Jul 15 14:02:37.995461 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:37.995439 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_33386959-b02a-4445-a367-a1b3a5ac2509/kube-rbac-proxy-web/0.log" Jul 15 14:02:38.022615 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:38.022589 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_33386959-b02a-4445-a367-a1b3a5ac2509/kube-rbac-proxy/0.log" Jul 15 14:02:38.054017 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:38.053972 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_33386959-b02a-4445-a367-a1b3a5ac2509/kube-rbac-proxy-thanos/0.log" Jul 15 14:02:38.107646 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:38.107553 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_33386959-b02a-4445-a367-a1b3a5ac2509/init-config-reloader/0.log" Jul 15 14:02:38.203872 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:38.203848 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-hl9ds_a478f11b-c1e5-4b03-b02a-b02a0b266f4a/prometheus-operator-admission-webhook/0.log" Jul 15 14:02:39.553404 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:39.553371 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mvswn/perf-node-gather-daemonset-q6qgm"] Jul 15 14:02:39.553800 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:39.553705 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="745c32e6-1cb3-4959-b8d6-dfbdabe39e3f" containerName="revoke-keys" Jul 15 14:02:39.553800 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:39.553717 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="745c32e6-1cb3-4959-b8d6-dfbdabe39e3f" containerName="revoke-keys" Jul 15 14:02:39.553800 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:39.553727 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9" containerName="istio-proxy" Jul 15 14:02:39.553800 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:39.553737 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9" containerName="istio-proxy" Jul 15 14:02:39.553800 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:39.553795 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="745c32e6-1cb3-4959-b8d6-dfbdabe39e3f" containerName="revoke-keys" Jul 15 14:02:39.553961 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:39.553805 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9" containerName="istio-proxy" Jul 15 14:02:39.553961 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:39.553811 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="53835d9e-7b4a-4a17-bd8c-1f8fcdaed4f9" containerName="istio-proxy" Jul 15 14:02:39.556730 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:39.556711 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-q6qgm" Jul 15 14:02:39.559839 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:39.559818 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mvswn\"/\"openshift-service-ca.crt\"" Jul 15 14:02:39.561198 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:39.561180 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mvswn\"/\"kube-root-ca.crt\"" Jul 15 14:02:39.561316 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:39.561183 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mvswn\"/\"default-dockercfg-9z4gh\"" Jul 15 14:02:39.566405 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:39.566386 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mvswn/perf-node-gather-daemonset-q6qgm"] Jul 15 14:02:39.590174 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:39.590152 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/338631d2-50db-4c9d-a01a-0c56ba1b31ef-podres\") pod \"perf-node-gather-daemonset-q6qgm\" (UID: \"338631d2-50db-4c9d-a01a-0c56ba1b31ef\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-q6qgm" Jul 15 14:02:39.590289 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:39.590185 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/338631d2-50db-4c9d-a01a-0c56ba1b31ef-proc\") pod \"perf-node-gather-daemonset-q6qgm\" (UID: \"338631d2-50db-4c9d-a01a-0c56ba1b31ef\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-q6qgm" Jul 15 14:02:39.590289 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:39.590215 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6l5v\" (UniqueName: \"kubernetes.io/projected/338631d2-50db-4c9d-a01a-0c56ba1b31ef-kube-api-access-l6l5v\") pod \"perf-node-gather-daemonset-q6qgm\" (UID: \"338631d2-50db-4c9d-a01a-0c56ba1b31ef\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-q6qgm" Jul 15 14:02:39.590366 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:39.590347 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/338631d2-50db-4c9d-a01a-0c56ba1b31ef-lib-modules\") pod \"perf-node-gather-daemonset-q6qgm\" (UID: \"338631d2-50db-4c9d-a01a-0c56ba1b31ef\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-q6qgm" Jul 15 14:02:39.590404 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:39.590375 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/338631d2-50db-4c9d-a01a-0c56ba1b31ef-sys\") pod \"perf-node-gather-daemonset-q6qgm\" (UID: \"338631d2-50db-4c9d-a01a-0c56ba1b31ef\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-q6qgm" Jul 15 14:02:39.691714 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:39.691684 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/338631d2-50db-4c9d-a01a-0c56ba1b31ef-lib-modules\") pod \"perf-node-gather-daemonset-q6qgm\" (UID: \"338631d2-50db-4c9d-a01a-0c56ba1b31ef\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-q6qgm" Jul 15 14:02:39.691872 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:39.691727 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/338631d2-50db-4c9d-a01a-0c56ba1b31ef-sys\") pod \"perf-node-gather-daemonset-q6qgm\" (UID: \"338631d2-50db-4c9d-a01a-0c56ba1b31ef\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-q6qgm" Jul 15 14:02:39.691872 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:39.691760 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/338631d2-50db-4c9d-a01a-0c56ba1b31ef-podres\") pod \"perf-node-gather-daemonset-q6qgm\" (UID: \"338631d2-50db-4c9d-a01a-0c56ba1b31ef\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-q6qgm" Jul 15 14:02:39.691872 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:39.691781 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/338631d2-50db-4c9d-a01a-0c56ba1b31ef-proc\") pod \"perf-node-gather-daemonset-q6qgm\" (UID: \"338631d2-50db-4c9d-a01a-0c56ba1b31ef\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-q6qgm" Jul 15 14:02:39.691872 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:39.691815 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6l5v\" (UniqueName: \"kubernetes.io/projected/338631d2-50db-4c9d-a01a-0c56ba1b31ef-kube-api-access-l6l5v\") pod \"perf-node-gather-daemonset-q6qgm\" (UID: \"338631d2-50db-4c9d-a01a-0c56ba1b31ef\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-q6qgm" Jul 15 14:02:39.692107 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:39.691885 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/338631d2-50db-4c9d-a01a-0c56ba1b31ef-lib-modules\") pod \"perf-node-gather-daemonset-q6qgm\" (UID: \"338631d2-50db-4c9d-a01a-0c56ba1b31ef\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-q6qgm" Jul 15 14:02:39.692107 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:39.691904 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/338631d2-50db-4c9d-a01a-0c56ba1b31ef-podres\") pod \"perf-node-gather-daemonset-q6qgm\" (UID: \"338631d2-50db-4c9d-a01a-0c56ba1b31ef\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-q6qgm" Jul 15 14:02:39.692107 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:39.691891 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/338631d2-50db-4c9d-a01a-0c56ba1b31ef-proc\") pod \"perf-node-gather-daemonset-q6qgm\" (UID: \"338631d2-50db-4c9d-a01a-0c56ba1b31ef\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-q6qgm" Jul 15 14:02:39.692107 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:39.691894 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/338631d2-50db-4c9d-a01a-0c56ba1b31ef-sys\") pod \"perf-node-gather-daemonset-q6qgm\" (UID: \"338631d2-50db-4c9d-a01a-0c56ba1b31ef\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-q6qgm" Jul 15 14:02:39.700617 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:39.700594 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6l5v\" (UniqueName: \"kubernetes.io/projected/338631d2-50db-4c9d-a01a-0c56ba1b31ef-kube-api-access-l6l5v\") pod \"perf-node-gather-daemonset-q6qgm\" (UID: \"338631d2-50db-4c9d-a01a-0c56ba1b31ef\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-q6qgm" Jul 15 14:02:39.867251 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:39.867156 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-q6qgm" Jul 15 14:02:39.994243 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:39.994215 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mvswn/perf-node-gather-daemonset-q6qgm"] Jul 15 14:02:39.996103 ip-10-0-132-114 kubenswrapper[2554]: W0715 14:02:39.996077 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod338631d2_50db_4c9d_a01a_0c56ba1b31ef.slice/crio-5f8c7c4617d56da9c1040daae7de1d62bf9776f9315bf9c12054f90a00503c55 WatchSource:0}: Error finding container 5f8c7c4617d56da9c1040daae7de1d62bf9776f9315bf9c12054f90a00503c55: Status 404 returned error can't find the container with id 5f8c7c4617d56da9c1040daae7de1d62bf9776f9315bf9c12054f90a00503c55 Jul 15 14:02:40.687690 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:40.687648 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-q6qgm" event={"ID":"338631d2-50db-4c9d-a01a-0c56ba1b31ef","Type":"ContainerStarted","Data":"baca62980ea1f45c767930fa74c5e96e7300812634c3360050ed269adf3a79bd"} Jul 15 14:02:40.688098 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:40.687698 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-q6qgm" event={"ID":"338631d2-50db-4c9d-a01a-0c56ba1b31ef","Type":"ContainerStarted","Data":"5f8c7c4617d56da9c1040daae7de1d62bf9776f9315bf9c12054f90a00503c55"} Jul 15 14:02:40.688098 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:40.687786 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-q6qgm" Jul 15 14:02:40.708844 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:40.708796 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-q6qgm" podStartSLOduration=1.708783591 podStartE2EDuration="1.708783591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:02:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:02:40.706519117 +0000 UTC m=+3074.137328690" watchObservedRunningTime="2026-07-15 14:02:40.708783591 +0000 UTC m=+3074.139593165" Jul 15 14:02:41.015967 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:41.015940 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-945tm_dbe3a9c0-b369-4faf-8629-062dd853c5d8/download-server/0.log" Jul 15 14:02:43.055350 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:43.055316 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f8z4j_d396aec3-e269-4e9e-8908-ef9b3712ac76/dns/0.log" Jul 15 14:02:43.086461 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:43.086433 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f8z4j_d396aec3-e269-4e9e-8908-ef9b3712ac76/kube-rbac-proxy/0.log" Jul 15 14:02:43.212740 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:43.212714 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5qwqm_871fcafa-ef85-4040-bd74-5756c6ff4c0a/dns-node-resolver/0.log" Jul 15 14:02:43.883093 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:43.883068 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j4ktm_d60f6645-bdeb-4b1f-9580-44b9ee9d0baf/node-ca/0.log" Jul 15 14:02:45.142024 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:45.141995 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-gtbf9_7c3588d3-d065-4ce1-8587-5c5dffc80b27/discovery/0.log" Jul 15 14:02:45.245839 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:45.245803 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-mzcfm_745be18d-f7b2-44a0-ba7c-33480476a1b3/istio-proxy/0.log" Jul 15 14:02:45.305635 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:45.305610 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-mzcfm_745be18d-f7b2-44a0-ba7c-33480476a1b3/istio-proxy/1.log" Jul 15 14:02:46.157208 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:46.157174 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6bd2c_369753f1-3b74-4d68-9d71-8805808340f0/serve-healthcheck-canary/0.log" Jul 15 14:02:46.701169 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:46.701131 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-q6qgm" Jul 15 14:02:47.246786 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:47.246752 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nsptb_cff04da2-b78c-4cb1-a533-25927065561a/kube-rbac-proxy/0.log" Jul 15 14:02:47.292240 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:47.292208 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nsptb_cff04da2-b78c-4cb1-a533-25927065561a/exporter/0.log" Jul 15 14:02:47.339163 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:47.339135 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nsptb_cff04da2-b78c-4cb1-a533-25927065561a/extractor/0.log" Jul 15 14:02:50.677737 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:50.677699 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-gtbf9_7c3588d3-d065-4ce1-8587-5c5dffc80b27/discovery/0.log" Jul 15 14:02:50.763513 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:50.763477 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-mzcfm_745be18d-f7b2-44a0-ba7c-33480476a1b3/istio-proxy/0.log" Jul 15 14:02:50.818271 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:50.818239 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-mzcfm_745be18d-f7b2-44a0-ba7c-33480476a1b3/istio-proxy/1.log" Jul 15 14:02:50.838350 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:50.838319 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f7f774c7f-lchnm_d0fe6f17-60ec-4264-a076-55c11c249abb/manager/0.log" Jul 15 14:02:50.870273 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:50.870243 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f7f774c7f-lchnm_d0fe6f17-60ec-4264-a076-55c11c249abb/copy-manifests/0.log" Jul 15 14:02:52.228919 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:52.228889 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7557b79948-trqwv_19d7d639-26e6-480f-bd0e-c0ca3721f792/manager/0.log" Jul 15 14:02:52.540131 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:52.540037 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-gtbf9_7c3588d3-d065-4ce1-8587-5c5dffc80b27/discovery/0.log" Jul 15 14:02:52.592767 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:52.592735 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-mzcfm_745be18d-f7b2-44a0-ba7c-33480476a1b3/istio-proxy/0.log" Jul 15 14:02:52.651824 ip-10-0-132-114 kubenswrapper[2554]: I0715 14:02:52.651786 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-mzcfm_745be18d-f7b2-44a0-ba7c-33480476a1b3/istio-proxy/1.log"