Jul 07 12:48:11.149807 ip-10-0-136-245 systemd[1]: Starting Kubernetes Kubelet... Jul 07 12:48:11.601742 ip-10-0-136-245 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 12:48:11.601742 ip-10-0-136-245 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 12:48:11.601742 ip-10-0-136-245 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 12:48:11.601742 ip-10-0-136-245 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 12:48:11.601742 ip-10-0-136-245 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 12:48:11.601742 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.592982 2555 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 12:48:11.601742 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600235 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 12:48:11.601742 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600250 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 12:48:11.601742 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600254 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 12:48:11.601742 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600258 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 12:48:11.601742 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600261 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 12:48:11.601742 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600264 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 12:48:11.601742 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600266 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 12:48:11.610509 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600269 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 12:48:11.610509 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600272 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 12:48:11.610509 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600274 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 12:48:11.610509 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600277 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 12:48:11.610509 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600279 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 12:48:11.610509 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600282 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 12:48:11.610509 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600284 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 12:48:11.610509 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600287 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 12:48:11.610509 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600289 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 12:48:11.610509 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600292 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 12:48:11.610509 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600294 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 12:48:11.610509 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600296 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 12:48:11.610509 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600299 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 12:48:11.610509 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600302 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 12:48:11.610509 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600305 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 12:48:11.610509 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600308 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 12:48:11.610509 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600310 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 12:48:11.610509 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600313 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 12:48:11.610509 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600315 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 12:48:11.610509 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600318 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 12:48:11.610509 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600321 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 07 12:48:11.614530 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600324 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 12:48:11.614530 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600326 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 12:48:11.614530 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600330 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 12:48:11.614530 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600332 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 12:48:11.614530 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600335 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 12:48:11.614530 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600337 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 12:48:11.614530 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600341 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 12:48:11.614530 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600344 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 12:48:11.614530 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600347 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 12:48:11.614530 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600349 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 12:48:11.614530 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600352 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 12:48:11.614530 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600354 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 12:48:11.614530 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600357 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 12:48:11.614530 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600359 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 12:48:11.614530 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600362 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 12:48:11.614530 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600365 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 12:48:11.614530 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600367 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 12:48:11.614530 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600370 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 12:48:11.614530 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600372 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 12:48:11.620119 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600376 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 12:48:11.620119 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600378 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 12:48:11.620119 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600381 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 12:48:11.620119 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600389 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 12:48:11.620119 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600392 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 12:48:11.620119 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600394 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 12:48:11.620119 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600397 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 12:48:11.620119 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600399 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 12:48:11.620119 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600402 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 12:48:11.620119 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600404 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 12:48:11.620119 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600406 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 12:48:11.620119 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600409 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 12:48:11.620119 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600411 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 12:48:11.620119 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600416 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 12:48:11.620119 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600437 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 12:48:11.620119 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600442 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 12:48:11.620119 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600446 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 12:48:11.620119 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600449 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 12:48:11.620119 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600452 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 12:48:11.636564 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600455 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 12:48:11.636564 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600458 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 12:48:11.636564 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600461 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 12:48:11.636564 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600464 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 12:48:11.636564 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600467 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 12:48:11.636564 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600469 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 12:48:11.636564 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600472 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 12:48:11.636564 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600475 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 12:48:11.636564 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600477 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 12:48:11.636564 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600480 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 12:48:11.636564 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600483 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 12:48:11.636564 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600485 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 12:48:11.636564 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600487 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 12:48:11.636564 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600490 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 12:48:11.636564 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600494 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 12:48:11.636564 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600496 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 12:48:11.636564 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600499 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 12:48:11.636564 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600505 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 12:48:11.636564 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600508 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 12:48:11.636564 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600511 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 12:48:11.647287 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600514 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 12:48:11.647287 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600516 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 12:48:11.647287 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600519 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 12:48:11.647287 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600522 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 12:48:11.647287 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600524 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 12:48:11.647287 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600527 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 12:48:11.647287 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600529 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 12:48:11.647287 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600532 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 12:48:11.647287 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600534 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 12:48:11.647287 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600537 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 12:48:11.647287 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600539 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 12:48:11.647287 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600542 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 12:48:11.647287 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.600544 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 12:48:11.647287 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601232 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 12:48:11.647287 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601239 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 12:48:11.647287 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601242 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 12:48:11.647287 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601245 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 12:48:11.647287 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601248 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 12:48:11.647287 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601250 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 12:48:11.647287 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601253 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 12:48:11.652116 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601256 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 12:48:11.652116 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601258 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 12:48:11.652116 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601261 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 12:48:11.652116 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601264 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 12:48:11.652116 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601267 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 12:48:11.652116 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601270 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 12:48:11.652116 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601273 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 12:48:11.652116 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601275 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 12:48:11.652116 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601278 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 12:48:11.652116 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601281 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 12:48:11.652116 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601285 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 12:48:11.652116 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601287 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 12:48:11.652116 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601290 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 12:48:11.652116 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601292 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 12:48:11.652116 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601295 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 12:48:11.652116 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601297 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 12:48:11.652116 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601300 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 12:48:11.652116 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601302 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 12:48:11.652116 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601305 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 12:48:11.652116 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601307 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 12:48:11.664174 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601310 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 12:48:11.664174 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601312 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 12:48:11.664174 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601314 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 12:48:11.664174 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601317 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 12:48:11.664174 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601319 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 12:48:11.664174 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601324 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 12:48:11.664174 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601328 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 12:48:11.664174 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601331 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 12:48:11.664174 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601334 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 12:48:11.664174 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601337 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 12:48:11.664174 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601340 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 12:48:11.664174 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601343 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 12:48:11.664174 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601346 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 12:48:11.664174 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601349 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 12:48:11.664174 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601351 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 12:48:11.664174 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601354 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 12:48:11.664174 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601356 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 12:48:11.664174 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601359 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 12:48:11.664174 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601361 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 12:48:11.667759 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601364 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 12:48:11.667759 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601367 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 12:48:11.667759 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601370 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 12:48:11.667759 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601373 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 12:48:11.667759 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601378 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 12:48:11.667759 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601380 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 12:48:11.667759 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601383 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 12:48:11.667759 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601385 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 12:48:11.667759 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601388 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 12:48:11.667759 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601390 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 12:48:11.667759 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601393 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 12:48:11.667759 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601396 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 12:48:11.667759 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601398 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 12:48:11.667759 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601401 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 12:48:11.667759 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601404 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 12:48:11.667759 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601406 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 12:48:11.667759 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601409 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 12:48:11.667759 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601411 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 12:48:11.667759 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601414 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 12:48:11.667759 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601416 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 12:48:11.682013 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601432 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 12:48:11.682013 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601437 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 12:48:11.682013 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601441 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 12:48:11.682013 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601444 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 12:48:11.682013 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601446 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 12:48:11.682013 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601449 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 12:48:11.682013 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601453 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 12:48:11.682013 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601455 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 12:48:11.682013 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601458 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 12:48:11.682013 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601460 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 12:48:11.682013 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601463 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 12:48:11.682013 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601465 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 12:48:11.682013 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601468 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 12:48:11.682013 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601471 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 12:48:11.682013 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601473 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 07 12:48:11.682013 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601476 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 12:48:11.682013 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601479 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 12:48:11.682013 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601482 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 12:48:11.682013 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601485 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 12:48:11.677059 ip-10-0-136-245 systemd[1]: Started Kubernetes Kubelet. Jul 07 12:48:11.687666 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601487 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 12:48:11.687666 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601490 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 12:48:11.687666 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601492 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 12:48:11.687666 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601496 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 12:48:11.687666 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601500 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 12:48:11.687666 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601502 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 12:48:11.687666 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601505 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 12:48:11.687666 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601508 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 12:48:11.687666 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601510 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 12:48:11.687666 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601513 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 12:48:11.687666 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601515 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 12:48:11.687666 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601518 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 12:48:11.687666 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601520 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 12:48:11.687666 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601523 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 12:48:11.687666 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601913 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 12:48:11.687666 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601918 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 12:48:11.687666 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601921 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 12:48:11.687666 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601923 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 12:48:11.687666 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601926 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 12:48:11.687666 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601929 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 12:48:11.712151 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601932 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 12:48:11.712151 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601934 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 12:48:11.712151 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601937 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 12:48:11.712151 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601939 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 12:48:11.712151 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601942 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 12:48:11.712151 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601945 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 12:48:11.712151 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601947 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 12:48:11.712151 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601949 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 12:48:11.712151 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601952 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 12:48:11.712151 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601956 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 12:48:11.712151 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601959 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 12:48:11.712151 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601962 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 12:48:11.712151 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601964 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 12:48:11.712151 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601967 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 12:48:11.712151 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601969 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 12:48:11.712151 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601972 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 12:48:11.712151 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601974 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 12:48:11.712151 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601977 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 12:48:11.712151 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601979 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 12:48:11.712151 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601982 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 12:48:11.716706 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601984 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 12:48:11.716706 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601987 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 12:48:11.716706 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601989 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 12:48:11.716706 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601992 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 12:48:11.716706 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601994 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 12:48:11.716706 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.601997 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 12:48:11.716706 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602001 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 12:48:11.716706 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602004 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 07 12:48:11.716706 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602006 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 12:48:11.716706 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602009 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 12:48:11.716706 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602011 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 12:48:11.716706 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602014 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 12:48:11.716706 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602016 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 12:48:11.716706 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602019 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 12:48:11.716706 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602022 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 12:48:11.716706 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602024 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 12:48:11.716706 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602027 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 12:48:11.716706 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602029 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 12:48:11.716706 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602031 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 12:48:11.716706 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602034 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 12:48:11.874714 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602036 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 12:48:11.874714 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602040 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 12:48:11.874714 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602042 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 12:48:11.874714 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602046 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 12:48:11.874714 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602048 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 12:48:11.874714 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602051 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 12:48:11.874714 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602053 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 12:48:11.874714 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602056 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 12:48:11.874714 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602058 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 12:48:11.874714 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602061 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 12:48:11.874714 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602063 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 12:48:11.874714 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602065 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 12:48:11.874714 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602068 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 12:48:11.874714 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602070 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 12:48:11.874714 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602073 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 12:48:11.874714 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602075 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 12:48:11.874714 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602077 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 12:48:11.874714 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602080 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 12:48:11.874714 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602084 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 12:48:11.874714 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602086 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 12:48:11.889605 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602089 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 12:48:11.889605 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602091 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 12:48:11.889605 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602095 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 12:48:11.889605 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602098 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 12:48:11.889605 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602101 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 12:48:11.889605 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602104 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 12:48:11.889605 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602106 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 12:48:11.889605 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602110 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 12:48:11.889605 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602113 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 12:48:11.889605 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602118 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 12:48:11.889605 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602120 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 12:48:11.889605 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602123 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 12:48:11.889605 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602126 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 12:48:11.889605 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602130 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 12:48:11.889605 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602133 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 12:48:11.889605 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602136 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 12:48:11.889605 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602139 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 12:48:11.889605 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602142 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 12:48:11.889605 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602145 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 12:48:11.894027 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602148 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 12:48:11.894027 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602150 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 12:48:11.894027 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602153 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 12:48:11.894027 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602156 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 12:48:11.894027 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602160 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 12:48:11.894027 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602163 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 12:48:11.894027 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602166 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 12:48:11.894027 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602168 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 12:48:11.894027 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602171 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 12:48:11.894027 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602174 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 12:48:11.894027 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602176 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 12:48:11.894027 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602180 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 12:48:11.894027 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602182 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 12:48:11.894027 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602185 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 12:48:11.894027 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602245 2555 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 12:48:11.894027 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602252 2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 12:48:11.894027 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602258 2555 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 12:48:11.894027 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602262 2555 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 12:48:11.894027 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602268 2555 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 12:48:11.894027 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602272 2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 12:48:11.894027 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602278 2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 12:48:11.895135 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602284 2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 12:48:11.895135 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602288 2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 12:48:11.895135 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602292 2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 12:48:11.895135 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602296 2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 12:48:11.895135 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602299 2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 12:48:11.895135 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602303 2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 12:48:11.895135 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602306 2555 flags.go:64] FLAG: --cgroup-root="" Jul 07 12:48:11.895135 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602309 2555 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 12:48:11.895135 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602312 2555 flags.go:64] FLAG: --client-ca-file="" Jul 07 12:48:11.895135 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602316 2555 flags.go:64] FLAG: --cloud-provider="external" Jul 07 12:48:11.895135 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602318 2555 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 12:48:11.895135 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602322 2555 flags.go:64] FLAG: --cluster-domain="" Jul 07 12:48:11.895135 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602325 2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 12:48:11.895135 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602328 2555 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 12:48:11.895135 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602331 2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 12:48:11.895135 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602334 2555 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 12:48:11.895135 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602337 2555 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 12:48:11.895135 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602340 2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 12:48:11.895135 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602343 2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 12:48:11.895135 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602346 2555 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 12:48:11.895135 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602349 2555 flags.go:64] FLAG: --contention-profiling="false" Jul 07 12:48:11.895135 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602352 2555 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 12:48:11.895135 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602357 2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 12:48:11.895135 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602360 2555 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 12:48:11.902505 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602362 2555 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 12:48:11.902505 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602366 2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 12:48:11.902505 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602369 2555 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 12:48:11.902505 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602372 2555 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 12:48:11.902505 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602375 2555 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 12:48:11.902505 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602377 2555 flags.go:64] FLAG: --enable-server="true" Jul 07 12:48:11.902505 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602380 2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 12:48:11.902505 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602385 2555 flags.go:64] FLAG: --event-burst="100" Jul 07 12:48:11.902505 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602387 2555 flags.go:64] FLAG: --event-qps="50" Jul 07 12:48:11.902505 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602390 2555 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 12:48:11.902505 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602393 2555 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 12:48:11.902505 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602396 2555 flags.go:64] FLAG: --eviction-hard="" Jul 07 12:48:11.902505 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602399 2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 12:48:11.902505 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602404 2555 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 12:48:11.902505 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602406 2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 12:48:11.902505 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602409 2555 flags.go:64] FLAG: --eviction-soft="" Jul 07 12:48:11.902505 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602412 2555 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 12:48:11.902505 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602415 2555 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 12:48:11.902505 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602435 2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 12:48:11.902505 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602439 2555 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 12:48:11.902505 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602442 2555 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 12:48:11.902505 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602445 2555 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 12:48:11.902505 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602448 2555 flags.go:64] FLAG: --feature-gates="" Jul 07 12:48:11.902505 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602453 2555 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 12:48:11.902505 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602456 2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 12:48:11.903999 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602459 2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 12:48:11.903999 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602462 2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 12:48:11.903999 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602465 2555 flags.go:64] FLAG: --healthz-port="10248" Jul 07 12:48:11.903999 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602468 2555 flags.go:64] FLAG: --help="false" Jul 07 12:48:11.903999 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602471 2555 flags.go:64] FLAG: --hostname-override="ip-10-0-136-245.ec2.internal" Jul 07 12:48:11.903999 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602476 2555 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 12:48:11.903999 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602479 2555 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 12:48:11.903999 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602481 2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 12:48:11.903999 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602485 2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 12:48:11.903999 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602488 2555 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 12:48:11.903999 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602491 2555 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 12:48:11.903999 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602494 2555 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 12:48:11.903999 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602496 2555 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 12:48:11.903999 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602499 2555 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 12:48:11.903999 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602502 2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 12:48:11.903999 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602505 2555 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 12:48:11.903999 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602507 2555 flags.go:64] FLAG: --kube-reserved="" Jul 07 12:48:11.903999 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602510 2555 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 12:48:11.903999 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602513 2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 12:48:11.903999 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602515 2555 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 12:48:11.903999 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602519 2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 12:48:11.903999 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602522 2555 flags.go:64] FLAG: --lock-file="" Jul 07 12:48:11.903999 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602525 2555 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 12:48:11.903999 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602527 2555 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 12:48:11.909069 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602530 2555 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 12:48:11.909069 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602535 2555 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 12:48:11.909069 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602539 2555 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 12:48:11.909069 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602542 2555 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 12:48:11.909069 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602544 2555 flags.go:64] FLAG: --logging-format="text" Jul 07 12:48:11.909069 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602547 2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 12:48:11.909069 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602550 2555 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 12:48:11.909069 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602553 2555 flags.go:64] FLAG: --manifest-url="" Jul 07 12:48:11.909069 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602556 2555 flags.go:64] FLAG: --manifest-url-header="" Jul 07 12:48:11.909069 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602560 2555 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 12:48:11.909069 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602562 2555 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 12:48:11.909069 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602566 2555 flags.go:64] FLAG: --max-pods="110" Jul 07 12:48:11.909069 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602569 2555 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 12:48:11.909069 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602573 2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 12:48:11.909069 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602576 2555 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 12:48:11.909069 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602579 2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 12:48:11.909069 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602582 2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 12:48:11.909069 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602584 2555 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 12:48:11.909069 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602587 2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 12:48:11.909069 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602594 2555 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 12:48:11.909069 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602596 2555 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 12:48:11.909069 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602599 2555 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 12:48:11.909069 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602602 2555 flags.go:64] FLAG: --pod-cidr="" Jul 07 12:48:11.909844 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602605 2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 12:48:11.909844 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602610 2555 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 12:48:11.909844 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602612 2555 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 12:48:11.909844 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602615 2555 flags.go:64] FLAG: --pods-per-core="0" Jul 07 12:48:11.909844 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602618 2555 flags.go:64] FLAG: --port="10250" Jul 07 12:48:11.909844 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602621 2555 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 12:48:11.909844 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602624 2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ef94499d088f22b0" Jul 07 12:48:11.909844 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602627 2555 flags.go:64] FLAG: --qos-reserved="" Jul 07 12:48:11.909844 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602630 2555 flags.go:64] FLAG: --read-only-port="10255" Jul 07 12:48:11.909844 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602633 2555 flags.go:64] FLAG: --register-node="true" Jul 07 12:48:11.909844 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602635 2555 flags.go:64] FLAG: --register-with-taints="" Jul 07 12:48:11.909844 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602639 2555 flags.go:64] FLAG: --registry-burst="10" Jul 07 12:48:11.909844 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602643 2555 flags.go:64] FLAG: --registry-qps="5" Jul 07 12:48:11.909844 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602645 2555 flags.go:64] FLAG: --reserved-cpus="" Jul 07 12:48:11.909844 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602648 2555 flags.go:64] FLAG: --reserved-memory="" Jul 07 12:48:11.909844 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602652 2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 12:48:11.909844 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602655 2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 12:48:11.909844 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602657 2555 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 12:48:11.909844 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602660 2555 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 12:48:11.909844 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602663 2555 flags.go:64] FLAG: --runonce="false" Jul 07 12:48:11.909844 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602666 2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 12:48:11.909844 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602669 2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 12:48:11.909844 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602672 2555 flags.go:64] FLAG: --seccomp-default="false" Jul 07 12:48:11.909844 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602676 2555 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 12:48:11.909844 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602679 2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 12:48:11.913816 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602681 2555 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 12:48:11.913816 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602684 2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 12:48:11.913816 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602687 2555 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 12:48:11.913816 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602690 2555 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 12:48:11.913816 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602693 2555 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 12:48:11.913816 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602695 2555 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 12:48:11.913816 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602698 2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 12:48:11.913816 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602701 2555 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 12:48:11.913816 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602704 2555 flags.go:64] FLAG: --system-cgroups="" Jul 07 12:48:11.913816 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602707 2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 12:48:11.913816 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602712 2555 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 12:48:11.913816 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602714 2555 flags.go:64] FLAG: --tls-cert-file="" Jul 07 12:48:11.913816 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602717 2555 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 12:48:11.913816 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602721 2555 flags.go:64] FLAG: --tls-min-version="" Jul 07 12:48:11.913816 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602723 2555 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 12:48:11.913816 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602726 2555 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 12:48:11.913816 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602729 2555 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 12:48:11.913816 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602732 2555 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 12:48:11.913816 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602734 2555 flags.go:64] FLAG: --v="2" Jul 07 12:48:11.913816 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602738 2555 flags.go:64] FLAG: --version="false" Jul 07 12:48:11.913816 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602742 2555 flags.go:64] FLAG: --vmodule="" Jul 07 12:48:11.913816 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602746 2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 12:48:11.913816 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.602749 2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 12:48:11.913816 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602870 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 12:48:11.913816 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602874 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 12:48:11.914959 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602877 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 12:48:11.914959 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602880 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 12:48:11.914959 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602882 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 12:48:11.914959 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602885 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 12:48:11.914959 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602888 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 12:48:11.914959 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602892 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 12:48:11.914959 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602894 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 12:48:11.914959 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602897 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 12:48:11.914959 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602899 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 12:48:11.914959 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602902 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 12:48:11.914959 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602904 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 12:48:11.914959 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602907 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 12:48:11.914959 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602910 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 12:48:11.914959 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602912 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 12:48:11.914959 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602915 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 12:48:11.914959 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602917 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 12:48:11.914959 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602920 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 12:48:11.914959 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602922 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 12:48:11.914959 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602927 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 12:48:11.918149 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602930 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 12:48:11.918149 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602933 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 12:48:11.918149 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602936 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 12:48:11.918149 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602939 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 12:48:11.918149 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602944 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 12:48:11.918149 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602947 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 12:48:11.918149 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602950 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 12:48:11.918149 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602952 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 12:48:11.918149 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602955 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 12:48:11.918149 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602958 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 12:48:11.918149 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602960 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 12:48:11.918149 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602963 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 12:48:11.918149 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602965 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 12:48:11.918149 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602968 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 12:48:11.918149 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602970 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 12:48:11.918149 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602973 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 12:48:11.918149 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602975 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 12:48:11.918149 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602978 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 12:48:11.918149 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602982 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 12:48:11.918149 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602985 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 12:48:11.918939 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602988 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 12:48:11.918939 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602990 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 12:48:11.918939 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602992 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 12:48:11.918939 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602995 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 12:48:11.918939 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.602998 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 12:48:11.918939 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603000 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 12:48:11.918939 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603003 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 12:48:11.918939 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603005 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 12:48:11.918939 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603007 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 12:48:11.918939 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603010 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 12:48:11.918939 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603012 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 12:48:11.918939 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603015 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 12:48:11.918939 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603017 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 12:48:11.918939 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603020 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 12:48:11.918939 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603022 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 12:48:11.918939 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603025 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 12:48:11.918939 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603028 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 12:48:11.918939 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603031 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 12:48:11.918939 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603034 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 12:48:11.918939 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603036 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 12:48:11.922328 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603039 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 12:48:11.922328 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603041 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 12:48:11.922328 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603044 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 12:48:11.922328 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603047 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 12:48:11.922328 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603049 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 12:48:11.922328 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603052 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 07 12:48:11.922328 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603054 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 12:48:11.922328 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603057 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 12:48:11.922328 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603059 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 12:48:11.922328 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603062 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 12:48:11.922328 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603066 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 12:48:11.922328 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603068 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 12:48:11.922328 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603071 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 12:48:11.922328 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603073 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 12:48:11.922328 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603075 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 12:48:11.922328 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603078 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 12:48:11.922328 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603081 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 12:48:11.922328 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603083 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 12:48:11.922328 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603087 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 12:48:11.922328 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603090 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 12:48:11.923255 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603093 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 12:48:11.923255 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603096 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 12:48:11.923255 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603099 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 12:48:11.923255 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603101 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 12:48:11.923255 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603104 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 12:48:11.923255 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603106 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 12:48:11.923255 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603109 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 12:48:11.923255 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603112 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 12:48:11.923255 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603115 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 12:48:11.923255 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603117 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 12:48:11.923255 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603120 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 12:48:11.923255 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603123 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 12:48:11.923255 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603125 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 12:48:11.923255 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603129 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 12:48:11.923255 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603132 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 12:48:11.923255 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603135 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 12:48:11.923255 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603138 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 12:48:11.923255 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.603141 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 12:48:11.928216 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.603146 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 12:48:11.928216 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.611106 2555 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 12:48:11.928216 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.611120 2555 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 12:48:11.928216 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.611139 2555 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 12:48:11.928216 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.611144 2555 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 12:48:11.928216 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611217 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 12:48:11.928216 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611223 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 12:48:11.928216 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611227 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 12:48:11.928216 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611230 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 12:48:11.928216 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611233 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 12:48:11.928216 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611235 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 12:48:11.928216 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611239 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 12:48:11.928216 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611242 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 12:48:11.928216 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611245 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 12:48:11.928739 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611247 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 12:48:11.928739 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611250 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 12:48:11.928739 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611253 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 12:48:11.928739 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611256 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 12:48:11.928739 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611259 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 12:48:11.928739 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611262 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 12:48:11.928739 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611264 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 12:48:11.928739 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611266 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 12:48:11.928739 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611269 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 12:48:11.928739 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611272 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 12:48:11.928739 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611279 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 12:48:11.928739 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611281 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 12:48:11.928739 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611284 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 12:48:11.928739 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611286 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 12:48:11.928739 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611289 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 12:48:11.928739 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611298 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 12:48:11.928739 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611301 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 12:48:11.928739 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611303 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 12:48:11.928739 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611305 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 12:48:11.934238 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611308 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 12:48:11.934238 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611310 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 12:48:11.934238 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611313 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 12:48:11.934238 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611316 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 12:48:11.934238 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611318 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 12:48:11.934238 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611320 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 12:48:11.934238 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611324 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 12:48:11.934238 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611328 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 12:48:11.934238 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611330 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 12:48:11.934238 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611333 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 12:48:11.934238 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611335 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 12:48:11.934238 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611338 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 07 12:48:11.934238 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611341 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 12:48:11.934238 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611343 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 12:48:11.934238 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611346 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 12:48:11.934238 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611349 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 12:48:11.934238 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611351 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 12:48:11.934238 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611354 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 12:48:11.934238 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611356 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 12:48:11.934238 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611358 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 12:48:11.935028 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611361 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 12:48:11.935028 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611363 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 12:48:11.935028 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611366 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 12:48:11.935028 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611370 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 12:48:11.935028 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611373 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 12:48:11.935028 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611375 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 12:48:11.935028 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611379 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 12:48:11.935028 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611383 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 12:48:11.935028 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611386 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 12:48:11.935028 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611394 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 12:48:11.935028 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611397 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 12:48:11.935028 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611400 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 12:48:11.935028 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611402 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 12:48:11.935028 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611405 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 12:48:11.935028 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611407 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 12:48:11.935028 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611410 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 12:48:11.935028 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611412 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 12:48:11.935028 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611415 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 12:48:11.935028 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611417 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 12:48:11.935028 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611436 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 12:48:12.030416 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611441 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 12:48:12.030416 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611444 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 12:48:12.030416 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611447 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 12:48:12.030416 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611450 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 12:48:12.030416 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611452 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 12:48:12.030416 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611455 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 12:48:12.030416 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611457 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 12:48:12.030416 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611460 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 12:48:12.030416 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611462 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 12:48:12.030416 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611465 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 12:48:12.030416 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611467 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 12:48:12.030416 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611470 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 12:48:12.030416 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611479 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 12:48:12.030416 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611482 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 12:48:12.030416 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611484 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 12:48:12.030416 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611490 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 12:48:12.030416 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611493 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 12:48:12.030416 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611495 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 12:48:12.030416 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611498 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 12:48:12.030416 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611500 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 12:48:12.035129 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611503 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 12:48:12.035129 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611506 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 12:48:12.035129 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611514 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 12:48:12.035129 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611517 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 12:48:12.035129 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611519 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 12:48:12.035129 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611522 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 12:48:12.035129 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611524 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 12:48:12.035129 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611527 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 12:48:12.035129 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611529 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 12:48:12.035129 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611532 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 12:48:12.035129 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611534 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 12:48:12.035129 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.611539 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 12:48:12.035129 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611682 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 12:48:12.035129 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611686 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 12:48:12.035129 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611690 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 12:48:12.035922 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611692 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 12:48:12.035922 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611695 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 12:48:12.035922 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611698 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 12:48:12.035922 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611701 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 12:48:12.035922 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611703 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 12:48:12.035922 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611706 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 12:48:12.035922 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611708 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 12:48:12.035922 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611711 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 12:48:12.035922 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611713 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 12:48:12.035922 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611716 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 12:48:12.035922 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611718 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 12:48:12.035922 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611720 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 12:48:12.035922 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611725 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 12:48:12.035922 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611729 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 12:48:12.035922 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611731 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 12:48:12.035922 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611734 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 12:48:12.035922 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611736 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 12:48:12.035922 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611739 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 12:48:12.035922 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611741 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 12:48:12.035922 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611744 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 12:48:12.036722 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611752 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 12:48:12.036722 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611755 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 12:48:12.036722 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611757 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 12:48:12.036722 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611759 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 12:48:12.036722 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611762 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 12:48:12.036722 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611764 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 12:48:12.036722 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611767 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 12:48:12.036722 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611769 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 12:48:12.036722 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611773 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 12:48:12.036722 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611777 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 12:48:12.036722 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611783 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 12:48:12.036722 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611786 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 12:48:12.036722 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611788 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 12:48:12.036722 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611791 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 12:48:12.036722 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611793 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 12:48:12.036722 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611796 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 12:48:12.036722 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611799 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 12:48:12.036722 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611801 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 12:48:12.036722 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611804 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 12:48:12.039085 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611806 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 12:48:12.039085 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611808 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 12:48:12.039085 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611811 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 12:48:12.039085 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611813 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 12:48:12.039085 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611816 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 12:48:12.039085 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611820 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 12:48:12.039085 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611824 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 12:48:12.039085 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611827 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 12:48:12.039085 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611829 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 12:48:12.039085 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611832 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 12:48:12.039085 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611834 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 12:48:12.039085 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611836 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 12:48:12.039085 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611839 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 12:48:12.039085 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611842 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 12:48:12.039085 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611849 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 12:48:12.039085 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611852 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 12:48:12.039085 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611854 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 12:48:12.039085 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611857 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 12:48:12.039085 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611860 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 12:48:12.039085 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611862 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 12:48:12.039869 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611865 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 12:48:12.039869 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611867 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 12:48:12.039869 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611869 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 12:48:12.039869 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611872 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 12:48:12.039869 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611874 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 12:48:12.039869 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611877 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 12:48:12.039869 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611880 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 12:48:12.039869 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611882 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 12:48:12.039869 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611885 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 12:48:12.039869 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611887 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 12:48:12.039869 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611889 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 12:48:12.039869 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611892 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 12:48:12.039869 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611894 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 12:48:12.039869 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611897 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 12:48:12.039869 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611900 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 12:48:12.039869 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611902 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 12:48:12.039869 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611905 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 12:48:12.039869 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611908 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 12:48:12.039869 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611912 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 12:48:12.039869 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611915 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 12:48:12.043009 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611917 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 12:48:12.043009 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611920 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 12:48:12.043009 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611922 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 12:48:12.043009 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611925 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 12:48:12.043009 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611927 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 12:48:12.043009 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611930 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 12:48:12.043009 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611932 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 12:48:12.043009 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611940 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 12:48:12.043009 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611943 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 12:48:12.043009 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611947 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 12:48:12.043009 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611950 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 12:48:12.043009 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611953 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 12:48:12.043009 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611956 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 12:48:12.043009 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611958 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 12:48:12.043009 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611961 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 07 12:48:12.043009 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611965 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 12:48:12.043009 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:11.611968 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 12:48:12.043817 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.611973 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 12:48:12.043817 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.612068 2555 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 12:48:12.043817 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.614298 2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 12:48:12.043817 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.616173 2555 server.go:1019] "Starting client certificate rotation" Jul 07 12:48:12.043817 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.616272 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 12:48:12.043817 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.616309 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 12:48:12.043817 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.619714 2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 12:48:12.043817 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.622774 2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 12:48:12.043817 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.632638 2555 log.go:25] "Validated CRI v1 runtime API" Jul 07 12:48:12.043817 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.638998 2555 log.go:25] "Validated CRI v1 image API" Jul 07 12:48:12.043817 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.643006 2555 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 12:48:12.043817 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.647540 2555 fs.go:135] Filesystem UUIDs: map[14d26aa5-1318-4ae0-97f0-4bc08820249c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9536c6b6-5991-4770-8291-0d413ff59b56:/dev/nvme0n1p3] Jul 07 12:48:12.141091 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.647561 2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 12:48:12.141091 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.650701 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 12:48:12.150582 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.653573 2555 manager.go:216] Machine: {Timestamp:2026-07-07 12:48:11.652267052 +0000 UTC m=+0.373994557 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099107 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2274a9cfc8ea8738a05d04943da51e SystemUUID:ec2274a9-cfc8-ea87-38a0-5d04943da51e BootID:7315f272-2abf-4644-94cd-279511cdbdfe Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:21:a5:2d:d0:09 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:21:a5:2d:d0:09 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:61:60:82:d0:89 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 12:48:12.150582 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.653696 2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 12:48:12.150582 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.653787 2555 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 12:48:12.150582 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.657730 2555 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 12:48:12.150582 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.657762 2555 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-245.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 12:48:12.150582 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.658503 2555 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 12:48:12.150582 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.658517 2555 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 12:48:12.150582 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.658526 2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 12:48:12.150582 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.659471 2555 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 12:48:12.150582 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.661314 2555 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 12:48:12.150582 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.664550 2555 state_mem.go:36] "Initialized new in-memory state store" Jul 07 12:48:12.150582 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.664673 2555 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 12:48:12.150582 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.664701 2555 kubelet.go:486] "Attempting to sync node with API server" Jul 07 12:48:12.150582 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.664714 2555 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 12:48:12.150582 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.664731 2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 12:48:12.150582 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.664743 2555 kubelet.go:398] "Adding apiserver pod source" Jul 07 12:48:12.150582 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.664755 2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 12:48:12.150582 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.667774 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.667798 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.670013 2555 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.671912 2555 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.671945 2555 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.673061 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.673074 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.673081 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.673086 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.673113 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.673120 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.673127 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.673132 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.673138 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.673143 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.673155 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.673160 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.673178 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.673184 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.676206 2555 server.go:1268] "Started kubelet" Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.676378 2555 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.676451 2555 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.677041 2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.678197 2555 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.681806 2555 server.go:310] "Adding debug handlers to kubelet server" Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:11.689815 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.689856 2555 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-245.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:11.689859 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-245.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:11.689990 2555 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:11.689810 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-245.ec2.internal.18c002c3a0a93414 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-245.ec2.internal,UID:ip-10-0-136-245.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-245.ec2.internal,},FirstTimestamp:2026-07-07 12:48:11.676038164 +0000 UTC m=+0.397765669,LastTimestamp:2026-07-07 12:48:11.676038164 +0000 UTC m=+0.397765669,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-245.ec2.internal,}" Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.692628 2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.692630 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:11.692694 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found" Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.693631 2555 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.693806 2555 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.693773 2555 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.694261 2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.694281 2555 factory.go:55] Registering systemd factory Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.694290 2555 factory.go:223] Registration of the systemd container factory successfully Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.694609 2555 reconstruct.go:97] "Volume reconstruction finished" Jul 07 12:48:12.151769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.694619 2555 reconciler.go:29] "Reconciler: start to sync state" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.694702 2555 factory.go:153] Registering CRI-O factory Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.694716 2555 factory.go:223] Registration of the crio container factory successfully Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.694738 2555 factory.go:103] Registering Raw factory Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.694761 2555 manager.go:1196] Started watching for new ooms in manager Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:11.694990 2555 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-245.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.695723 2555 manager.go:349] Starting recovery of all containers Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.701714 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:11.707072 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.707924 2555 manager.go:354] Recovery completed Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.711921 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nh7vp" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.713213 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.714880 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientMemory" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.714906 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.714916 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientPID" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.715483 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.715484 2555 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.715537 2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.715553 2555 state_mem.go:36] "Initialized new in-memory state store" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.716149 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientMemory" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.716171 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.716181 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientPID" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.716643 2555 policy_none.go:49] "None policy: Start" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.716658 2555 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.716673 2555 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.717594 2555 policy_none.go:47] "Start" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.721251 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nh7vp" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.744603 2555 manager.go:337] "Starting Device Plugin manager" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:11.744747 2555 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.744773 2555 server.go:87] "Starting device plugin registration server" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.744986 2555 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.744997 2555 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.745082 2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.745163 2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.745174 2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:11.745670 2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:11.745714 2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-245.ec2.internal\" not found" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.819016 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.819043 2555 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.819060 2555 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:11.819088 2555 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.821704 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.845810 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.846599 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientMemory" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.846638 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.846656 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientPID" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.846681 2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-245.ec2.internal" Jul 07 12:48:12.152977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.856368 2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-245.ec2.internal" Jul 07 12:48:12.155336 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:11.856386 2555 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-245.ec2.internal\": node \"ip-10-0-136-245.ec2.internal\" not found" Jul 07 12:48:12.155336 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:11.893388 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found" Jul 07 12:48:12.155336 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.919720 2555 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-245.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal"] Jul 07 12:48:12.155336 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.919772 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 12:48:12.155336 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.920688 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientMemory" Jul 07 12:48:12.155336 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.920716 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 12:48:12.155336 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.920726 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientPID" Jul 07 12:48:12.155336 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.921989 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 12:48:12.155336 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.922142 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-245.ec2.internal" Jul 07 12:48:12.155336 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.922168 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 12:48:12.155336 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.922786 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientMemory" Jul 07 12:48:12.155336 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.922821 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 12:48:12.155336 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.922833 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientMemory" Jul 07 12:48:12.155336 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.922856 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 12:48:12.155336 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.922869 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientPID" Jul 07 12:48:12.155336 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.922835 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientPID" Jul 07 12:48:12.155336 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.924113 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal" Jul 07 12:48:12.155336 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.924143 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 12:48:12.155336 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.924813 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientMemory" Jul 07 12:48:12.155336 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.924833 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 12:48:12.155336 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.924847 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeHasSufficientPID" Jul 07 12:48:12.155336 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:11.993769 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found" Jul 07 12:48:12.155336 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.995978 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7c175a9fb55810a6c1b33f39f05a41c8-config\") pod \"kube-apiserver-proxy-ip-10-0-136-245.ec2.internal\" (UID: \"7c175a9fb55810a6c1b33f39f05a41c8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-245.ec2.internal" Jul 07 12:48:12.155336 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.995999 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/05dfd04fd79f7fb9287794a7ffe49d97-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal\" (UID: \"05dfd04fd79f7fb9287794a7ffe49d97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal" Jul 07 12:48:12.155336 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:11.996015 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05dfd04fd79f7fb9287794a7ffe49d97-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal\" (UID: \"05dfd04fd79f7fb9287794a7ffe49d97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal" Jul 07 12:48:12.155336 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:12.093818 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found" Jul 07 12:48:12.155336 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:12.097038 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/05dfd04fd79f7fb9287794a7ffe49d97-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal\" (UID: \"05dfd04fd79f7fb9287794a7ffe49d97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal" Jul 07 12:48:12.155336 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:12.097057 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05dfd04fd79f7fb9287794a7ffe49d97-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal\" (UID: \"05dfd04fd79f7fb9287794a7ffe49d97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal" Jul 07 12:48:12.155336 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:12.097073 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7c175a9fb55810a6c1b33f39f05a41c8-config\") pod \"kube-apiserver-proxy-ip-10-0-136-245.ec2.internal\" (UID: \"7c175a9fb55810a6c1b33f39f05a41c8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-245.ec2.internal" Jul 07 12:48:12.156551 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:12.097118 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7c175a9fb55810a6c1b33f39f05a41c8-config\") pod \"kube-apiserver-proxy-ip-10-0-136-245.ec2.internal\" (UID: \"7c175a9fb55810a6c1b33f39f05a41c8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-245.ec2.internal" Jul 07 12:48:12.156551 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:12.097139 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/05dfd04fd79f7fb9287794a7ffe49d97-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal\" (UID: \"05dfd04fd79f7fb9287794a7ffe49d97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal" Jul 07 12:48:12.156551 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:12.097145 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05dfd04fd79f7fb9287794a7ffe49d97-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal\" (UID: \"05dfd04fd79f7fb9287794a7ffe49d97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal" Jul 07 12:48:12.255303 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:12.194540 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found" Jul 07 12:48:12.280238 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:12.280212 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-245.ec2.internal\" not found" node="ip-10-0-136-245.ec2.internal" Jul 07 12:48:12.283046 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:12.282950 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-245.ec2.internal" Jul 07 12:48:12.284697 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:12.284683 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-245.ec2.internal\" not found" node="ip-10-0-136-245.ec2.internal" Jul 07 12:48:12.287935 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:12.287659 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal" Jul 07 12:48:12.294622 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:12.294607 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found" Jul 07 12:48:12.395027 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:12.394973 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found" Jul 07 12:48:12.495484 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:12.495463 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found" Jul 07 12:48:12.595974 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:12.595954 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found" Jul 07 12:48:12.615234 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:12.615221 2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 12:48:12.615582 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:12.615336 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 12:48:12.696028 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:12.696011 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found" Jul 07 12:48:12.709793 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:12.709770 2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 12:48:12.723968 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:12.723939 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 12:43:12 +0000 UTC" deadline="2028-01-25 21:17:42.265342966 +0000 UTC" Jul 07 12:48:12.723968 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:12.723963 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13616h29m29.541383784s" Jul 07 12:48:12.796934 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:12.796913 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found" Jul 07 12:48:12.898623 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:12.898598 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found" Jul 07 12:48:12.999642 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:12.999594 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-245.ec2.internal\" not found" Jul 07 12:48:13.054900 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.054876 2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 12:48:13.093468 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.093419 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal" Jul 07 12:48:13.097564 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.097544 2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 12:48:13.109735 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.109714 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 12:48:13.112234 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.112218 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-245.ec2.internal" Jul 07 12:48:13.123779 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.123763 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 12:48:13.141203 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:13.141177 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c175a9fb55810a6c1b33f39f05a41c8.slice/crio-379ec604229ba83116aebb8146211d942f85bc6cb2ad41958000f6e99a99ad62 WatchSource:0}: Error finding container 379ec604229ba83116aebb8146211d942f85bc6cb2ad41958000f6e99a99ad62: Status 404 returned error can't find the container with id 379ec604229ba83116aebb8146211d942f85bc6cb2ad41958000f6e99a99ad62 Jul 07 12:48:13.141572 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:13.141557 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05dfd04fd79f7fb9287794a7ffe49d97.slice/crio-2f50a9eccd9117380fba072a18d74f43446261f49c4c424eda202b494ad0edc1 WatchSource:0}: Error finding container 2f50a9eccd9117380fba072a18d74f43446261f49c4c424eda202b494ad0edc1: Status 404 returned error can't find the container with id 2f50a9eccd9117380fba072a18d74f43446261f49c4c424eda202b494ad0edc1 Jul 07 12:48:13.148094 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.148080 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 12:48:13.666597 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.666574 2555 apiserver.go:52] "Watching apiserver" Jul 07 12:48:13.675642 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.675620 2555 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 12:48:13.676021 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.675998 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-cgbr7","kube-system/global-pull-secret-syncer-m6fbl","kube-system/konnectivity-agent-8k6fx","kube-system/kube-apiserver-proxy-ip-10-0-136-245.ec2.internal","openshift-cluster-node-tuning-operator/tuned-rvzj2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal","openshift-multus/multus-additional-cni-plugins-jktnw","openshift-multus/network-metrics-daemon-svv9n","openshift-network-diagnostics/network-check-target-jdccv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hlpsw","openshift-dns/node-resolver-x9n7p","openshift-image-registry/node-ca-xqj9j","openshift-multus/multus-rd9dk","openshift-network-operator/iptables-alerter-qjc5g"] Jul 07 12:48:13.678890 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.678863 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x9n7p" Jul 07 12:48:13.679943 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.679926 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qjc5g" Jul 07 12:48:13.681121 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.681104 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8k6fx" Jul 07 12:48:13.681813 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.681797 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-b56zz\"" Jul 07 12:48:13.682192 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.682172 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 12:48:13.682277 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.682209 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 12:48:13.682338 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.682284 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 12:48:13.682507 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.682479 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.682608 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.682593 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 12:48:13.682892 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.682867 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2hrbr\"" Jul 07 12:48:13.683181 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.683165 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 12:48:13.683778 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.683761 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 12:48:13.683897 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.683800 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.683897 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.683869 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-c7xfq\"" Jul 07 12:48:13.684297 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.684281 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 12:48:13.686191 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.685326 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.686191 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.685740 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 12:48:13.686191 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.685896 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 12:48:13.686947 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.686675 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 12:48:13.689053 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.687640 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 12:48:13.689053 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.687653 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 12:48:13.689053 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.688154 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 12:48:13.689053 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.688248 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 12:48:13.689053 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.688888 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5dwf5\"" Jul 07 12:48:13.689555 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.689534 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 12:48:13.689845 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.689768 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 12:48:13.690067 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.690048 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 12:48:13.690067 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.690061 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4vbsx\"" Jul 07 12:48:13.690275 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.690253 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-78cqx\"" Jul 07 12:48:13.690390 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.690355 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 12:48:13.690486 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.690383 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 12:48:13.691150 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.691129 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jktnw" Jul 07 12:48:13.692603 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.692582 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svv9n" Jul 07 12:48:13.692678 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:13.692659 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svv9n" podUID="22898bc2-4cf6-4d84-b1e1-54504130b156" Jul 07 12:48:13.693492 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.693451 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 12:48:13.693584 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.693471 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 12:48:13.693932 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.693911 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rqcxf\"" Jul 07 12:48:13.694033 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.694005 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdccv" Jul 07 12:48:13.694108 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:13.694085 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdccv" podUID="488e43e7-1c98-4b52-94c1-41b87c14bc73" Jul 07 12:48:13.694170 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.694005 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 12:48:13.695661 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.695644 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xqj9j" Jul 07 12:48:13.697055 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.697039 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hlpsw" Jul 07 12:48:13.697908 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.697889 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 12:48:13.698239 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.698218 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 12:48:13.698378 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.698298 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:13.698378 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:13.698359 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m6fbl" podUID="99606493-0799-450b-a6f8-d3795ff36e30" Jul 07 12:48:13.698518 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.698441 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 12:48:13.698518 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.698467 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-99lk5\"" Jul 07 12:48:13.699486 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.699459 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 12:48:13.699599 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.699566 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 12:48:13.699768 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.699751 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 12:48:13.699846 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.699784 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sxmrw\"" Jul 07 12:48:13.705644 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.705625 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq7c5\" (UniqueName: \"kubernetes.io/projected/08b292d1-7dd9-45f9-9746-369ba2b0167e-kube-api-access-qq7c5\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.705736 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.705650 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e1072848-f7b3-4b5b-9517-c09debf2e9af-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jktnw\" (UID: \"e1072848-f7b3-4b5b-9517-c09debf2e9af\") " pod="openshift-multus/multus-additional-cni-plugins-jktnw" Jul 07 12:48:13.705736 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.705668 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-etc-sysconfig\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.705736 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.705685 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-system-cni-dir\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.705736 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.705699 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-host-run-netns\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.705966 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.705751 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-multus-conf-dir\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.705966 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.705783 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-run\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.705966 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.705801 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cd96639c-8bd3-4c04-aedd-41dbd1c2acdb-serviceca\") pod \"node-ca-xqj9j\" (UID: \"cd96639c-8bd3-4c04-aedd-41dbd1c2acdb\") " pod="openshift-image-registry/node-ca-xqj9j" Jul 07 12:48:13.705966 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.705821 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-host-run-netns\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.705966 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.705846 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-cni-binary-copy\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.705966 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.705870 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx48l\" (UniqueName: \"kubernetes.io/projected/e1072848-f7b3-4b5b-9517-c09debf2e9af-kube-api-access-zx48l\") pod \"multus-additional-cni-plugins-jktnw\" (UID: \"e1072848-f7b3-4b5b-9517-c09debf2e9af\") " pod="openshift-multus/multus-additional-cni-plugins-jktnw" Jul 07 12:48:13.705966 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.705897 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/401b54f0-9e30-4ac3-8238-067fe8dd42c8-konnectivity-ca\") pod \"konnectivity-agent-8k6fx\" (UID: \"401b54f0-9e30-4ac3-8238-067fe8dd42c8\") " pod="kube-system/konnectivity-agent-8k6fx" Jul 07 12:48:13.705966 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.705921 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-var-lib-openvswitch\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.705966 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.705947 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.706419 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.705971 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-os-release\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.706419 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706002 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/401b54f0-9e30-4ac3-8238-067fe8dd42c8-agent-certs\") pod \"konnectivity-agent-8k6fx\" (UID: \"401b54f0-9e30-4ac3-8238-067fe8dd42c8\") " pod="kube-system/konnectivity-agent-8k6fx" Jul 07 12:48:13.706419 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706043 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-node-log\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.706419 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706075 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-host-var-lib-kubelet\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.706419 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706108 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs8dc\" (UniqueName: \"kubernetes.io/projected/22898bc2-4cf6-4d84-b1e1-54504130b156-kube-api-access-rs8dc\") pod \"network-metrics-daemon-svv9n\" (UID: \"22898bc2-4cf6-4d84-b1e1-54504130b156\") " pod="openshift-multus/network-metrics-daemon-svv9n" Jul 07 12:48:13.706419 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706134 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-host-kubelet\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.706419 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706163 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-host-var-lib-cni-multus\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.706419 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706179 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srv7l\" (UniqueName: \"kubernetes.io/projected/cd96639c-8bd3-4c04-aedd-41dbd1c2acdb-kube-api-access-srv7l\") pod \"node-ca-xqj9j\" (UID: \"cd96639c-8bd3-4c04-aedd-41dbd1c2acdb\") " pod="openshift-image-registry/node-ca-xqj9j" Jul 07 12:48:13.706419 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706206 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/013f74eb-3b7a-4b07-966b-a64e6fb4124b-host-slash\") pod \"iptables-alerter-qjc5g\" (UID: \"013f74eb-3b7a-4b07-966b-a64e6fb4124b\") " pod="openshift-network-operator/iptables-alerter-qjc5g" Jul 07 12:48:13.706419 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706228 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-var-lib-kubelet\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.706419 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706249 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rtms\" (UniqueName: \"kubernetes.io/projected/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-kube-api-access-2rtms\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.706419 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706310 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-log-socket\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.706419 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706324 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/08b292d1-7dd9-45f9-9746-369ba2b0167e-env-overrides\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.706419 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706344 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-host-run-k8s-cni-cncf-io\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.706419 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706358 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-hostroot\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.706419 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706377 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-host-run-multus-certs\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.706419 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706401 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e1072848-f7b3-4b5b-9517-c09debf2e9af-cnibin\") pod \"multus-additional-cni-plugins-jktnw\" (UID: \"e1072848-f7b3-4b5b-9517-c09debf2e9af\") " pod="openshift-multus/multus-additional-cni-plugins-jktnw" Jul 07 12:48:13.707356 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706418 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e1072848-f7b3-4b5b-9517-c09debf2e9af-cni-binary-copy\") pod \"multus-additional-cni-plugins-jktnw\" (UID: \"e1072848-f7b3-4b5b-9517-c09debf2e9af\") " pod="openshift-multus/multus-additional-cni-plugins-jktnw" Jul 07 12:48:13.707356 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706434 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqj28\" (UniqueName: \"kubernetes.io/projected/013f74eb-3b7a-4b07-966b-a64e6fb4124b-kube-api-access-xqj28\") pod \"iptables-alerter-qjc5g\" (UID: \"013f74eb-3b7a-4b07-966b-a64e6fb4124b\") " pod="openshift-network-operator/iptables-alerter-qjc5g" Jul 07 12:48:13.707356 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706478 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-run-systemd\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.707356 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706505 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/08b292d1-7dd9-45f9-9746-369ba2b0167e-ovnkube-config\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.707356 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706520 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/08b292d1-7dd9-45f9-9746-369ba2b0167e-ovnkube-script-lib\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.707356 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706538 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-etc-sysctl-d\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.707356 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706567 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-etc-sysctl-conf\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.707356 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706591 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-lib-modules\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.707356 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706608 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-etc-tuned\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.707356 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706630 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/162131a6-2800-4824-81fb-10c5396199ea-tmp-dir\") pod \"node-resolver-x9n7p\" (UID: \"162131a6-2800-4824-81fb-10c5396199ea\") " pod="openshift-dns/node-resolver-x9n7p" Jul 07 12:48:13.707356 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706649 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/013f74eb-3b7a-4b07-966b-a64e6fb4124b-iptables-alerter-script\") pod \"iptables-alerter-qjc5g\" (UID: \"013f74eb-3b7a-4b07-966b-a64e6fb4124b\") " pod="openshift-network-operator/iptables-alerter-qjc5g" Jul 07 12:48:13.707356 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706682 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-host-run-ovn-kubernetes\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.707356 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706701 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-multus-cni-dir\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.707356 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706716 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnc99\" (UniqueName: \"kubernetes.io/projected/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-kube-api-access-cnc99\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.707356 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706739 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-etc-systemd\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.707356 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706759 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-859sf\" (UniqueName: \"kubernetes.io/projected/162131a6-2800-4824-81fb-10c5396199ea-kube-api-access-859sf\") pod \"node-resolver-x9n7p\" (UID: \"162131a6-2800-4824-81fb-10c5396199ea\") " pod="openshift-dns/node-resolver-x9n7p" Jul 07 12:48:13.708177 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706774 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-run-openvswitch\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.708177 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706789 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-multus-socket-dir-parent\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.708177 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706806 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-etc-kubernetes\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.708177 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706834 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e1072848-f7b3-4b5b-9517-c09debf2e9af-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jktnw\" (UID: \"e1072848-f7b3-4b5b-9517-c09debf2e9af\") " pod="openshift-multus/multus-additional-cni-plugins-jktnw" Jul 07 12:48:13.708177 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706851 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-etc-kubernetes\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.708177 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706866 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-sys\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.708177 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706892 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-tmp\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.708177 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706919 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-host-cni-netd\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.708177 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706934 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e1072848-f7b3-4b5b-9517-c09debf2e9af-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jktnw\" (UID: \"e1072848-f7b3-4b5b-9517-c09debf2e9af\") " pod="openshift-multus/multus-additional-cni-plugins-jktnw" Jul 07 12:48:13.708177 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706949 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-host\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.708177 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706965 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzwct\" (UniqueName: \"kubernetes.io/projected/488e43e7-1c98-4b52-94c1-41b87c14bc73-kube-api-access-qzwct\") pod \"network-check-target-jdccv\" (UID: \"488e43e7-1c98-4b52-94c1-41b87c14bc73\") " pod="openshift-network-diagnostics/network-check-target-jdccv" Jul 07 12:48:13.708177 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.706990 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/08b292d1-7dd9-45f9-9746-369ba2b0167e-ovn-node-metrics-cert\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.708177 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.707029 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-cnibin\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.708177 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.707043 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-host-var-lib-cni-bin\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.708177 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.707058 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-multus-daemon-config\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.708177 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.707082 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-host-slash\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.709114 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.707096 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-host-cni-bin\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.709114 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.707109 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cd96639c-8bd3-4c04-aedd-41dbd1c2acdb-host\") pod \"node-ca-xqj9j\" (UID: \"cd96639c-8bd3-4c04-aedd-41dbd1c2acdb\") " pod="openshift-image-registry/node-ca-xqj9j" Jul 07 12:48:13.709114 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.707123 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/162131a6-2800-4824-81fb-10c5396199ea-hosts-file\") pod \"node-resolver-x9n7p\" (UID: \"162131a6-2800-4824-81fb-10c5396199ea\") " pod="openshift-dns/node-resolver-x9n7p" Jul 07 12:48:13.709114 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.707172 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-systemd-units\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.709114 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.707190 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-etc-openvswitch\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.709114 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.707205 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e1072848-f7b3-4b5b-9517-c09debf2e9af-os-release\") pod \"multus-additional-cni-plugins-jktnw\" (UID: \"e1072848-f7b3-4b5b-9517-c09debf2e9af\") " pod="openshift-multus/multus-additional-cni-plugins-jktnw" Jul 07 12:48:13.709114 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.707236 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22898bc2-4cf6-4d84-b1e1-54504130b156-metrics-certs\") pod \"network-metrics-daemon-svv9n\" (UID: \"22898bc2-4cf6-4d84-b1e1-54504130b156\") " pod="openshift-multus/network-metrics-daemon-svv9n" Jul 07 12:48:13.709114 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.707254 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1072848-f7b3-4b5b-9517-c09debf2e9af-system-cni-dir\") pod \"multus-additional-cni-plugins-jktnw\" (UID: \"e1072848-f7b3-4b5b-9517-c09debf2e9af\") " pod="openshift-multus/multus-additional-cni-plugins-jktnw" Jul 07 12:48:13.709114 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.707275 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-etc-modprobe-d\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.709114 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.707294 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-run-ovn\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.709114 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.707466 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 12:48:13.733360 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.733341 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8tgt2" Jul 07 12:48:13.742661 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.742644 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8tgt2" Jul 07 12:48:13.777023 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.776992 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 12:48:13.794526 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.794505 2555 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 12:48:13.808627 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.808606 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-etc-openvswitch\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.808724 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.808634 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e1072848-f7b3-4b5b-9517-c09debf2e9af-os-release\") pod \"multus-additional-cni-plugins-jktnw\" (UID: \"e1072848-f7b3-4b5b-9517-c09debf2e9af\") " pod="openshift-multus/multus-additional-cni-plugins-jktnw" Jul 07 12:48:13.808724 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.808653 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22898bc2-4cf6-4d84-b1e1-54504130b156-metrics-certs\") pod \"network-metrics-daemon-svv9n\" (UID: \"22898bc2-4cf6-4d84-b1e1-54504130b156\") " pod="openshift-multus/network-metrics-daemon-svv9n" Jul 07 12:48:13.808724 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.808677 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1072848-f7b3-4b5b-9517-c09debf2e9af-system-cni-dir\") pod \"multus-additional-cni-plugins-jktnw\" (UID: \"e1072848-f7b3-4b5b-9517-c09debf2e9af\") " pod="openshift-multus/multus-additional-cni-plugins-jktnw" Jul 07 12:48:13.808724 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.808701 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-etc-modprobe-d\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.808905 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.808747 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1072848-f7b3-4b5b-9517-c09debf2e9af-system-cni-dir\") pod \"multus-additional-cni-plugins-jktnw\" (UID: \"e1072848-f7b3-4b5b-9517-c09debf2e9af\") " pod="openshift-multus/multus-additional-cni-plugins-jktnw" Jul 07 12:48:13.808905 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.808745 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e1072848-f7b3-4b5b-9517-c09debf2e9af-os-release\") pod \"multus-additional-cni-plugins-jktnw\" (UID: \"e1072848-f7b3-4b5b-9517-c09debf2e9af\") " pod="openshift-multus/multus-additional-cni-plugins-jktnw" Jul 07 12:48:13.808905 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.808769 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-etc-openvswitch\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.808905 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:13.808809 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 12:48:13.808905 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.808816 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-run-ovn\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.808905 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.808846 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq7c5\" (UniqueName: \"kubernetes.io/projected/08b292d1-7dd9-45f9-9746-369ba2b0167e-kube-api-access-qq7c5\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.808905 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.808868 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-run-ovn\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.808905 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:13.808880 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22898bc2-4cf6-4d84-b1e1-54504130b156-metrics-certs podName:22898bc2-4cf6-4d84-b1e1-54504130b156 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:14.308858174 +0000 UTC m=+3.030585691 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22898bc2-4cf6-4d84-b1e1-54504130b156-metrics-certs") pod "network-metrics-daemon-svv9n" (UID: "22898bc2-4cf6-4d84-b1e1-54504130b156") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 12:48:13.809310 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.808905 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e1072848-f7b3-4b5b-9517-c09debf2e9af-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jktnw\" (UID: \"e1072848-f7b3-4b5b-9517-c09debf2e9af\") " pod="openshift-multus/multus-additional-cni-plugins-jktnw" Jul 07 12:48:13.809310 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.808921 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-etc-modprobe-d\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.809310 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.808938 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-etc-sysconfig\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.809310 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.808967 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a499a0dd-8beb-4c74-b8be-cd4783289255-etc-selinux\") pod \"aws-ebs-csi-driver-node-hlpsw\" (UID: \"a499a0dd-8beb-4c74-b8be-cd4783289255\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hlpsw" Jul 07 12:48:13.809310 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.808993 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-system-cni-dir\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.809310 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809015 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-host-run-netns\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.809310 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809039 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-multus-conf-dir\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.809310 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809062 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-run\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.809310 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809079 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-system-cni-dir\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.809310 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809082 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-host-run-netns\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.809310 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809038 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-etc-sysconfig\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.809310 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809098 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-multus-conf-dir\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.809310 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809087 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cd96639c-8bd3-4c04-aedd-41dbd1c2acdb-serviceca\") pod \"node-ca-xqj9j\" (UID: \"cd96639c-8bd3-4c04-aedd-41dbd1c2acdb\") " pod="openshift-image-registry/node-ca-xqj9j" Jul 07 12:48:13.809310 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809135 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt6dw\" (UniqueName: \"kubernetes.io/projected/a499a0dd-8beb-4c74-b8be-cd4783289255-kube-api-access-bt6dw\") pod \"aws-ebs-csi-driver-node-hlpsw\" (UID: \"a499a0dd-8beb-4c74-b8be-cd4783289255\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hlpsw" Jul 07 12:48:13.809310 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809155 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-host-run-netns\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.809310 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809198 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-cni-binary-copy\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.809310 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809220 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-host-run-netns\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.810152 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809223 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx48l\" (UniqueName: \"kubernetes.io/projected/e1072848-f7b3-4b5b-9517-c09debf2e9af-kube-api-access-zx48l\") pod \"multus-additional-cni-plugins-jktnw\" (UID: \"e1072848-f7b3-4b5b-9517-c09debf2e9af\") " pod="openshift-multus/multus-additional-cni-plugins-jktnw" Jul 07 12:48:13.810152 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809232 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-run\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.810152 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809254 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/99606493-0799-450b-a6f8-d3795ff36e30-kubelet-config\") pod \"global-pull-secret-syncer-m6fbl\" (UID: \"99606493-0799-450b-a6f8-d3795ff36e30\") " pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:13.810152 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809299 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/401b54f0-9e30-4ac3-8238-067fe8dd42c8-konnectivity-ca\") pod \"konnectivity-agent-8k6fx\" (UID: \"401b54f0-9e30-4ac3-8238-067fe8dd42c8\") " pod="kube-system/konnectivity-agent-8k6fx" Jul 07 12:48:13.810152 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809326 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-var-lib-openvswitch\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.810152 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809353 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.810152 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809377 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-os-release\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.810152 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809399 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/401b54f0-9e30-4ac3-8238-067fe8dd42c8-agent-certs\") pod \"konnectivity-agent-8k6fx\" (UID: \"401b54f0-9e30-4ac3-8238-067fe8dd42c8\") " pod="kube-system/konnectivity-agent-8k6fx" Jul 07 12:48:13.810152 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809422 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-node-log\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.810152 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809470 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-host-var-lib-kubelet\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.810152 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809466 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-var-lib-openvswitch\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.810152 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809497 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs8dc\" (UniqueName: \"kubernetes.io/projected/22898bc2-4cf6-4d84-b1e1-54504130b156-kube-api-access-rs8dc\") pod \"network-metrics-daemon-svv9n\" (UID: \"22898bc2-4cf6-4d84-b1e1-54504130b156\") " pod="openshift-multus/network-metrics-daemon-svv9n" Jul 07 12:48:13.810152 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809524 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-node-log\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.810152 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809562 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.810152 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809584 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-os-release\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.810152 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809597 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cd96639c-8bd3-4c04-aedd-41dbd1c2acdb-serviceca\") pod \"node-ca-xqj9j\" (UID: \"cd96639c-8bd3-4c04-aedd-41dbd1c2acdb\") " pod="openshift-image-registry/node-ca-xqj9j" Jul 07 12:48:13.810152 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809614 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-host-var-lib-kubelet\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.811078 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809524 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a499a0dd-8beb-4c74-b8be-cd4783289255-device-dir\") pod \"aws-ebs-csi-driver-node-hlpsw\" (UID: \"a499a0dd-8beb-4c74-b8be-cd4783289255\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hlpsw" Jul 07 12:48:13.811078 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809670 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-host-kubelet\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.811078 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809698 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-host-var-lib-cni-multus\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.811078 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809697 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e1072848-f7b3-4b5b-9517-c09debf2e9af-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jktnw\" (UID: \"e1072848-f7b3-4b5b-9517-c09debf2e9af\") " pod="openshift-multus/multus-additional-cni-plugins-jktnw" Jul 07 12:48:13.811078 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809723 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srv7l\" (UniqueName: \"kubernetes.io/projected/cd96639c-8bd3-4c04-aedd-41dbd1c2acdb-kube-api-access-srv7l\") pod \"node-ca-xqj9j\" (UID: \"cd96639c-8bd3-4c04-aedd-41dbd1c2acdb\") " pod="openshift-image-registry/node-ca-xqj9j" Jul 07 12:48:13.811078 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809749 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/013f74eb-3b7a-4b07-966b-a64e6fb4124b-host-slash\") pod \"iptables-alerter-qjc5g\" (UID: \"013f74eb-3b7a-4b07-966b-a64e6fb4124b\") " pod="openshift-network-operator/iptables-alerter-qjc5g" Jul 07 12:48:13.811078 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809766 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-host-kubelet\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.811078 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809774 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-var-lib-kubelet\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.811078 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809823 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-var-lib-kubelet\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.811078 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809816 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rtms\" (UniqueName: \"kubernetes.io/projected/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-kube-api-access-2rtms\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.811078 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809848 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/401b54f0-9e30-4ac3-8238-067fe8dd42c8-konnectivity-ca\") pod \"konnectivity-agent-8k6fx\" (UID: \"401b54f0-9e30-4ac3-8238-067fe8dd42c8\") " pod="kube-system/konnectivity-agent-8k6fx" Jul 07 12:48:13.811078 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809862 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-log-socket\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.811078 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809864 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-cni-binary-copy\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.811078 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809894 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/013f74eb-3b7a-4b07-966b-a64e6fb4124b-host-slash\") pod \"iptables-alerter-qjc5g\" (UID: \"013f74eb-3b7a-4b07-966b-a64e6fb4124b\") " pod="openshift-network-operator/iptables-alerter-qjc5g" Jul 07 12:48:13.811078 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809917 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-host-var-lib-cni-multus\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.811078 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809907 2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 12:48:13.811078 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809919 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-log-socket\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.811078 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.809979 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/08b292d1-7dd9-45f9-9746-369ba2b0167e-env-overrides\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.812013 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810007 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-host-run-k8s-cni-cncf-io\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.812013 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810027 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-hostroot\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.812013 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810042 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-host-run-multus-certs\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.812013 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810059 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e1072848-f7b3-4b5b-9517-c09debf2e9af-cnibin\") pod \"multus-additional-cni-plugins-jktnw\" (UID: \"e1072848-f7b3-4b5b-9517-c09debf2e9af\") " pod="openshift-multus/multus-additional-cni-plugins-jktnw" Jul 07 12:48:13.812013 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810076 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e1072848-f7b3-4b5b-9517-c09debf2e9af-cni-binary-copy\") pod \"multus-additional-cni-plugins-jktnw\" (UID: \"e1072848-f7b3-4b5b-9517-c09debf2e9af\") " pod="openshift-multus/multus-additional-cni-plugins-jktnw" Jul 07 12:48:13.812013 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810102 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqj28\" (UniqueName: \"kubernetes.io/projected/013f74eb-3b7a-4b07-966b-a64e6fb4124b-kube-api-access-xqj28\") pod \"iptables-alerter-qjc5g\" (UID: \"013f74eb-3b7a-4b07-966b-a64e6fb4124b\") " pod="openshift-network-operator/iptables-alerter-qjc5g" Jul 07 12:48:13.812013 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810104 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-hostroot\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.812013 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810111 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-host-run-multus-certs\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.812013 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810123 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e1072848-f7b3-4b5b-9517-c09debf2e9af-cnibin\") pod \"multus-additional-cni-plugins-jktnw\" (UID: \"e1072848-f7b3-4b5b-9517-c09debf2e9af\") " pod="openshift-multus/multus-additional-cni-plugins-jktnw" Jul 07 12:48:13.812013 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810150 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-host-run-k8s-cni-cncf-io\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.812013 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810187 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-run-systemd\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.812013 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810213 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/08b292d1-7dd9-45f9-9746-369ba2b0167e-ovnkube-config\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.812013 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810234 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-run-systemd\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.812013 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810238 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/08b292d1-7dd9-45f9-9746-369ba2b0167e-ovnkube-script-lib\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.812013 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810263 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-etc-sysctl-d\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.812013 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810286 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-etc-sysctl-conf\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.812013 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810309 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-lib-modules\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.812013 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810333 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-etc-tuned\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.812782 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810356 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/162131a6-2800-4824-81fb-10c5396199ea-tmp-dir\") pod \"node-resolver-x9n7p\" (UID: \"162131a6-2800-4824-81fb-10c5396199ea\") " pod="openshift-dns/node-resolver-x9n7p" Jul 07 12:48:13.812782 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810381 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-etc-sysctl-d\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.812782 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810419 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/013f74eb-3b7a-4b07-966b-a64e6fb4124b-iptables-alerter-script\") pod \"iptables-alerter-qjc5g\" (UID: \"013f74eb-3b7a-4b07-966b-a64e6fb4124b\") " pod="openshift-network-operator/iptables-alerter-qjc5g" Jul 07 12:48:13.812782 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810484 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-host-run-ovn-kubernetes\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.812782 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810514 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-multus-cni-dir\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.812782 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810536 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-lib-modules\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.812782 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810540 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnc99\" (UniqueName: \"kubernetes.io/projected/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-kube-api-access-cnc99\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.812782 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810546 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/08b292d1-7dd9-45f9-9746-369ba2b0167e-env-overrides\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.812782 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810572 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-etc-systemd\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.812782 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810593 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-host-run-ovn-kubernetes\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.812782 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810602 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a499a0dd-8beb-4c74-b8be-cd4783289255-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hlpsw\" (UID: \"a499a0dd-8beb-4c74-b8be-cd4783289255\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hlpsw" Jul 07 12:48:13.812782 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810642 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a499a0dd-8beb-4c74-b8be-cd4783289255-sys-fs\") pod \"aws-ebs-csi-driver-node-hlpsw\" (UID: \"a499a0dd-8beb-4c74-b8be-cd4783289255\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hlpsw" Jul 07 12:48:13.812782 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810653 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e1072848-f7b3-4b5b-9517-c09debf2e9af-cni-binary-copy\") pod \"multus-additional-cni-plugins-jktnw\" (UID: \"e1072848-f7b3-4b5b-9517-c09debf2e9af\") " pod="openshift-multus/multus-additional-cni-plugins-jktnw" Jul 07 12:48:13.812782 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810664 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-859sf\" (UniqueName: \"kubernetes.io/projected/162131a6-2800-4824-81fb-10c5396199ea-kube-api-access-859sf\") pod \"node-resolver-x9n7p\" (UID: \"162131a6-2800-4824-81fb-10c5396199ea\") " pod="openshift-dns/node-resolver-x9n7p" Jul 07 12:48:13.812782 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810687 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-run-openvswitch\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.812782 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810720 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-multus-cni-dir\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.812782 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810733 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-multus-socket-dir-parent\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.813293 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810742 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-etc-systemd\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.813293 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810759 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-etc-kubernetes\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.813293 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810801 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e1072848-f7b3-4b5b-9517-c09debf2e9af-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jktnw\" (UID: \"e1072848-f7b3-4b5b-9517-c09debf2e9af\") " pod="openshift-multus/multus-additional-cni-plugins-jktnw" Jul 07 12:48:13.813293 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810807 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/08b292d1-7dd9-45f9-9746-369ba2b0167e-ovnkube-config\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.813293 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810822 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-etc-kubernetes\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.813293 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810830 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-etc-kubernetes\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.813293 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810832 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/08b292d1-7dd9-45f9-9746-369ba2b0167e-ovnkube-script-lib\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.813293 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810854 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-sys\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.813293 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810873 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-multus-socket-dir-parent\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.813293 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810882 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-run-openvswitch\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.813293 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810931 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-etc-kubernetes\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.813293 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810930 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-etc-sysctl-conf\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.813293 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810941 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-sys\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.813293 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.810990 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-tmp\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.813293 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.811053 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/013f74eb-3b7a-4b07-966b-a64e6fb4124b-iptables-alerter-script\") pod \"iptables-alerter-qjc5g\" (UID: \"013f74eb-3b7a-4b07-966b-a64e6fb4124b\") " pod="openshift-network-operator/iptables-alerter-qjc5g" Jul 07 12:48:13.813293 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.811075 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-host-cni-netd\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.813293 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.811106 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e1072848-f7b3-4b5b-9517-c09debf2e9af-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jktnw\" (UID: \"e1072848-f7b3-4b5b-9517-c09debf2e9af\") " pod="openshift-multus/multus-additional-cni-plugins-jktnw" Jul 07 12:48:13.813293 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.811162 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-host\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.813847 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.811162 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/162131a6-2800-4824-81fb-10c5396199ea-tmp-dir\") pod \"node-resolver-x9n7p\" (UID: \"162131a6-2800-4824-81fb-10c5396199ea\") " pod="openshift-dns/node-resolver-x9n7p" Jul 07 12:48:13.813847 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.811228 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-host-cni-netd\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.813847 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.811302 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e1072848-f7b3-4b5b-9517-c09debf2e9af-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jktnw\" (UID: \"e1072848-f7b3-4b5b-9517-c09debf2e9af\") " pod="openshift-multus/multus-additional-cni-plugins-jktnw" Jul 07 12:48:13.813847 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.811309 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-host\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.813847 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.811266 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzwct\" (UniqueName: \"kubernetes.io/projected/488e43e7-1c98-4b52-94c1-41b87c14bc73-kube-api-access-qzwct\") pod \"network-check-target-jdccv\" (UID: \"488e43e7-1c98-4b52-94c1-41b87c14bc73\") " pod="openshift-network-diagnostics/network-check-target-jdccv" Jul 07 12:48:13.813847 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.811345 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a499a0dd-8beb-4c74-b8be-cd4783289255-registration-dir\") pod \"aws-ebs-csi-driver-node-hlpsw\" (UID: \"a499a0dd-8beb-4c74-b8be-cd4783289255\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hlpsw" Jul 07 12:48:13.813847 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.811371 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99606493-0799-450b-a6f8-d3795ff36e30-original-pull-secret\") pod \"global-pull-secret-syncer-m6fbl\" (UID: \"99606493-0799-450b-a6f8-d3795ff36e30\") " pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:13.813847 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.811396 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/08b292d1-7dd9-45f9-9746-369ba2b0167e-ovn-node-metrics-cert\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.813847 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.811417 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-cnibin\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.813847 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.811452 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e1072848-f7b3-4b5b-9517-c09debf2e9af-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jktnw\" (UID: \"e1072848-f7b3-4b5b-9517-c09debf2e9af\") " pod="openshift-multus/multus-additional-cni-plugins-jktnw" Jul 07 12:48:13.813847 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.811539 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-host-var-lib-cni-bin\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.813847 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.811579 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-multus-daemon-config\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.813847 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.811606 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-host-slash\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.813847 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.811618 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-cnibin\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.813847 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.811630 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-host-cni-bin\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.813847 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.811655 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cd96639c-8bd3-4c04-aedd-41dbd1c2acdb-host\") pod \"node-ca-xqj9j\" (UID: \"cd96639c-8bd3-4c04-aedd-41dbd1c2acdb\") " pod="openshift-image-registry/node-ca-xqj9j" Jul 07 12:48:13.813847 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.811709 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a499a0dd-8beb-4c74-b8be-cd4783289255-socket-dir\") pod \"aws-ebs-csi-driver-node-hlpsw\" (UID: \"a499a0dd-8beb-4c74-b8be-cd4783289255\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hlpsw" Jul 07 12:48:13.814425 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.811736 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/99606493-0799-450b-a6f8-d3795ff36e30-dbus\") pod \"global-pull-secret-syncer-m6fbl\" (UID: \"99606493-0799-450b-a6f8-d3795ff36e30\") " pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:13.814425 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.811764 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/162131a6-2800-4824-81fb-10c5396199ea-hosts-file\") pod \"node-resolver-x9n7p\" (UID: \"162131a6-2800-4824-81fb-10c5396199ea\") " pod="openshift-dns/node-resolver-x9n7p" Jul 07 12:48:13.814425 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.811791 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-systemd-units\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.814425 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.811867 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-systemd-units\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.814425 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.811915 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-host-slash\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.814425 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.811955 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08b292d1-7dd9-45f9-9746-369ba2b0167e-host-cni-bin\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.814425 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.811993 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cd96639c-8bd3-4c04-aedd-41dbd1c2acdb-host\") pod \"node-ca-xqj9j\" (UID: \"cd96639c-8bd3-4c04-aedd-41dbd1c2acdb\") " pod="openshift-image-registry/node-ca-xqj9j" Jul 07 12:48:13.814425 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.812058 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-multus-daemon-config\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.814425 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.812066 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/162131a6-2800-4824-81fb-10c5396199ea-hosts-file\") pod \"node-resolver-x9n7p\" (UID: \"162131a6-2800-4824-81fb-10c5396199ea\") " pod="openshift-dns/node-resolver-x9n7p" Jul 07 12:48:13.814425 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.812110 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-host-var-lib-cni-bin\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.814425 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.814349 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-tmp\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.814810 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.814431 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-etc-tuned\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.814810 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.814640 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/08b292d1-7dd9-45f9-9746-369ba2b0167e-ovn-node-metrics-cert\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.814810 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.814746 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/401b54f0-9e30-4ac3-8238-067fe8dd42c8-agent-certs\") pod \"konnectivity-agent-8k6fx\" (UID: \"401b54f0-9e30-4ac3-8238-067fe8dd42c8\") " pod="kube-system/konnectivity-agent-8k6fx" Jul 07 12:48:13.820042 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.820022 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq7c5\" (UniqueName: \"kubernetes.io/projected/08b292d1-7dd9-45f9-9746-369ba2b0167e-kube-api-access-qq7c5\") pod \"ovnkube-node-cgbr7\" (UID: \"08b292d1-7dd9-45f9-9746-369ba2b0167e\") " pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:13.820982 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:13.820960 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 12:48:13.821096 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:13.820986 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 12:48:13.821096 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:13.821000 2555 projected.go:196] Error preparing data for projected volume kube-api-access-qzwct for pod openshift-network-diagnostics/network-check-target-jdccv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 12:48:13.821096 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:13.821065 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/488e43e7-1c98-4b52-94c1-41b87c14bc73-kube-api-access-qzwct podName:488e43e7-1c98-4b52-94c1-41b87c14bc73 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:14.321044929 +0000 UTC m=+3.042772431 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qzwct" (UniqueName: "kubernetes.io/projected/488e43e7-1c98-4b52-94c1-41b87c14bc73-kube-api-access-qzwct") pod "network-check-target-jdccv" (UID: "488e43e7-1c98-4b52-94c1-41b87c14bc73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 12:48:13.822416 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.822285 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqj28\" (UniqueName: \"kubernetes.io/projected/013f74eb-3b7a-4b07-966b-a64e6fb4124b-kube-api-access-xqj28\") pod \"iptables-alerter-qjc5g\" (UID: \"013f74eb-3b7a-4b07-966b-a64e6fb4124b\") " pod="openshift-network-operator/iptables-alerter-qjc5g" Jul 07 12:48:13.822680 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.822600 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx48l\" (UniqueName: \"kubernetes.io/projected/e1072848-f7b3-4b5b-9517-c09debf2e9af-kube-api-access-zx48l\") pod \"multus-additional-cni-plugins-jktnw\" (UID: \"e1072848-f7b3-4b5b-9517-c09debf2e9af\") " pod="openshift-multus/multus-additional-cni-plugins-jktnw" Jul 07 12:48:13.823189 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.823121 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal" event={"ID":"05dfd04fd79f7fb9287794a7ffe49d97","Type":"ContainerStarted","Data":"2f50a9eccd9117380fba072a18d74f43446261f49c4c424eda202b494ad0edc1"} Jul 07 12:48:13.823290 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.823263 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rtms\" (UniqueName: \"kubernetes.io/projected/cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7-kube-api-access-2rtms\") pod \"tuned-rvzj2\" (UID: \"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7\") " pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:13.823937 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.823912 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-859sf\" (UniqueName: \"kubernetes.io/projected/162131a6-2800-4824-81fb-10c5396199ea-kube-api-access-859sf\") pod \"node-resolver-x9n7p\" (UID: \"162131a6-2800-4824-81fb-10c5396199ea\") " pod="openshift-dns/node-resolver-x9n7p" Jul 07 12:48:13.824318 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.824295 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-245.ec2.internal" event={"ID":"7c175a9fb55810a6c1b33f39f05a41c8","Type":"ContainerStarted","Data":"379ec604229ba83116aebb8146211d942f85bc6cb2ad41958000f6e99a99ad62"} Jul 07 12:48:13.824447 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.824387 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srv7l\" (UniqueName: \"kubernetes.io/projected/cd96639c-8bd3-4c04-aedd-41dbd1c2acdb-kube-api-access-srv7l\") pod \"node-ca-xqj9j\" (UID: \"cd96639c-8bd3-4c04-aedd-41dbd1c2acdb\") " pod="openshift-image-registry/node-ca-xqj9j" Jul 07 12:48:13.824827 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.824803 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs8dc\" (UniqueName: \"kubernetes.io/projected/22898bc2-4cf6-4d84-b1e1-54504130b156-kube-api-access-rs8dc\") pod \"network-metrics-daemon-svv9n\" (UID: \"22898bc2-4cf6-4d84-b1e1-54504130b156\") " pod="openshift-multus/network-metrics-daemon-svv9n" Jul 07 12:48:13.825159 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.825145 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnc99\" (UniqueName: \"kubernetes.io/projected/898c8ea7-1c99-4f3d-8b4d-beff802f2e91-kube-api-access-cnc99\") pod \"multus-rd9dk\" (UID: \"898c8ea7-1c99-4f3d-8b4d-beff802f2e91\") " pod="openshift-multus/multus-rd9dk" Jul 07 12:48:13.912857 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.912836 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a499a0dd-8beb-4c74-b8be-cd4783289255-etc-selinux\") pod \"aws-ebs-csi-driver-node-hlpsw\" (UID: \"a499a0dd-8beb-4c74-b8be-cd4783289255\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hlpsw" Jul 07 12:48:13.912954 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.912864 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt6dw\" (UniqueName: \"kubernetes.io/projected/a499a0dd-8beb-4c74-b8be-cd4783289255-kube-api-access-bt6dw\") pod \"aws-ebs-csi-driver-node-hlpsw\" (UID: \"a499a0dd-8beb-4c74-b8be-cd4783289255\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hlpsw" Jul 07 12:48:13.912954 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.912883 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/99606493-0799-450b-a6f8-d3795ff36e30-kubelet-config\") pod \"global-pull-secret-syncer-m6fbl\" (UID: \"99606493-0799-450b-a6f8-d3795ff36e30\") " pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:13.912954 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.912902 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a499a0dd-8beb-4c74-b8be-cd4783289255-device-dir\") pod \"aws-ebs-csi-driver-node-hlpsw\" (UID: \"a499a0dd-8beb-4c74-b8be-cd4783289255\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hlpsw" Jul 07 12:48:13.912954 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.912941 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a499a0dd-8beb-4c74-b8be-cd4783289255-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hlpsw\" (UID: \"a499a0dd-8beb-4c74-b8be-cd4783289255\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hlpsw" Jul 07 12:48:13.913167 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.912978 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a499a0dd-8beb-4c74-b8be-cd4783289255-etc-selinux\") pod \"aws-ebs-csi-driver-node-hlpsw\" (UID: \"a499a0dd-8beb-4c74-b8be-cd4783289255\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hlpsw" Jul 07 12:48:13.913167 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.913000 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a499a0dd-8beb-4c74-b8be-cd4783289255-device-dir\") pod \"aws-ebs-csi-driver-node-hlpsw\" (UID: \"a499a0dd-8beb-4c74-b8be-cd4783289255\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hlpsw" Jul 07 12:48:13.913167 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.912998 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a499a0dd-8beb-4c74-b8be-cd4783289255-sys-fs\") pod \"aws-ebs-csi-driver-node-hlpsw\" (UID: \"a499a0dd-8beb-4c74-b8be-cd4783289255\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hlpsw" Jul 07 12:48:13.913167 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.913061 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a499a0dd-8beb-4c74-b8be-cd4783289255-registration-dir\") pod \"aws-ebs-csi-driver-node-hlpsw\" (UID: \"a499a0dd-8beb-4c74-b8be-cd4783289255\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hlpsw" Jul 07 12:48:13.913167 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.913066 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a499a0dd-8beb-4c74-b8be-cd4783289255-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hlpsw\" (UID: \"a499a0dd-8beb-4c74-b8be-cd4783289255\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hlpsw" Jul 07 12:48:13.913167 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.913075 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/99606493-0799-450b-a6f8-d3795ff36e30-kubelet-config\") pod \"global-pull-secret-syncer-m6fbl\" (UID: \"99606493-0799-450b-a6f8-d3795ff36e30\") " pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:13.913167 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.913072 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a499a0dd-8beb-4c74-b8be-cd4783289255-sys-fs\") pod \"aws-ebs-csi-driver-node-hlpsw\" (UID: \"a499a0dd-8beb-4c74-b8be-cd4783289255\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hlpsw" Jul 07 12:48:13.913167 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.913089 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99606493-0799-450b-a6f8-d3795ff36e30-original-pull-secret\") pod \"global-pull-secret-syncer-m6fbl\" (UID: \"99606493-0799-450b-a6f8-d3795ff36e30\") " pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:13.913167 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.913138 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a499a0dd-8beb-4c74-b8be-cd4783289255-socket-dir\") pod \"aws-ebs-csi-driver-node-hlpsw\" (UID: \"a499a0dd-8beb-4c74-b8be-cd4783289255\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hlpsw" Jul 07 12:48:13.913167 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.913138 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a499a0dd-8beb-4c74-b8be-cd4783289255-registration-dir\") pod \"aws-ebs-csi-driver-node-hlpsw\" (UID: \"a499a0dd-8beb-4c74-b8be-cd4783289255\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hlpsw" Jul 07 12:48:13.913167 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.913166 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/99606493-0799-450b-a6f8-d3795ff36e30-dbus\") pod \"global-pull-secret-syncer-m6fbl\" (UID: \"99606493-0799-450b-a6f8-d3795ff36e30\") " pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:13.913669 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:13.913175 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 12:48:13.913669 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:13.913237 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99606493-0799-450b-a6f8-d3795ff36e30-original-pull-secret podName:99606493-0799-450b-a6f8-d3795ff36e30 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:14.413213996 +0000 UTC m=+3.134941504 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99606493-0799-450b-a6f8-d3795ff36e30-original-pull-secret") pod "global-pull-secret-syncer-m6fbl" (UID: "99606493-0799-450b-a6f8-d3795ff36e30") : object "kube-system"/"original-pull-secret" not registered Jul 07 12:48:13.913669 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.913252 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a499a0dd-8beb-4c74-b8be-cd4783289255-socket-dir\") pod \"aws-ebs-csi-driver-node-hlpsw\" (UID: \"a499a0dd-8beb-4c74-b8be-cd4783289255\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hlpsw" Jul 07 12:48:13.913669 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.913304 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/99606493-0799-450b-a6f8-d3795ff36e30-dbus\") pod \"global-pull-secret-syncer-m6fbl\" (UID: \"99606493-0799-450b-a6f8-d3795ff36e30\") " pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:13.924697 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.924645 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt6dw\" (UniqueName: \"kubernetes.io/projected/a499a0dd-8beb-4c74-b8be-cd4783289255-kube-api-access-bt6dw\") pod \"aws-ebs-csi-driver-node-hlpsw\" (UID: \"a499a0dd-8beb-4c74-b8be-cd4783289255\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hlpsw" Jul 07 12:48:13.991398 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.991368 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x9n7p" Jul 07 12:48:13.999578 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:13.999554 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qjc5g" Jul 07 12:48:14.000194 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:14.000170 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod162131a6_2800_4824_81fb_10c5396199ea.slice/crio-6bc260faf9c6e059b19464b0f6b17f345d66ca2015e5795cba811bf82fa89727 WatchSource:0}: Error finding container 6bc260faf9c6e059b19464b0f6b17f345d66ca2015e5795cba811bf82fa89727: Status 404 returned error can't find the container with id 6bc260faf9c6e059b19464b0f6b17f345d66ca2015e5795cba811bf82fa89727 Jul 07 12:48:14.007080 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:14.007063 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8k6fx" Jul 07 12:48:14.010555 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:14.010530 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod013f74eb_3b7a_4b07_966b_a64e6fb4124b.slice/crio-68981797b2d8cf76e8a0b2d308d98127c9fb601e9fcd5c13ef88ed021ac0c6a2 WatchSource:0}: Error finding container 68981797b2d8cf76e8a0b2d308d98127c9fb601e9fcd5c13ef88ed021ac0c6a2: Status 404 returned error can't find the container with id 68981797b2d8cf76e8a0b2d308d98127c9fb601e9fcd5c13ef88ed021ac0c6a2 Jul 07 12:48:14.012057 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:14.012035 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:14.016939 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:14.016913 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod401b54f0_9e30_4ac3_8238_067fe8dd42c8.slice/crio-989126eaf980db3b9eddbf2d29819137663af557b219dc2a6ba987085778d37e WatchSource:0}: Error finding container 989126eaf980db3b9eddbf2d29819137663af557b219dc2a6ba987085778d37e: Status 404 returned error can't find the container with id 989126eaf980db3b9eddbf2d29819137663af557b219dc2a6ba987085778d37e Jul 07 12:48:14.017939 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:14.017923 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" Jul 07 12:48:14.021784 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:14.021762 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08b292d1_7dd9_45f9_9746_369ba2b0167e.slice/crio-0920a6a3b89e9ad9e705969b6d95922a36d0942fb95f88d48c4b4ed1c785b568 WatchSource:0}: Error finding container 0920a6a3b89e9ad9e705969b6d95922a36d0942fb95f88d48c4b4ed1c785b568: Status 404 returned error can't find the container with id 0920a6a3b89e9ad9e705969b6d95922a36d0942fb95f88d48c4b4ed1c785b568 Jul 07 12:48:14.023934 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:14.023915 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rd9dk" Jul 07 12:48:14.027832 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:14.027794 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcad6ecfe_4edf_4cf0_b137_bf5525a1c7a7.slice/crio-6d97d74c626c1a43412d57d6e6412926b47b95d7e02c7c24fc79803ede7da4c1 WatchSource:0}: Error finding container 6d97d74c626c1a43412d57d6e6412926b47b95d7e02c7c24fc79803ede7da4c1: Status 404 returned error can't find the container with id 6d97d74c626c1a43412d57d6e6412926b47b95d7e02c7c24fc79803ede7da4c1 Jul 07 12:48:14.030469 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:14.030395 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jktnw" Jul 07 12:48:14.033692 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:14.033300 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod898c8ea7_1c99_4f3d_8b4d_beff802f2e91.slice/crio-f30dbe46bf26eb3b4a87af3abd459ad0db6791b99393a5c796b7050efb56b39b WatchSource:0}: Error finding container f30dbe46bf26eb3b4a87af3abd459ad0db6791b99393a5c796b7050efb56b39b: Status 404 returned error can't find the container with id f30dbe46bf26eb3b4a87af3abd459ad0db6791b99393a5c796b7050efb56b39b Jul 07 12:48:14.035689 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:14.035668 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xqj9j" Jul 07 12:48:14.039483 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:14.039390 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1072848_f7b3_4b5b_9517_c09debf2e9af.slice/crio-d919659ff2d4a3430837f590f8d7db976e5d57ffaf3c5790fc28972e86727c2c WatchSource:0}: Error finding container d919659ff2d4a3430837f590f8d7db976e5d57ffaf3c5790fc28972e86727c2c: Status 404 returned error can't find the container with id d919659ff2d4a3430837f590f8d7db976e5d57ffaf3c5790fc28972e86727c2c Jul 07 12:48:14.040829 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:14.040809 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hlpsw" Jul 07 12:48:14.049265 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:14.049241 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd96639c_8bd3_4c04_aedd_41dbd1c2acdb.slice/crio-f31f0f0d00e5a8e49c4c15be43b82a0405dcfc08e5be1db3a4df3225cd4a7eed WatchSource:0}: Error finding container f31f0f0d00e5a8e49c4c15be43b82a0405dcfc08e5be1db3a4df3225cd4a7eed: Status 404 returned error can't find the container with id f31f0f0d00e5a8e49c4c15be43b82a0405dcfc08e5be1db3a4df3225cd4a7eed Jul 07 12:48:14.053412 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:14.053388 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda499a0dd_8beb_4c74_b8be_cd4783289255.slice/crio-b7c62af81e75c6daef0b1822d5ed6224cbe7dfc26348de06e12dd936aabaca2d WatchSource:0}: Error finding container b7c62af81e75c6daef0b1822d5ed6224cbe7dfc26348de06e12dd936aabaca2d: Status 404 returned error can't find the container with id b7c62af81e75c6daef0b1822d5ed6224cbe7dfc26348de06e12dd936aabaca2d Jul 07 12:48:14.316101 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:14.316015 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22898bc2-4cf6-4d84-b1e1-54504130b156-metrics-certs\") pod \"network-metrics-daemon-svv9n\" (UID: \"22898bc2-4cf6-4d84-b1e1-54504130b156\") " pod="openshift-multus/network-metrics-daemon-svv9n" Jul 07 12:48:14.316270 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:14.316170 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 12:48:14.316270 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:14.316239 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22898bc2-4cf6-4d84-b1e1-54504130b156-metrics-certs podName:22898bc2-4cf6-4d84-b1e1-54504130b156 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:15.316218398 +0000 UTC m=+4.037945897 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22898bc2-4cf6-4d84-b1e1-54504130b156-metrics-certs") pod "network-metrics-daemon-svv9n" (UID: "22898bc2-4cf6-4d84-b1e1-54504130b156") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 12:48:14.416709 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:14.416672 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzwct\" (UniqueName: \"kubernetes.io/projected/488e43e7-1c98-4b52-94c1-41b87c14bc73-kube-api-access-qzwct\") pod \"network-check-target-jdccv\" (UID: \"488e43e7-1c98-4b52-94c1-41b87c14bc73\") " pod="openshift-network-diagnostics/network-check-target-jdccv" Jul 07 12:48:14.416887 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:14.416719 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99606493-0799-450b-a6f8-d3795ff36e30-original-pull-secret\") pod \"global-pull-secret-syncer-m6fbl\" (UID: \"99606493-0799-450b-a6f8-d3795ff36e30\") " pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:14.416887 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:14.416820 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 12:48:14.416887 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:14.416843 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 12:48:14.416887 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:14.416856 2555 projected.go:196] Error preparing data for projected volume kube-api-access-qzwct for pod openshift-network-diagnostics/network-check-target-jdccv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 12:48:14.416887 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:14.416868 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 12:48:14.417155 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:14.416920 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/488e43e7-1c98-4b52-94c1-41b87c14bc73-kube-api-access-qzwct podName:488e43e7-1c98-4b52-94c1-41b87c14bc73 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:15.416906085 +0000 UTC m=+4.138633578 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qzwct" (UniqueName: "kubernetes.io/projected/488e43e7-1c98-4b52-94c1-41b87c14bc73-kube-api-access-qzwct") pod "network-check-target-jdccv" (UID: "488e43e7-1c98-4b52-94c1-41b87c14bc73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 12:48:14.417155 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:14.416940 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99606493-0799-450b-a6f8-d3795ff36e30-original-pull-secret podName:99606493-0799-450b-a6f8-d3795ff36e30 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:15.416931068 +0000 UTC m=+4.138658561 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99606493-0799-450b-a6f8-d3795ff36e30-original-pull-secret") pod "global-pull-secret-syncer-m6fbl" (UID: "99606493-0799-450b-a6f8-d3795ff36e30") : object "kube-system"/"original-pull-secret" not registered Jul 07 12:48:14.745566 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:14.745362 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 12:43:14 +0000 UTC" deadline="2028-01-01 16:46:00.5630223 +0000 UTC" Jul 07 12:48:14.745566 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:14.745437 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13035h57m45.817589187s" Jul 07 12:48:14.821053 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:14.820521 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:14.821053 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:14.820657 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m6fbl" podUID="99606493-0799-450b-a6f8-d3795ff36e30" Jul 07 12:48:14.828697 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:14.828614 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qjc5g" event={"ID":"013f74eb-3b7a-4b07-966b-a64e6fb4124b","Type":"ContainerStarted","Data":"68981797b2d8cf76e8a0b2d308d98127c9fb601e9fcd5c13ef88ed021ac0c6a2"} Jul 07 12:48:14.831343 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:14.831311 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x9n7p" event={"ID":"162131a6-2800-4824-81fb-10c5396199ea","Type":"ContainerStarted","Data":"6bc260faf9c6e059b19464b0f6b17f345d66ca2015e5795cba811bf82fa89727"} Jul 07 12:48:14.832922 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:14.832847 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hlpsw" event={"ID":"a499a0dd-8beb-4c74-b8be-cd4783289255","Type":"ContainerStarted","Data":"b7c62af81e75c6daef0b1822d5ed6224cbe7dfc26348de06e12dd936aabaca2d"} Jul 07 12:48:14.834414 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:14.834334 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rd9dk" event={"ID":"898c8ea7-1c99-4f3d-8b4d-beff802f2e91","Type":"ContainerStarted","Data":"f30dbe46bf26eb3b4a87af3abd459ad0db6791b99393a5c796b7050efb56b39b"} Jul 07 12:48:14.836577 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:14.836552 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" event={"ID":"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7","Type":"ContainerStarted","Data":"6d97d74c626c1a43412d57d6e6412926b47b95d7e02c7c24fc79803ede7da4c1"} Jul 07 12:48:14.839228 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:14.839199 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" event={"ID":"08b292d1-7dd9-45f9-9746-369ba2b0167e","Type":"ContainerStarted","Data":"0920a6a3b89e9ad9e705969b6d95922a36d0942fb95f88d48c4b4ed1c785b568"} Jul 07 12:48:14.842697 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:14.842670 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8k6fx" event={"ID":"401b54f0-9e30-4ac3-8238-067fe8dd42c8","Type":"ContainerStarted","Data":"989126eaf980db3b9eddbf2d29819137663af557b219dc2a6ba987085778d37e"} Jul 07 12:48:14.845149 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:14.845027 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xqj9j" event={"ID":"cd96639c-8bd3-4c04-aedd-41dbd1c2acdb","Type":"ContainerStarted","Data":"f31f0f0d00e5a8e49c4c15be43b82a0405dcfc08e5be1db3a4df3225cd4a7eed"} Jul 07 12:48:14.848497 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:14.848419 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jktnw" event={"ID":"e1072848-f7b3-4b5b-9517-c09debf2e9af","Type":"ContainerStarted","Data":"d919659ff2d4a3430837f590f8d7db976e5d57ffaf3c5790fc28972e86727c2c"} Jul 07 12:48:15.323103 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:15.323063 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22898bc2-4cf6-4d84-b1e1-54504130b156-metrics-certs\") pod \"network-metrics-daemon-svv9n\" (UID: \"22898bc2-4cf6-4d84-b1e1-54504130b156\") " pod="openshift-multus/network-metrics-daemon-svv9n" Jul 07 12:48:15.323287 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:15.323216 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 12:48:15.323287 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:15.323281 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22898bc2-4cf6-4d84-b1e1-54504130b156-metrics-certs podName:22898bc2-4cf6-4d84-b1e1-54504130b156 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:17.323262257 +0000 UTC m=+6.044989763 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22898bc2-4cf6-4d84-b1e1-54504130b156-metrics-certs") pod "network-metrics-daemon-svv9n" (UID: "22898bc2-4cf6-4d84-b1e1-54504130b156") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 12:48:15.424316 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:15.424276 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzwct\" (UniqueName: \"kubernetes.io/projected/488e43e7-1c98-4b52-94c1-41b87c14bc73-kube-api-access-qzwct\") pod \"network-check-target-jdccv\" (UID: \"488e43e7-1c98-4b52-94c1-41b87c14bc73\") " pod="openshift-network-diagnostics/network-check-target-jdccv" Jul 07 12:48:15.424528 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:15.424330 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99606493-0799-450b-a6f8-d3795ff36e30-original-pull-secret\") pod \"global-pull-secret-syncer-m6fbl\" (UID: \"99606493-0799-450b-a6f8-d3795ff36e30\") " pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:15.424528 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:15.424512 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 12:48:15.424658 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:15.424575 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99606493-0799-450b-a6f8-d3795ff36e30-original-pull-secret podName:99606493-0799-450b-a6f8-d3795ff36e30 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:17.42455635 +0000 UTC m=+6.146283847 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99606493-0799-450b-a6f8-d3795ff36e30-original-pull-secret") pod "global-pull-secret-syncer-m6fbl" (UID: "99606493-0799-450b-a6f8-d3795ff36e30") : object "kube-system"/"original-pull-secret" not registered Jul 07 12:48:15.425039 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:15.425013 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 12:48:15.425133 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:15.425043 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 12:48:15.425133 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:15.425057 2555 projected.go:196] Error preparing data for projected volume kube-api-access-qzwct for pod openshift-network-diagnostics/network-check-target-jdccv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 12:48:15.425133 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:15.425105 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/488e43e7-1c98-4b52-94c1-41b87c14bc73-kube-api-access-qzwct podName:488e43e7-1c98-4b52-94c1-41b87c14bc73 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:17.425088953 +0000 UTC m=+6.146816448 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qzwct" (UniqueName: "kubernetes.io/projected/488e43e7-1c98-4b52-94c1-41b87c14bc73-kube-api-access-qzwct") pod "network-check-target-jdccv" (UID: "488e43e7-1c98-4b52-94c1-41b87c14bc73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 12:48:15.746317 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:15.746223 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 12:43:14 +0000 UTC" deadline="2028-04-18 02:49:46.422371096 +0000 UTC" Jul 07 12:48:15.746317 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:15.746268 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15614h1m30.676107513s" Jul 07 12:48:15.822972 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:15.819675 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdccv" Jul 07 12:48:15.822972 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:15.819811 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdccv" podUID="488e43e7-1c98-4b52-94c1-41b87c14bc73" Jul 07 12:48:15.822972 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:15.820213 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svv9n" Jul 07 12:48:15.822972 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:15.820316 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svv9n" podUID="22898bc2-4cf6-4d84-b1e1-54504130b156" Jul 07 12:48:16.819318 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:16.819283 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:16.819830 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:16.819419 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m6fbl" podUID="99606493-0799-450b-a6f8-d3795ff36e30" Jul 07 12:48:17.343586 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:17.343549 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22898bc2-4cf6-4d84-b1e1-54504130b156-metrics-certs\") pod \"network-metrics-daemon-svv9n\" (UID: \"22898bc2-4cf6-4d84-b1e1-54504130b156\") " pod="openshift-multus/network-metrics-daemon-svv9n" Jul 07 12:48:17.343777 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:17.343720 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 12:48:17.343847 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:17.343792 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22898bc2-4cf6-4d84-b1e1-54504130b156-metrics-certs podName:22898bc2-4cf6-4d84-b1e1-54504130b156 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:21.343771751 +0000 UTC m=+10.065499258 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22898bc2-4cf6-4d84-b1e1-54504130b156-metrics-certs") pod "network-metrics-daemon-svv9n" (UID: "22898bc2-4cf6-4d84-b1e1-54504130b156") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 12:48:17.443988 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:17.443954 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzwct\" (UniqueName: \"kubernetes.io/projected/488e43e7-1c98-4b52-94c1-41b87c14bc73-kube-api-access-qzwct\") pod \"network-check-target-jdccv\" (UID: \"488e43e7-1c98-4b52-94c1-41b87c14bc73\") " pod="openshift-network-diagnostics/network-check-target-jdccv" Jul 07 12:48:17.444140 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:17.444008 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99606493-0799-450b-a6f8-d3795ff36e30-original-pull-secret\") pod \"global-pull-secret-syncer-m6fbl\" (UID: \"99606493-0799-450b-a6f8-d3795ff36e30\") " pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:17.444218 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:17.444179 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 12:48:17.444218 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:17.444207 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 12:48:17.444286 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:17.444236 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 12:48:17.444286 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:17.444250 2555 projected.go:196] Error preparing data for projected volume kube-api-access-qzwct for pod openshift-network-diagnostics/network-check-target-jdccv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 12:48:17.444286 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:17.444279 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99606493-0799-450b-a6f8-d3795ff36e30-original-pull-secret podName:99606493-0799-450b-a6f8-d3795ff36e30 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:21.44425736 +0000 UTC m=+10.165984871 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99606493-0799-450b-a6f8-d3795ff36e30-original-pull-secret") pod "global-pull-secret-syncer-m6fbl" (UID: "99606493-0799-450b-a6f8-d3795ff36e30") : object "kube-system"/"original-pull-secret" not registered Jul 07 12:48:17.444392 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:17.444307 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/488e43e7-1c98-4b52-94c1-41b87c14bc73-kube-api-access-qzwct podName:488e43e7-1c98-4b52-94c1-41b87c14bc73 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:21.444290303 +0000 UTC m=+10.166017796 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qzwct" (UniqueName: "kubernetes.io/projected/488e43e7-1c98-4b52-94c1-41b87c14bc73-kube-api-access-qzwct") pod "network-check-target-jdccv" (UID: "488e43e7-1c98-4b52-94c1-41b87c14bc73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 12:48:17.823785 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:17.823707 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svv9n" Jul 07 12:48:17.824234 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:17.823707 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdccv" Jul 07 12:48:17.824234 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:17.823850 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svv9n" podUID="22898bc2-4cf6-4d84-b1e1-54504130b156" Jul 07 12:48:17.824234 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:17.823874 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdccv" podUID="488e43e7-1c98-4b52-94c1-41b87c14bc73" Jul 07 12:48:18.819809 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:18.819773 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:18.820043 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:18.819923 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m6fbl" podUID="99606493-0799-450b-a6f8-d3795ff36e30" Jul 07 12:48:19.822969 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:19.822941 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdccv" Jul 07 12:48:19.823410 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:19.823053 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdccv" podUID="488e43e7-1c98-4b52-94c1-41b87c14bc73" Jul 07 12:48:19.823410 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:19.823112 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svv9n" Jul 07 12:48:19.823410 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:19.823230 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svv9n" podUID="22898bc2-4cf6-4d84-b1e1-54504130b156" Jul 07 12:48:20.819954 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:20.819916 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:20.820096 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:20.820064 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m6fbl" podUID="99606493-0799-450b-a6f8-d3795ff36e30" Jul 07 12:48:21.378813 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:21.378765 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22898bc2-4cf6-4d84-b1e1-54504130b156-metrics-certs\") pod \"network-metrics-daemon-svv9n\" (UID: \"22898bc2-4cf6-4d84-b1e1-54504130b156\") " pod="openshift-multus/network-metrics-daemon-svv9n" Jul 07 12:48:21.379302 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:21.378934 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 12:48:21.379302 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:21.379011 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22898bc2-4cf6-4d84-b1e1-54504130b156-metrics-certs podName:22898bc2-4cf6-4d84-b1e1-54504130b156 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:29.378991039 +0000 UTC m=+18.100718533 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22898bc2-4cf6-4d84-b1e1-54504130b156-metrics-certs") pod "network-metrics-daemon-svv9n" (UID: "22898bc2-4cf6-4d84-b1e1-54504130b156") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 12:48:21.479814 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:21.479774 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzwct\" (UniqueName: \"kubernetes.io/projected/488e43e7-1c98-4b52-94c1-41b87c14bc73-kube-api-access-qzwct\") pod \"network-check-target-jdccv\" (UID: \"488e43e7-1c98-4b52-94c1-41b87c14bc73\") " pod="openshift-network-diagnostics/network-check-target-jdccv" Jul 07 12:48:21.480008 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:21.479832 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99606493-0799-450b-a6f8-d3795ff36e30-original-pull-secret\") pod \"global-pull-secret-syncer-m6fbl\" (UID: \"99606493-0799-450b-a6f8-d3795ff36e30\") " pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:21.480008 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:21.480002 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 12:48:21.480118 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:21.480070 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99606493-0799-450b-a6f8-d3795ff36e30-original-pull-secret podName:99606493-0799-450b-a6f8-d3795ff36e30 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:29.48004853 +0000 UTC m=+18.201776048 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99606493-0799-450b-a6f8-d3795ff36e30-original-pull-secret") pod "global-pull-secret-syncer-m6fbl" (UID: "99606493-0799-450b-a6f8-d3795ff36e30") : object "kube-system"/"original-pull-secret" not registered Jul 07 12:48:21.480254 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:21.480228 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 12:48:21.480254 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:21.480257 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 12:48:21.480503 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:21.480271 2555 projected.go:196] Error preparing data for projected volume kube-api-access-qzwct for pod openshift-network-diagnostics/network-check-target-jdccv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 12:48:21.480503 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:21.480325 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/488e43e7-1c98-4b52-94c1-41b87c14bc73-kube-api-access-qzwct podName:488e43e7-1c98-4b52-94c1-41b87c14bc73 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:29.480309042 +0000 UTC m=+18.202036551 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qzwct" (UniqueName: "kubernetes.io/projected/488e43e7-1c98-4b52-94c1-41b87c14bc73-kube-api-access-qzwct") pod "network-check-target-jdccv" (UID: "488e43e7-1c98-4b52-94c1-41b87c14bc73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 12:48:21.825471 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:21.824949 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdccv" Jul 07 12:48:21.825471 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:21.825069 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdccv" podUID="488e43e7-1c98-4b52-94c1-41b87c14bc73" Jul 07 12:48:21.825471 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:21.825331 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svv9n" Jul 07 12:48:21.825471 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:21.825459 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svv9n" podUID="22898bc2-4cf6-4d84-b1e1-54504130b156" Jul 07 12:48:22.820407 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:22.820370 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:22.820891 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:22.820527 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m6fbl" podUID="99606493-0799-450b-a6f8-d3795ff36e30" Jul 07 12:48:23.819851 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:23.819774 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svv9n" Jul 07 12:48:23.819851 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:23.819805 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdccv" Jul 07 12:48:23.820121 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:23.819935 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdccv" podUID="488e43e7-1c98-4b52-94c1-41b87c14bc73" Jul 07 12:48:23.820121 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:23.820077 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svv9n" podUID="22898bc2-4cf6-4d84-b1e1-54504130b156" Jul 07 12:48:24.820330 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:24.820127 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:24.820744 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:24.820435 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m6fbl" podUID="99606493-0799-450b-a6f8-d3795ff36e30" Jul 07 12:48:25.820540 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:25.820128 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svv9n" Jul 07 12:48:25.820540 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:25.820158 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdccv" Jul 07 12:48:25.820540 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:25.820276 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svv9n" podUID="22898bc2-4cf6-4d84-b1e1-54504130b156" Jul 07 12:48:25.820540 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:25.820367 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdccv" podUID="488e43e7-1c98-4b52-94c1-41b87c14bc73" Jul 07 12:48:26.819816 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:26.819785 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:26.819961 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:26.819895 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m6fbl" podUID="99606493-0799-450b-a6f8-d3795ff36e30" Jul 07 12:48:26.881149 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:26.881111 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" event={"ID":"cad6ecfe-4edf-4cf0-b137-bf5525a1c7a7","Type":"ContainerStarted","Data":"e152397262582968eb5c8d8dcf914772737799636f526f861b7ec4d8ce09b221"} Jul 07 12:48:26.882823 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:26.882794 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-245.ec2.internal" event={"ID":"7c175a9fb55810a6c1b33f39f05a41c8","Type":"ContainerStarted","Data":"f5229a18b1aa78d771c9c5486ccb636796a2841595662dfc6cb1ff31a3d401c3"} Jul 07 12:48:26.905579 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:26.903977 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rvzj2" podStartSLOduration=3.133777946 podStartE2EDuration="14.90395891s" totalImagesPullingTime="11.770180964s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 12:48:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:48:26.903186588 +0000 UTC m=+15.624914118" watchObservedRunningTime="2026-07-07 12:48:26.90395891 +0000 UTC m=+15.625686423" Jul 07 12:48:26.917827 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:26.917779 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-245.ec2.internal" podStartSLOduration=13.917762828 podStartE2EDuration="13.917762828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 12:48:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:48:26.917640928 +0000 UTC m=+15.639368444" watchObservedRunningTime="2026-07-07 12:48:26.917762828 +0000 UTC m=+15.639490344" Jul 07 12:48:27.819839 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:27.819620 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdccv" Jul 07 12:48:27.820016 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:27.819620 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svv9n" Jul 07 12:48:27.820016 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:27.819944 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdccv" podUID="488e43e7-1c98-4b52-94c1-41b87c14bc73" Jul 07 12:48:27.820108 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:27.820062 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svv9n" podUID="22898bc2-4cf6-4d84-b1e1-54504130b156" Jul 07 12:48:27.886056 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:27.886018 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hlpsw" event={"ID":"a499a0dd-8beb-4c74-b8be-cd4783289255","Type":"ContainerStarted","Data":"9eea11a496785e73054c6c69daadb8345340c1168cd422434300a455e36ea3f4"} Jul 07 12:48:27.887624 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:27.887595 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8k6fx" event={"ID":"401b54f0-9e30-4ac3-8238-067fe8dd42c8","Type":"ContainerStarted","Data":"128340d9a83ce03b14a5810333fb3607c267d3b84523aba211c8b0d02cb0ce5e"} Jul 07 12:48:27.889182 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:27.889159 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xqj9j" event={"ID":"cd96639c-8bd3-4c04-aedd-41dbd1c2acdb","Type":"ContainerStarted","Data":"81b92db196b93cefc645ade741b6e901af8f52f687eec79aff7a28e1b4bae03a"} Jul 07 12:48:27.890842 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:27.890816 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jktnw" event={"ID":"e1072848-f7b3-4b5b-9517-c09debf2e9af","Type":"ContainerStarted","Data":"80dccb2355842e0da75af346d51053d10ef64780a979b49076a8f6eb7aea2e62"} Jul 07 12:48:27.892348 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:27.892320 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qjc5g" event={"ID":"013f74eb-3b7a-4b07-966b-a64e6fb4124b","Type":"ContainerStarted","Data":"2c25e3dab14dfcd3cfd13136c7a213deb4d33278a4e88509e59b5eac9f1d4c64"} Jul 07 12:48:27.893968 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:27.893944 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x9n7p" event={"ID":"162131a6-2800-4824-81fb-10c5396199ea","Type":"ContainerStarted","Data":"48a5d83aa57687f505ed2b75d2924b9a9a91ef28de0c2240158f98ad62d1f02f"} Jul 07 12:48:27.895459 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:27.895435 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal" event={"ID":"05dfd04fd79f7fb9287794a7ffe49d97","Type":"ContainerStarted","Data":"be25f5df255b2a2a1a870872998774f18b37a06849f7032d9f1d840d2c27fb15"} Jul 07 12:48:27.909055 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:27.909011 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8k6fx" podStartSLOduration=4.368476222 podStartE2EDuration="15.908994601s" totalImagesPullingTime="11.540518379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:48:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:48:27.908854856 +0000 UTC m=+16.630582370" watchObservedRunningTime="2026-07-07 12:48:27.908994601 +0000 UTC m=+16.630722117" Jul 07 12:48:27.943163 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:27.943118 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-x9n7p" podStartSLOduration=4.249808071 podStartE2EDuration="15.943106898s" totalImagesPullingTime="11.693298827s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 12:48:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:48:27.943097051 +0000 UTC m=+16.664824556" watchObservedRunningTime="2026-07-07 12:48:27.943106898 +0000 UTC m=+16.664834410" Jul 07 12:48:28.009483 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:28.009435 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xqj9j" podStartSLOduration=4.367188163 podStartE2EDuration="16.009407002s" totalImagesPullingTime="11.642218839s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 12:48:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:48:27.98608621 +0000 UTC m=+16.707813724" watchObservedRunningTime="2026-07-07 12:48:28.009407002 +0000 UTC m=+16.731134520" Jul 07 12:48:28.009630 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:28.009575 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qjc5g" podStartSLOduration=4.32811215 podStartE2EDuration="16.009566912s" totalImagesPullingTime="11.681454762s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 12:48:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:48:28.009130674 +0000 UTC m=+16.730858187" watchObservedRunningTime="2026-07-07 12:48:28.009566912 +0000 UTC m=+16.731294425" Jul 07 12:48:28.180949 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:28.180869 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8k6fx" Jul 07 12:48:28.181544 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:28.181522 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8k6fx" Jul 07 12:48:28.819614 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:28.819580 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:28.819816 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:28.819696 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m6fbl" podUID="99606493-0799-450b-a6f8-d3795ff36e30" Jul 07 12:48:29.435571 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:29.435532 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22898bc2-4cf6-4d84-b1e1-54504130b156-metrics-certs\") pod \"network-metrics-daemon-svv9n\" (UID: \"22898bc2-4cf6-4d84-b1e1-54504130b156\") " pod="openshift-multus/network-metrics-daemon-svv9n" Jul 07 12:48:29.436045 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:29.435668 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 12:48:29.436045 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:29.435729 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22898bc2-4cf6-4d84-b1e1-54504130b156-metrics-certs podName:22898bc2-4cf6-4d84-b1e1-54504130b156 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:45.435711329 +0000 UTC m=+34.157438843 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22898bc2-4cf6-4d84-b1e1-54504130b156-metrics-certs") pod "network-metrics-daemon-svv9n" (UID: "22898bc2-4cf6-4d84-b1e1-54504130b156") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 12:48:29.536148 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:29.536108 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzwct\" (UniqueName: \"kubernetes.io/projected/488e43e7-1c98-4b52-94c1-41b87c14bc73-kube-api-access-qzwct\") pod \"network-check-target-jdccv\" (UID: \"488e43e7-1c98-4b52-94c1-41b87c14bc73\") " pod="openshift-network-diagnostics/network-check-target-jdccv" Jul 07 12:48:29.536148 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:29.536150 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99606493-0799-450b-a6f8-d3795ff36e30-original-pull-secret\") pod \"global-pull-secret-syncer-m6fbl\" (UID: \"99606493-0799-450b-a6f8-d3795ff36e30\") " pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:29.536383 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:29.536283 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 12:48:29.536383 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:29.536305 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 12:48:29.536383 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:29.536334 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 12:48:29.536383 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:29.536346 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99606493-0799-450b-a6f8-d3795ff36e30-original-pull-secret podName:99606493-0799-450b-a6f8-d3795ff36e30 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:45.536327291 +0000 UTC m=+34.258054781 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99606493-0799-450b-a6f8-d3795ff36e30-original-pull-secret") pod "global-pull-secret-syncer-m6fbl" (UID: "99606493-0799-450b-a6f8-d3795ff36e30") : object "kube-system"/"original-pull-secret" not registered Jul 07 12:48:29.536383 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:29.536347 2555 projected.go:196] Error preparing data for projected volume kube-api-access-qzwct for pod openshift-network-diagnostics/network-check-target-jdccv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 12:48:29.536383 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:29.536386 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/488e43e7-1c98-4b52-94c1-41b87c14bc73-kube-api-access-qzwct podName:488e43e7-1c98-4b52-94c1-41b87c14bc73 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:45.536378284 +0000 UTC m=+34.258105774 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qzwct" (UniqueName: "kubernetes.io/projected/488e43e7-1c98-4b52-94c1-41b87c14bc73-kube-api-access-qzwct") pod "network-check-target-jdccv" (UID: "488e43e7-1c98-4b52-94c1-41b87c14bc73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 12:48:29.819797 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:29.819761 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svv9n" Jul 07 12:48:29.819978 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:29.819903 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svv9n" podUID="22898bc2-4cf6-4d84-b1e1-54504130b156" Jul 07 12:48:29.819978 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:29.819955 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdccv" Jul 07 12:48:29.820093 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:29.820077 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdccv" podUID="488e43e7-1c98-4b52-94c1-41b87c14bc73" Jul 07 12:48:29.898890 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:29.898865 2555 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 07 12:48:30.819604 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:30.819571 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:30.820311 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:30.819692 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m6fbl" podUID="99606493-0799-450b-a6f8-d3795ff36e30" Jul 07 12:48:30.902588 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:30.902550 2555 generic.go:356] "Generic (PLEG): container finished" podID="05dfd04fd79f7fb9287794a7ffe49d97" containerID="be25f5df255b2a2a1a870872998774f18b37a06849f7032d9f1d840d2c27fb15" exitCode=0 Jul 07 12:48:30.902760 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:30.902605 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal" event={"ID":"05dfd04fd79f7fb9287794a7ffe49d97","Type":"ContainerDied","Data":"be25f5df255b2a2a1a870872998774f18b37a06849f7032d9f1d840d2c27fb15"} Jul 07 12:48:31.820665 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:31.820631 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svv9n" Jul 07 12:48:31.821165 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:31.820709 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdccv" Jul 07 12:48:31.821165 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:31.820720 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svv9n" podUID="22898bc2-4cf6-4d84-b1e1-54504130b156" Jul 07 12:48:31.821165 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:31.820784 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdccv" podUID="488e43e7-1c98-4b52-94c1-41b87c14bc73" Jul 07 12:48:32.819234 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:32.819206 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:32.819443 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:32.819404 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m6fbl" podUID="99606493-0799-450b-a6f8-d3795ff36e30" Jul 07 12:48:33.819452 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:33.819406 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svv9n" Jul 07 12:48:33.819935 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:33.819575 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svv9n" podUID="22898bc2-4cf6-4d84-b1e1-54504130b156" Jul 07 12:48:33.819935 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:33.819582 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdccv" Jul 07 12:48:33.819935 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:33.819713 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdccv" podUID="488e43e7-1c98-4b52-94c1-41b87c14bc73" Jul 07 12:48:34.820244 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:34.820173 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:34.820623 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:34.820298 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m6fbl" podUID="99606493-0799-450b-a6f8-d3795ff36e30" Jul 07 12:48:34.912959 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:34.912731 2555 generic.go:356] "Generic (PLEG): container finished" podID="e1072848-f7b3-4b5b-9517-c09debf2e9af" containerID="80dccb2355842e0da75af346d51053d10ef64780a979b49076a8f6eb7aea2e62" exitCode=0 Jul 07 12:48:34.913058 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:34.912985 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jktnw" event={"ID":"e1072848-f7b3-4b5b-9517-c09debf2e9af","Type":"ContainerDied","Data":"80dccb2355842e0da75af346d51053d10ef64780a979b49076a8f6eb7aea2e62"} Jul 07 12:48:35.016788 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:35.016752 2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 12:48:35.762645 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:35.762337 2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T12:48:35.016771805Z","UUID":"3ec2dd48-fd9d-4e02-8626-4dd36075aa8f","Handler":null,"Name":"","Endpoint":""} Jul 07 12:48:35.763904 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:35.763879 2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 12:48:35.764027 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:35.763920 2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 12:48:35.819912 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:35.819887 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svv9n" Jul 07 12:48:35.820076 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:35.820021 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svv9n" podUID="22898bc2-4cf6-4d84-b1e1-54504130b156" Jul 07 12:48:35.820076 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:35.820058 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdccv" Jul 07 12:48:35.820188 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:35.820143 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdccv" podUID="488e43e7-1c98-4b52-94c1-41b87c14bc73" Jul 07 12:48:35.917006 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:35.916980 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal" event={"ID":"05dfd04fd79f7fb9287794a7ffe49d97","Type":"ContainerStarted","Data":"4d6645c6d2b7c5b956ed5e6785b024ed7f893ae805d73ee3439b6a0893466bbc"} Jul 07 12:48:35.918694 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:35.918673 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hlpsw" event={"ID":"a499a0dd-8beb-4c74-b8be-cd4783289255","Type":"ContainerStarted","Data":"3e5cd7622f41a64385e6470564cd8a8221a40c6f42f07006f53db0b70661b5d3"} Jul 07 12:48:35.920019 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:35.920000 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rd9dk" event={"ID":"898c8ea7-1c99-4f3d-8b4d-beff802f2e91","Type":"ContainerStarted","Data":"9b3d664f851a277e42fed8968cda0ed6992ead02164d39f6ddfec62593826ca3"} Jul 07 12:48:35.922724 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:35.922704 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" event={"ID":"08b292d1-7dd9-45f9-9746-369ba2b0167e","Type":"ContainerStarted","Data":"dd7eaab22fdd3479b549bedbb23373a08c8ec420008b5c510f2cb63926fdd69f"} Jul 07 12:48:35.922802 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:35.922754 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" event={"ID":"08b292d1-7dd9-45f9-9746-369ba2b0167e","Type":"ContainerStarted","Data":"e475eda97a314bc19ec1591e903235405d0e91ff04643d26a21849f85435fa2d"} Jul 07 12:48:35.922802 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:35.922785 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" event={"ID":"08b292d1-7dd9-45f9-9746-369ba2b0167e","Type":"ContainerStarted","Data":"3e4b08bea64bc4453cd6bfb95da9c5db65ad54241cdad9b314fb63d74bbf87a7"} Jul 07 12:48:35.922873 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:35.922813 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" event={"ID":"08b292d1-7dd9-45f9-9746-369ba2b0167e","Type":"ContainerStarted","Data":"c20baf2f3bbf712a9d6bee78fa0dc23e8e22cfe4a7938152521ac19d37dfdd75"} Jul 07 12:48:35.922873 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:35.922840 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" event={"ID":"08b292d1-7dd9-45f9-9746-369ba2b0167e","Type":"ContainerStarted","Data":"aedb3f7c612c60e4ee06fb08136121b98b4b5863182e663edbfd306f113e6619"} Jul 07 12:48:35.922873 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:35.922866 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" event={"ID":"08b292d1-7dd9-45f9-9746-369ba2b0167e","Type":"ContainerStarted","Data":"5bb2fab2a3b10628d8c56ea889895e57db9636b2596542c673b0436b73020d20"} Jul 07 12:48:35.988274 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:35.988229 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-245.ec2.internal" podStartSLOduration=22.988208453 podStartE2EDuration="22.988208453s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 12:48:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:48:35.946948008 +0000 UTC m=+24.668675522" watchObservedRunningTime="2026-07-07 12:48:35.988208453 +0000 UTC m=+24.709935967" Jul 07 12:48:35.988645 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:35.988606 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rd9dk" podStartSLOduration=3.370466641 podStartE2EDuration="23.988596204s" totalImagesPullingTime="20.618129563s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 12:48:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:48:35.988209256 +0000 UTC m=+24.709936769" watchObservedRunningTime="2026-07-07 12:48:35.988596204 +0000 UTC m=+24.710323754" Jul 07 12:48:36.820134 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:36.820057 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:36.820311 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:36.820167 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m6fbl" podUID="99606493-0799-450b-a6f8-d3795ff36e30" Jul 07 12:48:36.927836 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:36.927794 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hlpsw" event={"ID":"a499a0dd-8beb-4c74-b8be-cd4783289255","Type":"ContainerStarted","Data":"59a9d1a4fa3884194995ba7d046260b8ddf518c381368d35909be202859c9a9f"} Jul 07 12:48:37.820163 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:37.820128 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdccv" Jul 07 12:48:37.820344 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:37.820128 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svv9n" Jul 07 12:48:37.820344 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:37.820264 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdccv" podUID="488e43e7-1c98-4b52-94c1-41b87c14bc73" Jul 07 12:48:37.820344 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:37.820331 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svv9n" podUID="22898bc2-4cf6-4d84-b1e1-54504130b156" Jul 07 12:48:37.932810 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:37.932782 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" event={"ID":"08b292d1-7dd9-45f9-9746-369ba2b0167e","Type":"ContainerStarted","Data":"2096ffd4e643063d535bfcf255083b5d9d309fd5d64ba29772234779db8af338"} Jul 07 12:48:38.820253 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:38.820226 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:38.820405 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:38.820326 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m6fbl" podUID="99606493-0799-450b-a6f8-d3795ff36e30" Jul 07 12:48:39.819953 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:39.819849 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svv9n" Jul 07 12:48:39.820404 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:39.819979 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svv9n" podUID="22898bc2-4cf6-4d84-b1e1-54504130b156" Jul 07 12:48:39.820404 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:39.820017 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdccv" Jul 07 12:48:39.820404 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:39.820075 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdccv" podUID="488e43e7-1c98-4b52-94c1-41b87c14bc73" Jul 07 12:48:40.670982 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:40.670924 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8k6fx" Jul 07 12:48:40.671151 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:40.671057 2555 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 07 12:48:40.671597 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:40.671574 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8k6fx" Jul 07 12:48:40.692550 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:40.692511 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hlpsw" podStartSLOduration=6.807938762 podStartE2EDuration="27.692495301s" totalImagesPullingTime="20.884556539s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 12:48:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:48:36.953231359 +0000 UTC m=+25.674958871" watchObservedRunningTime="2026-07-07 12:48:40.692495301 +0000 UTC m=+29.414222815" Jul 07 12:48:40.820226 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:40.820191 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:40.820624 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:40.820310 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m6fbl" podUID="99606493-0799-450b-a6f8-d3795ff36e30" Jul 07 12:48:41.820802 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:41.820638 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svv9n" Jul 07 12:48:41.821320 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:41.820702 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdccv" Jul 07 12:48:41.821320 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:41.820855 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svv9n" podUID="22898bc2-4cf6-4d84-b1e1-54504130b156" Jul 07 12:48:41.821320 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:41.820949 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdccv" podUID="488e43e7-1c98-4b52-94c1-41b87c14bc73" Jul 07 12:48:41.946820 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:41.946793 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" event={"ID":"08b292d1-7dd9-45f9-9746-369ba2b0167e","Type":"ContainerStarted","Data":"b803ebf1eb6b1356571960880cd47dbc9bb3320beb0fbe08b2e5fb5e6febe3c0"} Jul 07 12:48:41.947089 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:41.947062 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:41.947206 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:41.947124 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:41.948570 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:41.948550 2555 generic.go:356] "Generic (PLEG): container finished" podID="e1072848-f7b3-4b5b-9517-c09debf2e9af" containerID="625fd491a9aae8f99f130b86fb9e483c4cf9f0861b121f201bf2b42098d13e47" exitCode=0 Jul 07 12:48:41.948678 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:41.948582 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jktnw" event={"ID":"e1072848-f7b3-4b5b-9517-c09debf2e9af","Type":"ContainerDied","Data":"625fd491a9aae8f99f130b86fb9e483c4cf9f0861b121f201bf2b42098d13e47"} Jul 07 12:48:41.962557 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:41.962540 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:41.982550 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:41.982517 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" podStartSLOduration=9.141243331 podStartE2EDuration="29.982506295s" totalImagesPullingTime="20.841262964s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 12:48:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:48:41.982372284 +0000 UTC m=+30.704099808" watchObservedRunningTime="2026-07-07 12:48:41.982506295 +0000 UTC m=+30.704233808" Jul 07 12:48:42.819952 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:42.819924 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:42.820199 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:42.820046 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m6fbl" podUID="99606493-0799-450b-a6f8-d3795ff36e30" Jul 07 12:48:42.951238 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:42.951210 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:42.966090 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:42.966067 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:48:43.377685 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:43.377620 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jdccv"] Jul 07 12:48:43.377805 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:43.377717 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdccv" Jul 07 12:48:43.377805 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:43.377789 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdccv" podUID="488e43e7-1c98-4b52-94c1-41b87c14bc73" Jul 07 12:48:43.380652 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:43.380625 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-svv9n"] Jul 07 12:48:43.380767 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:43.380735 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svv9n" Jul 07 12:48:43.380866 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:43.380844 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svv9n" podUID="22898bc2-4cf6-4d84-b1e1-54504130b156" Jul 07 12:48:43.381169 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:43.381144 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-m6fbl"] Jul 07 12:48:43.381268 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:43.381226 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:43.381332 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:43.381315 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m6fbl" podUID="99606493-0799-450b-a6f8-d3795ff36e30" Jul 07 12:48:43.955798 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:43.955721 2555 generic.go:356] "Generic (PLEG): container finished" podID="e1072848-f7b3-4b5b-9517-c09debf2e9af" containerID="b75c1c6f5201ce556604dbe019e87bfdbc2ceb303c75cca4afe18ceb1099bf7a" exitCode=0 Jul 07 12:48:43.955798 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:43.955768 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jktnw" event={"ID":"e1072848-f7b3-4b5b-9517-c09debf2e9af","Type":"ContainerDied","Data":"b75c1c6f5201ce556604dbe019e87bfdbc2ceb303c75cca4afe18ceb1099bf7a"} Jul 07 12:48:44.820099 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:44.819922 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdccv" Jul 07 12:48:44.820273 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:44.819938 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:44.820273 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:44.820187 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdccv" podUID="488e43e7-1c98-4b52-94c1-41b87c14bc73" Jul 07 12:48:44.820273 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:44.820255 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m6fbl" podUID="99606493-0799-450b-a6f8-d3795ff36e30" Jul 07 12:48:44.820462 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:44.819979 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svv9n" Jul 07 12:48:44.820462 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:44.820340 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svv9n" podUID="22898bc2-4cf6-4d84-b1e1-54504130b156" Jul 07 12:48:45.456588 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:45.456517 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22898bc2-4cf6-4d84-b1e1-54504130b156-metrics-certs\") pod \"network-metrics-daemon-svv9n\" (UID: \"22898bc2-4cf6-4d84-b1e1-54504130b156\") " pod="openshift-multus/network-metrics-daemon-svv9n" Jul 07 12:48:45.456906 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:45.456629 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 12:48:45.456906 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:45.456677 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22898bc2-4cf6-4d84-b1e1-54504130b156-metrics-certs podName:22898bc2-4cf6-4d84-b1e1-54504130b156 nodeName:}" failed. No retries permitted until 2026-07-07 12:49:17.456664489 +0000 UTC m=+66.178391981 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22898bc2-4cf6-4d84-b1e1-54504130b156-metrics-certs") pod "network-metrics-daemon-svv9n" (UID: "22898bc2-4cf6-4d84-b1e1-54504130b156") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 12:48:45.557805 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:45.557777 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzwct\" (UniqueName: \"kubernetes.io/projected/488e43e7-1c98-4b52-94c1-41b87c14bc73-kube-api-access-qzwct\") pod \"network-check-target-jdccv\" (UID: \"488e43e7-1c98-4b52-94c1-41b87c14bc73\") " pod="openshift-network-diagnostics/network-check-target-jdccv" Jul 07 12:48:45.557805 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:45.557808 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99606493-0799-450b-a6f8-d3795ff36e30-original-pull-secret\") pod \"global-pull-secret-syncer-m6fbl\" (UID: \"99606493-0799-450b-a6f8-d3795ff36e30\") " pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:45.557959 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:45.557907 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 12:48:45.557959 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:45.557921 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 12:48:45.557959 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:45.557936 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 12:48:45.557959 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:45.557949 2555 projected.go:196] Error preparing data for projected volume kube-api-access-qzwct for pod openshift-network-diagnostics/network-check-target-jdccv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 12:48:45.558081 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:45.557964 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99606493-0799-450b-a6f8-d3795ff36e30-original-pull-secret podName:99606493-0799-450b-a6f8-d3795ff36e30 nodeName:}" failed. No retries permitted until 2026-07-07 12:49:17.557947992 +0000 UTC m=+66.279675500 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99606493-0799-450b-a6f8-d3795ff36e30-original-pull-secret") pod "global-pull-secret-syncer-m6fbl" (UID: "99606493-0799-450b-a6f8-d3795ff36e30") : object "kube-system"/"original-pull-secret" not registered Jul 07 12:48:45.558081 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:45.557983 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/488e43e7-1c98-4b52-94c1-41b87c14bc73-kube-api-access-qzwct podName:488e43e7-1c98-4b52-94c1-41b87c14bc73 nodeName:}" failed. No retries permitted until 2026-07-07 12:49:17.557973585 +0000 UTC m=+66.279701087 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qzwct" (UniqueName: "kubernetes.io/projected/488e43e7-1c98-4b52-94c1-41b87c14bc73-kube-api-access-qzwct") pod "network-check-target-jdccv" (UID: "488e43e7-1c98-4b52-94c1-41b87c14bc73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 12:48:45.962682 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:45.962647 2555 generic.go:356] "Generic (PLEG): container finished" podID="e1072848-f7b3-4b5b-9517-c09debf2e9af" containerID="a23f954eefbab5d8842e1f3e187b011148a74b823cece5a7080115700bef1368" exitCode=0 Jul 07 12:48:45.962865 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:45.962692 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jktnw" event={"ID":"e1072848-f7b3-4b5b-9517-c09debf2e9af","Type":"ContainerDied","Data":"a23f954eefbab5d8842e1f3e187b011148a74b823cece5a7080115700bef1368"} Jul 07 12:48:46.819839 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:46.819807 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:46.820225 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:46.819903 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdccv" Jul 07 12:48:46.820225 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:46.819911 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m6fbl" podUID="99606493-0799-450b-a6f8-d3795ff36e30" Jul 07 12:48:46.820225 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:46.819932 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svv9n" Jul 07 12:48:46.820225 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:46.820007 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdccv" podUID="488e43e7-1c98-4b52-94c1-41b87c14bc73" Jul 07 12:48:46.820225 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:46.820069 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svv9n" podUID="22898bc2-4cf6-4d84-b1e1-54504130b156" Jul 07 12:48:47.534879 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.534811 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-245.ec2.internal" event="NodeReady" Jul 07 12:48:47.535004 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.534908 2555 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 12:48:47.590518 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.590491 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-84c78544db-4hnvd"] Jul 07 12:48:47.610717 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.610698 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-44dxc"] Jul 07 12:48:47.610841 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.610828 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:48:47.613306 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.613279 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 12:48:47.613939 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.613913 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 12:48:47.614202 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.614183 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 12:48:47.614283 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.614240 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vgk5d\"" Jul 07 12:48:47.621269 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.621251 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 12:48:47.637041 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.637024 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-kqkwl"] Jul 07 12:48:47.637154 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.637138 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-44dxc" Jul 07 12:48:47.640191 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.639624 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 07 12:48:47.640191 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.639866 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xpztg\"" Jul 07 12:48:47.641123 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.641098 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 12:48:47.641380 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.641360 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 07 12:48:47.641538 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.641519 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 12:48:47.652855 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.652837 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lqpq8"] Jul 07 12:48:47.653408 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.653392 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-kqkwl" Jul 07 12:48:47.657939 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.657275 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 07 12:48:47.657939 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.657546 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 12:48:47.657939 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.657795 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 12:48:47.658405 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.658030 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-vdt8j\"" Jul 07 12:48:47.658586 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.658498 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 07 12:48:47.664626 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.664606 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 07 12:48:47.669013 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.668989 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-759d8757b9-whth9"] Jul 07 12:48:47.669103 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.669066 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lqpq8" Jul 07 12:48:47.674543 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.674161 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 07 12:48:47.674543 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.674316 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 07 12:48:47.674543 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.674334 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 07 12:48:47.674543 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.674410 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-7zzw7\"" Jul 07 12:48:47.691126 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.691104 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-gqgkf"] Jul 07 12:48:47.691257 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.691240 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-759d8757b9-whth9" Jul 07 12:48:47.693647 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.693629 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 07 12:48:47.693766 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.693748 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 07 12:48:47.694014 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.693998 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 07 12:48:47.694129 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.694013 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 12:48:47.694291 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.694266 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 07 12:48:47.694639 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.694416 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-kxpcp\"" Jul 07 12:48:47.694639 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.694498 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 12:48:47.711196 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.711161 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-7twbn"] Jul 07 12:48:47.711349 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.711335 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-gqgkf" Jul 07 12:48:47.713991 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.713976 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 07 12:48:47.714142 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.714031 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-q7klw\"" Jul 07 12:48:47.714358 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.714341 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 07 12:48:47.714461 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.714376 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 07 12:48:47.714730 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.714716 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 07 12:48:47.720309 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.720289 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 07 12:48:47.737112 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.737096 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j9zrl"] Jul 07 12:48:47.737211 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.737198 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-7twbn" Jul 07 12:48:47.739697 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.739678 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 07 12:48:47.740090 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.740074 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 07 12:48:47.740179 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.740134 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-8rm92\"" Jul 07 12:48:47.757264 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.757245 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s69bh"] Jul 07 12:48:47.757360 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.757346 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j9zrl" Jul 07 12:48:47.759964 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.759944 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 07 12:48:47.760060 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.759968 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-gpvnx\"" Jul 07 12:48:47.760060 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.759992 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 07 12:48:47.760060 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.760010 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 07 12:48:47.760605 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.760255 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 07 12:48:47.779584 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.779559 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-44dxc"] Jul 07 12:48:47.779673 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.779596 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lqpq8"] Jul 07 12:48:47.779673 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.779621 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-84c78544db-4hnvd"] Jul 07 12:48:47.779673 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.779643 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s69bh"] Jul 07 12:48:47.779673 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.779646 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s69bh" Jul 07 12:48:47.779673 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.779664 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-x9vgr"] Jul 07 12:48:47.779673 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.779556 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/280e8e44-e7c9-47ad-9cc9-611821d9bcfa-snapshots\") pod \"insights-operator-5c847dcfc4-kqkwl\" (UID: \"280e8e44-e7c9-47ad-9cc9-611821d9bcfa\") " pod="openshift-insights/insights-operator-5c847dcfc4-kqkwl" Jul 07 12:48:47.779948 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.779709 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/280e8e44-e7c9-47ad-9cc9-611821d9bcfa-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-kqkwl\" (UID: \"280e8e44-e7c9-47ad-9cc9-611821d9bcfa\") " pod="openshift-insights/insights-operator-5c847dcfc4-kqkwl" Jul 07 12:48:47.779948 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.779756 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bb41588d-7d7e-4497-ac10-caad90123497-default-certificate\") pod \"router-default-759d8757b9-whth9\" (UID: \"bb41588d-7d7e-4497-ac10-caad90123497\") " pod="openshift-ingress/router-default-759d8757b9-whth9" Jul 07 12:48:47.779948 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.779783 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bb41588d-7d7e-4497-ac10-caad90123497-stats-auth\") pod \"router-default-759d8757b9-whth9\" (UID: \"bb41588d-7d7e-4497-ac10-caad90123497\") " pod="openshift-ingress/router-default-759d8757b9-whth9" Jul 07 12:48:47.779948 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.779807 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/280e8e44-e7c9-47ad-9cc9-611821d9bcfa-serving-cert\") pod \"insights-operator-5c847dcfc4-kqkwl\" (UID: \"280e8e44-e7c9-47ad-9cc9-611821d9bcfa\") " pod="openshift-insights/insights-operator-5c847dcfc4-kqkwl" Jul 07 12:48:47.779948 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.779854 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmr9m\" (UniqueName: \"kubernetes.io/projected/7f2df1ca-1917-4482-93f4-b07c1a1a3abc-kube-api-access-hmr9m\") pod \"cluster-samples-operator-56fcf86bf-lqpq8\" (UID: \"7f2df1ca-1917-4482-93f4-b07c1a1a3abc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lqpq8" Jul 07 12:48:47.780207 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.780046 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52gp4\" (UniqueName: \"kubernetes.io/projected/280e8e44-e7c9-47ad-9cc9-611821d9bcfa-kube-api-access-52gp4\") pod \"insights-operator-5c847dcfc4-kqkwl\" (UID: \"280e8e44-e7c9-47ad-9cc9-611821d9bcfa\") " pod="openshift-insights/insights-operator-5c847dcfc4-kqkwl" Jul 07 12:48:47.780207 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.780081 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg244\" (UniqueName: \"kubernetes.io/projected/3ac07d23-9858-4ce7-a553-812f8a2151a4-kube-api-access-rg244\") pod \"cluster-monitoring-operator-64786d9cbb-44dxc\" (UID: \"3ac07d23-9858-4ce7-a553-812f8a2151a4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-44dxc" Jul 07 12:48:47.780207 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.780129 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5b6121e-690c-4400-beb6-235fcf5720f0-ca-trust-extracted\") pod \"image-registry-84c78544db-4hnvd\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:48:47.780207 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.780155 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5b6121e-690c-4400-beb6-235fcf5720f0-registry-certificates\") pod \"image-registry-84c78544db-4hnvd\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:48:47.780207 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.780179 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlt7t\" (UniqueName: \"kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-kube-api-access-hlt7t\") pod \"image-registry-84c78544db-4hnvd\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:48:47.780207 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.780202 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ac07d23-9858-4ce7-a553-812f8a2151a4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-44dxc\" (UID: \"3ac07d23-9858-4ce7-a553-812f8a2151a4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-44dxc" Jul 07 12:48:47.780537 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.780248 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdzvc\" (UniqueName: \"kubernetes.io/projected/bb41588d-7d7e-4497-ac10-caad90123497-kube-api-access-xdzvc\") pod \"router-default-759d8757b9-whth9\" (UID: \"bb41588d-7d7e-4497-ac10-caad90123497\") " pod="openshift-ingress/router-default-759d8757b9-whth9" Jul 07 12:48:47.780537 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.780297 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-registry-tls\") pod \"image-registry-84c78544db-4hnvd\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:48:47.780537 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.780353 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5b6121e-690c-4400-beb6-235fcf5720f0-image-registry-private-configuration\") pod \"image-registry-84c78544db-4hnvd\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:48:47.780537 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.780381 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3ac07d23-9858-4ce7-a553-812f8a2151a4-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-44dxc\" (UID: \"3ac07d23-9858-4ce7-a553-812f8a2151a4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-44dxc" Jul 07 12:48:47.780537 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.780407 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5b6121e-690c-4400-beb6-235fcf5720f0-trusted-ca\") pod \"image-registry-84c78544db-4hnvd\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:48:47.780537 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.780447 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5b6121e-690c-4400-beb6-235fcf5720f0-installation-pull-secrets\") pod \"image-registry-84c78544db-4hnvd\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:48:47.780537 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.780474 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-bound-sa-token\") pod \"image-registry-84c78544db-4hnvd\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:48:47.780537 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.780529 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb41588d-7d7e-4497-ac10-caad90123497-service-ca-bundle\") pod \"router-default-759d8757b9-whth9\" (UID: \"bb41588d-7d7e-4497-ac10-caad90123497\") " pod="openshift-ingress/router-default-759d8757b9-whth9" Jul 07 12:48:47.780802 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.780544 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/280e8e44-e7c9-47ad-9cc9-611821d9bcfa-tmp\") pod \"insights-operator-5c847dcfc4-kqkwl\" (UID: \"280e8e44-e7c9-47ad-9cc9-611821d9bcfa\") " pod="openshift-insights/insights-operator-5c847dcfc4-kqkwl" Jul 07 12:48:47.780802 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.780559 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb41588d-7d7e-4497-ac10-caad90123497-metrics-certs\") pod \"router-default-759d8757b9-whth9\" (UID: \"bb41588d-7d7e-4497-ac10-caad90123497\") " pod="openshift-ingress/router-default-759d8757b9-whth9" Jul 07 12:48:47.780802 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.780581 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/280e8e44-e7c9-47ad-9cc9-611821d9bcfa-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-kqkwl\" (UID: \"280e8e44-e7c9-47ad-9cc9-611821d9bcfa\") " pod="openshift-insights/insights-operator-5c847dcfc4-kqkwl" Jul 07 12:48:47.780802 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.780647 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f2df1ca-1917-4482-93f4-b07c1a1a3abc-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lqpq8\" (UID: \"7f2df1ca-1917-4482-93f4-b07c1a1a3abc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lqpq8" Jul 07 12:48:47.783027 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.783010 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 07 12:48:47.783527 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.783506 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 07 12:48:47.783654 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.783636 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-5qmjx\"" Jul 07 12:48:47.783725 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.783710 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 07 12:48:47.783834 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.783811 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 07 12:48:47.801566 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.801544 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-cxjzh"] Jul 07 12:48:47.801684 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.801666 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-x9vgr" Jul 07 12:48:47.804732 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.804717 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-bcn7l\"" Jul 07 12:48:47.805095 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.805078 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 12:48:47.805396 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.805382 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 12:48:47.815769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.815748 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-7twbn"] Jul 07 12:48:47.815850 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.815783 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-gqgkf"] Jul 07 12:48:47.815850 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.815803 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-kqkwl"] Jul 07 12:48:47.815850 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.815823 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-x9vgr"] Jul 07 12:48:47.815850 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.815839 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-cxjzh"] Jul 07 12:48:47.816031 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.815850 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-cxjzh" Jul 07 12:48:47.816031 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.815865 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-m2kzs"] Jul 07 12:48:47.818713 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.818696 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-8bldf\"" Jul 07 12:48:47.819505 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.819485 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 07 12:48:47.819692 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.819672 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 07 12:48:47.838067 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.838048 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kvkc7"] Jul 07 12:48:47.838360 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.838160 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m2kzs" Jul 07 12:48:47.841042 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.841024 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-58r4b\"" Jul 07 12:48:47.842155 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.842136 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 12:48:47.842155 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.842145 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 12:48:47.842312 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.842142 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 12:48:47.862069 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.862050 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j9zrl"] Jul 07 12:48:47.862186 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.862169 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kvkc7" Jul 07 12:48:47.864937 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.864837 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wb7sm\"" Jul 07 12:48:47.864937 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.864855 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 12:48:47.865096 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.865087 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 12:48:47.866236 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.866218 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-759d8757b9-whth9"] Jul 07 12:48:47.866311 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.866259 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m2kzs"] Jul 07 12:48:47.866311 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.866279 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kvkc7"] Jul 07 12:48:47.881723 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.881703 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d9ad543c-2b24-443d-a2ed-e3bc420cd888-config\") pod \"console-operator-68b757fb67-gqgkf\" (UID: \"d9ad543c-2b24-443d-a2ed-e3bc420cd888\") " pod="openshift-console-operator/console-operator-68b757fb67-gqgkf" Jul 07 12:48:47.881818 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.881731 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ffb9426d-0075-440a-9bad-f4d3373a2550-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-s69bh\" (UID: \"ffb9426d-0075-440a-9bad-f4d3373a2550\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s69bh" Jul 07 12:48:47.881818 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.881753 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bb41588d-7d7e-4497-ac10-caad90123497-default-certificate\") pod \"router-default-759d8757b9-whth9\" (UID: \"bb41588d-7d7e-4497-ac10-caad90123497\") " pod="openshift-ingress/router-default-759d8757b9-whth9" Jul 07 12:48:47.881818 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.881771 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d9ad543c-2b24-443d-a2ed-e3bc420cd888-serving-cert\") pod \"console-operator-68b757fb67-gqgkf\" (UID: \"d9ad543c-2b24-443d-a2ed-e3bc420cd888\") " pod="openshift-console-operator/console-operator-68b757fb67-gqgkf" Jul 07 12:48:47.881966 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.881817 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5b6121e-690c-4400-beb6-235fcf5720f0-ca-trust-extracted\") pod \"image-registry-84c78544db-4hnvd\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:48:47.881966 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.881913 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5b6121e-690c-4400-beb6-235fcf5720f0-image-registry-private-configuration\") pod \"image-registry-84c78544db-4hnvd\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:48:47.882032 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.881998 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nljq\" (UniqueName: \"kubernetes.io/projected/7b758bf7-cc6b-43ec-ae60-997d0c9c1b05-kube-api-access-9nljq\") pod \"volume-data-source-validator-5d456fdbcd-7twbn\" (UID: \"7b758bf7-cc6b-43ec-ae60-997d0c9c1b05\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-7twbn" Jul 07 12:48:47.882075 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.882033 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d9ad543c-2b24-443d-a2ed-e3bc420cd888-trusted-ca\") pod \"console-operator-68b757fb67-gqgkf\" (UID: \"d9ad543c-2b24-443d-a2ed-e3bc420cd888\") " pod="openshift-console-operator/console-operator-68b757fb67-gqgkf" Jul 07 12:48:47.882075 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.882063 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f2df1ca-1917-4482-93f4-b07c1a1a3abc-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lqpq8\" (UID: \"7f2df1ca-1917-4482-93f4-b07c1a1a3abc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lqpq8" Jul 07 12:48:47.882150 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.882088 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/280e8e44-e7c9-47ad-9cc9-611821d9bcfa-snapshots\") pod \"insights-operator-5c847dcfc4-kqkwl\" (UID: \"280e8e44-e7c9-47ad-9cc9-611821d9bcfa\") " pod="openshift-insights/insights-operator-5c847dcfc4-kqkwl" Jul 07 12:48:47.882150 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.882112 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5b6121e-690c-4400-beb6-235fcf5720f0-installation-pull-secrets\") pod \"image-registry-84c78544db-4hnvd\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:48:47.882150 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.882142 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlt7t\" (UniqueName: \"kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-kube-api-access-hlt7t\") pod \"image-registry-84c78544db-4hnvd\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:48:47.882287 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.882176 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5b6121e-690c-4400-beb6-235fcf5720f0-ca-trust-extracted\") pod \"image-registry-84c78544db-4hnvd\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:48:47.882287 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:47.882209 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 12:48:47.882287 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:47.882270 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f2df1ca-1917-4482-93f4-b07c1a1a3abc-samples-operator-tls podName:7f2df1ca-1917-4482-93f4-b07c1a1a3abc nodeName:}" failed. No retries permitted until 2026-07-07 12:48:48.382249829 +0000 UTC m=+37.103977355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7f2df1ca-1917-4482-93f4-b07c1a1a3abc-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lqpq8" (UID: "7f2df1ca-1917-4482-93f4-b07c1a1a3abc") : secret "samples-operator-tls" not found Jul 07 12:48:47.882487 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.882402 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb41588d-7d7e-4497-ac10-caad90123497-service-ca-bundle\") pod \"router-default-759d8757b9-whth9\" (UID: \"bb41588d-7d7e-4497-ac10-caad90123497\") " pod="openshift-ingress/router-default-759d8757b9-whth9" Jul 07 12:48:47.882487 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.882455 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb41588d-7d7e-4497-ac10-caad90123497-metrics-certs\") pod \"router-default-759d8757b9-whth9\" (UID: \"bb41588d-7d7e-4497-ac10-caad90123497\") " pod="openshift-ingress/router-default-759d8757b9-whth9" Jul 07 12:48:47.882604 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.882487 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/280e8e44-e7c9-47ad-9cc9-611821d9bcfa-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-kqkwl\" (UID: \"280e8e44-e7c9-47ad-9cc9-611821d9bcfa\") " pod="openshift-insights/insights-operator-5c847dcfc4-kqkwl" Jul 07 12:48:47.882604 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:47.882523 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb41588d-7d7e-4497-ac10-caad90123497-service-ca-bundle podName:bb41588d-7d7e-4497-ac10-caad90123497 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:48.382505707 +0000 UTC m=+37.104233200 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb41588d-7d7e-4497-ac10-caad90123497-service-ca-bundle") pod "router-default-759d8757b9-whth9" (UID: "bb41588d-7d7e-4497-ac10-caad90123497") : configmap references non-existent config key: service-ca.crt Jul 07 12:48:47.882604 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:47.882561 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 12:48:47.882751 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:47.882609 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb41588d-7d7e-4497-ac10-caad90123497-metrics-certs podName:bb41588d-7d7e-4497-ac10-caad90123497 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:48.382593787 +0000 UTC m=+37.104321293 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb41588d-7d7e-4497-ac10-caad90123497-metrics-certs") pod "router-default-759d8757b9-whth9" (UID: "bb41588d-7d7e-4497-ac10-caad90123497") : secret "router-metrics-certs-default" not found Jul 07 12:48:47.882751 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.882639 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/280e8e44-e7c9-47ad-9cc9-611821d9bcfa-tmp\") pod \"insights-operator-5c847dcfc4-kqkwl\" (UID: \"280e8e44-e7c9-47ad-9cc9-611821d9bcfa\") " pod="openshift-insights/insights-operator-5c847dcfc4-kqkwl" Jul 07 12:48:47.882751 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.882666 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/280e8e44-e7c9-47ad-9cc9-611821d9bcfa-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-kqkwl\" (UID: \"280e8e44-e7c9-47ad-9cc9-611821d9bcfa\") " pod="openshift-insights/insights-operator-5c847dcfc4-kqkwl" Jul 07 12:48:47.882751 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.882692 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/280e8e44-e7c9-47ad-9cc9-611821d9bcfa-serving-cert\") pod \"insights-operator-5c847dcfc4-kqkwl\" (UID: \"280e8e44-e7c9-47ad-9cc9-611821d9bcfa\") " pod="openshift-insights/insights-operator-5c847dcfc4-kqkwl" Jul 07 12:48:47.882751 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.882714 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5525b878-d89e-41f7-8c51-8e1ca4007876-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-j9zrl\" (UID: \"5525b878-d89e-41f7-8c51-8e1ca4007876\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j9zrl" Jul 07 12:48:47.882988 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.882751 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bb41588d-7d7e-4497-ac10-caad90123497-stats-auth\") pod \"router-default-759d8757b9-whth9\" (UID: \"bb41588d-7d7e-4497-ac10-caad90123497\") " pod="openshift-ingress/router-default-759d8757b9-whth9" Jul 07 12:48:47.882988 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.882781 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmr9m\" (UniqueName: \"kubernetes.io/projected/7f2df1ca-1917-4482-93f4-b07c1a1a3abc-kube-api-access-hmr9m\") pod \"cluster-samples-operator-56fcf86bf-lqpq8\" (UID: \"7f2df1ca-1917-4482-93f4-b07c1a1a3abc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lqpq8" Jul 07 12:48:47.882988 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.882788 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/280e8e44-e7c9-47ad-9cc9-611821d9bcfa-snapshots\") pod \"insights-operator-5c847dcfc4-kqkwl\" (UID: \"280e8e44-e7c9-47ad-9cc9-611821d9bcfa\") " pod="openshift-insights/insights-operator-5c847dcfc4-kqkwl" Jul 07 12:48:47.882988 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.882806 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52gp4\" (UniqueName: \"kubernetes.io/projected/280e8e44-e7c9-47ad-9cc9-611821d9bcfa-kube-api-access-52gp4\") pod \"insights-operator-5c847dcfc4-kqkwl\" (UID: \"280e8e44-e7c9-47ad-9cc9-611821d9bcfa\") " pod="openshift-insights/insights-operator-5c847dcfc4-kqkwl" Jul 07 12:48:47.882988 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.882840 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg244\" (UniqueName: \"kubernetes.io/projected/3ac07d23-9858-4ce7-a553-812f8a2151a4-kube-api-access-rg244\") pod \"cluster-monitoring-operator-64786d9cbb-44dxc\" (UID: \"3ac07d23-9858-4ce7-a553-812f8a2151a4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-44dxc" Jul 07 12:48:47.882988 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.882872 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62xtr\" (UniqueName: \"kubernetes.io/projected/d9ad543c-2b24-443d-a2ed-e3bc420cd888-kube-api-access-62xtr\") pod \"console-operator-68b757fb67-gqgkf\" (UID: \"d9ad543c-2b24-443d-a2ed-e3bc420cd888\") " pod="openshift-console-operator/console-operator-68b757fb67-gqgkf" Jul 07 12:48:47.882988 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.882903 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5525b878-d89e-41f7-8c51-8e1ca4007876-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-j9zrl\" (UID: \"5525b878-d89e-41f7-8c51-8e1ca4007876\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j9zrl" Jul 07 12:48:47.882988 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.882914 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/280e8e44-e7c9-47ad-9cc9-611821d9bcfa-tmp\") pod \"insights-operator-5c847dcfc4-kqkwl\" (UID: \"280e8e44-e7c9-47ad-9cc9-611821d9bcfa\") " pod="openshift-insights/insights-operator-5c847dcfc4-kqkwl" Jul 07 12:48:47.882988 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.882934 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5b6121e-690c-4400-beb6-235fcf5720f0-registry-certificates\") pod \"image-registry-84c78544db-4hnvd\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:48:47.883463 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.882996 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdzvc\" (UniqueName: \"kubernetes.io/projected/bb41588d-7d7e-4497-ac10-caad90123497-kube-api-access-xdzvc\") pod \"router-default-759d8757b9-whth9\" (UID: \"bb41588d-7d7e-4497-ac10-caad90123497\") " pod="openshift-ingress/router-default-759d8757b9-whth9" Jul 07 12:48:47.883463 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.883038 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-registry-tls\") pod \"image-registry-84c78544db-4hnvd\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:48:47.883463 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.883064 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ffb9426d-0075-440a-9bad-f4d3373a2550-config\") pod \"service-ca-operator-5d46d9ffd4-s69bh\" (UID: \"ffb9426d-0075-440a-9bad-f4d3373a2550\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s69bh" Jul 07 12:48:47.883463 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.883090 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3ac07d23-9858-4ce7-a553-812f8a2151a4-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-44dxc\" (UID: \"3ac07d23-9858-4ce7-a553-812f8a2151a4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-44dxc" Jul 07 12:48:47.883463 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.883280 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5b6121e-690c-4400-beb6-235fcf5720f0-trusted-ca\") pod \"image-registry-84c78544db-4hnvd\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:48:47.883463 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.883303 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-bound-sa-token\") pod \"image-registry-84c78544db-4hnvd\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:48:47.883463 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.883384 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5b6121e-690c-4400-beb6-235fcf5720f0-registry-certificates\") pod \"image-registry-84c78544db-4hnvd\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:48:47.883834 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:47.883489 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 12:48:47.883834 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:47.883503 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84c78544db-4hnvd: secret "image-registry-tls" not found Jul 07 12:48:47.883834 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:47.883560 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-registry-tls podName:d5b6121e-690c-4400-beb6-235fcf5720f0 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:48.383545379 +0000 UTC m=+37.105272885 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-registry-tls") pod "image-registry-84c78544db-4hnvd" (UID: "d5b6121e-690c-4400-beb6-235fcf5720f0") : secret "image-registry-tls" not found Jul 07 12:48:47.883834 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.883605 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/280e8e44-e7c9-47ad-9cc9-611821d9bcfa-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-kqkwl\" (UID: \"280e8e44-e7c9-47ad-9cc9-611821d9bcfa\") " pod="openshift-insights/insights-operator-5c847dcfc4-kqkwl" Jul 07 12:48:47.883834 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.883774 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57jz2\" (UniqueName: \"kubernetes.io/projected/5525b878-d89e-41f7-8c51-8e1ca4007876-kube-api-access-57jz2\") pod \"kube-storage-version-migrator-operator-846bf668f7-j9zrl\" (UID: \"5525b878-d89e-41f7-8c51-8e1ca4007876\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j9zrl" Jul 07 12:48:47.883834 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.883801 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztxxx\" (UniqueName: \"kubernetes.io/projected/ffb9426d-0075-440a-9bad-f4d3373a2550-kube-api-access-ztxxx\") pod \"service-ca-operator-5d46d9ffd4-s69bh\" (UID: \"ffb9426d-0075-440a-9bad-f4d3373a2550\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s69bh" Jul 07 12:48:47.884212 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.883840 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ac07d23-9858-4ce7-a553-812f8a2151a4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-44dxc\" (UID: \"3ac07d23-9858-4ce7-a553-812f8a2151a4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-44dxc" Jul 07 12:48:47.884212 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:47.883963 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 12:48:47.884212 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:47.884032 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ac07d23-9858-4ce7-a553-812f8a2151a4-cluster-monitoring-operator-tls podName:3ac07d23-9858-4ce7-a553-812f8a2151a4 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:48.384017258 +0000 UTC m=+37.105744749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ac07d23-9858-4ce7-a553-812f8a2151a4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-44dxc" (UID: "3ac07d23-9858-4ce7-a553-812f8a2151a4") : secret "cluster-monitoring-operator-tls" not found Jul 07 12:48:47.884360 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.884252 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3ac07d23-9858-4ce7-a553-812f8a2151a4-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-44dxc\" (UID: \"3ac07d23-9858-4ce7-a553-812f8a2151a4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-44dxc" Jul 07 12:48:47.884360 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.884354 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5b6121e-690c-4400-beb6-235fcf5720f0-trusted-ca\") pod \"image-registry-84c78544db-4hnvd\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:48:47.886567 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.886542 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/280e8e44-e7c9-47ad-9cc9-611821d9bcfa-serving-cert\") pod \"insights-operator-5c847dcfc4-kqkwl\" (UID: \"280e8e44-e7c9-47ad-9cc9-611821d9bcfa\") " pod="openshift-insights/insights-operator-5c847dcfc4-kqkwl" Jul 07 12:48:47.886661 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.886630 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5b6121e-690c-4400-beb6-235fcf5720f0-installation-pull-secrets\") pod \"image-registry-84c78544db-4hnvd\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:48:47.886661 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.886638 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bb41588d-7d7e-4497-ac10-caad90123497-default-certificate\") pod \"router-default-759d8757b9-whth9\" (UID: \"bb41588d-7d7e-4497-ac10-caad90123497\") " pod="openshift-ingress/router-default-759d8757b9-whth9" Jul 07 12:48:47.886661 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.886644 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5b6121e-690c-4400-beb6-235fcf5720f0-image-registry-private-configuration\") pod \"image-registry-84c78544db-4hnvd\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:48:47.886763 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.886662 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bb41588d-7d7e-4497-ac10-caad90123497-stats-auth\") pod \"router-default-759d8757b9-whth9\" (UID: \"bb41588d-7d7e-4497-ac10-caad90123497\") " pod="openshift-ingress/router-default-759d8757b9-whth9" Jul 07 12:48:47.894328 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.894306 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/280e8e44-e7c9-47ad-9cc9-611821d9bcfa-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-kqkwl\" (UID: \"280e8e44-e7c9-47ad-9cc9-611821d9bcfa\") " pod="openshift-insights/insights-operator-5c847dcfc4-kqkwl" Jul 07 12:48:47.898168 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.898148 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmr9m\" (UniqueName: \"kubernetes.io/projected/7f2df1ca-1917-4482-93f4-b07c1a1a3abc-kube-api-access-hmr9m\") pod \"cluster-samples-operator-56fcf86bf-lqpq8\" (UID: \"7f2df1ca-1917-4482-93f4-b07c1a1a3abc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lqpq8" Jul 07 12:48:47.898277 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.898256 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlt7t\" (UniqueName: \"kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-kube-api-access-hlt7t\") pod \"image-registry-84c78544db-4hnvd\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:48:47.898387 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.898364 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg244\" (UniqueName: \"kubernetes.io/projected/3ac07d23-9858-4ce7-a553-812f8a2151a4-kube-api-access-rg244\") pod \"cluster-monitoring-operator-64786d9cbb-44dxc\" (UID: \"3ac07d23-9858-4ce7-a553-812f8a2151a4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-44dxc" Jul 07 12:48:47.899649 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.899626 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-bound-sa-token\") pod \"image-registry-84c78544db-4hnvd\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:48:47.899808 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.899789 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52gp4\" (UniqueName: \"kubernetes.io/projected/280e8e44-e7c9-47ad-9cc9-611821d9bcfa-kube-api-access-52gp4\") pod \"insights-operator-5c847dcfc4-kqkwl\" (UID: \"280e8e44-e7c9-47ad-9cc9-611821d9bcfa\") " pod="openshift-insights/insights-operator-5c847dcfc4-kqkwl" Jul 07 12:48:47.902527 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.902508 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdzvc\" (UniqueName: \"kubernetes.io/projected/bb41588d-7d7e-4497-ac10-caad90123497-kube-api-access-xdzvc\") pod \"router-default-759d8757b9-whth9\" (UID: \"bb41588d-7d7e-4497-ac10-caad90123497\") " pod="openshift-ingress/router-default-759d8757b9-whth9" Jul 07 12:48:47.966016 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.965991 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-kqkwl" Jul 07 12:48:47.984776 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.984751 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4799efdd-3758-4f1f-b17e-05d428ce8edf-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-cxjzh\" (UID: \"4799efdd-3758-4f1f-b17e-05d428ce8edf\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cxjzh" Jul 07 12:48:47.984886 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.984790 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d9ad543c-2b24-443d-a2ed-e3bc420cd888-config\") pod \"console-operator-68b757fb67-gqgkf\" (UID: \"d9ad543c-2b24-443d-a2ed-e3bc420cd888\") " pod="openshift-console-operator/console-operator-68b757fb67-gqgkf" Jul 07 12:48:47.984886 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.984820 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ffb9426d-0075-440a-9bad-f4d3373a2550-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-s69bh\" (UID: \"ffb9426d-0075-440a-9bad-f4d3373a2550\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s69bh" Jul 07 12:48:47.984886 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.984860 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99331929-499a-431f-a1eb-81521986520b-tmp-dir\") pod \"dns-default-kvkc7\" (UID: \"99331929-499a-431f-a1eb-81521986520b\") " pod="openshift-dns/dns-default-kvkc7" Jul 07 12:48:47.985042 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.984884 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4799efdd-3758-4f1f-b17e-05d428ce8edf-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-cxjzh\" (UID: \"4799efdd-3758-4f1f-b17e-05d428ce8edf\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cxjzh" Jul 07 12:48:47.985042 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.984911 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d9ad543c-2b24-443d-a2ed-e3bc420cd888-serving-cert\") pod \"console-operator-68b757fb67-gqgkf\" (UID: \"d9ad543c-2b24-443d-a2ed-e3bc420cd888\") " pod="openshift-console-operator/console-operator-68b757fb67-gqgkf" Jul 07 12:48:47.985042 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.984945 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz5nf\" (UniqueName: \"kubernetes.io/projected/ea9e3849-f2d6-4acc-b089-f59ff406999a-kube-api-access-vz5nf\") pod \"network-check-source-989f8b8dc-x9vgr\" (UID: \"ea9e3849-f2d6-4acc-b089-f59ff406999a\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-x9vgr" Jul 07 12:48:47.985185 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.985038 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99331929-499a-431f-a1eb-81521986520b-metrics-tls\") pod \"dns-default-kvkc7\" (UID: \"99331929-499a-431f-a1eb-81521986520b\") " pod="openshift-dns/dns-default-kvkc7" Jul 07 12:48:47.985185 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.985063 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a3eff27-1183-4cc7-850c-216d0af8714a-cert\") pod \"ingress-canary-m2kzs\" (UID: \"8a3eff27-1183-4cc7-850c-216d0af8714a\") " pod="openshift-ingress-canary/ingress-canary-m2kzs" Jul 07 12:48:47.985185 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.985088 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nljq\" (UniqueName: \"kubernetes.io/projected/7b758bf7-cc6b-43ec-ae60-997d0c9c1b05-kube-api-access-9nljq\") pod \"volume-data-source-validator-5d456fdbcd-7twbn\" (UID: \"7b758bf7-cc6b-43ec-ae60-997d0c9c1b05\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-7twbn" Jul 07 12:48:47.985185 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.985112 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d9ad543c-2b24-443d-a2ed-e3bc420cd888-trusted-ca\") pod \"console-operator-68b757fb67-gqgkf\" (UID: \"d9ad543c-2b24-443d-a2ed-e3bc420cd888\") " pod="openshift-console-operator/console-operator-68b757fb67-gqgkf" Jul 07 12:48:47.985185 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.985130 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7c9m\" (UniqueName: \"kubernetes.io/projected/8a3eff27-1183-4cc7-850c-216d0af8714a-kube-api-access-n7c9m\") pod \"ingress-canary-m2kzs\" (UID: \"8a3eff27-1183-4cc7-850c-216d0af8714a\") " pod="openshift-ingress-canary/ingress-canary-m2kzs" Jul 07 12:48:47.985412 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.985254 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hdcs\" (UniqueName: \"kubernetes.io/projected/99331929-499a-431f-a1eb-81521986520b-kube-api-access-2hdcs\") pod \"dns-default-kvkc7\" (UID: \"99331929-499a-431f-a1eb-81521986520b\") " pod="openshift-dns/dns-default-kvkc7" Jul 07 12:48:47.985412 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.985306 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5525b878-d89e-41f7-8c51-8e1ca4007876-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-j9zrl\" (UID: \"5525b878-d89e-41f7-8c51-8e1ca4007876\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j9zrl" Jul 07 12:48:47.985558 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.985535 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d9ad543c-2b24-443d-a2ed-e3bc420cd888-config\") pod \"console-operator-68b757fb67-gqgkf\" (UID: \"d9ad543c-2b24-443d-a2ed-e3bc420cd888\") " pod="openshift-console-operator/console-operator-68b757fb67-gqgkf" Jul 07 12:48:47.985760 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.985646 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62xtr\" (UniqueName: \"kubernetes.io/projected/d9ad543c-2b24-443d-a2ed-e3bc420cd888-kube-api-access-62xtr\") pod \"console-operator-68b757fb67-gqgkf\" (UID: \"d9ad543c-2b24-443d-a2ed-e3bc420cd888\") " pod="openshift-console-operator/console-operator-68b757fb67-gqgkf" Jul 07 12:48:47.985848 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.985759 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5525b878-d89e-41f7-8c51-8e1ca4007876-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-j9zrl\" (UID: \"5525b878-d89e-41f7-8c51-8e1ca4007876\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j9zrl" Jul 07 12:48:47.985848 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.985807 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ffb9426d-0075-440a-9bad-f4d3373a2550-config\") pod \"service-ca-operator-5d46d9ffd4-s69bh\" (UID: \"ffb9426d-0075-440a-9bad-f4d3373a2550\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s69bh" Jul 07 12:48:47.985951 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.985845 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/99331929-499a-431f-a1eb-81521986520b-config-volume\") pod \"dns-default-kvkc7\" (UID: \"99331929-499a-431f-a1eb-81521986520b\") " pod="openshift-dns/dns-default-kvkc7" Jul 07 12:48:47.985951 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.985881 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57jz2\" (UniqueName: \"kubernetes.io/projected/5525b878-d89e-41f7-8c51-8e1ca4007876-kube-api-access-57jz2\") pod \"kube-storage-version-migrator-operator-846bf668f7-j9zrl\" (UID: \"5525b878-d89e-41f7-8c51-8e1ca4007876\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j9zrl" Jul 07 12:48:47.985951 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.985909 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztxxx\" (UniqueName: \"kubernetes.io/projected/ffb9426d-0075-440a-9bad-f4d3373a2550-kube-api-access-ztxxx\") pod \"service-ca-operator-5d46d9ffd4-s69bh\" (UID: \"ffb9426d-0075-440a-9bad-f4d3373a2550\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s69bh" Jul 07 12:48:47.986247 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.986164 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d9ad543c-2b24-443d-a2ed-e3bc420cd888-trusted-ca\") pod \"console-operator-68b757fb67-gqgkf\" (UID: \"d9ad543c-2b24-443d-a2ed-e3bc420cd888\") " pod="openshift-console-operator/console-operator-68b757fb67-gqgkf" Jul 07 12:48:47.986384 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.986344 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5525b878-d89e-41f7-8c51-8e1ca4007876-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-j9zrl\" (UID: \"5525b878-d89e-41f7-8c51-8e1ca4007876\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j9zrl" Jul 07 12:48:47.986465 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.986414 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ffb9426d-0075-440a-9bad-f4d3373a2550-config\") pod \"service-ca-operator-5d46d9ffd4-s69bh\" (UID: \"ffb9426d-0075-440a-9bad-f4d3373a2550\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s69bh" Jul 07 12:48:47.987672 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.987629 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d9ad543c-2b24-443d-a2ed-e3bc420cd888-serving-cert\") pod \"console-operator-68b757fb67-gqgkf\" (UID: \"d9ad543c-2b24-443d-a2ed-e3bc420cd888\") " pod="openshift-console-operator/console-operator-68b757fb67-gqgkf" Jul 07 12:48:47.988069 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.988026 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5525b878-d89e-41f7-8c51-8e1ca4007876-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-j9zrl\" (UID: \"5525b878-d89e-41f7-8c51-8e1ca4007876\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j9zrl" Jul 07 12:48:47.988069 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.988043 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ffb9426d-0075-440a-9bad-f4d3373a2550-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-s69bh\" (UID: \"ffb9426d-0075-440a-9bad-f4d3373a2550\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s69bh" Jul 07 12:48:47.997072 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.997048 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztxxx\" (UniqueName: \"kubernetes.io/projected/ffb9426d-0075-440a-9bad-f4d3373a2550-kube-api-access-ztxxx\") pod \"service-ca-operator-5d46d9ffd4-s69bh\" (UID: \"ffb9426d-0075-440a-9bad-f4d3373a2550\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s69bh" Jul 07 12:48:47.998313 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.998295 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62xtr\" (UniqueName: \"kubernetes.io/projected/d9ad543c-2b24-443d-a2ed-e3bc420cd888-kube-api-access-62xtr\") pod \"console-operator-68b757fb67-gqgkf\" (UID: \"d9ad543c-2b24-443d-a2ed-e3bc420cd888\") " pod="openshift-console-operator/console-operator-68b757fb67-gqgkf" Jul 07 12:48:47.998631 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.998610 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nljq\" (UniqueName: \"kubernetes.io/projected/7b758bf7-cc6b-43ec-ae60-997d0c9c1b05-kube-api-access-9nljq\") pod \"volume-data-source-validator-5d456fdbcd-7twbn\" (UID: \"7b758bf7-cc6b-43ec-ae60-997d0c9c1b05\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-7twbn" Jul 07 12:48:47.998771 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:47.998747 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57jz2\" (UniqueName: \"kubernetes.io/projected/5525b878-d89e-41f7-8c51-8e1ca4007876-kube-api-access-57jz2\") pod \"kube-storage-version-migrator-operator-846bf668f7-j9zrl\" (UID: \"5525b878-d89e-41f7-8c51-8e1ca4007876\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j9zrl" Jul 07 12:48:48.019779 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.019738 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-gqgkf" Jul 07 12:48:48.044458 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.044433 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-7twbn" Jul 07 12:48:48.067844 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.067813 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j9zrl" Jul 07 12:48:48.088510 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.086320 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4799efdd-3758-4f1f-b17e-05d428ce8edf-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-cxjzh\" (UID: \"4799efdd-3758-4f1f-b17e-05d428ce8edf\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cxjzh" Jul 07 12:48:48.088510 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.086555 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99331929-499a-431f-a1eb-81521986520b-tmp-dir\") pod \"dns-default-kvkc7\" (UID: \"99331929-499a-431f-a1eb-81521986520b\") " pod="openshift-dns/dns-default-kvkc7" Jul 07 12:48:48.088510 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.086586 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4799efdd-3758-4f1f-b17e-05d428ce8edf-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-cxjzh\" (UID: \"4799efdd-3758-4f1f-b17e-05d428ce8edf\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cxjzh" Jul 07 12:48:48.088510 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.086616 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz5nf\" (UniqueName: \"kubernetes.io/projected/ea9e3849-f2d6-4acc-b089-f59ff406999a-kube-api-access-vz5nf\") pod \"network-check-source-989f8b8dc-x9vgr\" (UID: \"ea9e3849-f2d6-4acc-b089-f59ff406999a\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-x9vgr" Jul 07 12:48:48.088510 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.086643 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99331929-499a-431f-a1eb-81521986520b-metrics-tls\") pod \"dns-default-kvkc7\" (UID: \"99331929-499a-431f-a1eb-81521986520b\") " pod="openshift-dns/dns-default-kvkc7" Jul 07 12:48:48.088510 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.086668 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a3eff27-1183-4cc7-850c-216d0af8714a-cert\") pod \"ingress-canary-m2kzs\" (UID: \"8a3eff27-1183-4cc7-850c-216d0af8714a\") " pod="openshift-ingress-canary/ingress-canary-m2kzs" Jul 07 12:48:48.088510 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.086693 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7c9m\" (UniqueName: \"kubernetes.io/projected/8a3eff27-1183-4cc7-850c-216d0af8714a-kube-api-access-n7c9m\") pod \"ingress-canary-m2kzs\" (UID: \"8a3eff27-1183-4cc7-850c-216d0af8714a\") " pod="openshift-ingress-canary/ingress-canary-m2kzs" Jul 07 12:48:48.088510 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.086804 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hdcs\" (UniqueName: \"kubernetes.io/projected/99331929-499a-431f-a1eb-81521986520b-kube-api-access-2hdcs\") pod \"dns-default-kvkc7\" (UID: \"99331929-499a-431f-a1eb-81521986520b\") " pod="openshift-dns/dns-default-kvkc7" Jul 07 12:48:48.088510 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.086888 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/99331929-499a-431f-a1eb-81521986520b-config-volume\") pod \"dns-default-kvkc7\" (UID: \"99331929-499a-431f-a1eb-81521986520b\") " pod="openshift-dns/dns-default-kvkc7" Jul 07 12:48:48.088510 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.087817 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/99331929-499a-431f-a1eb-81521986520b-config-volume\") pod \"dns-default-kvkc7\" (UID: \"99331929-499a-431f-a1eb-81521986520b\") " pod="openshift-dns/dns-default-kvkc7" Jul 07 12:48:48.088510 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.087855 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4799efdd-3758-4f1f-b17e-05d428ce8edf-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-cxjzh\" (UID: \"4799efdd-3758-4f1f-b17e-05d428ce8edf\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cxjzh" Jul 07 12:48:48.088510 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:48.087929 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 12:48:48.088510 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:48.087983 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99331929-499a-431f-a1eb-81521986520b-metrics-tls podName:99331929-499a-431f-a1eb-81521986520b nodeName:}" failed. No retries permitted until 2026-07-07 12:48:48.587965838 +0000 UTC m=+37.309693329 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99331929-499a-431f-a1eb-81521986520b-metrics-tls") pod "dns-default-kvkc7" (UID: "99331929-499a-431f-a1eb-81521986520b") : secret "dns-default-metrics-tls" not found Jul 07 12:48:48.088510 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.088275 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99331929-499a-431f-a1eb-81521986520b-tmp-dir\") pod \"dns-default-kvkc7\" (UID: \"99331929-499a-431f-a1eb-81521986520b\") " pod="openshift-dns/dns-default-kvkc7" Jul 07 12:48:48.088510 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:48.088361 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 12:48:48.088510 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:48.088409 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4799efdd-3758-4f1f-b17e-05d428ce8edf-networking-console-plugin-cert podName:4799efdd-3758-4f1f-b17e-05d428ce8edf nodeName:}" failed. No retries permitted until 2026-07-07 12:48:48.588393815 +0000 UTC m=+37.310121325 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4799efdd-3758-4f1f-b17e-05d428ce8edf-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-cxjzh" (UID: "4799efdd-3758-4f1f-b17e-05d428ce8edf") : secret "networking-console-plugin-cert" not found Jul 07 12:48:48.089801 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.089597 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s69bh" Jul 07 12:48:48.093802 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.093349 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a3eff27-1183-4cc7-850c-216d0af8714a-cert\") pod \"ingress-canary-m2kzs\" (UID: \"8a3eff27-1183-4cc7-850c-216d0af8714a\") " pod="openshift-ingress-canary/ingress-canary-m2kzs" Jul 07 12:48:48.103408 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.103347 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hdcs\" (UniqueName: \"kubernetes.io/projected/99331929-499a-431f-a1eb-81521986520b-kube-api-access-2hdcs\") pod \"dns-default-kvkc7\" (UID: \"99331929-499a-431f-a1eb-81521986520b\") " pod="openshift-dns/dns-default-kvkc7" Jul 07 12:48:48.115709 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.108489 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7c9m\" (UniqueName: \"kubernetes.io/projected/8a3eff27-1183-4cc7-850c-216d0af8714a-kube-api-access-n7c9m\") pod \"ingress-canary-m2kzs\" (UID: \"8a3eff27-1183-4cc7-850c-216d0af8714a\") " pod="openshift-ingress-canary/ingress-canary-m2kzs" Jul 07 12:48:48.115709 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.108896 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz5nf\" (UniqueName: \"kubernetes.io/projected/ea9e3849-f2d6-4acc-b089-f59ff406999a-kube-api-access-vz5nf\") pod \"network-check-source-989f8b8dc-x9vgr\" (UID: \"ea9e3849-f2d6-4acc-b089-f59ff406999a\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-x9vgr" Jul 07 12:48:48.115709 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.115126 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-x9vgr" Jul 07 12:48:48.153498 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.152634 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m2kzs" Jul 07 12:48:48.178179 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.178106 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-kqkwl"] Jul 07 12:48:48.195111 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:48.195036 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod280e8e44_e7c9_47ad_9cc9_611821d9bcfa.slice/crio-df4586ea6ac73296bab68b9661376814a43141063fa79cb5e3610acd7bef8fbe WatchSource:0}: Error finding container df4586ea6ac73296bab68b9661376814a43141063fa79cb5e3610acd7bef8fbe: Status 404 returned error can't find the container with id df4586ea6ac73296bab68b9661376814a43141063fa79cb5e3610acd7bef8fbe Jul 07 12:48:48.220031 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.220005 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-gqgkf"] Jul 07 12:48:48.268450 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.268352 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-7twbn"] Jul 07 12:48:48.275386 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:48.275353 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b758bf7_cc6b_43ec_ae60_997d0c9c1b05.slice/crio-edf53b3381cf91673934c936f4ad98c7814c8004439ff24c26473e3bb19d51da WatchSource:0}: Error finding container edf53b3381cf91673934c936f4ad98c7814c8004439ff24c26473e3bb19d51da: Status 404 returned error can't find the container with id edf53b3381cf91673934c936f4ad98c7814c8004439ff24c26473e3bb19d51da Jul 07 12:48:48.312524 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.312486 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j9zrl"] Jul 07 12:48:48.315314 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:48.315284 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5525b878_d89e_41f7_8c51_8e1ca4007876.slice/crio-06cd1b329308b17034c0da4005f7b19ea9571bf718b42e01b763d44c3b4145bd WatchSource:0}: Error finding container 06cd1b329308b17034c0da4005f7b19ea9571bf718b42e01b763d44c3b4145bd: Status 404 returned error can't find the container with id 06cd1b329308b17034c0da4005f7b19ea9571bf718b42e01b763d44c3b4145bd Jul 07 12:48:48.323778 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.323745 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s69bh"] Jul 07 12:48:48.327979 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:48.327955 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffb9426d_0075_440a_9bad_f4d3373a2550.slice/crio-c93dac3d3c33fdc89c414762ba97adb9be9d6671efe28813ba90a3dbe8970b15 WatchSource:0}: Error finding container c93dac3d3c33fdc89c414762ba97adb9be9d6671efe28813ba90a3dbe8970b15: Status 404 returned error can't find the container with id c93dac3d3c33fdc89c414762ba97adb9be9d6671efe28813ba90a3dbe8970b15 Jul 07 12:48:48.342360 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.342334 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-x9vgr"] Jul 07 12:48:48.346044 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:48.346017 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea9e3849_f2d6_4acc_b089_f59ff406999a.slice/crio-80456e14f2efccea1e770e7ff8ce7e5d0d1761b60a91389d0a8741e651e0ec6e WatchSource:0}: Error finding container 80456e14f2efccea1e770e7ff8ce7e5d0d1761b60a91389d0a8741e651e0ec6e: Status 404 returned error can't find the container with id 80456e14f2efccea1e770e7ff8ce7e5d0d1761b60a91389d0a8741e651e0ec6e Jul 07 12:48:48.389529 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.389502 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ac07d23-9858-4ce7-a553-812f8a2151a4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-44dxc\" (UID: \"3ac07d23-9858-4ce7-a553-812f8a2151a4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-44dxc" Jul 07 12:48:48.389652 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.389593 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f2df1ca-1917-4482-93f4-b07c1a1a3abc-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lqpq8\" (UID: \"7f2df1ca-1917-4482-93f4-b07c1a1a3abc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lqpq8" Jul 07 12:48:48.389652 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.389639 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m2kzs"] Jul 07 12:48:48.389652 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.389647 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb41588d-7d7e-4497-ac10-caad90123497-service-ca-bundle\") pod \"router-default-759d8757b9-whth9\" (UID: \"bb41588d-7d7e-4497-ac10-caad90123497\") " pod="openshift-ingress/router-default-759d8757b9-whth9" Jul 07 12:48:48.389802 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:48.389656 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 12:48:48.389802 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.389673 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb41588d-7d7e-4497-ac10-caad90123497-metrics-certs\") pod \"router-default-759d8757b9-whth9\" (UID: \"bb41588d-7d7e-4497-ac10-caad90123497\") " pod="openshift-ingress/router-default-759d8757b9-whth9" Jul 07 12:48:48.389802 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:48.389717 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ac07d23-9858-4ce7-a553-812f8a2151a4-cluster-monitoring-operator-tls podName:3ac07d23-9858-4ce7-a553-812f8a2151a4 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:49.389695932 +0000 UTC m=+38.111423428 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ac07d23-9858-4ce7-a553-812f8a2151a4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-44dxc" (UID: "3ac07d23-9858-4ce7-a553-812f8a2151a4") : secret "cluster-monitoring-operator-tls" not found Jul 07 12:48:48.389802 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:48.389750 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 12:48:48.389802 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:48.389786 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f2df1ca-1917-4482-93f4-b07c1a1a3abc-samples-operator-tls podName:7f2df1ca-1917-4482-93f4-b07c1a1a3abc nodeName:}" failed. No retries permitted until 2026-07-07 12:48:49.389774319 +0000 UTC m=+38.111501810 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7f2df1ca-1917-4482-93f4-b07c1a1a3abc-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lqpq8" (UID: "7f2df1ca-1917-4482-93f4-b07c1a1a3abc") : secret "samples-operator-tls" not found Jul 07 12:48:48.390035 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:48.389840 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 12:48:48.390035 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.389864 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-registry-tls\") pod \"image-registry-84c78544db-4hnvd\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:48:48.390035 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:48.389870 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb41588d-7d7e-4497-ac10-caad90123497-metrics-certs podName:bb41588d-7d7e-4497-ac10-caad90123497 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:49.38986054 +0000 UTC m=+38.111588036 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb41588d-7d7e-4497-ac10-caad90123497-metrics-certs") pod "router-default-759d8757b9-whth9" (UID: "bb41588d-7d7e-4497-ac10-caad90123497") : secret "router-metrics-certs-default" not found Jul 07 12:48:48.390035 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:48.389903 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb41588d-7d7e-4497-ac10-caad90123497-service-ca-bundle podName:bb41588d-7d7e-4497-ac10-caad90123497 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:49.389885232 +0000 UTC m=+38.111612728 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb41588d-7d7e-4497-ac10-caad90123497-service-ca-bundle") pod "router-default-759d8757b9-whth9" (UID: "bb41588d-7d7e-4497-ac10-caad90123497") : configmap references non-existent config key: service-ca.crt Jul 07 12:48:48.390035 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:48.389932 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 12:48:48.390035 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:48.389943 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84c78544db-4hnvd: secret "image-registry-tls" not found Jul 07 12:48:48.390035 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:48.389972 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-registry-tls podName:d5b6121e-690c-4400-beb6-235fcf5720f0 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:49.38996348 +0000 UTC m=+38.111690971 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-registry-tls") pod "image-registry-84c78544db-4hnvd" (UID: "d5b6121e-690c-4400-beb6-235fcf5720f0") : secret "image-registry-tls" not found Jul 07 12:48:48.392470 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:48:48.392445 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a3eff27_1183_4cc7_850c_216d0af8714a.slice/crio-a63ab6b85c326315f053063b8c493bb364e666e4c43414b6fdac889348820b56 WatchSource:0}: Error finding container a63ab6b85c326315f053063b8c493bb364e666e4c43414b6fdac889348820b56: Status 404 returned error can't find the container with id a63ab6b85c326315f053063b8c493bb364e666e4c43414b6fdac889348820b56 Jul 07 12:48:48.591144 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.591074 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4799efdd-3758-4f1f-b17e-05d428ce8edf-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-cxjzh\" (UID: \"4799efdd-3758-4f1f-b17e-05d428ce8edf\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cxjzh" Jul 07 12:48:48.591144 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.591108 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99331929-499a-431f-a1eb-81521986520b-metrics-tls\") pod \"dns-default-kvkc7\" (UID: \"99331929-499a-431f-a1eb-81521986520b\") " pod="openshift-dns/dns-default-kvkc7" Jul 07 12:48:48.591322 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:48.591208 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 12:48:48.591322 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:48.591226 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 12:48:48.591322 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:48.591262 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99331929-499a-431f-a1eb-81521986520b-metrics-tls podName:99331929-499a-431f-a1eb-81521986520b nodeName:}" failed. No retries permitted until 2026-07-07 12:48:49.59124724 +0000 UTC m=+38.312974732 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99331929-499a-431f-a1eb-81521986520b-metrics-tls") pod "dns-default-kvkc7" (UID: "99331929-499a-431f-a1eb-81521986520b") : secret "dns-default-metrics-tls" not found Jul 07 12:48:48.591322 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:48.591277 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4799efdd-3758-4f1f-b17e-05d428ce8edf-networking-console-plugin-cert podName:4799efdd-3758-4f1f-b17e-05d428ce8edf nodeName:}" failed. No retries permitted until 2026-07-07 12:48:49.591271496 +0000 UTC m=+38.312998986 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4799efdd-3758-4f1f-b17e-05d428ce8edf-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-cxjzh" (UID: "4799efdd-3758-4f1f-b17e-05d428ce8edf") : secret "networking-console-plugin-cert" not found Jul 07 12:48:48.819717 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.819686 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdccv" Jul 07 12:48:48.819717 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.819704 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svv9n" Jul 07 12:48:48.819717 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.819686 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:48:48.823316 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.823051 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 12:48:48.823316 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.823067 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cw2d4\"" Jul 07 12:48:48.823531 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.823455 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 12:48:48.823531 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.823470 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g5zg7\"" Jul 07 12:48:48.972517 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.972481 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-7twbn" event={"ID":"7b758bf7-cc6b-43ec-ae60-997d0c9c1b05","Type":"ContainerStarted","Data":"edf53b3381cf91673934c936f4ad98c7814c8004439ff24c26473e3bb19d51da"} Jul 07 12:48:48.973711 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.973685 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-gqgkf" event={"ID":"d9ad543c-2b24-443d-a2ed-e3bc420cd888","Type":"ContainerStarted","Data":"c287efcb32935a03d312d3167824bb3995816984e4215fa35d4e23a7546e92da"} Jul 07 12:48:48.974918 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.974899 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s69bh" event={"ID":"ffb9426d-0075-440a-9bad-f4d3373a2550","Type":"ContainerStarted","Data":"c93dac3d3c33fdc89c414762ba97adb9be9d6671efe28813ba90a3dbe8970b15"} Jul 07 12:48:48.976097 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.976078 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m2kzs" event={"ID":"8a3eff27-1183-4cc7-850c-216d0af8714a","Type":"ContainerStarted","Data":"a63ab6b85c326315f053063b8c493bb364e666e4c43414b6fdac889348820b56"} Jul 07 12:48:48.977250 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.977228 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j9zrl" event={"ID":"5525b878-d89e-41f7-8c51-8e1ca4007876","Type":"ContainerStarted","Data":"06cd1b329308b17034c0da4005f7b19ea9571bf718b42e01b763d44c3b4145bd"} Jul 07 12:48:48.978322 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.978297 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-kqkwl" event={"ID":"280e8e44-e7c9-47ad-9cc9-611821d9bcfa","Type":"ContainerStarted","Data":"df4586ea6ac73296bab68b9661376814a43141063fa79cb5e3610acd7bef8fbe"} Jul 07 12:48:48.979728 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:48.979708 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-x9vgr" event={"ID":"ea9e3849-f2d6-4acc-b089-f59ff406999a","Type":"ContainerStarted","Data":"80456e14f2efccea1e770e7ff8ce7e5d0d1761b60a91389d0a8741e651e0ec6e"} Jul 07 12:48:49.400822 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:49.399532 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f2df1ca-1917-4482-93f4-b07c1a1a3abc-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lqpq8\" (UID: \"7f2df1ca-1917-4482-93f4-b07c1a1a3abc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lqpq8" Jul 07 12:48:49.400822 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:49.399609 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb41588d-7d7e-4497-ac10-caad90123497-service-ca-bundle\") pod \"router-default-759d8757b9-whth9\" (UID: \"bb41588d-7d7e-4497-ac10-caad90123497\") " pod="openshift-ingress/router-default-759d8757b9-whth9" Jul 07 12:48:49.400822 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:49.399639 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb41588d-7d7e-4497-ac10-caad90123497-metrics-certs\") pod \"router-default-759d8757b9-whth9\" (UID: \"bb41588d-7d7e-4497-ac10-caad90123497\") " pod="openshift-ingress/router-default-759d8757b9-whth9" Jul 07 12:48:49.400822 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:49.399724 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-registry-tls\") pod \"image-registry-84c78544db-4hnvd\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:48:49.400822 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:49.399766 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ac07d23-9858-4ce7-a553-812f8a2151a4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-44dxc\" (UID: \"3ac07d23-9858-4ce7-a553-812f8a2151a4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-44dxc" Jul 07 12:48:49.400822 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:49.399939 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 12:48:49.400822 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:49.400007 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ac07d23-9858-4ce7-a553-812f8a2151a4-cluster-monitoring-operator-tls podName:3ac07d23-9858-4ce7-a553-812f8a2151a4 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:51.399984705 +0000 UTC m=+40.121712213 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ac07d23-9858-4ce7-a553-812f8a2151a4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-44dxc" (UID: "3ac07d23-9858-4ce7-a553-812f8a2151a4") : secret "cluster-monitoring-operator-tls" not found Jul 07 12:48:49.400822 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:49.400409 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 12:48:49.400822 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:49.400474 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f2df1ca-1917-4482-93f4-b07c1a1a3abc-samples-operator-tls podName:7f2df1ca-1917-4482-93f4-b07c1a1a3abc nodeName:}" failed. No retries permitted until 2026-07-07 12:48:51.400457303 +0000 UTC m=+40.122184801 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7f2df1ca-1917-4482-93f4-b07c1a1a3abc-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lqpq8" (UID: "7f2df1ca-1917-4482-93f4-b07c1a1a3abc") : secret "samples-operator-tls" not found Jul 07 12:48:49.400822 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:49.400545 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb41588d-7d7e-4497-ac10-caad90123497-service-ca-bundle podName:bb41588d-7d7e-4497-ac10-caad90123497 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:51.400534825 +0000 UTC m=+40.122262335 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb41588d-7d7e-4497-ac10-caad90123497-service-ca-bundle") pod "router-default-759d8757b9-whth9" (UID: "bb41588d-7d7e-4497-ac10-caad90123497") : configmap references non-existent config key: service-ca.crt Jul 07 12:48:49.400822 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:49.400604 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 12:48:49.400822 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:49.400640 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb41588d-7d7e-4497-ac10-caad90123497-metrics-certs podName:bb41588d-7d7e-4497-ac10-caad90123497 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:51.400629545 +0000 UTC m=+40.122357051 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb41588d-7d7e-4497-ac10-caad90123497-metrics-certs") pod "router-default-759d8757b9-whth9" (UID: "bb41588d-7d7e-4497-ac10-caad90123497") : secret "router-metrics-certs-default" not found Jul 07 12:48:49.400822 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:49.400705 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 12:48:49.400822 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:49.400716 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84c78544db-4hnvd: secret "image-registry-tls" not found Jul 07 12:48:49.400822 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:49.400749 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-registry-tls podName:d5b6121e-690c-4400-beb6-235fcf5720f0 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:51.400737429 +0000 UTC m=+40.122464937 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-registry-tls") pod "image-registry-84c78544db-4hnvd" (UID: "d5b6121e-690c-4400-beb6-235fcf5720f0") : secret "image-registry-tls" not found Jul 07 12:48:49.602656 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:49.602620 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4799efdd-3758-4f1f-b17e-05d428ce8edf-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-cxjzh\" (UID: \"4799efdd-3758-4f1f-b17e-05d428ce8edf\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cxjzh" Jul 07 12:48:49.602810 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:49.602681 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99331929-499a-431f-a1eb-81521986520b-metrics-tls\") pod \"dns-default-kvkc7\" (UID: \"99331929-499a-431f-a1eb-81521986520b\") " pod="openshift-dns/dns-default-kvkc7" Jul 07 12:48:49.603014 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:49.602994 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 12:48:49.603079 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:49.603066 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99331929-499a-431f-a1eb-81521986520b-metrics-tls podName:99331929-499a-431f-a1eb-81521986520b nodeName:}" failed. No retries permitted until 2026-07-07 12:48:51.603046902 +0000 UTC m=+40.324774394 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99331929-499a-431f-a1eb-81521986520b-metrics-tls") pod "dns-default-kvkc7" (UID: "99331929-499a-431f-a1eb-81521986520b") : secret "dns-default-metrics-tls" not found Jul 07 12:48:49.603394 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:49.603372 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 12:48:49.603490 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:49.603477 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4799efdd-3758-4f1f-b17e-05d428ce8edf-networking-console-plugin-cert podName:4799efdd-3758-4f1f-b17e-05d428ce8edf nodeName:}" failed. No retries permitted until 2026-07-07 12:48:51.603456401 +0000 UTC m=+40.325183894 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4799efdd-3758-4f1f-b17e-05d428ce8edf-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-cxjzh" (UID: "4799efdd-3758-4f1f-b17e-05d428ce8edf") : secret "networking-console-plugin-cert" not found Jul 07 12:48:51.422714 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:51.422682 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ac07d23-9858-4ce7-a553-812f8a2151a4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-44dxc\" (UID: \"3ac07d23-9858-4ce7-a553-812f8a2151a4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-44dxc" Jul 07 12:48:51.423223 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:51.422746 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f2df1ca-1917-4482-93f4-b07c1a1a3abc-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lqpq8\" (UID: \"7f2df1ca-1917-4482-93f4-b07c1a1a3abc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lqpq8" Jul 07 12:48:51.423223 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:51.422789 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb41588d-7d7e-4497-ac10-caad90123497-service-ca-bundle\") pod \"router-default-759d8757b9-whth9\" (UID: \"bb41588d-7d7e-4497-ac10-caad90123497\") " pod="openshift-ingress/router-default-759d8757b9-whth9" Jul 07 12:48:51.423223 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:51.422809 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb41588d-7d7e-4497-ac10-caad90123497-metrics-certs\") pod \"router-default-759d8757b9-whth9\" (UID: \"bb41588d-7d7e-4497-ac10-caad90123497\") " pod="openshift-ingress/router-default-759d8757b9-whth9" Jul 07 12:48:51.423223 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:51.422883 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-registry-tls\") pod \"image-registry-84c78544db-4hnvd\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:48:51.423223 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:51.422924 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 12:48:51.423223 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:51.422955 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 12:48:51.423223 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:51.422976 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 12:48:51.423223 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:51.422989 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84c78544db-4hnvd: secret "image-registry-tls" not found Jul 07 12:48:51.423223 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:51.422997 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 12:48:51.423223 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:51.423004 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f2df1ca-1917-4482-93f4-b07c1a1a3abc-samples-operator-tls podName:7f2df1ca-1917-4482-93f4-b07c1a1a3abc nodeName:}" failed. No retries permitted until 2026-07-07 12:48:55.422973386 +0000 UTC m=+44.144700892 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7f2df1ca-1917-4482-93f4-b07c1a1a3abc-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lqpq8" (UID: "7f2df1ca-1917-4482-93f4-b07c1a1a3abc") : secret "samples-operator-tls" not found Jul 07 12:48:51.423223 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:51.423067 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb41588d-7d7e-4497-ac10-caad90123497-service-ca-bundle podName:bb41588d-7d7e-4497-ac10-caad90123497 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:55.423051882 +0000 UTC m=+44.144779404 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb41588d-7d7e-4497-ac10-caad90123497-service-ca-bundle") pod "router-default-759d8757b9-whth9" (UID: "bb41588d-7d7e-4497-ac10-caad90123497") : configmap references non-existent config key: service-ca.crt Jul 07 12:48:51.423223 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:51.423087 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ac07d23-9858-4ce7-a553-812f8a2151a4-cluster-monitoring-operator-tls podName:3ac07d23-9858-4ce7-a553-812f8a2151a4 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:55.423077695 +0000 UTC m=+44.144805187 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ac07d23-9858-4ce7-a553-812f8a2151a4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-44dxc" (UID: "3ac07d23-9858-4ce7-a553-812f8a2151a4") : secret "cluster-monitoring-operator-tls" not found Jul 07 12:48:51.423223 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:51.423101 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-registry-tls podName:d5b6121e-690c-4400-beb6-235fcf5720f0 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:55.423094328 +0000 UTC m=+44.144821818 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-registry-tls") pod "image-registry-84c78544db-4hnvd" (UID: "d5b6121e-690c-4400-beb6-235fcf5720f0") : secret "image-registry-tls" not found Jul 07 12:48:51.423223 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:51.423114 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb41588d-7d7e-4497-ac10-caad90123497-metrics-certs podName:bb41588d-7d7e-4497-ac10-caad90123497 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:55.423107728 +0000 UTC m=+44.144835219 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb41588d-7d7e-4497-ac10-caad90123497-metrics-certs") pod "router-default-759d8757b9-whth9" (UID: "bb41588d-7d7e-4497-ac10-caad90123497") : secret "router-metrics-certs-default" not found Jul 07 12:48:51.624049 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:51.624011 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4799efdd-3758-4f1f-b17e-05d428ce8edf-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-cxjzh\" (UID: \"4799efdd-3758-4f1f-b17e-05d428ce8edf\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cxjzh" Jul 07 12:48:51.624227 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:51.624068 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99331929-499a-431f-a1eb-81521986520b-metrics-tls\") pod \"dns-default-kvkc7\" (UID: \"99331929-499a-431f-a1eb-81521986520b\") " pod="openshift-dns/dns-default-kvkc7" Jul 07 12:48:51.624227 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:51.624166 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 12:48:51.624343 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:51.624241 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4799efdd-3758-4f1f-b17e-05d428ce8edf-networking-console-plugin-cert podName:4799efdd-3758-4f1f-b17e-05d428ce8edf nodeName:}" failed. No retries permitted until 2026-07-07 12:48:55.624220577 +0000 UTC m=+44.345948075 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4799efdd-3758-4f1f-b17e-05d428ce8edf-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-cxjzh" (UID: "4799efdd-3758-4f1f-b17e-05d428ce8edf") : secret "networking-console-plugin-cert" not found Jul 07 12:48:51.624343 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:51.624306 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 12:48:51.624474 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:51.624358 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99331929-499a-431f-a1eb-81521986520b-metrics-tls podName:99331929-499a-431f-a1eb-81521986520b nodeName:}" failed. No retries permitted until 2026-07-07 12:48:55.624342384 +0000 UTC m=+44.346069900 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99331929-499a-431f-a1eb-81521986520b-metrics-tls") pod "dns-default-kvkc7" (UID: "99331929-499a-431f-a1eb-81521986520b") : secret "dns-default-metrics-tls" not found Jul 07 12:48:52.491692 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:52.491651 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:48:52.596273 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:52.596235 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:48:54.528460 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:54.528412 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:48:54.637836 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:54.637780 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:48:55.460117 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:55.460076 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f2df1ca-1917-4482-93f4-b07c1a1a3abc-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lqpq8\" (UID: \"7f2df1ca-1917-4482-93f4-b07c1a1a3abc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lqpq8" Jul 07 12:48:55.460306 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:55.460225 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb41588d-7d7e-4497-ac10-caad90123497-service-ca-bundle\") pod \"router-default-759d8757b9-whth9\" (UID: \"bb41588d-7d7e-4497-ac10-caad90123497\") " pod="openshift-ingress/router-default-759d8757b9-whth9" Jul 07 12:48:55.460306 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:55.460278 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb41588d-7d7e-4497-ac10-caad90123497-metrics-certs\") pod \"router-default-759d8757b9-whth9\" (UID: \"bb41588d-7d7e-4497-ac10-caad90123497\") " pod="openshift-ingress/router-default-759d8757b9-whth9" Jul 07 12:48:55.460468 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:55.460243 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 12:48:55.460468 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:55.460336 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb41588d-7d7e-4497-ac10-caad90123497-service-ca-bundle podName:bb41588d-7d7e-4497-ac10-caad90123497 nodeName:}" failed. No retries permitted until 2026-07-07 12:49:03.460315193 +0000 UTC m=+52.182042686 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb41588d-7d7e-4497-ac10-caad90123497-service-ca-bundle") pod "router-default-759d8757b9-whth9" (UID: "bb41588d-7d7e-4497-ac10-caad90123497") : configmap references non-existent config key: service-ca.crt Jul 07 12:48:55.460468 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:55.460353 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 12:48:55.460468 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:55.460368 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f2df1ca-1917-4482-93f4-b07c1a1a3abc-samples-operator-tls podName:7f2df1ca-1917-4482-93f4-b07c1a1a3abc nodeName:}" failed. No retries permitted until 2026-07-07 12:49:03.460356535 +0000 UTC m=+52.182084033 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7f2df1ca-1917-4482-93f4-b07c1a1a3abc-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lqpq8" (UID: "7f2df1ca-1917-4482-93f4-b07c1a1a3abc") : secret "samples-operator-tls" not found Jul 07 12:48:55.460468 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:55.460397 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb41588d-7d7e-4497-ac10-caad90123497-metrics-certs podName:bb41588d-7d7e-4497-ac10-caad90123497 nodeName:}" failed. No retries permitted until 2026-07-07 12:49:03.460385702 +0000 UTC m=+52.182113192 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb41588d-7d7e-4497-ac10-caad90123497-metrics-certs") pod "router-default-759d8757b9-whth9" (UID: "bb41588d-7d7e-4497-ac10-caad90123497") : secret "router-metrics-certs-default" not found Jul 07 12:48:55.460740 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:55.460488 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-registry-tls\") pod \"image-registry-84c78544db-4hnvd\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:48:55.460740 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:55.460537 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ac07d23-9858-4ce7-a553-812f8a2151a4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-44dxc\" (UID: \"3ac07d23-9858-4ce7-a553-812f8a2151a4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-44dxc" Jul 07 12:48:55.460740 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:55.460627 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 12:48:55.460740 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:55.460646 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84c78544db-4hnvd: secret "image-registry-tls" not found Jul 07 12:48:55.460740 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:55.460672 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 12:48:55.460740 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:55.460698 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-registry-tls podName:d5b6121e-690c-4400-beb6-235fcf5720f0 nodeName:}" failed. No retries permitted until 2026-07-07 12:49:03.460681159 +0000 UTC m=+52.182408689 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-registry-tls") pod "image-registry-84c78544db-4hnvd" (UID: "d5b6121e-690c-4400-beb6-235fcf5720f0") : secret "image-registry-tls" not found Jul 07 12:48:55.460740 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:55.460719 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ac07d23-9858-4ce7-a553-812f8a2151a4-cluster-monitoring-operator-tls podName:3ac07d23-9858-4ce7-a553-812f8a2151a4 nodeName:}" failed. No retries permitted until 2026-07-07 12:49:03.46070552 +0000 UTC m=+52.182433033 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ac07d23-9858-4ce7-a553-812f8a2151a4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-44dxc" (UID: "3ac07d23-9858-4ce7-a553-812f8a2151a4") : secret "cluster-monitoring-operator-tls" not found Jul 07 12:48:55.662385 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:55.662354 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4799efdd-3758-4f1f-b17e-05d428ce8edf-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-cxjzh\" (UID: \"4799efdd-3758-4f1f-b17e-05d428ce8edf\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cxjzh" Jul 07 12:48:55.662385 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:55.662388 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99331929-499a-431f-a1eb-81521986520b-metrics-tls\") pod \"dns-default-kvkc7\" (UID: \"99331929-499a-431f-a1eb-81521986520b\") " pod="openshift-dns/dns-default-kvkc7" Jul 07 12:48:55.662841 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:55.662503 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 12:48:55.662841 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:55.662594 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99331929-499a-431f-a1eb-81521986520b-metrics-tls podName:99331929-499a-431f-a1eb-81521986520b nodeName:}" failed. No retries permitted until 2026-07-07 12:49:03.662573671 +0000 UTC m=+52.384301167 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99331929-499a-431f-a1eb-81521986520b-metrics-tls") pod "dns-default-kvkc7" (UID: "99331929-499a-431f-a1eb-81521986520b") : secret "dns-default-metrics-tls" not found Jul 07 12:48:55.662841 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:55.662607 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 12:48:55.662841 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:55.662655 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4799efdd-3758-4f1f-b17e-05d428ce8edf-networking-console-plugin-cert podName:4799efdd-3758-4f1f-b17e-05d428ce8edf nodeName:}" failed. No retries permitted until 2026-07-07 12:49:03.662643546 +0000 UTC m=+52.384371036 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4799efdd-3758-4f1f-b17e-05d428ce8edf-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-cxjzh" (UID: "4799efdd-3758-4f1f-b17e-05d428ce8edf") : secret "networking-console-plugin-cert" not found Jul 07 12:48:55.789002 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:55.788966 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:48:55.905601 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:55.905565 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:48:56.033044 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:56.033004 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:48:56.663104 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:56.663068 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:48:56.831577 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:56.831534 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:48:58.012491 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.011437 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-kqkwl" event={"ID":"280e8e44-e7c9-47ad-9cc9-611821d9bcfa","Type":"ContainerStarted","Data":"a62b973a23f2ebe73a302709168618dc24a4fd06c7abf43bbc42cb5a3f0006b2"} Jul 07 12:48:58.017916 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.015168 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-x9vgr" event={"ID":"ea9e3849-f2d6-4acc-b089-f59ff406999a","Type":"ContainerStarted","Data":"8aa18ff60adea882784208c31d374f3a12e42385c63fc0e06d14d0ac793e51f5"} Jul 07 12:48:58.017916 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.017309 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-7twbn" event={"ID":"7b758bf7-cc6b-43ec-ae60-997d0c9c1b05","Type":"ContainerStarted","Data":"aeaad1ea8c2c49c43adb9f0aede50c71e3d2a9774f8005c16b5175b38ca52cd2"} Jul 07 12:48:58.023447 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.020702 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-gqgkf" event={"ID":"d9ad543c-2b24-443d-a2ed-e3bc420cd888","Type":"ContainerStarted","Data":"125f293d5da13cfb60a83583abf6c741de3c8fe5a3006974540a9ee8e98388d5"} Jul 07 12:48:58.023447 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.020767 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-gqgkf" Jul 07 12:48:58.023447 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.021227 2555 patch_prober.go:28] interesting pod/console-operator-68b757fb67-gqgkf container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.10:8443/readyz\": dial tcp 10.132.0.10:8443: connect: connection refused" start-of-body= Jul 07 12:48:58.023447 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.021273 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-68b757fb67-gqgkf" podUID="d9ad543c-2b24-443d-a2ed-e3bc420cd888" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.10:8443/readyz\": dial tcp 10.132.0.10:8443: connect: connection refused" Jul 07 12:48:58.023447 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.021640 2555 patch_prober.go:28] interesting pod/console-operator-68b757fb67-gqgkf container/console-operator namespace/openshift-console-operator: Liveness probe status=failure output="Get \"https://10.132.0.10:8443/healthz\": dial tcp 10.132.0.10:8443: connect: connection refused" start-of-body= Jul 07 12:48:58.023447 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.021675 2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-console-operator/console-operator-68b757fb67-gqgkf" podUID="d9ad543c-2b24-443d-a2ed-e3bc420cd888" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.10:8443/healthz\": dial tcp 10.132.0.10:8443: connect: connection refused" Jul 07 12:48:58.028140 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.028103 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s69bh" event={"ID":"ffb9426d-0075-440a-9bad-f4d3373a2550","Type":"ContainerStarted","Data":"c9428c4a6e8f0dc7abcd0c2ec2495fb4bd4a2cc33692e73c1f6a2de4eeff2ed4"} Jul 07 12:48:58.031014 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.030749 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m2kzs" event={"ID":"8a3eff27-1183-4cc7-850c-216d0af8714a","Type":"ContainerStarted","Data":"4034899a4b7fbe10e04f0014320e63be66bb06ca8e4901e2c3095554e7a12985"} Jul 07 12:48:58.032945 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.032522 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j9zrl" event={"ID":"5525b878-d89e-41f7-8c51-8e1ca4007876","Type":"ContainerStarted","Data":"83e5b17402751fb809bf34d34094c37000a7356ecf8005a33c8adb0d9e2b5410"} Jul 07 12:48:58.045784 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.044890 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-kqkwl" podStartSLOduration=34.452101445 podStartE2EDuration="44.044873269s" totalImagesPullingTime="9.592771824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:48:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:48:58.043811582 +0000 UTC m=+46.765539097" watchObservedRunningTime="2026-07-07 12:48:58.044873269 +0000 UTC m=+46.766600785" Jul 07 12:48:58.108549 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.107466 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-m2kzs" podStartSLOduration=1.708163523 podStartE2EDuration="11.107443589s" totalImagesPullingTime="9.399280066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:48:58.069959594 +0000 UTC m=+46.791687106" watchObservedRunningTime="2026-07-07 12:48:58.107443589 +0000 UTC m=+46.829171098" Jul 07 12:48:58.142462 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.141353 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j9zrl" podStartSLOduration=34.665497733 podStartE2EDuration="44.141333147s" totalImagesPullingTime="9.475835414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:48:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:48:58.140698221 +0000 UTC m=+46.862425735" watchObservedRunningTime="2026-07-07 12:48:58.141333147 +0000 UTC m=+46.863060660" Jul 07 12:48:58.142462 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.141594 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-gqgkf" podStartSLOduration=34.599449647 podStartE2EDuration="44.141577035s" totalImagesPullingTime="9.542127388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:48:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:48:58.108241745 +0000 UTC m=+46.829969261" watchObservedRunningTime="2026-07-07 12:48:58.141577035 +0000 UTC m=+46.863304548" Jul 07 12:48:58.181108 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.180166 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-7twbn" podStartSLOduration=34.718050812 podStartE2EDuration="44.18014556s" totalImagesPullingTime="9.462094748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:48:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:48:58.178970717 +0000 UTC m=+46.900698231" watchObservedRunningTime="2026-07-07 12:48:58.18014556 +0000 UTC m=+46.901873073" Jul 07 12:48:58.272036 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.271789 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s69bh" podStartSLOduration=34.802233862 podStartE2EDuration="44.271767284s" totalImagesPullingTime="9.469533422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:48:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:48:58.222006315 +0000 UTC m=+46.943733845" watchObservedRunningTime="2026-07-07 12:48:58.271767284 +0000 UTC m=+46.993494810" Jul 07 12:48:58.273514 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.273461 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-x9vgr" podStartSLOduration=32.827918145 podStartE2EDuration="42.273442105s" totalImagesPullingTime="9.44552396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:48:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:48:58.272919798 +0000 UTC m=+46.994647304" watchObservedRunningTime="2026-07-07 12:48:58.273442105 +0000 UTC m=+46.995169620" Jul 07 12:48:58.361059 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.361019 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:48:58.819965 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.819933 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qvthj"] Jul 07 12:48:58.826573 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.826550 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qvthj" Jul 07 12:48:58.834966 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.834946 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2zm52\"" Jul 07 12:48:58.835033 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.835006 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 12:48:58.835265 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.834956 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 12:48:58.894203 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.894162 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/711bbda5-9512-4927-8fd3-6c02b2fdb682-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qvthj\" (UID: \"711bbda5-9512-4927-8fd3-6c02b2fdb682\") " pod="openshift-insights/insights-runtime-extractor-qvthj" Jul 07 12:48:58.894528 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.894502 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/711bbda5-9512-4927-8fd3-6c02b2fdb682-data-volume\") pod \"insights-runtime-extractor-qvthj\" (UID: \"711bbda5-9512-4927-8fd3-6c02b2fdb682\") " pod="openshift-insights/insights-runtime-extractor-qvthj" Jul 07 12:48:58.894659 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.894559 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/711bbda5-9512-4927-8fd3-6c02b2fdb682-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qvthj\" (UID: \"711bbda5-9512-4927-8fd3-6c02b2fdb682\") " pod="openshift-insights/insights-runtime-extractor-qvthj" Jul 07 12:48:58.894725 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.894677 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d87b\" (UniqueName: \"kubernetes.io/projected/711bbda5-9512-4927-8fd3-6c02b2fdb682-kube-api-access-2d87b\") pod \"insights-runtime-extractor-qvthj\" (UID: \"711bbda5-9512-4927-8fd3-6c02b2fdb682\") " pod="openshift-insights/insights-runtime-extractor-qvthj" Jul 07 12:48:58.894780 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.894724 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/711bbda5-9512-4927-8fd3-6c02b2fdb682-crio-socket\") pod \"insights-runtime-extractor-qvthj\" (UID: \"711bbda5-9512-4927-8fd3-6c02b2fdb682\") " pod="openshift-insights/insights-runtime-extractor-qvthj" Jul 07 12:48:58.995292 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.995249 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d87b\" (UniqueName: \"kubernetes.io/projected/711bbda5-9512-4927-8fd3-6c02b2fdb682-kube-api-access-2d87b\") pod \"insights-runtime-extractor-qvthj\" (UID: \"711bbda5-9512-4927-8fd3-6c02b2fdb682\") " pod="openshift-insights/insights-runtime-extractor-qvthj" Jul 07 12:48:58.995498 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.995306 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/711bbda5-9512-4927-8fd3-6c02b2fdb682-crio-socket\") pod \"insights-runtime-extractor-qvthj\" (UID: \"711bbda5-9512-4927-8fd3-6c02b2fdb682\") " pod="openshift-insights/insights-runtime-extractor-qvthj" Jul 07 12:48:58.995498 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.995462 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/711bbda5-9512-4927-8fd3-6c02b2fdb682-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qvthj\" (UID: \"711bbda5-9512-4927-8fd3-6c02b2fdb682\") " pod="openshift-insights/insights-runtime-extractor-qvthj" Jul 07 12:48:58.995621 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.995510 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/711bbda5-9512-4927-8fd3-6c02b2fdb682-data-volume\") pod \"insights-runtime-extractor-qvthj\" (UID: \"711bbda5-9512-4927-8fd3-6c02b2fdb682\") " pod="openshift-insights/insights-runtime-extractor-qvthj" Jul 07 12:48:58.995621 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.995547 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/711bbda5-9512-4927-8fd3-6c02b2fdb682-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qvthj\" (UID: \"711bbda5-9512-4927-8fd3-6c02b2fdb682\") " pod="openshift-insights/insights-runtime-extractor-qvthj" Jul 07 12:48:58.995621 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.995587 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/711bbda5-9512-4927-8fd3-6c02b2fdb682-crio-socket\") pod \"insights-runtime-extractor-qvthj\" (UID: \"711bbda5-9512-4927-8fd3-6c02b2fdb682\") " pod="openshift-insights/insights-runtime-extractor-qvthj" Jul 07 12:48:58.995769 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:58.995620 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 12:48:58.995769 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:58.995667 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/711bbda5-9512-4927-8fd3-6c02b2fdb682-kube-rbac-proxy-cm podName:711bbda5-9512-4927-8fd3-6c02b2fdb682 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:59.495654304 +0000 UTC m=+48.217381796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/711bbda5-9512-4927-8fd3-6c02b2fdb682-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qvthj" (UID: "711bbda5-9512-4927-8fd3-6c02b2fdb682") : configmap "kube-rbac-proxy" not found Jul 07 12:48:58.995769 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:58.995690 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 12:48:58.995769 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:58.995750 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/711bbda5-9512-4927-8fd3-6c02b2fdb682-insights-runtime-extractor-tls podName:711bbda5-9512-4927-8fd3-6c02b2fdb682 nodeName:}" failed. No retries permitted until 2026-07-07 12:48:59.49573348 +0000 UTC m=+48.217460975 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/711bbda5-9512-4927-8fd3-6c02b2fdb682-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qvthj" (UID: "711bbda5-9512-4927-8fd3-6c02b2fdb682") : secret "insights-runtime-extractor-tls" not found Jul 07 12:48:58.996037 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:58.996019 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/711bbda5-9512-4927-8fd3-6c02b2fdb682-data-volume\") pod \"insights-runtime-extractor-qvthj\" (UID: \"711bbda5-9512-4927-8fd3-6c02b2fdb682\") " pod="openshift-insights/insights-runtime-extractor-qvthj" Jul 07 12:48:59.005194 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:59.005166 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qvthj"] Jul 07 12:48:59.028663 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:59.028631 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d87b\" (UniqueName: \"kubernetes.io/projected/711bbda5-9512-4927-8fd3-6c02b2fdb682-kube-api-access-2d87b\") pod \"insights-runtime-extractor-qvthj\" (UID: \"711bbda5-9512-4927-8fd3-6c02b2fdb682\") " pod="openshift-insights/insights-runtime-extractor-qvthj" Jul 07 12:48:59.038195 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:59.038170 2555 generic.go:356] "Generic (PLEG): container finished" podID="e1072848-f7b3-4b5b-9517-c09debf2e9af" containerID="f3519fd101b6f9d8de4a03277729c160565b231da210c8bdc8ade19a7ec0a480" exitCode=0 Jul 07 12:48:59.038319 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:59.038233 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jktnw" event={"ID":"e1072848-f7b3-4b5b-9517-c09debf2e9af","Type":"ContainerDied","Data":"f3519fd101b6f9d8de4a03277729c160565b231da210c8bdc8ade19a7ec0a480"} Jul 07 12:48:59.040097 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:59.040074 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gqgkf_d9ad543c-2b24-443d-a2ed-e3bc420cd888/console-operator/0.log" Jul 07 12:48:59.040216 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:59.040109 2555 generic.go:356] "Generic (PLEG): container finished" podID="d9ad543c-2b24-443d-a2ed-e3bc420cd888" containerID="125f293d5da13cfb60a83583abf6c741de3c8fe5a3006974540a9ee8e98388d5" exitCode=255 Jul 07 12:48:59.040216 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:59.040209 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:48:59.040440 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:59.040406 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-gqgkf" event={"ID":"d9ad543c-2b24-443d-a2ed-e3bc420cd888","Type":"ContainerDied","Data":"125f293d5da13cfb60a83583abf6c741de3c8fe5a3006974540a9ee8e98388d5"} Jul 07 12:48:59.040710 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:59.040676 2555 scope.go:117] "RemoveContainer" containerID="125f293d5da13cfb60a83583abf6c741de3c8fe5a3006974540a9ee8e98388d5" Jul 07 12:48:59.202361 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:59.202110 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:48:59.499226 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:59.499192 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/711bbda5-9512-4927-8fd3-6c02b2fdb682-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qvthj\" (UID: \"711bbda5-9512-4927-8fd3-6c02b2fdb682\") " pod="openshift-insights/insights-runtime-extractor-qvthj" Jul 07 12:48:59.499387 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:59.499269 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/711bbda5-9512-4927-8fd3-6c02b2fdb682-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qvthj\" (UID: \"711bbda5-9512-4927-8fd3-6c02b2fdb682\") " pod="openshift-insights/insights-runtime-extractor-qvthj" Jul 07 12:48:59.499387 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:59.499337 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 12:48:59.499512 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:59.499397 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/711bbda5-9512-4927-8fd3-6c02b2fdb682-insights-runtime-extractor-tls podName:711bbda5-9512-4927-8fd3-6c02b2fdb682 nodeName:}" failed. No retries permitted until 2026-07-07 12:49:00.499381315 +0000 UTC m=+49.221108805 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/711bbda5-9512-4927-8fd3-6c02b2fdb682-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qvthj" (UID: "711bbda5-9512-4927-8fd3-6c02b2fdb682") : secret "insights-runtime-extractor-tls" not found Jul 07 12:48:59.499512 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:59.499397 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 12:48:59.499627 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:48:59.499518 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/711bbda5-9512-4927-8fd3-6c02b2fdb682-kube-rbac-proxy-cm podName:711bbda5-9512-4927-8fd3-6c02b2fdb682 nodeName:}" failed. No retries permitted until 2026-07-07 12:49:00.499501183 +0000 UTC m=+49.221228682 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/711bbda5-9512-4927-8fd3-6c02b2fdb682-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qvthj" (UID: "711bbda5-9512-4927-8fd3-6c02b2fdb682") : configmap "kube-rbac-proxy" not found Jul 07 12:48:59.595362 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:59.595331 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:48:59.683303 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:59.683277 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:48:59.875003 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:59.874971 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:48:59.984918 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:48:59.984879 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:00.047254 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:00.047224 2555 generic.go:356] "Generic (PLEG): container finished" podID="e1072848-f7b3-4b5b-9517-c09debf2e9af" containerID="9fe0f6247f4285efa135ce08c37bc58c267020cf5c1de58aef04d08b77611c3e" exitCode=0 Jul 07 12:49:00.047799 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:00.047301 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jktnw" event={"ID":"e1072848-f7b3-4b5b-9517-c09debf2e9af","Type":"ContainerDied","Data":"9fe0f6247f4285efa135ce08c37bc58c267020cf5c1de58aef04d08b77611c3e"} Jul 07 12:49:00.049072 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:00.049053 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gqgkf_d9ad543c-2b24-443d-a2ed-e3bc420cd888/console-operator/1.log" Jul 07 12:49:00.049491 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:00.049475 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gqgkf_d9ad543c-2b24-443d-a2ed-e3bc420cd888/console-operator/0.log" Jul 07 12:49:00.049578 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:00.049508 2555 generic.go:356] "Generic (PLEG): container finished" podID="d9ad543c-2b24-443d-a2ed-e3bc420cd888" containerID="59b6ac0eb185b3988e192cedc84740f9a9efc6fc9994a8d020b9d2882d32f07a" exitCode=255 Jul 07 12:49:00.049578 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:00.049562 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-gqgkf" event={"ID":"d9ad543c-2b24-443d-a2ed-e3bc420cd888","Type":"ContainerDied","Data":"59b6ac0eb185b3988e192cedc84740f9a9efc6fc9994a8d020b9d2882d32f07a"} Jul 07 12:49:00.049652 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:00.049595 2555 scope.go:117] "RemoveContainer" containerID="125f293d5da13cfb60a83583abf6c741de3c8fe5a3006974540a9ee8e98388d5" Jul 07 12:49:00.049876 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:00.049846 2555 scope.go:117] "RemoveContainer" containerID="59b6ac0eb185b3988e192cedc84740f9a9efc6fc9994a8d020b9d2882d32f07a" Jul 07 12:49:00.050064 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:49:00.050040 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-gqgkf_openshift-console-operator(d9ad543c-2b24-443d-a2ed-e3bc420cd888)\"" pod="openshift-console-operator/console-operator-68b757fb67-gqgkf" podUID="d9ad543c-2b24-443d-a2ed-e3bc420cd888" Jul 07 12:49:00.170477 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:00.170417 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:00.264523 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:00.264500 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x9n7p_162131a6-2800-4824-81fb-10c5396199ea/dns-node-resolver/0.log" Jul 07 12:49:00.287586 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:00.287565 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-pd985"] Jul 07 12:49:00.313519 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:00.313312 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-pd985"] Jul 07 12:49:00.313519 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:00.313442 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pd985" Jul 07 12:49:00.318311 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:00.318284 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 07 12:49:00.318418 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:00.318337 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-dppbr\"" Jul 07 12:49:00.323869 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:00.323851 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 07 12:49:00.328037 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:00.327992 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:00.408852 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:00.408820 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gb45\" (UniqueName: \"kubernetes.io/projected/ae903d64-7b28-4dec-a634-ff46544d4f1d-kube-api-access-4gb45\") pod \"migrator-d57d58cc9-pd985\" (UID: \"ae903d64-7b28-4dec-a634-ff46544d4f1d\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pd985" Jul 07 12:49:00.474208 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:00.474178 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:00.509345 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:00.509319 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/711bbda5-9512-4927-8fd3-6c02b2fdb682-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qvthj\" (UID: \"711bbda5-9512-4927-8fd3-6c02b2fdb682\") " pod="openshift-insights/insights-runtime-extractor-qvthj" Jul 07 12:49:00.509451 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:00.509442 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gb45\" (UniqueName: \"kubernetes.io/projected/ae903d64-7b28-4dec-a634-ff46544d4f1d-kube-api-access-4gb45\") pod \"migrator-d57d58cc9-pd985\" (UID: \"ae903d64-7b28-4dec-a634-ff46544d4f1d\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pd985" Jul 07 12:49:00.509495 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:00.509464 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/711bbda5-9512-4927-8fd3-6c02b2fdb682-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qvthj\" (UID: \"711bbda5-9512-4927-8fd3-6c02b2fdb682\") " pod="openshift-insights/insights-runtime-extractor-qvthj" Jul 07 12:49:00.509555 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:49:00.509444 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 12:49:00.509613 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:49:00.509556 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 12:49:00.509613 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:49:00.509578 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/711bbda5-9512-4927-8fd3-6c02b2fdb682-kube-rbac-proxy-cm podName:711bbda5-9512-4927-8fd3-6c02b2fdb682 nodeName:}" failed. No retries permitted until 2026-07-07 12:49:02.509556103 +0000 UTC m=+51.231283619 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/711bbda5-9512-4927-8fd3-6c02b2fdb682-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qvthj" (UID: "711bbda5-9512-4927-8fd3-6c02b2fdb682") : configmap "kube-rbac-proxy" not found Jul 07 12:49:00.509613 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:49:00.509600 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/711bbda5-9512-4927-8fd3-6c02b2fdb682-insights-runtime-extractor-tls podName:711bbda5-9512-4927-8fd3-6c02b2fdb682 nodeName:}" failed. No retries permitted until 2026-07-07 12:49:02.509589109 +0000 UTC m=+51.231316604 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/711bbda5-9512-4927-8fd3-6c02b2fdb682-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qvthj" (UID: "711bbda5-9512-4927-8fd3-6c02b2fdb682") : secret "insights-runtime-extractor-tls" not found Jul 07 12:49:00.520835 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:00.520811 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gb45\" (UniqueName: \"kubernetes.io/projected/ae903d64-7b28-4dec-a634-ff46544d4f1d-kube-api-access-4gb45\") pod \"migrator-d57d58cc9-pd985\" (UID: \"ae903d64-7b28-4dec-a634-ff46544d4f1d\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pd985" Jul 07 12:49:00.626660 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:00.626607 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pd985" Jul 07 12:49:00.755257 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:00.755233 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-pd985"] Jul 07 12:49:00.757832 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:49:00.757805 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae903d64_7b28_4dec_a634_ff46544d4f1d.slice/crio-a079697449852859c8ad95643db689ca05740f17303064c3bc970811b30d8e96 WatchSource:0}: Error finding container a079697449852859c8ad95643db689ca05740f17303064c3bc970811b30d8e96: Status 404 returned error can't find the container with id a079697449852859c8ad95643db689ca05740f17303064c3bc970811b30d8e96 Jul 07 12:49:01.001865 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:01.001833 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:01.057302 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:01.057269 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jktnw" event={"ID":"e1072848-f7b3-4b5b-9517-c09debf2e9af","Type":"ContainerStarted","Data":"1d386279248c2f1ea3c2e70618262fec23a7ea8b95d6e7d7aad23b76ca336dea"} Jul 07 12:49:01.058676 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:01.058656 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gqgkf_d9ad543c-2b24-443d-a2ed-e3bc420cd888/console-operator/1.log" Jul 07 12:49:01.058929 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:01.058913 2555 scope.go:117] "RemoveContainer" containerID="59b6ac0eb185b3988e192cedc84740f9a9efc6fc9994a8d020b9d2882d32f07a" Jul 07 12:49:01.059088 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:49:01.059069 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-gqgkf_openshift-console-operator(d9ad543c-2b24-443d-a2ed-e3bc420cd888)\"" pod="openshift-console-operator/console-operator-68b757fb67-gqgkf" podUID="d9ad543c-2b24-443d-a2ed-e3bc420cd888" Jul 07 12:49:01.059773 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:01.059750 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pd985" event={"ID":"ae903d64-7b28-4dec-a634-ff46544d4f1d","Type":"ContainerStarted","Data":"a079697449852859c8ad95643db689ca05740f17303064c3bc970811b30d8e96"} Jul 07 12:49:01.096953 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:01.096907 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jktnw" podStartSLOduration=16.881612723 podStartE2EDuration="49.096895634s" totalImagesPullingTime="32.215282911s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 12:48:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:01.09607527 +0000 UTC m=+49.817802785" watchObservedRunningTime="2026-07-07 12:49:01.096895634 +0000 UTC m=+49.818623124" Jul 07 12:49:01.150718 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:01.150686 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:01.248022 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:01.247995 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xqj9j_cd96639c-8bd3-4c04-aedd-41dbd1c2acdb/node-ca/0.log" Jul 07 12:49:01.373923 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:01.373821 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:01.467375 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:01.467348 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-bflxs"] Jul 07 12:49:01.469734 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:01.469713 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-bflxs" Jul 07 12:49:01.474754 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:01.474720 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 07 12:49:01.474882 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:01.474835 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-k7bdm\"" Jul 07 12:49:01.474994 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:01.474975 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 07 12:49:01.475092 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:01.475011 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 07 12:49:01.475092 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:01.475055 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 07 12:49:01.507333 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:01.507311 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-bflxs"] Jul 07 12:49:01.517399 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:01.517378 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f5249f02-bb30-407f-b45d-7e9f58491688-signing-key\") pod \"service-ca-758f599c5-bflxs\" (UID: \"f5249f02-bb30-407f-b45d-7e9f58491688\") " pod="openshift-service-ca/service-ca-758f599c5-bflxs" Jul 07 12:49:01.517536 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:01.517519 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f5249f02-bb30-407f-b45d-7e9f58491688-signing-cabundle\") pod \"service-ca-758f599c5-bflxs\" (UID: \"f5249f02-bb30-407f-b45d-7e9f58491688\") " pod="openshift-service-ca/service-ca-758f599c5-bflxs" Jul 07 12:49:01.517576 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:01.517548 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkmtz\" (UniqueName: \"kubernetes.io/projected/f5249f02-bb30-407f-b45d-7e9f58491688-kube-api-access-pkmtz\") pod \"service-ca-758f599c5-bflxs\" (UID: \"f5249f02-bb30-407f-b45d-7e9f58491688\") " pod="openshift-service-ca/service-ca-758f599c5-bflxs" Jul 07 12:49:01.519996 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:01.519946 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:01.618086 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:01.618052 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f5249f02-bb30-407f-b45d-7e9f58491688-signing-key\") pod \"service-ca-758f599c5-bflxs\" (UID: \"f5249f02-bb30-407f-b45d-7e9f58491688\") " pod="openshift-service-ca/service-ca-758f599c5-bflxs" Jul 07 12:49:01.618233 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:01.618154 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f5249f02-bb30-407f-b45d-7e9f58491688-signing-cabundle\") pod \"service-ca-758f599c5-bflxs\" (UID: \"f5249f02-bb30-407f-b45d-7e9f58491688\") " pod="openshift-service-ca/service-ca-758f599c5-bflxs" Jul 07 12:49:01.618233 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:01.618174 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkmtz\" (UniqueName: \"kubernetes.io/projected/f5249f02-bb30-407f-b45d-7e9f58491688-kube-api-access-pkmtz\") pod \"service-ca-758f599c5-bflxs\" (UID: \"f5249f02-bb30-407f-b45d-7e9f58491688\") " pod="openshift-service-ca/service-ca-758f599c5-bflxs" Jul 07 12:49:01.618891 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:01.618872 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f5249f02-bb30-407f-b45d-7e9f58491688-signing-cabundle\") pod \"service-ca-758f599c5-bflxs\" (UID: \"f5249f02-bb30-407f-b45d-7e9f58491688\") " pod="openshift-service-ca/service-ca-758f599c5-bflxs" Jul 07 12:49:01.620361 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:01.620340 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f5249f02-bb30-407f-b45d-7e9f58491688-signing-key\") pod \"service-ca-758f599c5-bflxs\" (UID: \"f5249f02-bb30-407f-b45d-7e9f58491688\") " pod="openshift-service-ca/service-ca-758f599c5-bflxs" Jul 07 12:49:01.642304 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:01.642254 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m2kzs_8a3eff27-1183-4cc7-850c-216d0af8714a/serve-healthcheck-canary/0.log" Jul 07 12:49:01.645287 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:01.645263 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkmtz\" (UniqueName: \"kubernetes.io/projected/f5249f02-bb30-407f-b45d-7e9f58491688-kube-api-access-pkmtz\") pod \"service-ca-758f599c5-bflxs\" (UID: \"f5249f02-bb30-407f-b45d-7e9f58491688\") " pod="openshift-service-ca/service-ca-758f599c5-bflxs" Jul 07 12:49:01.700906 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:01.700877 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:01.781442 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:01.781398 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-bflxs" Jul 07 12:49:01.900362 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:01.900276 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:01.936237 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:01.936204 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-bflxs"] Jul 07 12:49:02.076627 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:49:02.076594 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5249f02_bb30_407f_b45d_7e9f58491688.slice/crio-26ebf17943f151fb1e9c8c8a6d4cf270e06d29730047498aa38a0ef376fb756f WatchSource:0}: Error finding container 26ebf17943f151fb1e9c8c8a6d4cf270e06d29730047498aa38a0ef376fb756f: Status 404 returned error can't find the container with id 26ebf17943f151fb1e9c8c8a6d4cf270e06d29730047498aa38a0ef376fb756f Jul 07 12:49:02.193442 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:02.193391 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:02.519043 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:02.519013 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:02.526008 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:02.525985 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/711bbda5-9512-4927-8fd3-6c02b2fdb682-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qvthj\" (UID: \"711bbda5-9512-4927-8fd3-6c02b2fdb682\") " pod="openshift-insights/insights-runtime-extractor-qvthj" Jul 07 12:49:02.526077 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:02.526064 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/711bbda5-9512-4927-8fd3-6c02b2fdb682-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qvthj\" (UID: \"711bbda5-9512-4927-8fd3-6c02b2fdb682\") " pod="openshift-insights/insights-runtime-extractor-qvthj" Jul 07 12:49:02.526145 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:49:02.526132 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 12:49:02.526192 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:49:02.526176 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 12:49:02.526228 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:49:02.526198 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/711bbda5-9512-4927-8fd3-6c02b2fdb682-insights-runtime-extractor-tls podName:711bbda5-9512-4927-8fd3-6c02b2fdb682 nodeName:}" failed. No retries permitted until 2026-07-07 12:49:06.526182803 +0000 UTC m=+55.247910314 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/711bbda5-9512-4927-8fd3-6c02b2fdb682-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qvthj" (UID: "711bbda5-9512-4927-8fd3-6c02b2fdb682") : secret "insights-runtime-extractor-tls" not found Jul 07 12:49:02.526228 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:49:02.526226 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/711bbda5-9512-4927-8fd3-6c02b2fdb682-kube-rbac-proxy-cm podName:711bbda5-9512-4927-8fd3-6c02b2fdb682 nodeName:}" failed. No retries permitted until 2026-07-07 12:49:06.52621296 +0000 UTC m=+55.247940455 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/711bbda5-9512-4927-8fd3-6c02b2fdb682-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qvthj" (UID: "711bbda5-9512-4927-8fd3-6c02b2fdb682") : configmap "kube-rbac-proxy" not found Jul 07 12:49:02.644000 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:02.643966 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:03.068843 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:03.068806 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pd985" event={"ID":"ae903d64-7b28-4dec-a634-ff46544d4f1d","Type":"ContainerStarted","Data":"2ce8dd94a2cfefadf9eb2cd702e6a25a9fdec61a1119307a91a81ddd5f337e1d"} Jul 07 12:49:03.069038 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:03.068867 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pd985" event={"ID":"ae903d64-7b28-4dec-a634-ff46544d4f1d","Type":"ContainerStarted","Data":"28370ebf6bc493a243098912e66eb15974e7302f412dcc68f6c693b5a07370e9"} Jul 07 12:49:03.070356 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:03.070325 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-bflxs" event={"ID":"f5249f02-bb30-407f-b45d-7e9f58491688","Type":"ContainerStarted","Data":"cab7c86ab84da42ac3837a9a5dc7f1e0b20baaf46664e5fbe212d7d3438583f8"} Jul 07 12:49:03.070468 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:03.070369 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-bflxs" event={"ID":"f5249f02-bb30-407f-b45d-7e9f58491688","Type":"ContainerStarted","Data":"26ebf17943f151fb1e9c8c8a6d4cf270e06d29730047498aa38a0ef376fb756f"} Jul 07 12:49:03.109240 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:03.109186 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pd985" podStartSLOduration=1.76272632 podStartE2EDuration="3.109166179s" totalImagesPullingTime="1.346439859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:49:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:03.108360553 +0000 UTC m=+51.830088066" watchObservedRunningTime="2026-07-07 12:49:03.109166179 +0000 UTC m=+51.830893693" Jul 07 12:49:03.136275 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:03.136234 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-bflxs" podStartSLOduration=2.136220194 podStartE2EDuration="2.136220194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:49:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:03.135839991 +0000 UTC m=+51.857567506" watchObservedRunningTime="2026-07-07 12:49:03.136220194 +0000 UTC m=+51.857947707" Jul 07 12:49:03.535403 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:03.535368 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb41588d-7d7e-4497-ac10-caad90123497-service-ca-bundle\") pod \"router-default-759d8757b9-whth9\" (UID: \"bb41588d-7d7e-4497-ac10-caad90123497\") " pod="openshift-ingress/router-default-759d8757b9-whth9" Jul 07 12:49:03.535403 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:03.535410 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb41588d-7d7e-4497-ac10-caad90123497-metrics-certs\") pod \"router-default-759d8757b9-whth9\" (UID: \"bb41588d-7d7e-4497-ac10-caad90123497\") " pod="openshift-ingress/router-default-759d8757b9-whth9" Jul 07 12:49:03.535679 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:49:03.535541 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb41588d-7d7e-4497-ac10-caad90123497-service-ca-bundle podName:bb41588d-7d7e-4497-ac10-caad90123497 nodeName:}" failed. No retries permitted until 2026-07-07 12:49:19.535523457 +0000 UTC m=+68.257250948 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bb41588d-7d7e-4497-ac10-caad90123497-service-ca-bundle") pod "router-default-759d8757b9-whth9" (UID: "bb41588d-7d7e-4497-ac10-caad90123497") : configmap references non-existent config key: service-ca.crt Jul 07 12:49:03.535679 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:49:03.535563 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 12:49:03.535679 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:49:03.535614 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb41588d-7d7e-4497-ac10-caad90123497-metrics-certs podName:bb41588d-7d7e-4497-ac10-caad90123497 nodeName:}" failed. No retries permitted until 2026-07-07 12:49:19.535600138 +0000 UTC m=+68.257327635 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb41588d-7d7e-4497-ac10-caad90123497-metrics-certs") pod "router-default-759d8757b9-whth9" (UID: "bb41588d-7d7e-4497-ac10-caad90123497") : secret "router-metrics-certs-default" not found Jul 07 12:49:03.535679 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:03.535654 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-registry-tls\") pod \"image-registry-84c78544db-4hnvd\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:49:03.535932 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:03.535700 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ac07d23-9858-4ce7-a553-812f8a2151a4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-44dxc\" (UID: \"3ac07d23-9858-4ce7-a553-812f8a2151a4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-44dxc" Jul 07 12:49:03.535932 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:49:03.535800 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 12:49:03.535932 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:49:03.535818 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84c78544db-4hnvd: secret "image-registry-tls" not found Jul 07 12:49:03.535932 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:49:03.535858 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-registry-tls podName:d5b6121e-690c-4400-beb6-235fcf5720f0 nodeName:}" failed. No retries permitted until 2026-07-07 12:49:19.535844903 +0000 UTC m=+68.257572407 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-registry-tls") pod "image-registry-84c78544db-4hnvd" (UID: "d5b6121e-690c-4400-beb6-235fcf5720f0") : secret "image-registry-tls" not found Jul 07 12:49:03.535932 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:49:03.535805 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 12:49:03.535932 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:49:03.535895 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ac07d23-9858-4ce7-a553-812f8a2151a4-cluster-monitoring-operator-tls podName:3ac07d23-9858-4ce7-a553-812f8a2151a4 nodeName:}" failed. No retries permitted until 2026-07-07 12:49:19.535888287 +0000 UTC m=+68.257615779 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ac07d23-9858-4ce7-a553-812f8a2151a4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-44dxc" (UID: "3ac07d23-9858-4ce7-a553-812f8a2151a4") : secret "cluster-monitoring-operator-tls" not found Jul 07 12:49:03.535932 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:03.535931 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f2df1ca-1917-4482-93f4-b07c1a1a3abc-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lqpq8\" (UID: \"7f2df1ca-1917-4482-93f4-b07c1a1a3abc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lqpq8" Jul 07 12:49:03.536161 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:49:03.535996 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 12:49:03.536161 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:49:03.536016 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f2df1ca-1917-4482-93f4-b07c1a1a3abc-samples-operator-tls podName:7f2df1ca-1917-4482-93f4-b07c1a1a3abc nodeName:}" failed. No retries permitted until 2026-07-07 12:49:19.536009267 +0000 UTC m=+68.257736758 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7f2df1ca-1917-4482-93f4-b07c1a1a3abc-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lqpq8" (UID: "7f2df1ca-1917-4482-93f4-b07c1a1a3abc") : secret "samples-operator-tls" not found Jul 07 12:49:03.738007 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:03.737967 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99331929-499a-431f-a1eb-81521986520b-metrics-tls\") pod \"dns-default-kvkc7\" (UID: \"99331929-499a-431f-a1eb-81521986520b\") " pod="openshift-dns/dns-default-kvkc7" Jul 07 12:49:03.738158 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:49:03.738138 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 12:49:03.738218 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:03.738176 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4799efdd-3758-4f1f-b17e-05d428ce8edf-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-cxjzh\" (UID: \"4799efdd-3758-4f1f-b17e-05d428ce8edf\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cxjzh" Jul 07 12:49:03.738218 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:49:03.738198 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99331929-499a-431f-a1eb-81521986520b-metrics-tls podName:99331929-499a-431f-a1eb-81521986520b nodeName:}" failed. No retries permitted until 2026-07-07 12:49:19.738182165 +0000 UTC m=+68.459909656 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99331929-499a-431f-a1eb-81521986520b-metrics-tls") pod "dns-default-kvkc7" (UID: "99331929-499a-431f-a1eb-81521986520b") : secret "dns-default-metrics-tls" not found Jul 07 12:49:03.738312 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:49:03.738249 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 12:49:03.738312 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:49:03.738299 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4799efdd-3758-4f1f-b17e-05d428ce8edf-networking-console-plugin-cert podName:4799efdd-3758-4f1f-b17e-05d428ce8edf nodeName:}" failed. No retries permitted until 2026-07-07 12:49:19.738287733 +0000 UTC m=+68.460015224 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4799efdd-3758-4f1f-b17e-05d428ce8edf-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-cxjzh" (UID: "4799efdd-3758-4f1f-b17e-05d428ce8edf") : secret "networking-console-plugin-cert" not found Jul 07 12:49:03.931640 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:03.931556 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:04.092815 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:04.092775 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:04.217035 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:04.216942 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:04.305474 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:04.305438 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:04.481965 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:04.481935 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:04.643923 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:04.643887 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:05.610808 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:05.610775 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:06.051892 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:06.051851 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:06.226096 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:06.226063 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:06.396670 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:06.396589 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:06.562884 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:06.562854 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/711bbda5-9512-4927-8fd3-6c02b2fdb682-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qvthj\" (UID: \"711bbda5-9512-4927-8fd3-6c02b2fdb682\") " pod="openshift-insights/insights-runtime-extractor-qvthj" Jul 07 12:49:06.563037 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:06.562923 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/711bbda5-9512-4927-8fd3-6c02b2fdb682-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qvthj\" (UID: \"711bbda5-9512-4927-8fd3-6c02b2fdb682\") " pod="openshift-insights/insights-runtime-extractor-qvthj" Jul 07 12:49:06.563037 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:49:06.562999 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 12:49:06.563037 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:49:06.563020 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 12:49:06.563155 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:49:06.563070 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/711bbda5-9512-4927-8fd3-6c02b2fdb682-insights-runtime-extractor-tls podName:711bbda5-9512-4927-8fd3-6c02b2fdb682 nodeName:}" failed. No retries permitted until 2026-07-07 12:49:14.56305217 +0000 UTC m=+63.284779678 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/711bbda5-9512-4927-8fd3-6c02b2fdb682-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qvthj" (UID: "711bbda5-9512-4927-8fd3-6c02b2fdb682") : secret "insights-runtime-extractor-tls" not found Jul 07 12:49:06.563155 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:49:06.563086 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/711bbda5-9512-4927-8fd3-6c02b2fdb682-kube-rbac-proxy-cm podName:711bbda5-9512-4927-8fd3-6c02b2fdb682 nodeName:}" failed. No retries permitted until 2026-07-07 12:49:14.563077907 +0000 UTC m=+63.284805398 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/711bbda5-9512-4927-8fd3-6c02b2fdb682-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qvthj" (UID: "711bbda5-9512-4927-8fd3-6c02b2fdb682") : configmap "kube-rbac-proxy" not found Jul 07 12:49:06.585308 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:06.585280 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:07.358307 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:07.358273 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:07.592669 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:07.592642 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:07.700207 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:07.700142 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:07.989184 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:07.989148 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:08.020001 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:08.019973 2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-gqgkf" Jul 07 12:49:08.020139 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:08.020014 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-gqgkf" Jul 07 12:49:08.020369 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:08.020356 2555 scope.go:117] "RemoveContainer" containerID="59b6ac0eb185b3988e192cedc84740f9a9efc6fc9994a8d020b9d2882d32f07a" Jul 07 12:49:08.020538 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:49:08.020519 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-gqgkf_openshift-console-operator(d9ad543c-2b24-443d-a2ed-e3bc420cd888)\"" pod="openshift-console-operator/console-operator-68b757fb67-gqgkf" podUID="d9ad543c-2b24-443d-a2ed-e3bc420cd888" Jul 07 12:49:08.211577 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:08.211537 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:08.374659 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:08.374584 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:08.528459 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:08.528410 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:08.738727 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:08.738696 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:09.609398 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:09.609362 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:09.844759 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:09.844728 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:09.948232 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:09.948158 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:10.186829 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:10.186798 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:10.391576 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:10.391539 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:10.847529 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:10.847498 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:11.585927 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:11.585898 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:11.775811 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:11.775780 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:12.022963 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:12.022927 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:12.137850 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:12.137823 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:12.252464 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:12.252419 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:12.405924 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:12.405863 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:12.805236 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:12.805207 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:13.581024 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:13.580918 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:13.815788 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:13.815750 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:14.188606 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:14.188573 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:14.390541 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:14.390510 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:14.595264 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:14.595220 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:14.628553 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:14.628530 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/711bbda5-9512-4927-8fd3-6c02b2fdb682-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qvthj\" (UID: \"711bbda5-9512-4927-8fd3-6c02b2fdb682\") " pod="openshift-insights/insights-runtime-extractor-qvthj" Jul 07 12:49:14.628673 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:14.628656 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/711bbda5-9512-4927-8fd3-6c02b2fdb682-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qvthj\" (UID: \"711bbda5-9512-4927-8fd3-6c02b2fdb682\") " pod="openshift-insights/insights-runtime-extractor-qvthj" Jul 07 12:49:14.629063 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:14.629047 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/711bbda5-9512-4927-8fd3-6c02b2fdb682-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qvthj\" (UID: \"711bbda5-9512-4927-8fd3-6c02b2fdb682\") " pod="openshift-insights/insights-runtime-extractor-qvthj" Jul 07 12:49:14.630913 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:14.630897 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/711bbda5-9512-4927-8fd3-6c02b2fdb682-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qvthj\" (UID: \"711bbda5-9512-4927-8fd3-6c02b2fdb682\") " pod="openshift-insights/insights-runtime-extractor-qvthj" Jul 07 12:49:14.741603 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:14.741584 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2zm52\"" Jul 07 12:49:14.749564 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:14.749549 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qvthj" Jul 07 12:49:14.893284 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:14.892508 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qvthj"] Jul 07 12:49:14.896518 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:49:14.896482 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod711bbda5_9512_4927_8fd3_6c02b2fdb682.slice/crio-b049797395481d51542531928d326a49f292128bee3ba150dc250e6a0c9b5ce0 WatchSource:0}: Error finding container b049797395481d51542531928d326a49f292128bee3ba150dc250e6a0c9b5ce0: Status 404 returned error can't find the container with id b049797395481d51542531928d326a49f292128bee3ba150dc250e6a0c9b5ce0 Jul 07 12:49:14.968279 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:14.968254 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cgbr7" Jul 07 12:49:15.111315 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:15.111275 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qvthj" event={"ID":"711bbda5-9512-4927-8fd3-6c02b2fdb682","Type":"ContainerStarted","Data":"b049797395481d51542531928d326a49f292128bee3ba150dc250e6a0c9b5ce0"} Jul 07 12:49:17.557000 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:17.556962 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22898bc2-4cf6-4d84-b1e1-54504130b156-metrics-certs\") pod \"network-metrics-daemon-svv9n\" (UID: \"22898bc2-4cf6-4d84-b1e1-54504130b156\") " pod="openshift-multus/network-metrics-daemon-svv9n" Jul 07 12:49:17.560929 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:17.560904 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 12:49:17.569796 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:17.569772 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22898bc2-4cf6-4d84-b1e1-54504130b156-metrics-certs\") pod \"network-metrics-daemon-svv9n\" (UID: \"22898bc2-4cf6-4d84-b1e1-54504130b156\") " pod="openshift-multus/network-metrics-daemon-svv9n" Jul 07 12:49:17.637834 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:17.637811 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cw2d4\"" Jul 07 12:49:17.643761 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:17.643745 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svv9n" Jul 07 12:49:17.658322 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:17.658300 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99606493-0799-450b-a6f8-d3795ff36e30-original-pull-secret\") pod \"global-pull-secret-syncer-m6fbl\" (UID: \"99606493-0799-450b-a6f8-d3795ff36e30\") " pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:49:17.658400 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:17.658344 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzwct\" (UniqueName: \"kubernetes.io/projected/488e43e7-1c98-4b52-94c1-41b87c14bc73-kube-api-access-qzwct\") pod \"network-check-target-jdccv\" (UID: \"488e43e7-1c98-4b52-94c1-41b87c14bc73\") " pod="openshift-network-diagnostics/network-check-target-jdccv" Jul 07 12:49:17.660575 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:17.660556 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzwct\" (UniqueName: \"kubernetes.io/projected/488e43e7-1c98-4b52-94c1-41b87c14bc73-kube-api-access-qzwct\") pod \"network-check-target-jdccv\" (UID: \"488e43e7-1c98-4b52-94c1-41b87c14bc73\") " pod="openshift-network-diagnostics/network-check-target-jdccv" Jul 07 12:49:17.661084 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:17.661066 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 12:49:17.671349 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:17.671322 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99606493-0799-450b-a6f8-d3795ff36e30-original-pull-secret\") pod \"global-pull-secret-syncer-m6fbl\" (UID: \"99606493-0799-450b-a6f8-d3795ff36e30\") " pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:49:17.944722 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:17.944658 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g5zg7\"" Jul 07 12:49:17.948100 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:17.948066 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m6fbl" Jul 07 12:49:17.952323 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:17.952300 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdccv" Jul 07 12:49:18.712990 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:18.712961 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jdccv"] Jul 07 12:49:18.716379 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:49:18.716353 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod488e43e7_1c98_4b52_94c1_41b87c14bc73.slice/crio-acd32a1c29ea741002274977f6711d4f74808c9d4152b361546a15f5b85b70f5 WatchSource:0}: Error finding container acd32a1c29ea741002274977f6711d4f74808c9d4152b361546a15f5b85b70f5: Status 404 returned error can't find the container with id acd32a1c29ea741002274977f6711d4f74808c9d4152b361546a15f5b85b70f5 Jul 07 12:49:18.931228 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:18.931153 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-m6fbl"] Jul 07 12:49:18.938931 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:18.938911 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-svv9n"] Jul 07 12:49:18.940991 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:49:18.940965 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99606493_0799_450b_a6f8_d3795ff36e30.slice/crio-36fbd7b8abc35ac2e7af92d67f46ba39b3ee009aa4698d2a55a731e9de957542 WatchSource:0}: Error finding container 36fbd7b8abc35ac2e7af92d67f46ba39b3ee009aa4698d2a55a731e9de957542: Status 404 returned error can't find the container with id 36fbd7b8abc35ac2e7af92d67f46ba39b3ee009aa4698d2a55a731e9de957542 Jul 07 12:49:18.942027 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:49:18.941995 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22898bc2_4cf6_4d84_b1e1_54504130b156.slice/crio-8aa8c69d55ab839a468c7fbfc4562b76bb746e0d33589f1a0c8b9dc45671a464 WatchSource:0}: Error finding container 8aa8c69d55ab839a468c7fbfc4562b76bb746e0d33589f1a0c8b9dc45671a464: Status 404 returned error can't find the container with id 8aa8c69d55ab839a468c7fbfc4562b76bb746e0d33589f1a0c8b9dc45671a464 Jul 07 12:49:19.130096 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.130063 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qvthj" event={"ID":"711bbda5-9512-4927-8fd3-6c02b2fdb682","Type":"ContainerStarted","Data":"8ce98283e761d921b786e7cad1fe4a3f35bd4a031c7bc5d4f116e88fe02bad22"} Jul 07 12:49:19.131354 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.131324 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jdccv" event={"ID":"488e43e7-1c98-4b52-94c1-41b87c14bc73","Type":"ContainerStarted","Data":"0bb05c5cb2084fc4bc71fe0325a00c8967f0726f17ed083b4bc46f74d3b538dc"} Jul 07 12:49:19.131468 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.131362 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jdccv" event={"ID":"488e43e7-1c98-4b52-94c1-41b87c14bc73","Type":"ContainerStarted","Data":"acd32a1c29ea741002274977f6711d4f74808c9d4152b361546a15f5b85b70f5"} Jul 07 12:49:19.131633 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.131616 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jdccv" Jul 07 12:49:19.132461 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.132442 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-m6fbl" event={"ID":"99606493-0799-450b-a6f8-d3795ff36e30","Type":"ContainerStarted","Data":"36fbd7b8abc35ac2e7af92d67f46ba39b3ee009aa4698d2a55a731e9de957542"} Jul 07 12:49:19.133521 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.133498 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-svv9n" event={"ID":"22898bc2-4cf6-4d84-b1e1-54504130b156","Type":"ContainerStarted","Data":"8aa8c69d55ab839a468c7fbfc4562b76bb746e0d33589f1a0c8b9dc45671a464"} Jul 07 12:49:19.163135 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.163094 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jdccv" podStartSLOduration=67.163080497 podStartE2EDuration="1m7.163080497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:48:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:19.162308363 +0000 UTC m=+67.884035877" watchObservedRunningTime="2026-07-07 12:49:19.163080497 +0000 UTC m=+67.884808010" Jul 07 12:49:19.575637 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.575604 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f2df1ca-1917-4482-93f4-b07c1a1a3abc-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lqpq8\" (UID: \"7f2df1ca-1917-4482-93f4-b07c1a1a3abc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lqpq8" Jul 07 12:49:19.575817 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.575653 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb41588d-7d7e-4497-ac10-caad90123497-service-ca-bundle\") pod \"router-default-759d8757b9-whth9\" (UID: \"bb41588d-7d7e-4497-ac10-caad90123497\") " pod="openshift-ingress/router-default-759d8757b9-whth9" Jul 07 12:49:19.575817 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.575682 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb41588d-7d7e-4497-ac10-caad90123497-metrics-certs\") pod \"router-default-759d8757b9-whth9\" (UID: \"bb41588d-7d7e-4497-ac10-caad90123497\") " pod="openshift-ingress/router-default-759d8757b9-whth9" Jul 07 12:49:19.575817 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.575723 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-registry-tls\") pod \"image-registry-84c78544db-4hnvd\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:49:19.575817 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.575753 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ac07d23-9858-4ce7-a553-812f8a2151a4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-44dxc\" (UID: \"3ac07d23-9858-4ce7-a553-812f8a2151a4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-44dxc" Jul 07 12:49:19.576492 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.576463 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb41588d-7d7e-4497-ac10-caad90123497-service-ca-bundle\") pod \"router-default-759d8757b9-whth9\" (UID: \"bb41588d-7d7e-4497-ac10-caad90123497\") " pod="openshift-ingress/router-default-759d8757b9-whth9" Jul 07 12:49:19.578523 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.578493 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f2df1ca-1917-4482-93f4-b07c1a1a3abc-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lqpq8\" (UID: \"7f2df1ca-1917-4482-93f4-b07c1a1a3abc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lqpq8" Jul 07 12:49:19.578612 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.578520 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-registry-tls\") pod \"image-registry-84c78544db-4hnvd\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:49:19.578612 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.578544 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb41588d-7d7e-4497-ac10-caad90123497-metrics-certs\") pod \"router-default-759d8757b9-whth9\" (UID: \"bb41588d-7d7e-4497-ac10-caad90123497\") " pod="openshift-ingress/router-default-759d8757b9-whth9" Jul 07 12:49:19.578612 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.578493 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ac07d23-9858-4ce7-a553-812f8a2151a4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-44dxc\" (UID: \"3ac07d23-9858-4ce7-a553-812f8a2151a4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-44dxc" Jul 07 12:49:19.727414 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.727380 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vgk5d\"" Jul 07 12:49:19.734922 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.734715 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:49:19.755581 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.755366 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xpztg\"" Jul 07 12:49:19.761509 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.761478 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-44dxc" Jul 07 12:49:19.778733 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.778183 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4799efdd-3758-4f1f-b17e-05d428ce8edf-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-cxjzh\" (UID: \"4799efdd-3758-4f1f-b17e-05d428ce8edf\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cxjzh" Jul 07 12:49:19.778733 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.778227 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99331929-499a-431f-a1eb-81521986520b-metrics-tls\") pod \"dns-default-kvkc7\" (UID: \"99331929-499a-431f-a1eb-81521986520b\") " pod="openshift-dns/dns-default-kvkc7" Jul 07 12:49:19.783784 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.783286 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4799efdd-3758-4f1f-b17e-05d428ce8edf-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-cxjzh\" (UID: \"4799efdd-3758-4f1f-b17e-05d428ce8edf\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cxjzh" Jul 07 12:49:19.783784 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.783582 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-7zzw7\"" Jul 07 12:49:19.786743 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.786719 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99331929-499a-431f-a1eb-81521986520b-metrics-tls\") pod \"dns-default-kvkc7\" (UID: \"99331929-499a-431f-a1eb-81521986520b\") " pod="openshift-dns/dns-default-kvkc7" Jul 07 12:49:19.788970 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.788778 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lqpq8" Jul 07 12:49:19.805313 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.805279 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-kxpcp\"" Jul 07 12:49:19.813034 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.813011 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-759d8757b9-whth9" Jul 07 12:49:19.934593 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.934553 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-8bldf\"" Jul 07 12:49:19.935804 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.935621 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-cxjzh" Jul 07 12:49:19.953504 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.953416 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-84c78544db-4hnvd"] Jul 07 12:49:19.965990 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:49:19.965956 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5b6121e_690c_4400_beb6_235fcf5720f0.slice/crio-9b21d3328d4d8d09afc4db0076e08bf54ecbdef0225b2e0ae3fa0ebd97cb03cc WatchSource:0}: Error finding container 9b21d3328d4d8d09afc4db0076e08bf54ecbdef0225b2e0ae3fa0ebd97cb03cc: Status 404 returned error can't find the container with id 9b21d3328d4d8d09afc4db0076e08bf54ecbdef0225b2e0ae3fa0ebd97cb03cc Jul 07 12:49:19.974943 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.974746 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wb7sm\"" Jul 07 12:49:19.982712 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:19.982499 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kvkc7" Jul 07 12:49:20.018361 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:20.018285 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-44dxc"] Jul 07 12:49:20.038229 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:49:20.037324 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ac07d23_9858_4ce7_a553_812f8a2151a4.slice/crio-0fa120091f5744e6d9dd67d4e0a1f832a694e061a8e685f04b4f251f59570c5d WatchSource:0}: Error finding container 0fa120091f5744e6d9dd67d4e0a1f832a694e061a8e685f04b4f251f59570c5d: Status 404 returned error can't find the container with id 0fa120091f5744e6d9dd67d4e0a1f832a694e061a8e685f04b4f251f59570c5d Jul 07 12:49:20.043100 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:20.043024 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lqpq8"] Jul 07 12:49:20.085991 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:20.085947 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-759d8757b9-whth9"] Jul 07 12:49:20.146241 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:20.145707 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qvthj" event={"ID":"711bbda5-9512-4927-8fd3-6c02b2fdb682","Type":"ContainerStarted","Data":"f4d5064d4eb95c591495c587177b0f83586aa3f79cf436f7098493587e8e171b"} Jul 07 12:49:20.148735 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:20.148668 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lqpq8" event={"ID":"7f2df1ca-1917-4482-93f4-b07c1a1a3abc","Type":"ContainerStarted","Data":"afed6c318075b5f53603acc0c26f05fd6f9e06b6660c6b204b83c353ccce0a8e"} Jul 07 12:49:20.150870 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:20.150807 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-759d8757b9-whth9" event={"ID":"bb41588d-7d7e-4497-ac10-caad90123497","Type":"ContainerStarted","Data":"71ec2e295aa6ec1beb5adf88da4144b3c4f28e459f28b658c3d10d277e817a19"} Jul 07 12:49:20.153060 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:20.153011 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-44dxc" event={"ID":"3ac07d23-9858-4ce7-a553-812f8a2151a4","Type":"ContainerStarted","Data":"0fa120091f5744e6d9dd67d4e0a1f832a694e061a8e685f04b4f251f59570c5d"} Jul 07 12:49:20.161065 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:20.161014 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84c78544db-4hnvd" event={"ID":"d5b6121e-690c-4400-beb6-235fcf5720f0","Type":"ContainerStarted","Data":"382d88d77d7ada5247539178b3f104b690e2227c41eaa58d78dfe552cb589aa0"} Jul 07 12:49:20.161175 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:20.161082 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84c78544db-4hnvd" event={"ID":"d5b6121e-690c-4400-beb6-235fcf5720f0","Type":"ContainerStarted","Data":"9b21d3328d4d8d09afc4db0076e08bf54ecbdef0225b2e0ae3fa0ebd97cb03cc"} Jul 07 12:49:20.161175 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:20.161111 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:49:20.169825 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:20.169745 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-cxjzh"] Jul 07 12:49:20.199393 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:20.198690 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-84c78544db-4hnvd" podStartSLOduration=67.198668903 podStartE2EDuration="1m7.198668903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:48:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:20.196100589 +0000 UTC m=+68.917828105" watchObservedRunningTime="2026-07-07 12:49:20.198668903 +0000 UTC m=+68.920396417" Jul 07 12:49:20.266763 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:20.266732 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kvkc7"] Jul 07 12:49:20.483713 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:49:20.483537 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4799efdd_3758_4f1f_b17e_05d428ce8edf.slice/crio-29e889b22502107e0df1b37270dcf73ae9f9df9d4f427e09747af31e78cb1a72 WatchSource:0}: Error finding container 29e889b22502107e0df1b37270dcf73ae9f9df9d4f427e09747af31e78cb1a72: Status 404 returned error can't find the container with id 29e889b22502107e0df1b37270dcf73ae9f9df9d4f427e09747af31e78cb1a72 Jul 07 12:49:20.484599 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:49:20.484561 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99331929_499a_431f_a1eb_81521986520b.slice/crio-eebb42773939da195e0d4f865c09a664a5aeb6f333768dcc20e2c3451ebb995a WatchSource:0}: Error finding container eebb42773939da195e0d4f865c09a664a5aeb6f333768dcc20e2c3451ebb995a: Status 404 returned error can't find the container with id eebb42773939da195e0d4f865c09a664a5aeb6f333768dcc20e2c3451ebb995a Jul 07 12:49:20.820292 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:20.820260 2555 scope.go:117] "RemoveContainer" containerID="59b6ac0eb185b3988e192cedc84740f9a9efc6fc9994a8d020b9d2882d32f07a" Jul 07 12:49:21.169605 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:21.169504 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gqgkf_d9ad543c-2b24-443d-a2ed-e3bc420cd888/console-operator/1.log" Jul 07 12:49:21.169892 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:21.169643 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-gqgkf" event={"ID":"d9ad543c-2b24-443d-a2ed-e3bc420cd888","Type":"ContainerStarted","Data":"1633ceef077f8b48c7762434758c2cd9b873c4fa69fae9ab286ec6860ef57e67"} Jul 07 12:49:21.171025 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:21.170927 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-gqgkf" Jul 07 12:49:21.174503 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:21.173585 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kvkc7" event={"ID":"99331929-499a-431f-a1eb-81521986520b","Type":"ContainerStarted","Data":"eebb42773939da195e0d4f865c09a664a5aeb6f333768dcc20e2c3451ebb995a"} Jul 07 12:49:21.177208 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:21.177181 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-svv9n" event={"ID":"22898bc2-4cf6-4d84-b1e1-54504130b156","Type":"ContainerStarted","Data":"5170427b6d786b43965e81017c7acab81cc8cdb42cdc8f0e7d86745ad8ce36c5"} Jul 07 12:49:21.177322 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:21.177234 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-svv9n" event={"ID":"22898bc2-4cf6-4d84-b1e1-54504130b156","Type":"ContainerStarted","Data":"8a0e94a8af37226678620a337ed10f48ed60c3dabcd88dd483bd1abd7072f835"} Jul 07 12:49:21.179492 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:21.179465 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-cxjzh" event={"ID":"4799efdd-3758-4f1f-b17e-05d428ce8edf","Type":"ContainerStarted","Data":"29e889b22502107e0df1b37270dcf73ae9f9df9d4f427e09747af31e78cb1a72"} Jul 07 12:49:21.184751 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:21.184729 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-759d8757b9-whth9" event={"ID":"bb41588d-7d7e-4497-ac10-caad90123497","Type":"ContainerStarted","Data":"0b5d2b9ea71fe769ba7178f119de2cfaa96f4ea57aa28930de510088db1b88bf"} Jul 07 12:49:21.235867 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:21.235799 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-759d8757b9-whth9" podStartSLOduration=67.235779249 podStartE2EDuration="1m7.235779249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:48:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:21.233041263 +0000 UTC m=+69.954768777" watchObservedRunningTime="2026-07-07 12:49:21.235779249 +0000 UTC m=+69.957506762" Jul 07 12:49:21.255956 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:21.255682 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-svv9n" podStartSLOduration=67.671057222 podStartE2EDuration="1m9.255662104s" totalImagesPullingTime="1.584604882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:48:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:21.25490036 +0000 UTC m=+69.976627871" watchObservedRunningTime="2026-07-07 12:49:21.255662104 +0000 UTC m=+69.977389618" Jul 07 12:49:21.813368 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:21.813336 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-759d8757b9-whth9" Jul 07 12:49:21.817256 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:21.816939 2555 patch_prober.go:28] interesting pod/router-default-759d8757b9-whth9 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 07 12:49:21.817256 ip-10-0-136-245 kubenswrapper[2555]: [-]has-synced failed: reason withheld Jul 07 12:49:21.817256 ip-10-0-136-245 kubenswrapper[2555]: [+]process-running ok Jul 07 12:49:21.817256 ip-10-0-136-245 kubenswrapper[2555]: healthz check failed Jul 07 12:49:21.817256 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:21.816996 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-759d8757b9-whth9" podUID="bb41588d-7d7e-4497-ac10-caad90123497" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 07 12:49:21.978362 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:21.978013 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-gqgkf" Jul 07 12:49:22.222742 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:22.222635 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:22.347480 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:22.347411 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:22.524249 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:22.524128 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:22.814776 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:22.814696 2555 patch_prober.go:28] interesting pod/router-default-759d8757b9-whth9 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 07 12:49:22.814776 ip-10-0-136-245 kubenswrapper[2555]: [-]has-synced failed: reason withheld Jul 07 12:49:22.814776 ip-10-0-136-245 kubenswrapper[2555]: [+]process-running ok Jul 07 12:49:22.814776 ip-10-0-136-245 kubenswrapper[2555]: healthz check failed Jul 07 12:49:22.814776 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:22.814758 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-759d8757b9-whth9" podUID="bb41588d-7d7e-4497-ac10-caad90123497" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 07 12:49:22.881767 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:22.881721 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:22.992155 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:22.992115 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:23.090873 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:23.090794 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:23.260679 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:23.260630 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:23.669699 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:23.669656 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:23.814368 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:23.814335 2555 patch_prober.go:28] interesting pod/router-default-759d8757b9-whth9 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 07 12:49:23.814368 ip-10-0-136-245 kubenswrapper[2555]: [-]has-synced failed: reason withheld Jul 07 12:49:23.814368 ip-10-0-136-245 kubenswrapper[2555]: [+]process-running ok Jul 07 12:49:23.814368 ip-10-0-136-245 kubenswrapper[2555]: healthz check failed Jul 07 12:49:23.814650 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:23.814389 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-759d8757b9-whth9" podUID="bb41588d-7d7e-4497-ac10-caad90123497" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 07 12:49:24.096636 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:24.096605 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:24.463416 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:24.463301 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:24.568187 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:24.568152 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:24.814862 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:24.814834 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-759d8757b9-whth9" Jul 07 12:49:24.815086 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:24.815068 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-759d8757b9-whth9" Jul 07 12:49:24.816079 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:24.816059 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-759d8757b9-whth9" Jul 07 12:49:24.856473 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:24.856439 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:24.966314 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:24.966249 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:26.068831 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.068794 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:26.197289 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.197251 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:26.732234 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.732197 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f8b5c986d-n65gv"] Jul 07 12:49:26.777064 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.776740 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cb79c96-wlz8z"] Jul 07 12:49:26.777064 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.776911 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f8b5c986d-n65gv" Jul 07 12:49:26.782690 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.782667 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 07 12:49:26.782944 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.782923 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 07 12:49:26.783046 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.782926 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-sl6ds\"" Jul 07 12:49:26.783833 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.783789 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 07 12:49:26.783833 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.783802 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 07 12:49:26.788268 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.788249 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-785c96d9-sqjtw"] Jul 07 12:49:26.788419 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.788398 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cb79c96-wlz8z" Jul 07 12:49:26.790981 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.790958 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 07 12:49:26.791115 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.791100 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 07 12:49:26.791252 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.791230 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 07 12:49:26.791616 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.791556 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 07 12:49:26.809617 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.809595 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f8b5c986d-n65gv"] Jul 07 12:49:26.809710 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.809626 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cb79c96-wlz8z"] Jul 07 12:49:26.809710 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.809644 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-785c96d9-sqjtw"] Jul 07 12:49:26.809777 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.809728 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785c96d9-sqjtw" Jul 07 12:49:26.812831 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.812806 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 07 12:49:26.900182 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.900158 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-9npsg"] Jul 07 12:49:26.916594 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.916570 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-9npsg" Jul 07 12:49:26.921103 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.921084 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-jlm9l\"" Jul 07 12:49:26.922035 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.922012 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:26.922214 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.922196 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 12:49:26.931475 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.931455 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 12:49:26.941002 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.940979 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/25701116-c59f-4f4b-9b0e-15073b238f07-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8cb79c96-wlz8z\" (UID: \"25701116-c59f-4f4b-9b0e-15073b238f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cb79c96-wlz8z" Jul 07 12:49:26.941089 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.941010 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6585t\" (UniqueName: \"kubernetes.io/projected/bec7170a-5ea1-406e-86ed-e18e6dac8635-kube-api-access-6585t\") pod \"klusterlet-addon-workmgr-785c96d9-sqjtw\" (UID: \"bec7170a-5ea1-406e-86ed-e18e6dac8635\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785c96d9-sqjtw" Jul 07 12:49:26.941089 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.941028 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/25701116-c59f-4f4b-9b0e-15073b238f07-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8cb79c96-wlz8z\" (UID: \"25701116-c59f-4f4b-9b0e-15073b238f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cb79c96-wlz8z" Jul 07 12:49:26.941170 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.941101 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bec7170a-5ea1-406e-86ed-e18e6dac8635-klusterlet-config\") pod \"klusterlet-addon-workmgr-785c96d9-sqjtw\" (UID: \"bec7170a-5ea1-406e-86ed-e18e6dac8635\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785c96d9-sqjtw" Jul 07 12:49:26.941170 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.941121 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/25701116-c59f-4f4b-9b0e-15073b238f07-hub\") pod \"cluster-proxy-proxy-agent-8cb79c96-wlz8z\" (UID: \"25701116-c59f-4f4b-9b0e-15073b238f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cb79c96-wlz8z" Jul 07 12:49:26.941170 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.941148 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bec7170a-5ea1-406e-86ed-e18e6dac8635-tmp\") pod \"klusterlet-addon-workmgr-785c96d9-sqjtw\" (UID: \"bec7170a-5ea1-406e-86ed-e18e6dac8635\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785c96d9-sqjtw" Jul 07 12:49:26.941273 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.941171 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6ce8ea92-854e-428a-804f-2963fd14ccb9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f8b5c986d-n65gv\" (UID: \"6ce8ea92-854e-428a-804f-2963fd14ccb9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f8b5c986d-n65gv" Jul 07 12:49:26.941273 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.941197 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mrk6\" (UniqueName: \"kubernetes.io/projected/6ce8ea92-854e-428a-804f-2963fd14ccb9-kube-api-access-5mrk6\") pod \"managed-serviceaccount-addon-agent-7f8b5c986d-n65gv\" (UID: \"6ce8ea92-854e-428a-804f-2963fd14ccb9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f8b5c986d-n65gv" Jul 07 12:49:26.941273 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.941216 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/25701116-c59f-4f4b-9b0e-15073b238f07-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8cb79c96-wlz8z\" (UID: \"25701116-c59f-4f4b-9b0e-15073b238f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cb79c96-wlz8z" Jul 07 12:49:26.941273 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.941232 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/25701116-c59f-4f4b-9b0e-15073b238f07-ca\") pod \"cluster-proxy-proxy-agent-8cb79c96-wlz8z\" (UID: \"25701116-c59f-4f4b-9b0e-15073b238f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cb79c96-wlz8z" Jul 07 12:49:26.941273 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.941248 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc24k\" (UniqueName: \"kubernetes.io/projected/25701116-c59f-4f4b-9b0e-15073b238f07-kube-api-access-kc24k\") pod \"cluster-proxy-proxy-agent-8cb79c96-wlz8z\" (UID: \"25701116-c59f-4f4b-9b0e-15073b238f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cb79c96-wlz8z" Jul 07 12:49:26.975948 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:26.975926 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-9npsg"] Jul 07 12:49:27.042488 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.042461 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6585t\" (UniqueName: \"kubernetes.io/projected/bec7170a-5ea1-406e-86ed-e18e6dac8635-kube-api-access-6585t\") pod \"klusterlet-addon-workmgr-785c96d9-sqjtw\" (UID: \"bec7170a-5ea1-406e-86ed-e18e6dac8635\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785c96d9-sqjtw" Jul 07 12:49:27.042585 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.042492 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/25701116-c59f-4f4b-9b0e-15073b238f07-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8cb79c96-wlz8z\" (UID: \"25701116-c59f-4f4b-9b0e-15073b238f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cb79c96-wlz8z" Jul 07 12:49:27.042585 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.042533 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g74d\" (UniqueName: \"kubernetes.io/projected/31d76d64-0d00-4ee6-ad7b-92e297328b2b-kube-api-access-9g74d\") pod \"downloads-685bfb5f64-9npsg\" (UID: \"31d76d64-0d00-4ee6-ad7b-92e297328b2b\") " pod="openshift-console/downloads-685bfb5f64-9npsg" Jul 07 12:49:27.042698 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.042591 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bec7170a-5ea1-406e-86ed-e18e6dac8635-klusterlet-config\") pod \"klusterlet-addon-workmgr-785c96d9-sqjtw\" (UID: \"bec7170a-5ea1-406e-86ed-e18e6dac8635\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785c96d9-sqjtw" Jul 07 12:49:27.042698 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.042615 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/25701116-c59f-4f4b-9b0e-15073b238f07-hub\") pod \"cluster-proxy-proxy-agent-8cb79c96-wlz8z\" (UID: \"25701116-c59f-4f4b-9b0e-15073b238f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cb79c96-wlz8z" Jul 07 12:49:27.042698 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.042673 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bec7170a-5ea1-406e-86ed-e18e6dac8635-tmp\") pod \"klusterlet-addon-workmgr-785c96d9-sqjtw\" (UID: \"bec7170a-5ea1-406e-86ed-e18e6dac8635\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785c96d9-sqjtw" Jul 07 12:49:27.042847 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.042714 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6ce8ea92-854e-428a-804f-2963fd14ccb9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f8b5c986d-n65gv\" (UID: \"6ce8ea92-854e-428a-804f-2963fd14ccb9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f8b5c986d-n65gv" Jul 07 12:49:27.042847 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.042762 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mrk6\" (UniqueName: \"kubernetes.io/projected/6ce8ea92-854e-428a-804f-2963fd14ccb9-kube-api-access-5mrk6\") pod \"managed-serviceaccount-addon-agent-7f8b5c986d-n65gv\" (UID: \"6ce8ea92-854e-428a-804f-2963fd14ccb9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f8b5c986d-n65gv" Jul 07 12:49:27.042847 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.042796 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/25701116-c59f-4f4b-9b0e-15073b238f07-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8cb79c96-wlz8z\" (UID: \"25701116-c59f-4f4b-9b0e-15073b238f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cb79c96-wlz8z" Jul 07 12:49:27.042847 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.042822 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/25701116-c59f-4f4b-9b0e-15073b238f07-ca\") pod \"cluster-proxy-proxy-agent-8cb79c96-wlz8z\" (UID: \"25701116-c59f-4f4b-9b0e-15073b238f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cb79c96-wlz8z" Jul 07 12:49:27.043038 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.042850 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc24k\" (UniqueName: \"kubernetes.io/projected/25701116-c59f-4f4b-9b0e-15073b238f07-kube-api-access-kc24k\") pod \"cluster-proxy-proxy-agent-8cb79c96-wlz8z\" (UID: \"25701116-c59f-4f4b-9b0e-15073b238f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cb79c96-wlz8z" Jul 07 12:49:27.043038 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.042876 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/25701116-c59f-4f4b-9b0e-15073b238f07-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8cb79c96-wlz8z\" (UID: \"25701116-c59f-4f4b-9b0e-15073b238f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cb79c96-wlz8z" Jul 07 12:49:27.043138 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.043057 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bec7170a-5ea1-406e-86ed-e18e6dac8635-tmp\") pod \"klusterlet-addon-workmgr-785c96d9-sqjtw\" (UID: \"bec7170a-5ea1-406e-86ed-e18e6dac8635\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785c96d9-sqjtw" Jul 07 12:49:27.043889 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.043861 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/25701116-c59f-4f4b-9b0e-15073b238f07-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8cb79c96-wlz8z\" (UID: \"25701116-c59f-4f4b-9b0e-15073b238f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cb79c96-wlz8z" Jul 07 12:49:27.045402 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.045377 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/25701116-c59f-4f4b-9b0e-15073b238f07-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8cb79c96-wlz8z\" (UID: \"25701116-c59f-4f4b-9b0e-15073b238f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cb79c96-wlz8z" Jul 07 12:49:27.045521 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.045410 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6ce8ea92-854e-428a-804f-2963fd14ccb9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f8b5c986d-n65gv\" (UID: \"6ce8ea92-854e-428a-804f-2963fd14ccb9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f8b5c986d-n65gv" Jul 07 12:49:27.045590 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.045528 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/25701116-c59f-4f4b-9b0e-15073b238f07-hub\") pod \"cluster-proxy-proxy-agent-8cb79c96-wlz8z\" (UID: \"25701116-c59f-4f4b-9b0e-15073b238f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cb79c96-wlz8z" Jul 07 12:49:27.045710 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.045686 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/25701116-c59f-4f4b-9b0e-15073b238f07-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8cb79c96-wlz8z\" (UID: \"25701116-c59f-4f4b-9b0e-15073b238f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cb79c96-wlz8z" Jul 07 12:49:27.045816 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.045800 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/25701116-c59f-4f4b-9b0e-15073b238f07-ca\") pod \"cluster-proxy-proxy-agent-8cb79c96-wlz8z\" (UID: \"25701116-c59f-4f4b-9b0e-15073b238f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cb79c96-wlz8z" Jul 07 12:49:27.045984 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.045965 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bec7170a-5ea1-406e-86ed-e18e6dac8635-klusterlet-config\") pod \"klusterlet-addon-workmgr-785c96d9-sqjtw\" (UID: \"bec7170a-5ea1-406e-86ed-e18e6dac8635\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785c96d9-sqjtw" Jul 07 12:49:27.064171 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.064152 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc24k\" (UniqueName: \"kubernetes.io/projected/25701116-c59f-4f4b-9b0e-15073b238f07-kube-api-access-kc24k\") pod \"cluster-proxy-proxy-agent-8cb79c96-wlz8z\" (UID: \"25701116-c59f-4f4b-9b0e-15073b238f07\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cb79c96-wlz8z" Jul 07 12:49:27.066993 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.066969 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6585t\" (UniqueName: \"kubernetes.io/projected/bec7170a-5ea1-406e-86ed-e18e6dac8635-kube-api-access-6585t\") pod \"klusterlet-addon-workmgr-785c96d9-sqjtw\" (UID: \"bec7170a-5ea1-406e-86ed-e18e6dac8635\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785c96d9-sqjtw" Jul 07 12:49:27.067073 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.067060 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mrk6\" (UniqueName: \"kubernetes.io/projected/6ce8ea92-854e-428a-804f-2963fd14ccb9-kube-api-access-5mrk6\") pod \"managed-serviceaccount-addon-agent-7f8b5c986d-n65gv\" (UID: \"6ce8ea92-854e-428a-804f-2963fd14ccb9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f8b5c986d-n65gv" Jul 07 12:49:27.099755 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.099738 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f8b5c986d-n65gv" Jul 07 12:49:27.105984 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.105957 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:27.109854 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.109840 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cb79c96-wlz8z" Jul 07 12:49:27.123872 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.123858 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785c96d9-sqjtw" Jul 07 12:49:27.143456 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.143417 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g74d\" (UniqueName: \"kubernetes.io/projected/31d76d64-0d00-4ee6-ad7b-92e297328b2b-kube-api-access-9g74d\") pod \"downloads-685bfb5f64-9npsg\" (UID: \"31d76d64-0d00-4ee6-ad7b-92e297328b2b\") " pod="openshift-console/downloads-685bfb5f64-9npsg" Jul 07 12:49:27.157133 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.157114 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g74d\" (UniqueName: \"kubernetes.io/projected/31d76d64-0d00-4ee6-ad7b-92e297328b2b-kube-api-access-9g74d\") pod \"downloads-685bfb5f64-9npsg\" (UID: \"31d76d64-0d00-4ee6-ad7b-92e297328b2b\") " pod="openshift-console/downloads-685bfb5f64-9npsg" Jul 07 12:49:27.205551 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.205524 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:27.225394 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.225371 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-9npsg" Jul 07 12:49:27.393461 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.393408 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:27.545136 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.544488 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:27.658744 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.658717 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f8b5c986d-n65gv"] Jul 07 12:49:27.660084 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:49:27.659948 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ce8ea92_854e_428a_804f_2963fd14ccb9.slice/crio-aba031238551606c2f832beda53ac8c40ccebc69d3f5c10ec1cbcbf66086241d WatchSource:0}: Error finding container aba031238551606c2f832beda53ac8c40ccebc69d3f5c10ec1cbcbf66086241d: Status 404 returned error can't find the container with id aba031238551606c2f832beda53ac8c40ccebc69d3f5c10ec1cbcbf66086241d Jul 07 12:49:27.937406 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.937379 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:27.955518 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.955450 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-785c96d9-sqjtw"] Jul 07 12:49:27.960101 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:49:27.960069 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbec7170a_5ea1_406e_86ed_e18e6dac8635.slice/crio-820ed28d78c41a6b1083af8c5ffca85de81cfefb484c5a92346982f16d335e7c WatchSource:0}: Error finding container 820ed28d78c41a6b1083af8c5ffca85de81cfefb484c5a92346982f16d335e7c: Status 404 returned error can't find the container with id 820ed28d78c41a6b1083af8c5ffca85de81cfefb484c5a92346982f16d335e7c Jul 07 12:49:27.984630 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.984602 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cb79c96-wlz8z"] Jul 07 12:49:27.988029 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:49:27.987992 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25701116_c59f_4f4b_9b0e_15073b238f07.slice/crio-772d8ad89cbe6b548496de03a8247ffa49c42a73ef85ca52473a5327f5651740 WatchSource:0}: Error finding container 772d8ad89cbe6b548496de03a8247ffa49c42a73ef85ca52473a5327f5651740: Status 404 returned error can't find the container with id 772d8ad89cbe6b548496de03a8247ffa49c42a73ef85ca52473a5327f5651740 Jul 07 12:49:27.996654 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:27.996631 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-9npsg"] Jul 07 12:49:28.000122 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:49:28.000100 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31d76d64_0d00_4ee6_ad7b_92e297328b2b.slice/crio-04ab70d710a16b935ec6417faff938279fa7c6dda8e390014f891048b7de7135 WatchSource:0}: Error finding container 04ab70d710a16b935ec6417faff938279fa7c6dda8e390014f891048b7de7135: Status 404 returned error can't find the container with id 04ab70d710a16b935ec6417faff938279fa7c6dda8e390014f891048b7de7135 Jul 07 12:49:28.218518 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:28.218479 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f8b5c986d-n65gv" event={"ID":"6ce8ea92-854e-428a-804f-2963fd14ccb9","Type":"ContainerStarted","Data":"aba031238551606c2f832beda53ac8c40ccebc69d3f5c10ec1cbcbf66086241d"} Jul 07 12:49:28.220228 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:28.220197 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kvkc7" event={"ID":"99331929-499a-431f-a1eb-81521986520b","Type":"ContainerStarted","Data":"0773eeda1b1a090f63ffb0cdec55b472dc74b648a7d490583349b20a84ba7451"} Jul 07 12:49:28.220435 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:28.220259 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kvkc7" event={"ID":"99331929-499a-431f-a1eb-81521986520b","Type":"ContainerStarted","Data":"68c79f5da7958c636b3c2a195eb4905c5f9d98de1711663c7f331fd490cd6b63"} Jul 07 12:49:28.220435 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:28.220317 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kvkc7" Jul 07 12:49:28.221723 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:28.221696 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785c96d9-sqjtw" event={"ID":"bec7170a-5ea1-406e-86ed-e18e6dac8635","Type":"ContainerStarted","Data":"820ed28d78c41a6b1083af8c5ffca85de81cfefb484c5a92346982f16d335e7c"} Jul 07 12:49:28.223544 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:28.223513 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lqpq8" event={"ID":"7f2df1ca-1917-4482-93f4-b07c1a1a3abc","Type":"ContainerStarted","Data":"5d26176bd8eec83b6206eb246667fa7f2f119bf7a55d3755a90aaa27941bb33c"} Jul 07 12:49:28.223666 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:28.223551 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lqpq8" event={"ID":"7f2df1ca-1917-4482-93f4-b07c1a1a3abc","Type":"ContainerStarted","Data":"286b9ad68a65fb55ecaca9c172613da3b58bd756dd4fffe04b6a14c1694b229b"} Jul 07 12:49:28.225085 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:28.225065 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-cxjzh" event={"ID":"4799efdd-3758-4f1f-b17e-05d428ce8edf","Type":"ContainerStarted","Data":"8bc5fe20478dda7645aa8370200bc0f1541f35d25c20adf3e2a2bfa4523f2fc9"} Jul 07 12:49:28.226289 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:28.226270 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cb79c96-wlz8z" event={"ID":"25701116-c59f-4f4b-9b0e-15073b238f07","Type":"ContainerStarted","Data":"772d8ad89cbe6b548496de03a8247ffa49c42a73ef85ca52473a5327f5651740"} Jul 07 12:49:28.227441 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:28.227405 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-9npsg" event={"ID":"31d76d64-0d00-4ee6-ad7b-92e297328b2b","Type":"ContainerStarted","Data":"04ab70d710a16b935ec6417faff938279fa7c6dda8e390014f891048b7de7135"} Jul 07 12:49:28.229389 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:28.229370 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qvthj" event={"ID":"711bbda5-9512-4927-8fd3-6c02b2fdb682","Type":"ContainerStarted","Data":"0107d5db03a5fbf9b63451aa16bd89a14d2ab146502232b73db6fd2355f886b2"} Jul 07 12:49:28.230952 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:28.230928 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-m6fbl" event={"ID":"99606493-0799-450b-a6f8-d3795ff36e30","Type":"ContainerStarted","Data":"2cd9c643180de758bde8694474f48faf49d9a11c73692b26dee3633cd8ba770c"} Jul 07 12:49:28.232321 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:28.232301 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-44dxc" event={"ID":"3ac07d23-9858-4ce7-a553-812f8a2151a4","Type":"ContainerStarted","Data":"c89bbaf265ece4cf48134ecc3ded9063dd0c2325a49de2ff53ee4bc18a43d0c8"} Jul 07 12:49:28.246020 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:28.245992 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:28.324071 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:28.323993 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-44dxc" podStartSLOduration=66.905446055 podStartE2EDuration="1m14.323980768s" totalImagesPullingTime="7.418534713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:48:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:28.318951393 +0000 UTC m=+77.040678918" watchObservedRunningTime="2026-07-07 12:49:28.323980768 +0000 UTC m=+77.045708281" Jul 07 12:49:28.324772 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:28.324746 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kvkc7" podStartSLOduration=34.355040225 podStartE2EDuration="41.324737976s" totalImagesPullingTime="6.969697751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:28.269180799 +0000 UTC m=+76.990908309" watchObservedRunningTime="2026-07-07 12:49:28.324737976 +0000 UTC m=+77.046465488" Jul 07 12:49:28.387322 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:28.387270 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-m6fbl" podStartSLOduration=66.873855996 podStartE2EDuration="1m15.387250372s" totalImagesPullingTime="8.513394376s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 12:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:28.38550752 +0000 UTC m=+77.107235034" watchObservedRunningTime="2026-07-07 12:49:28.387250372 +0000 UTC m=+77.108977889" Jul 07 12:49:28.441057 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:28.441012 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lqpq8" podStartSLOduration=67.099790635 podStartE2EDuration="1m14.440997713s" totalImagesPullingTime="7.341207078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:48:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:28.439947236 +0000 UTC m=+77.161674749" watchObservedRunningTime="2026-07-07 12:49:28.440997713 +0000 UTC m=+77.162725241" Jul 07 12:49:28.454029 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:28.454005 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:28.598146 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:28.598061 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-cxjzh" podStartSLOduration=37.62713071 podStartE2EDuration="44.598043756s" totalImagesPullingTime="6.970913046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:48:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:28.500877515 +0000 UTC m=+77.222605039" watchObservedRunningTime="2026-07-07 12:49:28.598043756 +0000 UTC m=+77.319771269" Jul 07 12:49:28.719210 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:28.719157 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:28.946650 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:28.946556 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:29.292663 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:29.292609 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:29.511025 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:29.510912 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:29.785253 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:29.785220 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:32.970288 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:32.970190 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:33.107005 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:33.106945 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:34.433861 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:34.433411 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:34.535227 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:34.535172 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:34.615510 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:34.615475 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:34.718146 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:34.718066 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:34.823266 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:34.823235 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:35.274871 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:35.274829 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f8b5c986d-n65gv" event={"ID":"6ce8ea92-854e-428a-804f-2963fd14ccb9","Type":"ContainerStarted","Data":"d1c8e2528a01bfb4ae093cb2f51dfd0fafccc8f62e73bf65a58b570d0cac342c"} Jul 07 12:49:35.277029 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:35.276994 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785c96d9-sqjtw" event={"ID":"bec7170a-5ea1-406e-86ed-e18e6dac8635","Type":"ContainerStarted","Data":"30421321234c67a44f9593b1e361f4d9d18028e53a45b721fd6d3b8665bd6482"} Jul 07 12:49:35.277166 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:35.277084 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785c96d9-sqjtw" Jul 07 12:49:35.278875 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:35.278858 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785c96d9-sqjtw" Jul 07 12:49:35.279640 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:35.279607 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cb79c96-wlz8z" event={"ID":"25701116-c59f-4f4b-9b0e-15073b238f07","Type":"ContainerStarted","Data":"70d28f3af363b6bc78e1ed553124ff89af1e281703eeaceed4809bd502b35e10"} Jul 07 12:49:35.279791 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:35.279650 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cb79c96-wlz8z" event={"ID":"25701116-c59f-4f4b-9b0e-15073b238f07","Type":"ContainerStarted","Data":"063f9beaacd565574d76fba8fa4b9a07170da15b8b143b4099ff22b407408fe3"} Jul 07 12:49:35.279791 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:35.279666 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cb79c96-wlz8z" event={"ID":"25701116-c59f-4f4b-9b0e-15073b238f07","Type":"ContainerStarted","Data":"5957be80d5630aecce7f645b85abb67183e1095ee4ecda17aad5c72a51c88a55"} Jul 07 12:49:35.302216 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:35.302169 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qvthj" podStartSLOduration=24.867026077 podStartE2EDuration="37.302150629s" totalImagesPullingTime="12.435124552s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 12:48:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:28.597350092 +0000 UTC m=+77.319077607" watchObservedRunningTime="2026-07-07 12:49:35.302150629 +0000 UTC m=+84.023878144" Jul 07 12:49:35.341225 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:35.341185 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8cb79c96-wlz8z" podStartSLOduration=2.477386426 podStartE2EDuration="9.341172368s" totalImagesPullingTime="6.863785942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:49:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:35.339886047 +0000 UTC m=+84.061613563" watchObservedRunningTime="2026-07-07 12:49:35.341172368 +0000 UTC m=+84.062899882" Jul 07 12:49:35.341601 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:35.341573 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f8b5c986d-n65gv" podStartSLOduration=2.168800848 podStartE2EDuration="9.341566131s" totalImagesPullingTime="7.172765283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:49:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:35.3016574 +0000 UTC m=+84.023384930" watchObservedRunningTime="2026-07-07 12:49:35.341566131 +0000 UTC m=+84.063293647" Jul 07 12:49:35.366661 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:35.366623 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-785c96d9-sqjtw" podStartSLOduration=2.468669009 podStartE2EDuration="9.366614213s" totalImagesPullingTime="6.897945204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:49:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:35.364847841 +0000 UTC m=+84.086575355" watchObservedRunningTime="2026-07-07 12:49:35.366614213 +0000 UTC m=+84.088341725" Jul 07 12:49:36.800998 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:36.800947 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:36.944777 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:36.944738 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:37.602473 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:37.602366 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:38.242400 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:38.242369 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kvkc7" Jul 07 12:49:39.130749 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:39.130713 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:39.274669 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:39.274627 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:39.739896 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:39.739858 2555 patch_prober.go:28] interesting pod/image-registry-84c78544db-4hnvd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 07 12:49:39.740067 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:39.739933 2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-84c78544db-4hnvd" podUID="d5b6121e-690c-4400-beb6-235fcf5720f0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 12:49:39.947946 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:39.947912 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:40.049318 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:40.049232 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:40.143379 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:40.143330 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:41.189719 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:41.189688 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:49:41.609188 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:41.609147 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:41.730990 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:41.730962 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:41.884164 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:41.884089 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:41.987984 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:41.987952 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:42.878456 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:42.878403 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:45.069562 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:45.069502 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:45.423656 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:45.423537 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:45.566449 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:45.566340 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:45.681704 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:45.681626 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-srfjq"] Jul 07 12:49:45.805607 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:45.805508 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:45.891962 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:45.891921 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-srfjq" Jul 07 12:49:45.907105 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:45.907086 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 12:49:45.908173 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:45.908148 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 12:49:45.908291 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:45.908207 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-j4q47\"" Jul 07 12:49:45.908291 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:45.908262 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 12:49:45.908415 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:45.908322 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 12:49:45.955730 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:45.955662 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:46.002693 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:46.002659 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/879d02ae-7cba-48f4-bba7-2a123c96e2e5-node-exporter-wtmp\") pod \"node-exporter-srfjq\" (UID: \"879d02ae-7cba-48f4-bba7-2a123c96e2e5\") " pod="openshift-monitoring/node-exporter-srfjq" Jul 07 12:49:46.002852 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:46.002745 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/879d02ae-7cba-48f4-bba7-2a123c96e2e5-root\") pod \"node-exporter-srfjq\" (UID: \"879d02ae-7cba-48f4-bba7-2a123c96e2e5\") " pod="openshift-monitoring/node-exporter-srfjq" Jul 07 12:49:46.002852 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:46.002797 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/879d02ae-7cba-48f4-bba7-2a123c96e2e5-node-exporter-tls\") pod \"node-exporter-srfjq\" (UID: \"879d02ae-7cba-48f4-bba7-2a123c96e2e5\") " pod="openshift-monitoring/node-exporter-srfjq" Jul 07 12:49:46.002852 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:46.002829 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78hk5\" (UniqueName: \"kubernetes.io/projected/879d02ae-7cba-48f4-bba7-2a123c96e2e5-kube-api-access-78hk5\") pod \"node-exporter-srfjq\" (UID: \"879d02ae-7cba-48f4-bba7-2a123c96e2e5\") " pod="openshift-monitoring/node-exporter-srfjq" Jul 07 12:49:46.003003 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:46.002860 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/879d02ae-7cba-48f4-bba7-2a123c96e2e5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-srfjq\" (UID: \"879d02ae-7cba-48f4-bba7-2a123c96e2e5\") " pod="openshift-monitoring/node-exporter-srfjq" Jul 07 12:49:46.003003 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:46.002895 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/879d02ae-7cba-48f4-bba7-2a123c96e2e5-metrics-client-ca\") pod \"node-exporter-srfjq\" (UID: \"879d02ae-7cba-48f4-bba7-2a123c96e2e5\") " pod="openshift-monitoring/node-exporter-srfjq" Jul 07 12:49:46.003003 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:46.002911 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/879d02ae-7cba-48f4-bba7-2a123c96e2e5-node-exporter-accelerators-collector-config\") pod \"node-exporter-srfjq\" (UID: \"879d02ae-7cba-48f4-bba7-2a123c96e2e5\") " pod="openshift-monitoring/node-exporter-srfjq" Jul 07 12:49:46.003003 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:46.002940 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/879d02ae-7cba-48f4-bba7-2a123c96e2e5-sys\") pod \"node-exporter-srfjq\" (UID: \"879d02ae-7cba-48f4-bba7-2a123c96e2e5\") " pod="openshift-monitoring/node-exporter-srfjq" Jul 07 12:49:46.003191 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:46.003038 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/879d02ae-7cba-48f4-bba7-2a123c96e2e5-node-exporter-textfile\") pod \"node-exporter-srfjq\" (UID: \"879d02ae-7cba-48f4-bba7-2a123c96e2e5\") " pod="openshift-monitoring/node-exporter-srfjq" Jul 07 12:49:46.104390 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:46.104349 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/879d02ae-7cba-48f4-bba7-2a123c96e2e5-root\") pod \"node-exporter-srfjq\" (UID: \"879d02ae-7cba-48f4-bba7-2a123c96e2e5\") " pod="openshift-monitoring/node-exporter-srfjq" Jul 07 12:49:46.104843 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:46.104487 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/879d02ae-7cba-48f4-bba7-2a123c96e2e5-root\") pod \"node-exporter-srfjq\" (UID: \"879d02ae-7cba-48f4-bba7-2a123c96e2e5\") " pod="openshift-monitoring/node-exporter-srfjq" Jul 07 12:49:46.104843 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:46.104507 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/879d02ae-7cba-48f4-bba7-2a123c96e2e5-node-exporter-tls\") pod \"node-exporter-srfjq\" (UID: \"879d02ae-7cba-48f4-bba7-2a123c96e2e5\") " pod="openshift-monitoring/node-exporter-srfjq" Jul 07 12:49:46.104843 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:46.104550 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78hk5\" (UniqueName: \"kubernetes.io/projected/879d02ae-7cba-48f4-bba7-2a123c96e2e5-kube-api-access-78hk5\") pod \"node-exporter-srfjq\" (UID: \"879d02ae-7cba-48f4-bba7-2a123c96e2e5\") " pod="openshift-monitoring/node-exporter-srfjq" Jul 07 12:49:46.104843 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:46.104584 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/879d02ae-7cba-48f4-bba7-2a123c96e2e5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-srfjq\" (UID: \"879d02ae-7cba-48f4-bba7-2a123c96e2e5\") " pod="openshift-monitoring/node-exporter-srfjq" Jul 07 12:49:46.104843 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:46.104613 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/879d02ae-7cba-48f4-bba7-2a123c96e2e5-metrics-client-ca\") pod \"node-exporter-srfjq\" (UID: \"879d02ae-7cba-48f4-bba7-2a123c96e2e5\") " pod="openshift-monitoring/node-exporter-srfjq" Jul 07 12:49:46.104843 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:46.104629 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/879d02ae-7cba-48f4-bba7-2a123c96e2e5-node-exporter-accelerators-collector-config\") pod \"node-exporter-srfjq\" (UID: \"879d02ae-7cba-48f4-bba7-2a123c96e2e5\") " pod="openshift-monitoring/node-exporter-srfjq" Jul 07 12:49:46.104843 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:46.104654 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/879d02ae-7cba-48f4-bba7-2a123c96e2e5-sys\") pod \"node-exporter-srfjq\" (UID: \"879d02ae-7cba-48f4-bba7-2a123c96e2e5\") " pod="openshift-monitoring/node-exporter-srfjq" Jul 07 12:49:46.104843 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:46.104685 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/879d02ae-7cba-48f4-bba7-2a123c96e2e5-node-exporter-textfile\") pod \"node-exporter-srfjq\" (UID: \"879d02ae-7cba-48f4-bba7-2a123c96e2e5\") " pod="openshift-monitoring/node-exporter-srfjq" Jul 07 12:49:46.104843 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:46.104758 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/879d02ae-7cba-48f4-bba7-2a123c96e2e5-node-exporter-wtmp\") pod \"node-exporter-srfjq\" (UID: \"879d02ae-7cba-48f4-bba7-2a123c96e2e5\") " pod="openshift-monitoring/node-exporter-srfjq" Jul 07 12:49:46.105284 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:46.104921 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/879d02ae-7cba-48f4-bba7-2a123c96e2e5-node-exporter-wtmp\") pod \"node-exporter-srfjq\" (UID: \"879d02ae-7cba-48f4-bba7-2a123c96e2e5\") " pod="openshift-monitoring/node-exporter-srfjq" Jul 07 12:49:46.105284 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:46.104976 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/879d02ae-7cba-48f4-bba7-2a123c96e2e5-sys\") pod \"node-exporter-srfjq\" (UID: \"879d02ae-7cba-48f4-bba7-2a123c96e2e5\") " pod="openshift-monitoring/node-exporter-srfjq" Jul 07 12:49:46.105284 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:46.105267 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/879d02ae-7cba-48f4-bba7-2a123c96e2e5-node-exporter-textfile\") pod \"node-exporter-srfjq\" (UID: \"879d02ae-7cba-48f4-bba7-2a123c96e2e5\") " pod="openshift-monitoring/node-exporter-srfjq" Jul 07 12:49:46.105695 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:46.105670 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/879d02ae-7cba-48f4-bba7-2a123c96e2e5-node-exporter-accelerators-collector-config\") pod \"node-exporter-srfjq\" (UID: \"879d02ae-7cba-48f4-bba7-2a123c96e2e5\") " pod="openshift-monitoring/node-exporter-srfjq" Jul 07 12:49:46.105804 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:46.105786 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/879d02ae-7cba-48f4-bba7-2a123c96e2e5-metrics-client-ca\") pod \"node-exporter-srfjq\" (UID: \"879d02ae-7cba-48f4-bba7-2a123c96e2e5\") " pod="openshift-monitoring/node-exporter-srfjq" Jul 07 12:49:46.107278 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:46.107226 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/879d02ae-7cba-48f4-bba7-2a123c96e2e5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-srfjq\" (UID: \"879d02ae-7cba-48f4-bba7-2a123c96e2e5\") " pod="openshift-monitoring/node-exporter-srfjq" Jul 07 12:49:46.107414 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:46.107348 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/879d02ae-7cba-48f4-bba7-2a123c96e2e5-node-exporter-tls\") pod \"node-exporter-srfjq\" (UID: \"879d02ae-7cba-48f4-bba7-2a123c96e2e5\") " pod="openshift-monitoring/node-exporter-srfjq" Jul 07 12:49:46.120660 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:46.120634 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78hk5\" (UniqueName: \"kubernetes.io/projected/879d02ae-7cba-48f4-bba7-2a123c96e2e5-kube-api-access-78hk5\") pod \"node-exporter-srfjq\" (UID: \"879d02ae-7cba-48f4-bba7-2a123c96e2e5\") " pod="openshift-monitoring/node-exporter-srfjq" Jul 07 12:49:46.143256 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:46.143138 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:46.202701 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:46.202676 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-srfjq" Jul 07 12:49:46.233983 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:49:46.233951 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod879d02ae_7cba_48f4_bba7_2a123c96e2e5.slice/crio-176d9b6663830df42481b7387b6c6a68db4e4cc60bed417198a67cfd4ed615ed WatchSource:0}: Error finding container 176d9b6663830df42481b7387b6c6a68db4e4cc60bed417198a67cfd4ed615ed: Status 404 returned error can't find the container with id 176d9b6663830df42481b7387b6c6a68db4e4cc60bed417198a67cfd4ed615ed Jul 07 12:49:46.329649 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:46.329617 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-srfjq" event={"ID":"879d02ae-7cba-48f4-bba7-2a123c96e2e5","Type":"ContainerStarted","Data":"176d9b6663830df42481b7387b6c6a68db4e4cc60bed417198a67cfd4ed615ed"} Jul 07 12:49:46.447354 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:46.447313 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:46.568582 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:46.568548 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:46.709257 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:46.709213 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:47.320761 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:47.320710 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:47.336506 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:47.336464 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-9npsg" event={"ID":"31d76d64-0d00-4ee6-ad7b-92e297328b2b","Type":"ContainerStarted","Data":"05fc2fddc84b53c2597f9f6ac05d2e8fd160a97c9f0e61ebdc7a884cc0ac0bd5"} Jul 07 12:49:47.336746 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:47.336682 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-9npsg" Jul 07 12:49:47.350098 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:47.350077 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-9npsg" Jul 07 12:49:47.407562 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:47.407509 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-9npsg" podStartSLOduration=2.774406379 podStartE2EDuration="21.407492128s" totalImagesPullingTime="18.633085749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:49:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:47.406349007 +0000 UTC m=+96.128076521" watchObservedRunningTime="2026-07-07 12:49:47.407492128 +0000 UTC m=+96.129219642" Jul 07 12:49:47.655044 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:47.654965 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:47.946832 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:47.946748 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:48.343493 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:48.343460 2555 generic.go:356] "Generic (PLEG): container finished" podID="879d02ae-7cba-48f4-bba7-2a123c96e2e5" containerID="74719aa0c529942d2e090e1e45a89c3f85e3b34a23bf845414070e1e2b9363a5" exitCode=0 Jul 07 12:49:48.343997 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:48.343609 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-srfjq" event={"ID":"879d02ae-7cba-48f4-bba7-2a123c96e2e5","Type":"ContainerDied","Data":"74719aa0c529942d2e090e1e45a89c3f85e3b34a23bf845414070e1e2b9363a5"} Jul 07 12:49:48.824480 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:48.824443 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:48.946528 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:48.946446 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:49.145289 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:49.145256 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:49.341383 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:49.341346 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:49.350723 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:49.350688 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-srfjq" event={"ID":"879d02ae-7cba-48f4-bba7-2a123c96e2e5","Type":"ContainerStarted","Data":"1cd3281a3fd22a05f48d0c0bec4101a628dc7cd19ff76a38ad28180af67396c7"} Jul 07 12:49:49.351149 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:49.350749 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-srfjq" event={"ID":"879d02ae-7cba-48f4-bba7-2a123c96e2e5","Type":"ContainerStarted","Data":"7d1285931ab722677b46e3f069bdfabcdd511b0113acadf37dc9d0d95a9ca941"} Jul 07 12:49:49.392863 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:49.392812 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-srfjq" podStartSLOduration=2.831830108 podStartE2EDuration="4.392797287s" totalImagesPullingTime="1.476911858s" totalInitContainerRuntime="84.055321ms" isStatefulPod=true podCreationTimestamp="2026-07-07 12:49:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:49:49.391492741 +0000 UTC m=+98.113220258" watchObservedRunningTime="2026-07-07 12:49:49.392797287 +0000 UTC m=+98.114524800" Jul 07 12:49:49.757313 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:49.757276 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-84c78544db-4hnvd"] Jul 07 12:49:49.987320 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:49.987282 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:50.163504 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:50.163401 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jdccv" Jul 07 12:49:50.241988 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:50.241953 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:50.364317 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:50.364282 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:50.461799 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:50.461681 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:51.243286 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:51.243252 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:51.312513 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:51.312480 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:52.194363 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:52.194324 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:52.391316 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:52.391270 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:52.550622 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:52.550572 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:52.897709 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:52.897668 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:52.991684 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:52.991645 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:54.252131 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:54.252095 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:54.388859 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:54.388823 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:54.535497 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:54.535402 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:54.641082 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:54.641041 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:56.608815 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:56.608779 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:49:56.773795 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:49:56.773765 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:50:01.331590 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:01.331555 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:50:01.475113 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:01.475076 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:50:02.144921 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:02.144886 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:50:02.457030 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:02.456952 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:50:03.411454 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:03.411406 2555 generic.go:356] "Generic (PLEG): container finished" podID="ffb9426d-0075-440a-9bad-f4d3373a2550" containerID="c9428c4a6e8f0dc7abcd0c2ec2495fb4bd4a2cc33692e73c1f6a2de4eeff2ed4" exitCode=0 Jul 07 12:50:03.411454 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:03.411448 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s69bh" event={"ID":"ffb9426d-0075-440a-9bad-f4d3373a2550","Type":"ContainerDied","Data":"c9428c4a6e8f0dc7abcd0c2ec2495fb4bd4a2cc33692e73c1f6a2de4eeff2ed4"} Jul 07 12:50:03.411826 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:03.411809 2555 scope.go:117] "RemoveContainer" containerID="c9428c4a6e8f0dc7abcd0c2ec2495fb4bd4a2cc33692e73c1f6a2de4eeff2ed4" Jul 07 12:50:04.416942 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:04.416906 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-s69bh" event={"ID":"ffb9426d-0075-440a-9bad-f4d3373a2550","Type":"ContainerStarted","Data":"cda23829ce3892fd0159f8bcb3fb37e51f8ff36ce50f09fd6d92f912b751ba02"} Jul 07 12:50:05.551080 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:05.551043 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:50:05.660526 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:05.660489 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:50:09.502635 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:09.502600 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:50:09.618479 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:09.618450 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:50:14.780830 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:14.780790 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-84c78544db-4hnvd" podUID="d5b6121e-690c-4400-beb6-235fcf5720f0" containerName="registry" containerID="cri-o://382d88d77d7ada5247539178b3f104b690e2227c41eaa58d78dfe552cb589aa0" gracePeriod=30 Jul 07 12:50:15.056628 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.056568 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:50:15.149121 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.149092 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5b6121e-690c-4400-beb6-235fcf5720f0-image-registry-private-configuration\") pod \"d5b6121e-690c-4400-beb6-235fcf5720f0\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " Jul 07 12:50:15.149289 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.149145 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-registry-tls\") pod \"d5b6121e-690c-4400-beb6-235fcf5720f0\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " Jul 07 12:50:15.149289 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.149215 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5b6121e-690c-4400-beb6-235fcf5720f0-ca-trust-extracted\") pod \"d5b6121e-690c-4400-beb6-235fcf5720f0\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " Jul 07 12:50:15.149289 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.149244 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-bound-sa-token\") pod \"d5b6121e-690c-4400-beb6-235fcf5720f0\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " Jul 07 12:50:15.149289 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.149261 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlt7t\" (UniqueName: \"kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-kube-api-access-hlt7t\") pod \"d5b6121e-690c-4400-beb6-235fcf5720f0\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " Jul 07 12:50:15.149289 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.149280 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5b6121e-690c-4400-beb6-235fcf5720f0-registry-certificates\") pod \"d5b6121e-690c-4400-beb6-235fcf5720f0\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " Jul 07 12:50:15.149593 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.149326 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5b6121e-690c-4400-beb6-235fcf5720f0-trusted-ca\") pod \"d5b6121e-690c-4400-beb6-235fcf5720f0\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " Jul 07 12:50:15.149593 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.149395 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5b6121e-690c-4400-beb6-235fcf5720f0-installation-pull-secrets\") pod \"d5b6121e-690c-4400-beb6-235fcf5720f0\" (UID: \"d5b6121e-690c-4400-beb6-235fcf5720f0\") " Jul 07 12:50:15.149803 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.149749 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5b6121e-690c-4400-beb6-235fcf5720f0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d5b6121e-690c-4400-beb6-235fcf5720f0" (UID: "d5b6121e-690c-4400-beb6-235fcf5720f0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 12:50:15.149872 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.149824 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5b6121e-690c-4400-beb6-235fcf5720f0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d5b6121e-690c-4400-beb6-235fcf5720f0" (UID: "d5b6121e-690c-4400-beb6-235fcf5720f0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 12:50:15.151737 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.151705 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5b6121e-690c-4400-beb6-235fcf5720f0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d5b6121e-690c-4400-beb6-235fcf5720f0" (UID: "d5b6121e-690c-4400-beb6-235fcf5720f0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 12:50:15.151864 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.151720 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d5b6121e-690c-4400-beb6-235fcf5720f0" (UID: "d5b6121e-690c-4400-beb6-235fcf5720f0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 12:50:15.151864 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.151824 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d5b6121e-690c-4400-beb6-235fcf5720f0" (UID: "d5b6121e-690c-4400-beb6-235fcf5720f0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 12:50:15.152006 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.151985 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5b6121e-690c-4400-beb6-235fcf5720f0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d5b6121e-690c-4400-beb6-235fcf5720f0" (UID: "d5b6121e-690c-4400-beb6-235fcf5720f0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 12:50:15.152175 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.152157 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-kube-api-access-hlt7t" (OuterVolumeSpecName: "kube-api-access-hlt7t") pod "d5b6121e-690c-4400-beb6-235fcf5720f0" (UID: "d5b6121e-690c-4400-beb6-235fcf5720f0"). InnerVolumeSpecName "kube-api-access-hlt7t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 12:50:15.157887 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.157857 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5b6121e-690c-4400-beb6-235fcf5720f0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d5b6121e-690c-4400-beb6-235fcf5720f0" (UID: "d5b6121e-690c-4400-beb6-235fcf5720f0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 12:50:15.250933 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.250906 2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5b6121e-690c-4400-beb6-235fcf5720f0-installation-pull-secrets\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 12:50:15.250933 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.250930 2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5b6121e-690c-4400-beb6-235fcf5720f0-image-registry-private-configuration\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 12:50:15.251104 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.250940 2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-registry-tls\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 12:50:15.251104 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.250949 2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5b6121e-690c-4400-beb6-235fcf5720f0-ca-trust-extracted\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 12:50:15.251104 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.250957 2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-bound-sa-token\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 12:50:15.251104 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.250965 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlt7t\" (UniqueName: \"kubernetes.io/projected/d5b6121e-690c-4400-beb6-235fcf5720f0-kube-api-access-hlt7t\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 12:50:15.251104 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.250973 2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5b6121e-690c-4400-beb6-235fcf5720f0-registry-certificates\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 12:50:15.251104 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.250981 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5b6121e-690c-4400-beb6-235fcf5720f0-trusted-ca\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 12:50:15.457084 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.457001 2555 generic.go:356] "Generic (PLEG): container finished" podID="d5b6121e-690c-4400-beb6-235fcf5720f0" containerID="382d88d77d7ada5247539178b3f104b690e2227c41eaa58d78dfe552cb589aa0" exitCode=0 Jul 07 12:50:15.457084 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.457051 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84c78544db-4hnvd" Jul 07 12:50:15.457254 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.457088 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84c78544db-4hnvd" event={"ID":"d5b6121e-690c-4400-beb6-235fcf5720f0","Type":"ContainerDied","Data":"382d88d77d7ada5247539178b3f104b690e2227c41eaa58d78dfe552cb589aa0"} Jul 07 12:50:15.457254 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.457142 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84c78544db-4hnvd" event={"ID":"d5b6121e-690c-4400-beb6-235fcf5720f0","Type":"ContainerDied","Data":"9b21d3328d4d8d09afc4db0076e08bf54ecbdef0225b2e0ae3fa0ebd97cb03cc"} Jul 07 12:50:15.457254 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.457166 2555 scope.go:117] "RemoveContainer" containerID="382d88d77d7ada5247539178b3f104b690e2227c41eaa58d78dfe552cb589aa0" Jul 07 12:50:15.465488 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.465473 2555 scope.go:117] "RemoveContainer" containerID="382d88d77d7ada5247539178b3f104b690e2227c41eaa58d78dfe552cb589aa0" Jul 07 12:50:15.465767 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:50:15.465745 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"382d88d77d7ada5247539178b3f104b690e2227c41eaa58d78dfe552cb589aa0\": container with ID starting with 382d88d77d7ada5247539178b3f104b690e2227c41eaa58d78dfe552cb589aa0 not found: ID does not exist" containerID="382d88d77d7ada5247539178b3f104b690e2227c41eaa58d78dfe552cb589aa0" Jul 07 12:50:15.465844 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.465777 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"382d88d77d7ada5247539178b3f104b690e2227c41eaa58d78dfe552cb589aa0"} err="failed to get container status \"382d88d77d7ada5247539178b3f104b690e2227c41eaa58d78dfe552cb589aa0\": rpc error: code = NotFound desc = could not find container \"382d88d77d7ada5247539178b3f104b690e2227c41eaa58d78dfe552cb589aa0\": container with ID starting with 382d88d77d7ada5247539178b3f104b690e2227c41eaa58d78dfe552cb589aa0 not found: ID does not exist" Jul 07 12:50:15.484715 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.484694 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-84c78544db-4hnvd"] Jul 07 12:50:15.488621 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.488600 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-84c78544db-4hnvd"] Jul 07 12:50:15.824532 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:15.824502 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5b6121e-690c-4400-beb6-235fcf5720f0" path="/var/lib/kubelet/pods/d5b6121e-690c-4400-beb6-235fcf5720f0/volumes" Jul 07 12:50:24.520062 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:24.520026 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:50:24.640755 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:24.640719 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:50:28.506762 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:28.506728 2555 generic.go:356] "Generic (PLEG): container finished" podID="280e8e44-e7c9-47ad-9cc9-611821d9bcfa" containerID="a62b973a23f2ebe73a302709168618dc24a4fd06c7abf43bbc42cb5a3f0006b2" exitCode=0 Jul 07 12:50:28.507081 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:28.506793 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-kqkwl" event={"ID":"280e8e44-e7c9-47ad-9cc9-611821d9bcfa","Type":"ContainerDied","Data":"a62b973a23f2ebe73a302709168618dc24a4fd06c7abf43bbc42cb5a3f0006b2"} Jul 07 12:50:28.507124 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:28.507102 2555 scope.go:117] "RemoveContainer" containerID="a62b973a23f2ebe73a302709168618dc24a4fd06c7abf43bbc42cb5a3f0006b2" Jul 07 12:50:29.215680 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:29.215638 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-759d8757b9-whth9_bb41588d-7d7e-4497-ac10-caad90123497/router/0.log" Jul 07 12:50:29.244957 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:29.244921 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m2kzs_8a3eff27-1183-4cc7-850c-216d0af8714a/serve-healthcheck-canary/0.log" Jul 07 12:50:29.512116 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:29.512080 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-kqkwl" event={"ID":"280e8e44-e7c9-47ad-9cc9-611821d9bcfa","Type":"ContainerStarted","Data":"6d2018dad755b5aa52e2ed6e914ea2cb374318d0ca2c27d2d5f7ba613a72bcda"} Jul 07 12:50:31.864287 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:31.864245 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:50:31.983815 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:31.983783 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:50:32.067041 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:32.067007 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:50:34.531311 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:34.531278 2555 generic.go:356] "Generic (PLEG): container finished" podID="5525b878-d89e-41f7-8c51-8e1ca4007876" containerID="83e5b17402751fb809bf34d34094c37000a7356ecf8005a33c8adb0d9e2b5410" exitCode=0 Jul 07 12:50:34.531694 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:34.531345 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j9zrl" event={"ID":"5525b878-d89e-41f7-8c51-8e1ca4007876","Type":"ContainerDied","Data":"83e5b17402751fb809bf34d34094c37000a7356ecf8005a33c8adb0d9e2b5410"} Jul 07 12:50:34.531694 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:34.531650 2555 scope.go:117] "RemoveContainer" containerID="83e5b17402751fb809bf34d34094c37000a7356ecf8005a33c8adb0d9e2b5410" Jul 07 12:50:35.536717 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:50:35.536685 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-j9zrl" event={"ID":"5525b878-d89e-41f7-8c51-8e1ca4007876","Type":"ContainerStarted","Data":"bb895465f109b7024fee56c85881482561b1f46ececdc816f92e508cd51ec4ba"} Jul 07 12:51:05.143337 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:51:05.143237 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:51:05.421791 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:51:05.421692 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:51:16.537403 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:51:16.537359 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:51:16.636869 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:51:16.636838 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:51:27.263149 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:51:27.263116 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:51:27.358745 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:51:27.358710 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:51:41.230785 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:51:41.230751 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:51:59.349894 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:51:59.349857 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:52:00.250215 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:52:00.250178 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:52:08.314257 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:52:08.314215 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:52:20.451067 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:52:20.451026 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:52:20.546664 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:52:20.546630 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:52:23.763087 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:52:23.763050 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:52:23.835272 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:52:23.835236 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:52:32.454846 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:52:32.454805 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:52:32.508496 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:52:32.508460 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:52:34.456006 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:52:34.455876 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:52:34.556903 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:52:34.556874 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:52:34.617630 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:52:34.617598 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:52:39.497001 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:52:39.496971 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:52:39.597921 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:52:39.597883 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:53:11.705578 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:53:11.705546 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gqgkf_d9ad543c-2b24-443d-a2ed-e3bc420cd888/console-operator/1.log" Jul 07 12:53:11.710061 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:53:11.710031 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gqgkf_d9ad543c-2b24-443d-a2ed-e3bc420cd888/console-operator/1.log" Jul 07 12:53:11.715840 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:53:11.715820 2555 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 12:53:16.341444 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:53:16.341389 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:53:17.329242 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:53:17.329207 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:53:48.561603 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:53:48.561564 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:53:49.924079 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:53:49.924051 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:53:52.170216 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:53:52.170179 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:53:52.274881 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:53:52.274849 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:53:53.193074 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:53:53.193038 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:53:53.342063 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:53:53.342033 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:53:54.359925 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:53:54.359884 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:53:54.486034 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:53:54.485987 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:53:55.959910 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:53:55.959829 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:53:56.746644 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:53:56.746607 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:53:59.185523 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:53:59.185488 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:53:59.348520 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:53:59.348487 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:00.850052 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:00.850021 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:00.949102 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:00.949070 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:05.190071 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:05.189982 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:05.286932 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:05.286897 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:05.783756 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:05.783722 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:13.754804 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:13.754768 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:13.854029 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:13.853992 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:15.430658 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:15.430626 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:27.657834 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:27.657797 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:27.833674 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:27.833644 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:28.209000 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:28.208969 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:28.458564 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:28.458532 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:28.565714 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:28.565680 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:28.633560 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:28.633535 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-chn9l"] Jul 07 12:54:28.633887 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:28.633871 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5b6121e-690c-4400-beb6-235fcf5720f0" containerName="registry" Jul 07 12:54:28.633969 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:28.633890 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5b6121e-690c-4400-beb6-235fcf5720f0" containerName="registry" Jul 07 12:54:28.634037 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:28.633987 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5b6121e-690c-4400-beb6-235fcf5720f0" containerName="registry" Jul 07 12:54:28.636200 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:28.636178 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-chn9l" Jul 07 12:54:28.641089 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:28.641068 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 12:54:28.641462 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:28.641410 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gknqs\"" Jul 07 12:54:28.641551 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:28.641514 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 12:54:28.641907 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:28.641890 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 12:54:28.641967 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:28.641925 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 12:54:28.733905 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:28.733875 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-chn9l"] Jul 07 12:54:28.734201 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:28.734122 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8da2cc5-9445-4dd5-bc89-3d2b88c7be21-tmp\") pod \"opendatahub-operator-controller-manager-7c99b98b8b-chn9l\" (UID: \"d8da2cc5-9445-4dd5-bc89-3d2b88c7be21\") " pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-chn9l" Jul 07 12:54:28.734201 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:28.734149 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d8da2cc5-9445-4dd5-bc89-3d2b88c7be21-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c99b98b8b-chn9l\" (UID: \"d8da2cc5-9445-4dd5-bc89-3d2b88c7be21\") " pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-chn9l" Jul 07 12:54:28.734201 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:28.734169 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tmvc\" (UniqueName: \"kubernetes.io/projected/d8da2cc5-9445-4dd5-bc89-3d2b88c7be21-kube-api-access-4tmvc\") pod \"opendatahub-operator-controller-manager-7c99b98b8b-chn9l\" (UID: \"d8da2cc5-9445-4dd5-bc89-3d2b88c7be21\") " pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-chn9l" Jul 07 12:54:28.734315 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:28.734280 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8da2cc5-9445-4dd5-bc89-3d2b88c7be21-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c99b98b8b-chn9l\" (UID: \"d8da2cc5-9445-4dd5-bc89-3d2b88c7be21\") " pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-chn9l" Jul 07 12:54:28.734354 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:28.734313 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d8da2cc5-9445-4dd5-bc89-3d2b88c7be21-manifests\") pod \"opendatahub-operator-controller-manager-7c99b98b8b-chn9l\" (UID: \"d8da2cc5-9445-4dd5-bc89-3d2b88c7be21\") " pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-chn9l" Jul 07 12:54:28.835591 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:28.835516 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8da2cc5-9445-4dd5-bc89-3d2b88c7be21-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c99b98b8b-chn9l\" (UID: \"d8da2cc5-9445-4dd5-bc89-3d2b88c7be21\") " pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-chn9l" Jul 07 12:54:28.835591 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:28.835556 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d8da2cc5-9445-4dd5-bc89-3d2b88c7be21-manifests\") pod \"opendatahub-operator-controller-manager-7c99b98b8b-chn9l\" (UID: \"d8da2cc5-9445-4dd5-bc89-3d2b88c7be21\") " pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-chn9l" Jul 07 12:54:28.835591 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:28.835577 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8da2cc5-9445-4dd5-bc89-3d2b88c7be21-tmp\") pod \"opendatahub-operator-controller-manager-7c99b98b8b-chn9l\" (UID: \"d8da2cc5-9445-4dd5-bc89-3d2b88c7be21\") " pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-chn9l" Jul 07 12:54:28.835845 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:28.835596 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d8da2cc5-9445-4dd5-bc89-3d2b88c7be21-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c99b98b8b-chn9l\" (UID: \"d8da2cc5-9445-4dd5-bc89-3d2b88c7be21\") " pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-chn9l" Jul 07 12:54:28.835845 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:28.835621 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tmvc\" (UniqueName: \"kubernetes.io/projected/d8da2cc5-9445-4dd5-bc89-3d2b88c7be21-kube-api-access-4tmvc\") pod \"opendatahub-operator-controller-manager-7c99b98b8b-chn9l\" (UID: \"d8da2cc5-9445-4dd5-bc89-3d2b88c7be21\") " pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-chn9l" Jul 07 12:54:28.835957 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:28.835904 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d8da2cc5-9445-4dd5-bc89-3d2b88c7be21-manifests\") pod \"opendatahub-operator-controller-manager-7c99b98b8b-chn9l\" (UID: \"d8da2cc5-9445-4dd5-bc89-3d2b88c7be21\") " pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-chn9l" Jul 07 12:54:28.837967 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:28.837936 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8da2cc5-9445-4dd5-bc89-3d2b88c7be21-tmp\") pod \"opendatahub-operator-controller-manager-7c99b98b8b-chn9l\" (UID: \"d8da2cc5-9445-4dd5-bc89-3d2b88c7be21\") " pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-chn9l" Jul 07 12:54:28.838079 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:28.838052 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d8da2cc5-9445-4dd5-bc89-3d2b88c7be21-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c99b98b8b-chn9l\" (UID: \"d8da2cc5-9445-4dd5-bc89-3d2b88c7be21\") " pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-chn9l" Jul 07 12:54:28.838079 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:28.838060 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8da2cc5-9445-4dd5-bc89-3d2b88c7be21-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c99b98b8b-chn9l\" (UID: \"d8da2cc5-9445-4dd5-bc89-3d2b88c7be21\") " pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-chn9l" Jul 07 12:54:28.847670 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:28.847637 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tmvc\" (UniqueName: \"kubernetes.io/projected/d8da2cc5-9445-4dd5-bc89-3d2b88c7be21-kube-api-access-4tmvc\") pod \"opendatahub-operator-controller-manager-7c99b98b8b-chn9l\" (UID: \"d8da2cc5-9445-4dd5-bc89-3d2b88c7be21\") " pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-chn9l" Jul 07 12:54:28.862856 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:28.862835 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:28.945981 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:28.945957 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-chn9l" Jul 07 12:54:28.962995 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:28.962953 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:29.049878 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:29.049841 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:29.083882 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:29.083863 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-chn9l"] Jul 07 12:54:29.086054 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:54:29.085998 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8da2cc5_9445_4dd5_bc89_3d2b88c7be21.slice/crio-80b64d6cd70b80ab3d744201154a723d12f3b5d4e006ca9f41495703cae973da WatchSource:0}: Error finding container 80b64d6cd70b80ab3d744201154a723d12f3b5d4e006ca9f41495703cae973da: Status 404 returned error can't find the container with id 80b64d6cd70b80ab3d744201154a723d12f3b5d4e006ca9f41495703cae973da Jul 07 12:54:29.087861 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:29.087845 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 12:54:29.128039 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:29.127999 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:29.236808 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:29.236776 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:29.343352 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:29.343275 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:29.423390 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:29.423361 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-chn9l" event={"ID":"d8da2cc5-9445-4dd5-bc89-3d2b88c7be21","Type":"ContainerStarted","Data":"80b64d6cd70b80ab3d744201154a723d12f3b5d4e006ca9f41495703cae973da"} Jul 07 12:54:32.441476 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:32.441381 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-chn9l" event={"ID":"d8da2cc5-9445-4dd5-bc89-3d2b88c7be21","Type":"ContainerStarted","Data":"2e26f71cc3f978818cdc8f1039c6a0de7eec6106299773c3393c2ffd6dcaacaf"} Jul 07 12:54:33.447088 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:33.447053 2555 generic.go:356] "Generic (PLEG): container finished" podID="d8da2cc5-9445-4dd5-bc89-3d2b88c7be21" containerID="2e26f71cc3f978818cdc8f1039c6a0de7eec6106299773c3393c2ffd6dcaacaf" exitCode=0 Jul 07 12:54:33.447494 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:33.447141 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-chn9l" event={"ID":"d8da2cc5-9445-4dd5-bc89-3d2b88c7be21","Type":"ContainerDied","Data":"2e26f71cc3f978818cdc8f1039c6a0de7eec6106299773c3393c2ffd6dcaacaf"} Jul 07 12:54:34.453251 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:34.453208 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-chn9l" event={"ID":"d8da2cc5-9445-4dd5-bc89-3d2b88c7be21","Type":"ContainerStarted","Data":"daa5604700d00b3e10aea5836682addd859d3ab4b49c73514b7231f87cc04c68"} Jul 07 12:54:34.453656 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:34.453359 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-chn9l" Jul 07 12:54:34.475413 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:34.475364 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-chn9l" podStartSLOduration=1.990011892 podStartE2EDuration="6.475347443s" totalImagesPullingTime="3.415031292s" totalInitContainerRuntime="1.070304259s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:54:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:54:34.473809083 +0000 UTC m=+383.195536635" watchObservedRunningTime="2026-07-07 12:54:34.475347443 +0000 UTC m=+383.197074955" Jul 07 12:54:37.744983 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:37.744948 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:37.815127 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:37.815100 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:41.044820 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:41.044779 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:41.104075 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:41.104042 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:41.504131 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:41.504100 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:41.571714 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:41.571680 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:45.459725 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:45.459696 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c99b98b8b-chn9l" Jul 07 12:54:48.027671 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:48.027627 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:48.181312 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:48.181273 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:48.541040 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:48.541005 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:48.848194 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:48.848107 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:49.164294 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:49.164203 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:49.270814 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:49.270767 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:49.370936 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:49.370897 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:49.598310 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:49.598273 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:49.998321 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:49.998272 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:50.233610 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:50.233572 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:50.381360 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:50.381265 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:50.455288 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:50.455252 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:51.532020 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:51.531984 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:56.198367 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:56.198335 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:56.286936 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:56.286903 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:57.022040 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.022005 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx"] Jul 07 12:54:57.031024 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.031002 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" Jul 07 12:54:57.033953 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.033936 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 12:54:57.034040 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.034025 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-kj9vl\"" Jul 07 12:54:57.055748 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.055723 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx"] Jul 07 12:54:57.058075 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.058045 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:57.156143 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.156101 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7368a1a-91d8-45e2-932c-d1bab2eed80c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fbwlx\" (UID: \"f7368a1a-91d8-45e2-932c-d1bab2eed80c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" Jul 07 12:54:57.156318 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.156158 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7368a1a-91d8-45e2-932c-d1bab2eed80c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fbwlx\" (UID: \"f7368a1a-91d8-45e2-932c-d1bab2eed80c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" Jul 07 12:54:57.156318 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.156193 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7368a1a-91d8-45e2-932c-d1bab2eed80c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fbwlx\" (UID: \"f7368a1a-91d8-45e2-932c-d1bab2eed80c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" Jul 07 12:54:57.156318 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.156263 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7368a1a-91d8-45e2-932c-d1bab2eed80c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fbwlx\" (UID: \"f7368a1a-91d8-45e2-932c-d1bab2eed80c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" Jul 07 12:54:57.156318 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.156289 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7368a1a-91d8-45e2-932c-d1bab2eed80c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fbwlx\" (UID: \"f7368a1a-91d8-45e2-932c-d1bab2eed80c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" Jul 07 12:54:57.156318 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.156315 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7368a1a-91d8-45e2-932c-d1bab2eed80c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fbwlx\" (UID: \"f7368a1a-91d8-45e2-932c-d1bab2eed80c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" Jul 07 12:54:57.156546 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.156440 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7368a1a-91d8-45e2-932c-d1bab2eed80c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fbwlx\" (UID: \"f7368a1a-91d8-45e2-932c-d1bab2eed80c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" Jul 07 12:54:57.156546 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.156484 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66wxq\" (UniqueName: \"kubernetes.io/projected/f7368a1a-91d8-45e2-932c-d1bab2eed80c-kube-api-access-66wxq\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fbwlx\" (UID: \"f7368a1a-91d8-45e2-932c-d1bab2eed80c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" Jul 07 12:54:57.156546 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.156513 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7368a1a-91d8-45e2-932c-d1bab2eed80c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fbwlx\" (UID: \"f7368a1a-91d8-45e2-932c-d1bab2eed80c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" Jul 07 12:54:57.257437 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.257400 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7368a1a-91d8-45e2-932c-d1bab2eed80c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fbwlx\" (UID: \"f7368a1a-91d8-45e2-932c-d1bab2eed80c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" Jul 07 12:54:57.257863 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.257460 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7368a1a-91d8-45e2-932c-d1bab2eed80c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fbwlx\" (UID: \"f7368a1a-91d8-45e2-932c-d1bab2eed80c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" Jul 07 12:54:57.257863 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.257480 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7368a1a-91d8-45e2-932c-d1bab2eed80c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fbwlx\" (UID: \"f7368a1a-91d8-45e2-932c-d1bab2eed80c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" Jul 07 12:54:57.257863 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.257505 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7368a1a-91d8-45e2-932c-d1bab2eed80c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fbwlx\" (UID: \"f7368a1a-91d8-45e2-932c-d1bab2eed80c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" Jul 07 12:54:57.257863 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.257523 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66wxq\" (UniqueName: \"kubernetes.io/projected/f7368a1a-91d8-45e2-932c-d1bab2eed80c-kube-api-access-66wxq\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fbwlx\" (UID: \"f7368a1a-91d8-45e2-932c-d1bab2eed80c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" Jul 07 12:54:57.257863 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.257538 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7368a1a-91d8-45e2-932c-d1bab2eed80c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fbwlx\" (UID: \"f7368a1a-91d8-45e2-932c-d1bab2eed80c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" Jul 07 12:54:57.257863 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.257698 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7368a1a-91d8-45e2-932c-d1bab2eed80c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fbwlx\" (UID: \"f7368a1a-91d8-45e2-932c-d1bab2eed80c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" Jul 07 12:54:57.257863 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.257745 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7368a1a-91d8-45e2-932c-d1bab2eed80c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fbwlx\" (UID: \"f7368a1a-91d8-45e2-932c-d1bab2eed80c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" Jul 07 12:54:57.257863 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.257776 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7368a1a-91d8-45e2-932c-d1bab2eed80c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fbwlx\" (UID: \"f7368a1a-91d8-45e2-932c-d1bab2eed80c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" Jul 07 12:54:57.258293 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.257929 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7368a1a-91d8-45e2-932c-d1bab2eed80c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fbwlx\" (UID: \"f7368a1a-91d8-45e2-932c-d1bab2eed80c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" Jul 07 12:54:57.258293 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.258134 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7368a1a-91d8-45e2-932c-d1bab2eed80c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fbwlx\" (UID: \"f7368a1a-91d8-45e2-932c-d1bab2eed80c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" Jul 07 12:54:57.258293 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.258226 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7368a1a-91d8-45e2-932c-d1bab2eed80c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fbwlx\" (UID: \"f7368a1a-91d8-45e2-932c-d1bab2eed80c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" Jul 07 12:54:57.258467 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.258349 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7368a1a-91d8-45e2-932c-d1bab2eed80c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fbwlx\" (UID: \"f7368a1a-91d8-45e2-932c-d1bab2eed80c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" Jul 07 12:54:57.258525 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.258508 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7368a1a-91d8-45e2-932c-d1bab2eed80c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fbwlx\" (UID: \"f7368a1a-91d8-45e2-932c-d1bab2eed80c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" Jul 07 12:54:57.259886 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.259870 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7368a1a-91d8-45e2-932c-d1bab2eed80c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fbwlx\" (UID: \"f7368a1a-91d8-45e2-932c-d1bab2eed80c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" Jul 07 12:54:57.260019 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.260004 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7368a1a-91d8-45e2-932c-d1bab2eed80c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fbwlx\" (UID: \"f7368a1a-91d8-45e2-932c-d1bab2eed80c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" Jul 07 12:54:57.268761 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.268738 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7368a1a-91d8-45e2-932c-d1bab2eed80c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fbwlx\" (UID: \"f7368a1a-91d8-45e2-932c-d1bab2eed80c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" Jul 07 12:54:57.268992 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.268969 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66wxq\" (UniqueName: \"kubernetes.io/projected/f7368a1a-91d8-45e2-932c-d1bab2eed80c-kube-api-access-66wxq\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fbwlx\" (UID: \"f7368a1a-91d8-45e2-932c-d1bab2eed80c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" Jul 07 12:54:57.287617 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.287547 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:57.340995 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.340977 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" Jul 07 12:54:57.410149 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.410119 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:57.489619 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.489592 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx"] Jul 07 12:54:57.492127 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:54:57.492098 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7368a1a_91d8_45e2_932c_d1bab2eed80c.slice/crio-f9a39abacdec74074dc45286b175109166d8751bc9870e9797b328ab2efb7931 WatchSource:0}: Error finding container f9a39abacdec74074dc45286b175109166d8751bc9870e9797b328ab2efb7931: Status 404 returned error can't find the container with id f9a39abacdec74074dc45286b175109166d8751bc9870e9797b328ab2efb7931 Jul 07 12:54:57.550874 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:57.550812 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" event={"ID":"f7368a1a-91d8-45e2-932c-d1bab2eed80c","Type":"ContainerStarted","Data":"f9a39abacdec74074dc45286b175109166d8751bc9870e9797b328ab2efb7931"} Jul 07 12:54:59.656121 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:59.656077 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:59.704578 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:59.704546 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c57499d8c-9k4tn"] Jul 07 12:54:59.709815 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:59.709789 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c57499d8c-9k4tn" Jul 07 12:54:59.721561 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:59.721373 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 07 12:54:59.721561 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:59.721381 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 07 12:54:59.723531 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:59.723303 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tfpcr\"" Jul 07 12:54:59.723531 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:59.723483 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 07 12:54:59.725050 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:59.724972 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 07 12:54:59.735044 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:59.735026 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 07 12:54:59.772776 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:59.772746 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c57499d8c-9k4tn"] Jul 07 12:54:59.777827 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:59.777795 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/afa4a5db-47ce-47dc-af97-e6757838a1fd-manager-config\") pod \"lws-controller-manager-7c57499d8c-9k4tn\" (UID: \"afa4a5db-47ce-47dc-af97-e6757838a1fd\") " pod="openshift-lws-operator/lws-controller-manager-7c57499d8c-9k4tn" Jul 07 12:54:59.778535 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:59.777895 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmnkz\" (UniqueName: \"kubernetes.io/projected/afa4a5db-47ce-47dc-af97-e6757838a1fd-kube-api-access-hmnkz\") pod \"lws-controller-manager-7c57499d8c-9k4tn\" (UID: \"afa4a5db-47ce-47dc-af97-e6757838a1fd\") " pod="openshift-lws-operator/lws-controller-manager-7c57499d8c-9k4tn" Jul 07 12:54:59.778535 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:59.777929 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/afa4a5db-47ce-47dc-af97-e6757838a1fd-cert\") pod \"lws-controller-manager-7c57499d8c-9k4tn\" (UID: \"afa4a5db-47ce-47dc-af97-e6757838a1fd\") " pod="openshift-lws-operator/lws-controller-manager-7c57499d8c-9k4tn" Jul 07 12:54:59.778535 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:59.777977 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/afa4a5db-47ce-47dc-af97-e6757838a1fd-metrics-cert\") pod \"lws-controller-manager-7c57499d8c-9k4tn\" (UID: \"afa4a5db-47ce-47dc-af97-e6757838a1fd\") " pod="openshift-lws-operator/lws-controller-manager-7c57499d8c-9k4tn" Jul 07 12:54:59.861153 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:59.861106 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:54:59.879208 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:59.879177 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/afa4a5db-47ce-47dc-af97-e6757838a1fd-metrics-cert\") pod \"lws-controller-manager-7c57499d8c-9k4tn\" (UID: \"afa4a5db-47ce-47dc-af97-e6757838a1fd\") " pod="openshift-lws-operator/lws-controller-manager-7c57499d8c-9k4tn" Jul 07 12:54:59.879376 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:59.879255 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/afa4a5db-47ce-47dc-af97-e6757838a1fd-manager-config\") pod \"lws-controller-manager-7c57499d8c-9k4tn\" (UID: \"afa4a5db-47ce-47dc-af97-e6757838a1fd\") " pod="openshift-lws-operator/lws-controller-manager-7c57499d8c-9k4tn" Jul 07 12:54:59.879376 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:59.879320 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmnkz\" (UniqueName: \"kubernetes.io/projected/afa4a5db-47ce-47dc-af97-e6757838a1fd-kube-api-access-hmnkz\") pod \"lws-controller-manager-7c57499d8c-9k4tn\" (UID: \"afa4a5db-47ce-47dc-af97-e6757838a1fd\") " pod="openshift-lws-operator/lws-controller-manager-7c57499d8c-9k4tn" Jul 07 12:54:59.879376 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:59.879345 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/afa4a5db-47ce-47dc-af97-e6757838a1fd-cert\") pod \"lws-controller-manager-7c57499d8c-9k4tn\" (UID: \"afa4a5db-47ce-47dc-af97-e6757838a1fd\") " pod="openshift-lws-operator/lws-controller-manager-7c57499d8c-9k4tn" Jul 07 12:54:59.880485 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:59.880451 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/afa4a5db-47ce-47dc-af97-e6757838a1fd-manager-config\") pod \"lws-controller-manager-7c57499d8c-9k4tn\" (UID: \"afa4a5db-47ce-47dc-af97-e6757838a1fd\") " pod="openshift-lws-operator/lws-controller-manager-7c57499d8c-9k4tn" Jul 07 12:54:59.882470 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:59.882445 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/afa4a5db-47ce-47dc-af97-e6757838a1fd-cert\") pod \"lws-controller-manager-7c57499d8c-9k4tn\" (UID: \"afa4a5db-47ce-47dc-af97-e6757838a1fd\") " pod="openshift-lws-operator/lws-controller-manager-7c57499d8c-9k4tn" Jul 07 12:54:59.882972 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:59.882951 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/afa4a5db-47ce-47dc-af97-e6757838a1fd-metrics-cert\") pod \"lws-controller-manager-7c57499d8c-9k4tn\" (UID: \"afa4a5db-47ce-47dc-af97-e6757838a1fd\") " pod="openshift-lws-operator/lws-controller-manager-7c57499d8c-9k4tn" Jul 07 12:54:59.898344 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:54:59.898318 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmnkz\" (UniqueName: \"kubernetes.io/projected/afa4a5db-47ce-47dc-af97-e6757838a1fd-kube-api-access-hmnkz\") pod \"lws-controller-manager-7c57499d8c-9k4tn\" (UID: \"afa4a5db-47ce-47dc-af97-e6757838a1fd\") " pod="openshift-lws-operator/lws-controller-manager-7c57499d8c-9k4tn" Jul 07 12:55:00.024634 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:55:00.024594 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c57499d8c-9k4tn" Jul 07 12:55:00.153387 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:55:00.153314 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:55:00.301547 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:55:00.301509 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:55:00.302326 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:55:00.302293 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 12:55:00.302393 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:55:00.302364 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 12:55:00.302472 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:55:00.302392 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 12:55:00.429855 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:55:00.429824 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c57499d8c-9k4tn"] Jul 07 12:55:00.432977 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:55:00.432947 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafa4a5db_47ce_47dc_af97_e6757838a1fd.slice/crio-497c748b8186369745d1a33d63ecbe33f6e74f6fc324cf9fa3fbc8e80ae4c9e3 WatchSource:0}: Error finding container 497c748b8186369745d1a33d63ecbe33f6e74f6fc324cf9fa3fbc8e80ae4c9e3: Status 404 returned error can't find the container with id 497c748b8186369745d1a33d63ecbe33f6e74f6fc324cf9fa3fbc8e80ae4c9e3 Jul 07 12:55:00.488950 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:55:00.488875 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:55:00.568206 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:55:00.568118 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c57499d8c-9k4tn" event={"ID":"afa4a5db-47ce-47dc-af97-e6757838a1fd","Type":"ContainerStarted","Data":"497c748b8186369745d1a33d63ecbe33f6e74f6fc324cf9fa3fbc8e80ae4c9e3"} Jul 07 12:55:00.569733 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:55:00.569706 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" event={"ID":"f7368a1a-91d8-45e2-932c-d1bab2eed80c","Type":"ContainerStarted","Data":"6cf30a5ca2cc53072cd9a422c118adea6ceba7ecd4dbc41c3d9167b7e68d6d13"} Jul 07 12:55:00.642096 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:55:00.642041 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" podStartSLOduration=1.83406716 podStartE2EDuration="4.642021726s" totalImagesPullingTime="2.807954566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:54:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:55:00.639678397 +0000 UTC m=+409.361405892" watchObservedRunningTime="2026-07-07 12:55:00.642021726 +0000 UTC m=+409.363749239" Jul 07 12:55:01.341471 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:55:01.341416 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" Jul 07 12:55:01.347237 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:55:01.347202 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" Jul 07 12:55:01.575364 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:55:01.575320 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" Jul 07 12:55:01.576636 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:55:01.576612 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fbwlx" Jul 07 12:55:03.585449 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:55:03.585393 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c57499d8c-9k4tn" event={"ID":"afa4a5db-47ce-47dc-af97-e6757838a1fd","Type":"ContainerStarted","Data":"7dc49a236b1e30182ad6bdc479aab219cda88fe832757131ab3076b3e2c2dd26"} Jul 07 12:55:03.585882 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:55:03.585685 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7c57499d8c-9k4tn" Jul 07 12:55:03.605824 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:55:03.605775 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7c57499d8c-9k4tn" podStartSLOduration=2.268638471 podStartE2EDuration="4.605758005s" totalImagesPullingTime="2.337119534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:54:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:55:03.604273039 +0000 UTC m=+412.326000566" watchObservedRunningTime="2026-07-07 12:55:03.605758005 +0000 UTC m=+412.327485518" Jul 07 12:55:04.123604 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:55:04.123554 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:55:04.227612 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:55:04.227577 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:55:14.592279 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:55:14.592245 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7c57499d8c-9k4tn" Jul 07 12:55:31.041342 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:55:31.041300 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:55:31.127265 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:55:31.127235 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:55:49.432685 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:55:49.432594 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:55:49.530809 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:55:49.530776 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:55:49.618881 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:55:49.618839 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:06.997495 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:06.997456 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:15.518057 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:15.518011 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:18.460722 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:18.460685 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:19.071127 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:19.071090 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:19.492811 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:19.492776 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:22.859282 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:22.859244 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:23.496072 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:23.496033 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:23.849869 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:23.849788 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:23.961373 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:23.961341 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:24.528104 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:24.528074 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:24.678349 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:24.678317 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:25.981045 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:25.981009 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:26.114438 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:26.114403 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:28.583200 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:28.583171 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:29.073317 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:29.073287 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:30.809920 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:30.809885 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:33.533403 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:33.533372 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:33.642032 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:33.641976 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:33.751524 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:33.751490 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:33.943902 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:33.943808 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:34.625737 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:34.625701 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:34.730016 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:34.729984 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:34.828596 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:34.828567 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:37.310204 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:37.310166 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:37.406873 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:37.406839 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:40.425116 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:40.425080 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:40.924035 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:40.924004 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:41.473832 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:41.473794 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:41.576298 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:41.576269 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:45.042210 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:45.042176 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:45.149897 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:45.149867 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:50.746475 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:50.746446 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pcd7r"] Jul 07 12:56:50.748794 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:50.748775 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pcd7r" Jul 07 12:56:50.751558 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:50.751531 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-x7f7q\"" Jul 07 12:56:50.751724 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:50.751610 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 12:56:50.751826 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:50.751812 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 12:56:50.771189 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:50.771156 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pcd7r"] Jul 07 12:56:50.852735 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:50.852707 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vsg7\" (UniqueName: \"kubernetes.io/projected/832c09a7-c852-4a8d-b743-30c024090221-kube-api-access-5vsg7\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pcd7r\" (UID: \"832c09a7-c852-4a8d-b743-30c024090221\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pcd7r" Jul 07 12:56:50.852898 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:50.852745 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/832c09a7-c852-4a8d-b743-30c024090221-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pcd7r\" (UID: \"832c09a7-c852-4a8d-b743-30c024090221\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pcd7r" Jul 07 12:56:50.942076 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:50.942032 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pcd7r"] Jul 07 12:56:50.942302 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:56:50.942281 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-5vsg7], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pcd7r" podUID="832c09a7-c852-4a8d-b743-30c024090221" Jul 07 12:56:50.953673 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:50.953652 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vsg7\" (UniqueName: \"kubernetes.io/projected/832c09a7-c852-4a8d-b743-30c024090221-kube-api-access-5vsg7\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pcd7r\" (UID: \"832c09a7-c852-4a8d-b743-30c024090221\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pcd7r" Jul 07 12:56:50.953787 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:50.953682 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/832c09a7-c852-4a8d-b743-30c024090221-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pcd7r\" (UID: \"832c09a7-c852-4a8d-b743-30c024090221\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pcd7r" Jul 07 12:56:50.954022 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:50.954006 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/832c09a7-c852-4a8d-b743-30c024090221-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pcd7r\" (UID: \"832c09a7-c852-4a8d-b743-30c024090221\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pcd7r" Jul 07 12:56:50.964106 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:50.964078 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vsg7\" (UniqueName: \"kubernetes.io/projected/832c09a7-c852-4a8d-b743-30c024090221-kube-api-access-5vsg7\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pcd7r\" (UID: \"832c09a7-c852-4a8d-b743-30c024090221\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pcd7r" Jul 07 12:56:51.037514 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:51.037447 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pcd7r" Jul 07 12:56:51.043258 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:51.043240 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pcd7r" Jul 07 12:56:51.054455 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:51.054435 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/832c09a7-c852-4a8d-b743-30c024090221-extensions-socket-volume\") pod \"832c09a7-c852-4a8d-b743-30c024090221\" (UID: \"832c09a7-c852-4a8d-b743-30c024090221\") " Jul 07 12:56:51.054545 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:51.054506 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vsg7\" (UniqueName: \"kubernetes.io/projected/832c09a7-c852-4a8d-b743-30c024090221-kube-api-access-5vsg7\") pod \"832c09a7-c852-4a8d-b743-30c024090221\" (UID: \"832c09a7-c852-4a8d-b743-30c024090221\") " Jul 07 12:56:51.054646 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:51.054623 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/832c09a7-c852-4a8d-b743-30c024090221-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "832c09a7-c852-4a8d-b743-30c024090221" (UID: "832c09a7-c852-4a8d-b743-30c024090221"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 12:56:51.056553 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:51.056533 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/832c09a7-c852-4a8d-b743-30c024090221-kube-api-access-5vsg7" (OuterVolumeSpecName: "kube-api-access-5vsg7") pod "832c09a7-c852-4a8d-b743-30c024090221" (UID: "832c09a7-c852-4a8d-b743-30c024090221"). InnerVolumeSpecName "kube-api-access-5vsg7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 12:56:51.155691 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:51.155661 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vsg7\" (UniqueName: \"kubernetes.io/projected/832c09a7-c852-4a8d-b743-30c024090221-kube-api-access-5vsg7\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 12:56:51.155691 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:51.155686 2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/832c09a7-c852-4a8d-b743-30c024090221-extensions-socket-volume\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 12:56:51.388553 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:51.388465 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pcd7r"] Jul 07 12:56:51.396175 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:51.396135 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pcd7r"] Jul 07 12:56:51.502750 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:51.502723 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwszn"] Jul 07 12:56:51.505124 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:51.505102 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwszn" Jul 07 12:56:51.558268 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:51.558239 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/baacf162-b006-485d-b4cf-08fa1e35304b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wwszn\" (UID: \"baacf162-b006-485d-b4cf-08fa1e35304b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwszn" Jul 07 12:56:51.558407 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:51.558348 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqzmp\" (UniqueName: \"kubernetes.io/projected/baacf162-b006-485d-b4cf-08fa1e35304b-kube-api-access-dqzmp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wwszn\" (UID: \"baacf162-b006-485d-b4cf-08fa1e35304b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwszn" Jul 07 12:56:51.605762 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:51.605739 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwszn"] Jul 07 12:56:51.659309 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:51.659250 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqzmp\" (UniqueName: \"kubernetes.io/projected/baacf162-b006-485d-b4cf-08fa1e35304b-kube-api-access-dqzmp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wwszn\" (UID: \"baacf162-b006-485d-b4cf-08fa1e35304b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwszn" Jul 07 12:56:51.659309 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:51.659299 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/baacf162-b006-485d-b4cf-08fa1e35304b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wwszn\" (UID: \"baacf162-b006-485d-b4cf-08fa1e35304b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwszn" Jul 07 12:56:51.659667 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:51.659651 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/baacf162-b006-485d-b4cf-08fa1e35304b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wwszn\" (UID: \"baacf162-b006-485d-b4cf-08fa1e35304b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwszn" Jul 07 12:56:51.673989 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:51.673962 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqzmp\" (UniqueName: \"kubernetes.io/projected/baacf162-b006-485d-b4cf-08fa1e35304b-kube-api-access-dqzmp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wwszn\" (UID: \"baacf162-b006-485d-b4cf-08fa1e35304b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwszn" Jul 07 12:56:51.817257 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:51.817199 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwszn" Jul 07 12:56:51.825172 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:51.825145 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="832c09a7-c852-4a8d-b743-30c024090221" path="/var/lib/kubelet/pods/832c09a7-c852-4a8d-b743-30c024090221/volumes" Jul 07 12:56:51.994695 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:51.994673 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwszn"] Jul 07 12:56:51.996645 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:56:51.996620 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaacf162_b006_485d_b4cf_08fa1e35304b.slice/crio-33b09e42ed2091dd387af3a20590659902175fd8239764eea54f6a704f0eeba7 WatchSource:0}: Error finding container 33b09e42ed2091dd387af3a20590659902175fd8239764eea54f6a704f0eeba7: Status 404 returned error can't find the container with id 33b09e42ed2091dd387af3a20590659902175fd8239764eea54f6a704f0eeba7 Jul 07 12:56:52.043539 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:52.043517 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pcd7r" Jul 07 12:56:52.043648 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:52.043539 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwszn" event={"ID":"baacf162-b006-485d-b4cf-08fa1e35304b","Type":"ContainerStarted","Data":"33b09e42ed2091dd387af3a20590659902175fd8239764eea54f6a704f0eeba7"} Jul 07 12:56:52.375977 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:52.375885 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:52.512728 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:52.512697 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:52.721185 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:52.721092 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:55.762183 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:55.762143 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:55.868646 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:55.868557 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:57.069806 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:57.069715 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwszn" event={"ID":"baacf162-b006-485d-b4cf-08fa1e35304b","Type":"ContainerStarted","Data":"2c1a574445e8a930f22fcdeeb8951690fd54c888b0e749edb7ac4cf2ec7fde52"} Jul 07 12:56:57.070167 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:57.069831 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwszn" Jul 07 12:56:59.834714 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:59.834681 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:56:59.992857 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:56:59.992821 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:57:03.365354 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:03.365314 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:57:03.461980 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:03.461946 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:57:08.075352 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:08.075265 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwszn" Jul 07 12:57:08.103972 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:08.103923 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwszn" podStartSLOduration=12.288435479 podStartE2EDuration="17.103908166s" totalImagesPullingTime="4.815472687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:56:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:56:57.123184087 +0000 UTC m=+525.844911600" watchObservedRunningTime="2026-07-07 12:57:08.103908166 +0000 UTC m=+536.825635679" Jul 07 12:57:14.700769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:14.700730 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwszn"] Jul 07 12:57:14.701288 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:14.700952 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwszn" podUID="baacf162-b006-485d-b4cf-08fa1e35304b" containerName="manager" containerID="cri-o://2c1a574445e8a930f22fcdeeb8951690fd54c888b0e749edb7ac4cf2ec7fde52" gracePeriod=10 Jul 07 12:57:14.947019 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:14.946997 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwszn" Jul 07 12:57:15.040825 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:15.040790 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/baacf162-b006-485d-b4cf-08fa1e35304b-extensions-socket-volume\") pod \"baacf162-b006-485d-b4cf-08fa1e35304b\" (UID: \"baacf162-b006-485d-b4cf-08fa1e35304b\") " Jul 07 12:57:15.041014 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:15.040860 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqzmp\" (UniqueName: \"kubernetes.io/projected/baacf162-b006-485d-b4cf-08fa1e35304b-kube-api-access-dqzmp\") pod \"baacf162-b006-485d-b4cf-08fa1e35304b\" (UID: \"baacf162-b006-485d-b4cf-08fa1e35304b\") " Jul 07 12:57:15.041154 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:15.041129 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baacf162-b006-485d-b4cf-08fa1e35304b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "baacf162-b006-485d-b4cf-08fa1e35304b" (UID: "baacf162-b006-485d-b4cf-08fa1e35304b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 12:57:15.043025 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:15.042996 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baacf162-b006-485d-b4cf-08fa1e35304b-kube-api-access-dqzmp" (OuterVolumeSpecName: "kube-api-access-dqzmp") pod "baacf162-b006-485d-b4cf-08fa1e35304b" (UID: "baacf162-b006-485d-b4cf-08fa1e35304b"). InnerVolumeSpecName "kube-api-access-dqzmp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 12:57:15.141648 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:15.141623 2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/baacf162-b006-485d-b4cf-08fa1e35304b-extensions-socket-volume\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 12:57:15.141648 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:15.141649 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqzmp\" (UniqueName: \"kubernetes.io/projected/baacf162-b006-485d-b4cf-08fa1e35304b-kube-api-access-dqzmp\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 12:57:15.146209 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:15.146184 2555 generic.go:356] "Generic (PLEG): container finished" podID="baacf162-b006-485d-b4cf-08fa1e35304b" containerID="2c1a574445e8a930f22fcdeeb8951690fd54c888b0e749edb7ac4cf2ec7fde52" exitCode=0 Jul 07 12:57:15.146309 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:15.146231 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwszn" Jul 07 12:57:15.146309 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:15.146242 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwszn" event={"ID":"baacf162-b006-485d-b4cf-08fa1e35304b","Type":"ContainerDied","Data":"2c1a574445e8a930f22fcdeeb8951690fd54c888b0e749edb7ac4cf2ec7fde52"} Jul 07 12:57:15.146309 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:15.146283 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwszn" event={"ID":"baacf162-b006-485d-b4cf-08fa1e35304b","Type":"ContainerDied","Data":"33b09e42ed2091dd387af3a20590659902175fd8239764eea54f6a704f0eeba7"} Jul 07 12:57:15.146309 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:15.146304 2555 scope.go:117] "RemoveContainer" containerID="2c1a574445e8a930f22fcdeeb8951690fd54c888b0e749edb7ac4cf2ec7fde52" Jul 07 12:57:15.154764 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:15.154749 2555 scope.go:117] "RemoveContainer" containerID="2c1a574445e8a930f22fcdeeb8951690fd54c888b0e749edb7ac4cf2ec7fde52" Jul 07 12:57:15.155003 ip-10-0-136-245 kubenswrapper[2555]: E0707 12:57:15.154985 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c1a574445e8a930f22fcdeeb8951690fd54c888b0e749edb7ac4cf2ec7fde52\": container with ID starting with 2c1a574445e8a930f22fcdeeb8951690fd54c888b0e749edb7ac4cf2ec7fde52 not found: ID does not exist" containerID="2c1a574445e8a930f22fcdeeb8951690fd54c888b0e749edb7ac4cf2ec7fde52" Jul 07 12:57:15.155063 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:15.155011 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c1a574445e8a930f22fcdeeb8951690fd54c888b0e749edb7ac4cf2ec7fde52"} err="failed to get container status \"2c1a574445e8a930f22fcdeeb8951690fd54c888b0e749edb7ac4cf2ec7fde52\": rpc error: code = NotFound desc = could not find container \"2c1a574445e8a930f22fcdeeb8951690fd54c888b0e749edb7ac4cf2ec7fde52\": container with ID starting with 2c1a574445e8a930f22fcdeeb8951690fd54c888b0e749edb7ac4cf2ec7fde52 not found: ID does not exist" Jul 07 12:57:15.171675 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:15.171656 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwszn"] Jul 07 12:57:15.179134 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:15.179116 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wwszn"] Jul 07 12:57:15.824605 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:15.824576 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="baacf162-b006-485d-b4cf-08fa1e35304b" path="/var/lib/kubelet/pods/baacf162-b006-485d-b4cf-08fa1e35304b/volumes" Jul 07 12:57:22.203073 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:22.203037 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:57:22.322092 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:22.322058 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:57:31.119829 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.119796 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns"] Jul 07 12:57:31.120357 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.120339 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baacf162-b006-485d-b4cf-08fa1e35304b" containerName="manager" Jul 07 12:57:31.120459 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.120373 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="baacf162-b006-485d-b4cf-08fa1e35304b" containerName="manager" Jul 07 12:57:31.120516 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.120499 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="baacf162-b006-485d-b4cf-08fa1e35304b" containerName="manager" Jul 07 12:57:31.123992 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.123974 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:57:31.129866 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.129845 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-ng87q\"" Jul 07 12:57:31.139524 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.139501 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns"] Jul 07 12:57:31.163996 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.163973 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:57:31.264321 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.264296 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d192d0f-161c-4eee-8493-f872408fbc10-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-vg4ns\" (UID: \"6d192d0f-161c-4eee-8493-f872408fbc10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:57:31.264464 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.264339 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d192d0f-161c-4eee-8493-f872408fbc10-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-vg4ns\" (UID: \"6d192d0f-161c-4eee-8493-f872408fbc10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:57:31.264464 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.264357 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d192d0f-161c-4eee-8493-f872408fbc10-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-vg4ns\" (UID: \"6d192d0f-161c-4eee-8493-f872408fbc10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:57:31.264597 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.264467 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d192d0f-161c-4eee-8493-f872408fbc10-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vg4ns\" (UID: \"6d192d0f-161c-4eee-8493-f872408fbc10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:57:31.264597 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.264511 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d192d0f-161c-4eee-8493-f872408fbc10-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-vg4ns\" (UID: \"6d192d0f-161c-4eee-8493-f872408fbc10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:57:31.264597 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.264537 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92knx\" (UniqueName: \"kubernetes.io/projected/6d192d0f-161c-4eee-8493-f872408fbc10-kube-api-access-92knx\") pod \"maas-default-gateway-openshift-default-56654dcf7-vg4ns\" (UID: \"6d192d0f-161c-4eee-8493-f872408fbc10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:57:31.264597 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.264576 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d192d0f-161c-4eee-8493-f872408fbc10-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-vg4ns\" (UID: \"6d192d0f-161c-4eee-8493-f872408fbc10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:57:31.264780 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.264654 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d192d0f-161c-4eee-8493-f872408fbc10-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-vg4ns\" (UID: \"6d192d0f-161c-4eee-8493-f872408fbc10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:57:31.264780 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.264697 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d192d0f-161c-4eee-8493-f872408fbc10-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vg4ns\" (UID: \"6d192d0f-161c-4eee-8493-f872408fbc10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:57:31.365642 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.365616 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d192d0f-161c-4eee-8493-f872408fbc10-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vg4ns\" (UID: \"6d192d0f-161c-4eee-8493-f872408fbc10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:57:31.365769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.365654 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d192d0f-161c-4eee-8493-f872408fbc10-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-vg4ns\" (UID: \"6d192d0f-161c-4eee-8493-f872408fbc10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:57:31.365769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.365681 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d192d0f-161c-4eee-8493-f872408fbc10-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-vg4ns\" (UID: \"6d192d0f-161c-4eee-8493-f872408fbc10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:57:31.365769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.365702 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d192d0f-161c-4eee-8493-f872408fbc10-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-vg4ns\" (UID: \"6d192d0f-161c-4eee-8493-f872408fbc10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:57:31.365769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.365727 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d192d0f-161c-4eee-8493-f872408fbc10-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vg4ns\" (UID: \"6d192d0f-161c-4eee-8493-f872408fbc10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:57:31.365769 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.365751 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d192d0f-161c-4eee-8493-f872408fbc10-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-vg4ns\" (UID: \"6d192d0f-161c-4eee-8493-f872408fbc10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:57:31.366033 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.365776 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92knx\" (UniqueName: \"kubernetes.io/projected/6d192d0f-161c-4eee-8493-f872408fbc10-kube-api-access-92knx\") pod \"maas-default-gateway-openshift-default-56654dcf7-vg4ns\" (UID: \"6d192d0f-161c-4eee-8493-f872408fbc10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:57:31.366092 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.366060 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d192d0f-161c-4eee-8493-f872408fbc10-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vg4ns\" (UID: \"6d192d0f-161c-4eee-8493-f872408fbc10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:57:31.366141 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.366107 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d192d0f-161c-4eee-8493-f872408fbc10-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-vg4ns\" (UID: \"6d192d0f-161c-4eee-8493-f872408fbc10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:57:31.366204 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.365806 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d192d0f-161c-4eee-8493-f872408fbc10-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-vg4ns\" (UID: \"6d192d0f-161c-4eee-8493-f872408fbc10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:57:31.366255 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.366207 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d192d0f-161c-4eee-8493-f872408fbc10-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-vg4ns\" (UID: \"6d192d0f-161c-4eee-8493-f872408fbc10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:57:31.366255 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.366238 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d192d0f-161c-4eee-8493-f872408fbc10-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-vg4ns\" (UID: \"6d192d0f-161c-4eee-8493-f872408fbc10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:57:31.366556 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.366536 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d192d0f-161c-4eee-8493-f872408fbc10-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-vg4ns\" (UID: \"6d192d0f-161c-4eee-8493-f872408fbc10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:57:31.366707 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.366688 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d192d0f-161c-4eee-8493-f872408fbc10-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-vg4ns\" (UID: \"6d192d0f-161c-4eee-8493-f872408fbc10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:57:31.368188 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.368156 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d192d0f-161c-4eee-8493-f872408fbc10-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-vg4ns\" (UID: \"6d192d0f-161c-4eee-8493-f872408fbc10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:57:31.368311 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.368294 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d192d0f-161c-4eee-8493-f872408fbc10-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-vg4ns\" (UID: \"6d192d0f-161c-4eee-8493-f872408fbc10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:57:31.374562 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.374517 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d192d0f-161c-4eee-8493-f872408fbc10-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-vg4ns\" (UID: \"6d192d0f-161c-4eee-8493-f872408fbc10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:57:31.374631 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.374582 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92knx\" (UniqueName: \"kubernetes.io/projected/6d192d0f-161c-4eee-8493-f872408fbc10-kube-api-access-92knx\") pod \"maas-default-gateway-openshift-default-56654dcf7-vg4ns\" (UID: \"6d192d0f-161c-4eee-8493-f872408fbc10\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:57:31.434538 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.434516 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:57:31.567849 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.567823 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns"] Jul 07 12:57:31.570154 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:57:31.570124 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d192d0f_161c_4eee_8493_f872408fbc10.slice/crio-08e4376b7184cc2a634d4e7a5add463a8b0be62ef9893ed84f2ffdec696feff8 WatchSource:0}: Error finding container 08e4376b7184cc2a634d4e7a5add463a8b0be62ef9893ed84f2ffdec696feff8: Status 404 returned error can't find the container with id 08e4376b7184cc2a634d4e7a5add463a8b0be62ef9893ed84f2ffdec696feff8 Jul 07 12:57:31.572682 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.572641 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 12:57:31.572774 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.572723 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 12:57:31.572774 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.572763 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 12:57:31.779708 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:31.779672 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:57:32.218862 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:32.218829 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" event={"ID":"6d192d0f-161c-4eee-8493-f872408fbc10","Type":"ContainerStarted","Data":"c20421f65f3bebd098e53da5ee6aaf6902cafe8b7cd9a7628b43b1d0068f793a"} Jul 07 12:57:32.219225 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:32.218882 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" event={"ID":"6d192d0f-161c-4eee-8493-f872408fbc10","Type":"ContainerStarted","Data":"08e4376b7184cc2a634d4e7a5add463a8b0be62ef9893ed84f2ffdec696feff8"} Jul 07 12:57:32.241158 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:32.241116 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" podStartSLOduration=1.24110144 podStartE2EDuration="1.24110144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:57:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:57:32.239592637 +0000 UTC m=+560.961320151" watchObservedRunningTime="2026-07-07 12:57:32.24110144 +0000 UTC m=+560.962828952" Jul 07 12:57:32.435647 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:32.435616 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:57:32.439721 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:32.439697 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:57:33.223553 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:33.223525 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:57:33.224538 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:33.224518 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:57:33.763024 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:33.762992 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:57:33.871687 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:33.871658 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:57:33.977880 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:33.977837 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:57:34.191778 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:34.191707 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 12:57:34.194210 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:34.194183 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-5nwht" Jul 07 12:57:34.198781 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:34.198753 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 12:57:34.198781 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:34.198772 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 12:57:34.198952 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:34.198846 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 07 12:57:34.199853 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:34.199828 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-254pd\"" Jul 07 12:57:34.210267 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:34.210247 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 12:57:34.253299 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:34.253274 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 12:57:34.290034 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:34.290011 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8b3c2af3-cabd-4b04-8ae3-defb1be20de6-config-file\") pod \"limitador-limitador-54d6d988d5-5nwht\" (UID: \"8b3c2af3-cabd-4b04-8ae3-defb1be20de6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5nwht" Jul 07 12:57:34.290121 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:34.290045 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xhtn\" (UniqueName: \"kubernetes.io/projected/8b3c2af3-cabd-4b04-8ae3-defb1be20de6-kube-api-access-4xhtn\") pod \"limitador-limitador-54d6d988d5-5nwht\" (UID: \"8b3c2af3-cabd-4b04-8ae3-defb1be20de6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5nwht" Jul 07 12:57:34.391287 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:34.391265 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8b3c2af3-cabd-4b04-8ae3-defb1be20de6-config-file\") pod \"limitador-limitador-54d6d988d5-5nwht\" (UID: \"8b3c2af3-cabd-4b04-8ae3-defb1be20de6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5nwht" Jul 07 12:57:34.391391 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:34.391301 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xhtn\" (UniqueName: \"kubernetes.io/projected/8b3c2af3-cabd-4b04-8ae3-defb1be20de6-kube-api-access-4xhtn\") pod \"limitador-limitador-54d6d988d5-5nwht\" (UID: \"8b3c2af3-cabd-4b04-8ae3-defb1be20de6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5nwht" Jul 07 12:57:34.391990 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:34.391969 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8b3c2af3-cabd-4b04-8ae3-defb1be20de6-config-file\") pod \"limitador-limitador-54d6d988d5-5nwht\" (UID: \"8b3c2af3-cabd-4b04-8ae3-defb1be20de6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5nwht" Jul 07 12:57:34.401974 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:34.401952 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xhtn\" (UniqueName: \"kubernetes.io/projected/8b3c2af3-cabd-4b04-8ae3-defb1be20de6-kube-api-access-4xhtn\") pod \"limitador-limitador-54d6d988d5-5nwht\" (UID: \"8b3c2af3-cabd-4b04-8ae3-defb1be20de6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5nwht" Jul 07 12:57:34.504866 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:34.504840 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-5nwht" Jul 07 12:57:34.635267 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:34.635246 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 12:57:34.637747 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:57:34.637704 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b3c2af3_cabd_4b04_8ae3_defb1be20de6.slice/crio-1263b1af9d0ac743e943f8695fc0b371f08fb5561140fb0b7f24f8aa6dd36afd WatchSource:0}: Error finding container 1263b1af9d0ac743e943f8695fc0b371f08fb5561140fb0b7f24f8aa6dd36afd: Status 404 returned error can't find the container with id 1263b1af9d0ac743e943f8695fc0b371f08fb5561140fb0b7f24f8aa6dd36afd Jul 07 12:57:34.638925 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:34.638890 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:57:34.810789 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:34.810707 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:57:35.241219 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:35.241181 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-5nwht" event={"ID":"8b3c2af3-cabd-4b04-8ae3-defb1be20de6","Type":"ContainerStarted","Data":"1263b1af9d0ac743e943f8695fc0b371f08fb5561140fb0b7f24f8aa6dd36afd"} Jul 07 12:57:37.251131 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:37.251045 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-5nwht" event={"ID":"8b3c2af3-cabd-4b04-8ae3-defb1be20de6","Type":"ContainerStarted","Data":"573d958712a8d6c52eb814ac8310beb1f0c430fc36be11112fed4e4f85127715"} Jul 07 12:57:37.251534 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:37.251228 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-5nwht" Jul 07 12:57:37.270410 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:37.270364 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-5nwht" podStartSLOduration=0.920235813 podStartE2EDuration="3.270350863s" totalImagesPullingTime="2.35011505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:57:37.268552777 +0000 UTC m=+565.990280291" watchObservedRunningTime="2026-07-07 12:57:37.270350863 +0000 UTC m=+565.992078376" Jul 07 12:57:48.257003 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:48.256975 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-5nwht" Jul 07 12:57:50.518804 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:50.518767 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:57:54.898633 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:57:54.898604 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:58:07.314768 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:07.314728 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:58:07.690459 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:07.690368 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:58:08.105792 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:08.105759 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-78f99c6f74-b5997"] Jul 07 12:58:08.108768 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:08.108747 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78f99c6f74-b5997" Jul 07 12:58:08.113238 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:08.113217 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 07 12:58:08.113357 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:08.113219 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-z79xl\"" Jul 07 12:58:08.120308 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:08.120286 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-78f99c6f74-b5997"] Jul 07 12:58:08.161293 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:08.161266 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfglt\" (UniqueName: \"kubernetes.io/projected/a7aa31b0-1c24-4574-b804-11dbd45a6370-kube-api-access-bfglt\") pod \"authorino-78f99c6f74-b5997\" (UID: \"a7aa31b0-1c24-4574-b804-11dbd45a6370\") " pod="kuadrant-system/authorino-78f99c6f74-b5997" Jul 07 12:58:08.161399 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:08.161346 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a7aa31b0-1c24-4574-b804-11dbd45a6370-tls-cert\") pod \"authorino-78f99c6f74-b5997\" (UID: \"a7aa31b0-1c24-4574-b804-11dbd45a6370\") " pod="kuadrant-system/authorino-78f99c6f74-b5997" Jul 07 12:58:08.261684 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:08.261658 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfglt\" (UniqueName: \"kubernetes.io/projected/a7aa31b0-1c24-4574-b804-11dbd45a6370-kube-api-access-bfglt\") pod \"authorino-78f99c6f74-b5997\" (UID: \"a7aa31b0-1c24-4574-b804-11dbd45a6370\") " pod="kuadrant-system/authorino-78f99c6f74-b5997" Jul 07 12:58:08.261803 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:08.261759 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a7aa31b0-1c24-4574-b804-11dbd45a6370-tls-cert\") pod \"authorino-78f99c6f74-b5997\" (UID: \"a7aa31b0-1c24-4574-b804-11dbd45a6370\") " pod="kuadrant-system/authorino-78f99c6f74-b5997" Jul 07 12:58:08.264125 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:08.264105 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a7aa31b0-1c24-4574-b804-11dbd45a6370-tls-cert\") pod \"authorino-78f99c6f74-b5997\" (UID: \"a7aa31b0-1c24-4574-b804-11dbd45a6370\") " pod="kuadrant-system/authorino-78f99c6f74-b5997" Jul 07 12:58:08.272508 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:08.272485 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfglt\" (UniqueName: \"kubernetes.io/projected/a7aa31b0-1c24-4574-b804-11dbd45a6370-kube-api-access-bfglt\") pod \"authorino-78f99c6f74-b5997\" (UID: \"a7aa31b0-1c24-4574-b804-11dbd45a6370\") " pod="kuadrant-system/authorino-78f99c6f74-b5997" Jul 07 12:58:08.417168 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:08.417109 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78f99c6f74-b5997" Jul 07 12:58:08.546932 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:08.546901 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-78f99c6f74-b5997"] Jul 07 12:58:08.550137 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:58:08.550111 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda7aa31b0_1c24_4574_b804_11dbd45a6370.slice/crio-85f90fe2b3dd3a39e41a7c3f91ff4fc7feac44028fa64014cb047a2bf0c3f703 WatchSource:0}: Error finding container 85f90fe2b3dd3a39e41a7c3f91ff4fc7feac44028fa64014cb047a2bf0c3f703: Status 404 returned error can't find the container with id 85f90fe2b3dd3a39e41a7c3f91ff4fc7feac44028fa64014cb047a2bf0c3f703 Jul 07 12:58:09.398072 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:09.398030 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78f99c6f74-b5997" event={"ID":"a7aa31b0-1c24-4574-b804-11dbd45a6370","Type":"ContainerStarted","Data":"85f90fe2b3dd3a39e41a7c3f91ff4fc7feac44028fa64014cb047a2bf0c3f703"} Jul 07 12:58:11.736755 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:11.736715 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gqgkf_d9ad543c-2b24-443d-a2ed-e3bc420cd888/console-operator/1.log" Jul 07 12:58:11.742695 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:11.742673 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gqgkf_d9ad543c-2b24-443d-a2ed-e3bc420cd888/console-operator/1.log" Jul 07 12:58:12.420802 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:12.420766 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78f99c6f74-b5997" event={"ID":"a7aa31b0-1c24-4574-b804-11dbd45a6370","Type":"ContainerStarted","Data":"64b9bedc45d2e8a12e32de10590ade96bd361f1c21fee0a84bb3c4944688ba18"} Jul 07 12:58:12.461316 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:12.461266 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-78f99c6f74-b5997" podStartSLOduration=1.624327461 podStartE2EDuration="4.461251948s" totalImagesPullingTime="2.836924487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:58:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:58:12.46008337 +0000 UTC m=+601.181810882" watchObservedRunningTime="2026-07-07 12:58:12.461251948 +0000 UTC m=+601.182979477" Jul 07 12:58:16.836440 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:16.836400 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:58:16.948095 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:16.948060 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:58:17.052442 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:17.052388 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:58:17.135801 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:17.135700 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:58:19.748699 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:19.748659 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:58:20.880374 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:20.880336 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:58:51.264594 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:51.264516 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:58:51.877726 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:51.877696 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:58:52.463056 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:52.463010 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:58:52.608737 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:52.608704 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:58:52.702670 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:52.702633 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:58:52.781810 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:52.781773 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 12:58:59.908346 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:59.908311 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:58:59.979526 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:58:59.979492 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:59:00.638988 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:00.638957 2555 generic.go:356] "Generic (PLEG): container finished" podID="6d192d0f-161c-4eee-8493-f872408fbc10" containerID="c20421f65f3bebd098e53da5ee6aaf6902cafe8b7cd9a7628b43b1d0068f793a" exitCode=0 Jul 07 12:59:00.639189 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:00.639030 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" event={"ID":"6d192d0f-161c-4eee-8493-f872408fbc10","Type":"ContainerDied","Data":"c20421f65f3bebd098e53da5ee6aaf6902cafe8b7cd9a7628b43b1d0068f793a"} Jul 07 12:59:00.639439 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:00.639404 2555 scope.go:117] "RemoveContainer" containerID="c20421f65f3bebd098e53da5ee6aaf6902cafe8b7cd9a7628b43b1d0068f793a" Jul 07 12:59:00.640521 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:00.640493 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 12:59:00.640620 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:00.640603 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 12:59:00.640673 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:00.640659 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 12:59:01.645763 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:01.645732 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" event={"ID":"6d192d0f-161c-4eee-8493-f872408fbc10","Type":"ContainerStarted","Data":"104f6e4a82fb05eb9eda006fa7504634ca77d0072b3e653af0b4fc60558ca043"} Jul 07 12:59:02.435271 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:02.435235 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:59:02.436377 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:02.436347 2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-vg4ns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body= Jul 07 12:59:02.436519 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:02.436400 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" podUID="6d192d0f-161c-4eee-8493-f872408fbc10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" Jul 07 12:59:02.742262 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:02.742226 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:59:02.831568 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:02.831537 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:59:03.224482 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:03.224449 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:59:03.435371 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:03.435334 2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-vg4ns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body= Jul 07 12:59:03.435568 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:03.435401 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" podUID="6d192d0f-161c-4eee-8493-f872408fbc10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" Jul 07 12:59:04.435947 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:04.435913 2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-vg4ns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body= Jul 07 12:59:04.436327 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:04.435982 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" podUID="6d192d0f-161c-4eee-8493-f872408fbc10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" Jul 07 12:59:05.435515 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:05.435473 2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-vg4ns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body= Jul 07 12:59:05.435733 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:05.435536 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" podUID="6d192d0f-161c-4eee-8493-f872408fbc10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" Jul 07 12:59:06.438519 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:06.438490 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:59:06.439572 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:06.439551 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-vg4ns" Jul 07 12:59:09.641034 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:09.640977 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:59:10.114499 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:10.114456 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 12:59:18.044078 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:18.043726 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:59:18.896850 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:18.896812 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 12:59:35.292730 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:35.292694 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:59:49.221530 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:49.221498 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-qdmlr"] Jul 07 12:59:49.223771 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:49.223754 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qdmlr" Jul 07 12:59:49.229526 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:49.229502 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 07 12:59:49.229666 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:49.229527 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 07 12:59:49.229666 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:49.229562 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 07 12:59:49.229666 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:49.229503 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hd286\"" Jul 07 12:59:49.238682 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:49.238658 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-qdmlr"] Jul 07 12:59:49.277832 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:49.277788 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 12:59:49.357747 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:49.357720 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdr5r\" (UniqueName: \"kubernetes.io/projected/56556382-f0f8-496a-841c-95bad2fd97ed-kube-api-access-mdr5r\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qdmlr\" (UID: \"56556382-f0f8-496a-841c-95bad2fd97ed\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qdmlr" Jul 07 12:59:49.357866 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:49.357752 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56556382-f0f8-496a-841c-95bad2fd97ed-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qdmlr\" (UID: \"56556382-f0f8-496a-841c-95bad2fd97ed\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qdmlr" Jul 07 12:59:49.357866 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:49.357768 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56556382-f0f8-496a-841c-95bad2fd97ed-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qdmlr\" (UID: \"56556382-f0f8-496a-841c-95bad2fd97ed\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qdmlr" Jul 07 12:59:49.357866 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:49.357801 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56556382-f0f8-496a-841c-95bad2fd97ed-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qdmlr\" (UID: \"56556382-f0f8-496a-841c-95bad2fd97ed\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qdmlr" Jul 07 12:59:49.358036 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:49.357924 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56556382-f0f8-496a-841c-95bad2fd97ed-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qdmlr\" (UID: \"56556382-f0f8-496a-841c-95bad2fd97ed\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qdmlr" Jul 07 12:59:49.358036 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:49.357980 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56556382-f0f8-496a-841c-95bad2fd97ed-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qdmlr\" (UID: \"56556382-f0f8-496a-841c-95bad2fd97ed\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qdmlr" Jul 07 12:59:49.458928 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:49.458897 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdr5r\" (UniqueName: \"kubernetes.io/projected/56556382-f0f8-496a-841c-95bad2fd97ed-kube-api-access-mdr5r\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qdmlr\" (UID: \"56556382-f0f8-496a-841c-95bad2fd97ed\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qdmlr" Jul 07 12:59:49.459079 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:49.458932 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56556382-f0f8-496a-841c-95bad2fd97ed-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qdmlr\" (UID: \"56556382-f0f8-496a-841c-95bad2fd97ed\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qdmlr" Jul 07 12:59:49.459079 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:49.458949 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56556382-f0f8-496a-841c-95bad2fd97ed-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qdmlr\" (UID: \"56556382-f0f8-496a-841c-95bad2fd97ed\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qdmlr" Jul 07 12:59:49.459079 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:49.458977 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56556382-f0f8-496a-841c-95bad2fd97ed-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qdmlr\" (UID: \"56556382-f0f8-496a-841c-95bad2fd97ed\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qdmlr" Jul 07 12:59:49.459079 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:49.459045 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56556382-f0f8-496a-841c-95bad2fd97ed-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qdmlr\" (UID: \"56556382-f0f8-496a-841c-95bad2fd97ed\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qdmlr" Jul 07 12:59:49.459304 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:49.459089 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56556382-f0f8-496a-841c-95bad2fd97ed-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qdmlr\" (UID: \"56556382-f0f8-496a-841c-95bad2fd97ed\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qdmlr" Jul 07 12:59:49.459465 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:49.459419 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56556382-f0f8-496a-841c-95bad2fd97ed-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qdmlr\" (UID: \"56556382-f0f8-496a-841c-95bad2fd97ed\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qdmlr" Jul 07 12:59:49.459520 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:49.459490 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56556382-f0f8-496a-841c-95bad2fd97ed-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qdmlr\" (UID: \"56556382-f0f8-496a-841c-95bad2fd97ed\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qdmlr" Jul 07 12:59:49.459520 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:49.459505 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56556382-f0f8-496a-841c-95bad2fd97ed-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qdmlr\" (UID: \"56556382-f0f8-496a-841c-95bad2fd97ed\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qdmlr" Jul 07 12:59:49.461095 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:49.461073 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56556382-f0f8-496a-841c-95bad2fd97ed-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qdmlr\" (UID: \"56556382-f0f8-496a-841c-95bad2fd97ed\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qdmlr" Jul 07 12:59:49.461416 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:49.461400 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56556382-f0f8-496a-841c-95bad2fd97ed-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qdmlr\" (UID: \"56556382-f0f8-496a-841c-95bad2fd97ed\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qdmlr" Jul 07 12:59:49.467401 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:49.467381 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdr5r\" (UniqueName: \"kubernetes.io/projected/56556382-f0f8-496a-841c-95bad2fd97ed-kube-api-access-mdr5r\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qdmlr\" (UID: \"56556382-f0f8-496a-841c-95bad2fd97ed\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qdmlr" Jul 07 12:59:49.533728 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:49.533706 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qdmlr" Jul 07 12:59:49.674920 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:49.674890 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-qdmlr"] Jul 07 12:59:49.678105 ip-10-0-136-245 kubenswrapper[2555]: W0707 12:59:49.678076 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56556382_f0f8_496a_841c_95bad2fd97ed.slice/crio-27604ae527cc58a4c0d74f74624a76fde8caee29053abd3a20c43067ea70d39a WatchSource:0}: Error finding container 27604ae527cc58a4c0d74f74624a76fde8caee29053abd3a20c43067ea70d39a: Status 404 returned error can't find the container with id 27604ae527cc58a4c0d74f74624a76fde8caee29053abd3a20c43067ea70d39a Jul 07 12:59:49.679505 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:49.679485 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 12:59:49.870309 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:49.870222 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qdmlr" event={"ID":"56556382-f0f8-496a-841c-95bad2fd97ed","Type":"ContainerStarted","Data":"27604ae527cc58a4c0d74f74624a76fde8caee29053abd3a20c43067ea70d39a"} Jul 07 12:59:49.904449 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:49.904407 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 12:59:50.876746 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:50.876717 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qdmlr" event={"ID":"56556382-f0f8-496a-841c-95bad2fd97ed","Type":"ContainerStarted","Data":"911263ee712b2d985a68b9ae0101e808952b1ae53f1e4afc8cab7a73423ceee8"} Jul 07 12:59:51.908434 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:51.908383 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qdmlr" podStartSLOduration=1.7752722840000001 podStartE2EDuration="2.908369297s" totalImagesPullingTime="1.133097013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:59:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:59:51.906086782 +0000 UTC m=+700.627814295" watchObservedRunningTime="2026-07-07 12:59:51.908369297 +0000 UTC m=+700.630096810" Jul 07 12:59:59.534605 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:59.534576 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qdmlr" Jul 07 12:59:59.535020 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:59.534634 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qdmlr" Jul 07 12:59:59.546847 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:59.546819 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qdmlr" Jul 07 12:59:59.932314 ip-10-0-136-245 kubenswrapper[2555]: I0707 12:59:59.932237 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qdmlr" Jul 07 13:00:02.452493 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:02.452459 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:00:03.960599 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:03.960564 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:00:08.778315 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:08.778280 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xhz49"] Jul 07 13:00:08.781248 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:08.781230 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhz49" Jul 07 13:00:08.784952 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:08.784931 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 07 13:00:08.801446 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:08.801409 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xhz49"] Jul 07 13:00:08.816297 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:08.816277 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea2f1630-286b-4bda-96df-3ea2e9eb5338-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhz49\" (UID: \"ea2f1630-286b-4bda-96df-3ea2e9eb5338\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhz49" Jul 07 13:00:08.816386 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:08.816309 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea2f1630-286b-4bda-96df-3ea2e9eb5338-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhz49\" (UID: \"ea2f1630-286b-4bda-96df-3ea2e9eb5338\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhz49" Jul 07 13:00:08.816386 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:08.816361 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea2f1630-286b-4bda-96df-3ea2e9eb5338-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhz49\" (UID: \"ea2f1630-286b-4bda-96df-3ea2e9eb5338\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhz49" Jul 07 13:00:08.816473 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:08.816407 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd9jg\" (UniqueName: \"kubernetes.io/projected/ea2f1630-286b-4bda-96df-3ea2e9eb5338-kube-api-access-hd9jg\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhz49\" (UID: \"ea2f1630-286b-4bda-96df-3ea2e9eb5338\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhz49" Jul 07 13:00:08.816473 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:08.816441 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea2f1630-286b-4bda-96df-3ea2e9eb5338-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhz49\" (UID: \"ea2f1630-286b-4bda-96df-3ea2e9eb5338\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhz49" Jul 07 13:00:08.816537 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:08.816519 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea2f1630-286b-4bda-96df-3ea2e9eb5338-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhz49\" (UID: \"ea2f1630-286b-4bda-96df-3ea2e9eb5338\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhz49" Jul 07 13:00:08.856166 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:08.856137 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:00:08.917276 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:08.917242 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea2f1630-286b-4bda-96df-3ea2e9eb5338-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhz49\" (UID: \"ea2f1630-286b-4bda-96df-3ea2e9eb5338\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhz49" Jul 07 13:00:08.917453 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:08.917298 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd9jg\" (UniqueName: \"kubernetes.io/projected/ea2f1630-286b-4bda-96df-3ea2e9eb5338-kube-api-access-hd9jg\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhz49\" (UID: \"ea2f1630-286b-4bda-96df-3ea2e9eb5338\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhz49" Jul 07 13:00:08.917453 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:08.917324 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea2f1630-286b-4bda-96df-3ea2e9eb5338-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhz49\" (UID: \"ea2f1630-286b-4bda-96df-3ea2e9eb5338\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhz49" Jul 07 13:00:08.917453 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:08.917394 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea2f1630-286b-4bda-96df-3ea2e9eb5338-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhz49\" (UID: \"ea2f1630-286b-4bda-96df-3ea2e9eb5338\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhz49" Jul 07 13:00:08.917635 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:08.917466 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea2f1630-286b-4bda-96df-3ea2e9eb5338-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhz49\" (UID: \"ea2f1630-286b-4bda-96df-3ea2e9eb5338\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhz49" Jul 07 13:00:08.917635 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:08.917502 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea2f1630-286b-4bda-96df-3ea2e9eb5338-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhz49\" (UID: \"ea2f1630-286b-4bda-96df-3ea2e9eb5338\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhz49" Jul 07 13:00:08.917790 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:08.917765 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea2f1630-286b-4bda-96df-3ea2e9eb5338-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhz49\" (UID: \"ea2f1630-286b-4bda-96df-3ea2e9eb5338\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhz49" Jul 07 13:00:08.917937 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:08.917905 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea2f1630-286b-4bda-96df-3ea2e9eb5338-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhz49\" (UID: \"ea2f1630-286b-4bda-96df-3ea2e9eb5338\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhz49" Jul 07 13:00:08.917937 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:08.917910 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea2f1630-286b-4bda-96df-3ea2e9eb5338-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhz49\" (UID: \"ea2f1630-286b-4bda-96df-3ea2e9eb5338\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhz49" Jul 07 13:00:08.919622 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:08.919600 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea2f1630-286b-4bda-96df-3ea2e9eb5338-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhz49\" (UID: \"ea2f1630-286b-4bda-96df-3ea2e9eb5338\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhz49" Jul 07 13:00:08.920556 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:08.920537 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea2f1630-286b-4bda-96df-3ea2e9eb5338-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhz49\" (UID: \"ea2f1630-286b-4bda-96df-3ea2e9eb5338\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhz49" Jul 07 13:00:08.938402 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:08.938380 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd9jg\" (UniqueName: \"kubernetes.io/projected/ea2f1630-286b-4bda-96df-3ea2e9eb5338-kube-api-access-hd9jg\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-xhz49\" (UID: \"ea2f1630-286b-4bda-96df-3ea2e9eb5338\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhz49" Jul 07 13:00:09.092759 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:09.092672 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhz49" Jul 07 13:00:09.222223 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:09.222198 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-xhz49"] Jul 07 13:00:09.224221 ip-10-0-136-245 kubenswrapper[2555]: W0707 13:00:09.224194 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea2f1630_286b_4bda_96df_3ea2e9eb5338.slice/crio-7e1f4c0c25020bfd405d9bc22233aa92e27630d20703aab97075fbe8a984bea1 WatchSource:0}: Error finding container 7e1f4c0c25020bfd405d9bc22233aa92e27630d20703aab97075fbe8a984bea1: Status 404 returned error can't find the container with id 7e1f4c0c25020bfd405d9bc22233aa92e27630d20703aab97075fbe8a984bea1 Jul 07 13:00:09.965913 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:09.965883 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhz49" event={"ID":"ea2f1630-286b-4bda-96df-3ea2e9eb5338","Type":"ContainerStarted","Data":"7e1f4c0c25020bfd405d9bc22233aa92e27630d20703aab97075fbe8a984bea1"} Jul 07 13:00:11.791492 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:11.791461 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:00:12.983278 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:12.983244 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhz49" event={"ID":"ea2f1630-286b-4bda-96df-3ea2e9eb5338","Type":"ContainerStarted","Data":"18d8eedae14f6941b54c3e67c495e5bb69b8f542d7c90b81ef692d6ece1062ee"} Jul 07 13:00:13.014802 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:13.014749 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhz49" podStartSLOduration=1.6085087260000002 podStartE2EDuration="5.014734528s" totalImagesPullingTime="3.406225802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:00:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:00:13.01406464 +0000 UTC m=+721.735792154" watchObservedRunningTime="2026-07-07 13:00:13.014734528 +0000 UTC m=+721.736462041" Jul 07 13:00:19.032810 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:19.032774 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:00:19.093228 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:19.093197 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhz49" Jul 07 13:00:19.093405 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:19.093287 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhz49" Jul 07 13:00:19.105765 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:19.105741 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhz49" Jul 07 13:00:20.024874 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:20.024845 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-xhz49" Jul 07 13:00:21.696625 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:00:21.696588 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:01:03.190851 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:03.190804 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:01:18.143018 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:18.142983 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5b74bd9b95-ws24f"] Jul 07 13:01:18.145275 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:18.145259 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b74bd9b95-ws24f" Jul 07 13:01:18.152695 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:18.152675 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b74bd9b95-ws24f"] Jul 07 13:01:18.191835 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:18.191809 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/508c8201-0684-4157-b17e-46f1db331610-tls-cert\") pod \"authorino-5b74bd9b95-ws24f\" (UID: \"508c8201-0684-4157-b17e-46f1db331610\") " pod="kuadrant-system/authorino-5b74bd9b95-ws24f" Jul 07 13:01:18.191956 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:18.191860 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79kng\" (UniqueName: \"kubernetes.io/projected/508c8201-0684-4157-b17e-46f1db331610-kube-api-access-79kng\") pod \"authorino-5b74bd9b95-ws24f\" (UID: \"508c8201-0684-4157-b17e-46f1db331610\") " pod="kuadrant-system/authorino-5b74bd9b95-ws24f" Jul 07 13:01:18.293176 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:18.293151 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/508c8201-0684-4157-b17e-46f1db331610-tls-cert\") pod \"authorino-5b74bd9b95-ws24f\" (UID: \"508c8201-0684-4157-b17e-46f1db331610\") " pod="kuadrant-system/authorino-5b74bd9b95-ws24f" Jul 07 13:01:18.293315 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:18.293206 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79kng\" (UniqueName: \"kubernetes.io/projected/508c8201-0684-4157-b17e-46f1db331610-kube-api-access-79kng\") pod \"authorino-5b74bd9b95-ws24f\" (UID: \"508c8201-0684-4157-b17e-46f1db331610\") " pod="kuadrant-system/authorino-5b74bd9b95-ws24f" Jul 07 13:01:18.295403 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:18.295385 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/508c8201-0684-4157-b17e-46f1db331610-tls-cert\") pod \"authorino-5b74bd9b95-ws24f\" (UID: \"508c8201-0684-4157-b17e-46f1db331610\") " pod="kuadrant-system/authorino-5b74bd9b95-ws24f" Jul 07 13:01:18.301156 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:18.301133 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79kng\" (UniqueName: \"kubernetes.io/projected/508c8201-0684-4157-b17e-46f1db331610-kube-api-access-79kng\") pod \"authorino-5b74bd9b95-ws24f\" (UID: \"508c8201-0684-4157-b17e-46f1db331610\") " pod="kuadrant-system/authorino-5b74bd9b95-ws24f" Jul 07 13:01:18.454193 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:18.454129 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b74bd9b95-ws24f" Jul 07 13:01:18.589958 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:18.589929 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b74bd9b95-ws24f"] Jul 07 13:01:18.593146 ip-10-0-136-245 kubenswrapper[2555]: W0707 13:01:18.593122 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod508c8201_0684_4157_b17e_46f1db331610.slice/crio-f466324e23b8b3c7495e2917fcfff86164a485d41a12ea17448dd57f04041e36 WatchSource:0}: Error finding container f466324e23b8b3c7495e2917fcfff86164a485d41a12ea17448dd57f04041e36: Status 404 returned error can't find the container with id f466324e23b8b3c7495e2917fcfff86164a485d41a12ea17448dd57f04041e36 Jul 07 13:01:18.616278 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:18.616251 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:01:18.734027 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:18.733999 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:01:19.276322 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:19.276284 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b74bd9b95-ws24f" event={"ID":"508c8201-0684-4157-b17e-46f1db331610","Type":"ContainerStarted","Data":"f466324e23b8b3c7495e2917fcfff86164a485d41a12ea17448dd57f04041e36"} Jul 07 13:01:19.775000 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:19.774960 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:01:19.874601 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:19.874566 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:01:20.284120 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:20.284080 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b74bd9b95-ws24f" event={"ID":"508c8201-0684-4157-b17e-46f1db331610","Type":"ContainerStarted","Data":"a9b7c36c402ff3eb3e158e4788f3619b333a4e66e6d06d2c0138b4dc3acd80e4"} Jul 07 13:01:20.309960 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:20.309912 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5b74bd9b95-ws24f" podStartSLOduration=1.507067722 podStartE2EDuration="2.309895472s" totalImagesPullingTime="802.82775ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:01:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:01:20.307324272 +0000 UTC m=+789.029051786" watchObservedRunningTime="2026-07-07 13:01:20.309895472 +0000 UTC m=+789.031622982" Jul 07 13:01:20.357883 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:20.357847 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78f99c6f74-b5997"] Jul 07 13:01:20.358106 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:20.358078 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-78f99c6f74-b5997" podUID="a7aa31b0-1c24-4574-b804-11dbd45a6370" containerName="authorino" containerID="cri-o://64b9bedc45d2e8a12e32de10590ade96bd361f1c21fee0a84bb3c4944688ba18" gracePeriod=30 Jul 07 13:01:20.628530 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:20.628508 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78f99c6f74-b5997" Jul 07 13:01:20.711617 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:20.711587 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfglt\" (UniqueName: \"kubernetes.io/projected/a7aa31b0-1c24-4574-b804-11dbd45a6370-kube-api-access-bfglt\") pod \"a7aa31b0-1c24-4574-b804-11dbd45a6370\" (UID: \"a7aa31b0-1c24-4574-b804-11dbd45a6370\") " Jul 07 13:01:20.711795 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:20.711653 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a7aa31b0-1c24-4574-b804-11dbd45a6370-tls-cert\") pod \"a7aa31b0-1c24-4574-b804-11dbd45a6370\" (UID: \"a7aa31b0-1c24-4574-b804-11dbd45a6370\") " Jul 07 13:01:20.713739 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:20.713703 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7aa31b0-1c24-4574-b804-11dbd45a6370-kube-api-access-bfglt" (OuterVolumeSpecName: "kube-api-access-bfglt") pod "a7aa31b0-1c24-4574-b804-11dbd45a6370" (UID: "a7aa31b0-1c24-4574-b804-11dbd45a6370"). InnerVolumeSpecName "kube-api-access-bfglt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:01:20.722137 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:20.722109 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7aa31b0-1c24-4574-b804-11dbd45a6370-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a7aa31b0-1c24-4574-b804-11dbd45a6370" (UID: "a7aa31b0-1c24-4574-b804-11dbd45a6370"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:01:20.812539 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:20.812460 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfglt\" (UniqueName: \"kubernetes.io/projected/a7aa31b0-1c24-4574-b804-11dbd45a6370-kube-api-access-bfglt\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:01:20.812539 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:20.812490 2555 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a7aa31b0-1c24-4574-b804-11dbd45a6370-tls-cert\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:01:21.296774 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:21.296730 2555 generic.go:356] "Generic (PLEG): container finished" podID="a7aa31b0-1c24-4574-b804-11dbd45a6370" containerID="64b9bedc45d2e8a12e32de10590ade96bd361f1c21fee0a84bb3c4944688ba18" exitCode=0 Jul 07 13:01:21.297185 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:21.296791 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78f99c6f74-b5997" Jul 07 13:01:21.297185 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:21.296812 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78f99c6f74-b5997" event={"ID":"a7aa31b0-1c24-4574-b804-11dbd45a6370","Type":"ContainerDied","Data":"64b9bedc45d2e8a12e32de10590ade96bd361f1c21fee0a84bb3c4944688ba18"} Jul 07 13:01:21.297185 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:21.296865 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78f99c6f74-b5997" event={"ID":"a7aa31b0-1c24-4574-b804-11dbd45a6370","Type":"ContainerDied","Data":"85f90fe2b3dd3a39e41a7c3f91ff4fc7feac44028fa64014cb047a2bf0c3f703"} Jul 07 13:01:21.297185 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:21.296886 2555 scope.go:117] "RemoveContainer" containerID="64b9bedc45d2e8a12e32de10590ade96bd361f1c21fee0a84bb3c4944688ba18" Jul 07 13:01:21.306889 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:21.306872 2555 scope.go:117] "RemoveContainer" containerID="64b9bedc45d2e8a12e32de10590ade96bd361f1c21fee0a84bb3c4944688ba18" Jul 07 13:01:21.307122 ip-10-0-136-245 kubenswrapper[2555]: E0707 13:01:21.307098 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64b9bedc45d2e8a12e32de10590ade96bd361f1c21fee0a84bb3c4944688ba18\": container with ID starting with 64b9bedc45d2e8a12e32de10590ade96bd361f1c21fee0a84bb3c4944688ba18 not found: ID does not exist" containerID="64b9bedc45d2e8a12e32de10590ade96bd361f1c21fee0a84bb3c4944688ba18" Jul 07 13:01:21.307186 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:21.307130 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64b9bedc45d2e8a12e32de10590ade96bd361f1c21fee0a84bb3c4944688ba18"} err="failed to get container status \"64b9bedc45d2e8a12e32de10590ade96bd361f1c21fee0a84bb3c4944688ba18\": rpc error: code = NotFound desc = could not find container \"64b9bedc45d2e8a12e32de10590ade96bd361f1c21fee0a84bb3c4944688ba18\": container with ID starting with 64b9bedc45d2e8a12e32de10590ade96bd361f1c21fee0a84bb3c4944688ba18 not found: ID does not exist" Jul 07 13:01:21.323874 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:21.323840 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78f99c6f74-b5997"] Jul 07 13:01:21.330863 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:21.330839 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-78f99c6f74-b5997"] Jul 07 13:01:21.825178 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:01:21.825147 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7aa31b0-1c24-4574-b804-11dbd45a6370" path="/var/lib/kubelet/pods/a7aa31b0-1c24-4574-b804-11dbd45a6370/volumes" Jul 07 13:02:18.954432 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:02:18.954379 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:02:19.014475 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:02:19.014410 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:02:20.409514 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:02:20.409483 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:02:30.057242 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:02:30.057207 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:02:32.424139 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:02:32.424107 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:02:42.001284 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:02:42.001257 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:02:49.798636 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:02:49.798605 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:03:00.809169 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:03:00.809130 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:03:03.511300 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:03:03.511263 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:03:05.402241 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:03:05.402155 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:03:11.766098 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:03:11.766067 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gqgkf_d9ad543c-2b24-443d-a2ed-e3bc420cd888/console-operator/1.log" Jul 07 13:03:11.768469 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:03:11.768408 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gqgkf_d9ad543c-2b24-443d-a2ed-e3bc420cd888/console-operator/1.log" Jul 07 13:03:29.207938 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:03:29.207892 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:03:40.731147 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:03:40.731112 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:03:46.750852 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:03:46.750817 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:03:49.023968 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:03:49.023928 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:03:53.813563 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:03:53.813524 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:03:53.919854 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:03:53.919817 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:03:54.014745 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:03:54.014708 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:03:54.196883 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:03:54.196789 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:04:00.199076 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:04:00.199036 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:04:00.302741 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:04:00.302686 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:04:16.898006 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:04:16.897972 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:04:26.798822 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:04:26.798786 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:04:35.407826 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:04:35.407743 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:04:44.897494 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:04:44.897457 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:04:55.491729 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:04:55.491692 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:05:04.402965 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:05:04.402927 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:05:16.402789 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:05:16.402718 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:05:25.359938 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:05:25.359901 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:05:26.217059 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:05:26.217024 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:05:51.938559 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:05:51.938523 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:05:55.030994 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:05:55.030957 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:06:00.999846 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:06:00.999815 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:06:21.603674 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:06:21.603578 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:06:22.493802 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:06:22.493757 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:06:22.594845 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:06:22.594817 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:06:26.495303 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:06:26.495270 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:06:36.497380 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:06:36.497343 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:06:51.711727 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:06:51.711693 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:07:00.992808 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:07:00.992773 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:07:10.604519 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:07:10.604476 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:07:20.295235 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:07:20.295201 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:07:29.294732 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:07:29.294698 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:08:11.794874 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:08:11.794799 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gqgkf_d9ad543c-2b24-443d-a2ed-e3bc420cd888/console-operator/1.log" Jul 07 13:08:11.795400 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:08:11.795223 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gqgkf_d9ad543c-2b24-443d-a2ed-e3bc420cd888/console-operator/1.log" Jul 07 13:08:33.538893 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:08:33.538862 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:08:33.626763 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:08:33.626727 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:09:19.697954 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:09:19.697867 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:09:28.798851 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:09:28.798819 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:09:43.667747 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:09:43.667712 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:09:52.094704 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:09:52.094674 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:10:02.090581 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:10:02.090542 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:10:10.593727 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:10:10.593684 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:10:21.386189 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:10:21.386155 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:10:32.989205 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:10:32.989174 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:10:41.384628 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:10:41.384536 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:10:52.699460 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:10:52.699416 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:11:03.992089 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:11:03.992052 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:11:11.195121 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:11:11.195092 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:11:29.606168 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:11:29.606130 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:11:38.797313 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:11:38.797271 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:11:43.428738 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:11:43.428706 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:11:48.713330 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:11:48.713291 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:11:59.396073 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:11:59.396037 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:12:15.725812 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:12:15.725724 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:12:25.290492 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:12:25.290455 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:12:34.494039 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:12:34.494004 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:12:46.202181 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:12:46.202147 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:12:54.906045 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:12:54.906004 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:13:04.596034 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:13:04.595996 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:13:11.823254 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:13:11.823211 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gqgkf_d9ad543c-2b24-443d-a2ed-e3bc420cd888/console-operator/1.log" Jul 07 13:13:11.824879 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:13:11.824857 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gqgkf_d9ad543c-2b24-443d-a2ed-e3bc420cd888/console-operator/1.log" Jul 07 13:13:17.802946 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:13:17.802906 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:13:27.136541 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:13:27.136501 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:13:36.628444 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:13:36.628339 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:13:46.397764 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:13:46.397725 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:14:04.573049 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:04.573016 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:14:05.706996 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:05.706961 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:14:17.400963 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:17.400926 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:14:28.910941 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:28.910902 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:14:39.990612 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:39.990577 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:14:44.283344 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:44.283306 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:14:44.390238 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:44.390204 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:14:44.764738 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:44.764705 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:14:50.461162 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.461130 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:14:50.563278 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.563245 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:14:50.666839 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.666809 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp"] Jul 07 13:14:50.667190 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.667178 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7aa31b0-1c24-4574-b804-11dbd45a6370" containerName="authorino" Jul 07 13:14:50.667235 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.667191 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7aa31b0-1c24-4574-b804-11dbd45a6370" containerName="authorino" Jul 07 13:14:50.667269 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.667253 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7aa31b0-1c24-4574-b804-11dbd45a6370" containerName="authorino" Jul 07 13:14:50.670211 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.670195 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:14:50.673637 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.673618 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-bafec94a-openshift-default-dockercfg-rwkqh\"" Jul 07 13:14:50.717103 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.717048 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp"] Jul 07 13:14:50.718994 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.718972 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:14:50.810650 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.810617 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:14:50.831116 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.831091 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smhf2\" (UniqueName: \"kubernetes.io/projected/b1672473-f286-42a5-940f-1017d6437c2a-kube-api-access-smhf2\") pod \"e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:14:50.831223 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.831133 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1672473-f286-42a5-940f-1017d6437c2a-istio-podinfo\") pod \"e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:14:50.831223 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.831156 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1672473-f286-42a5-940f-1017d6437c2a-istiod-ca-cert\") pod \"e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:14:50.831223 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.831193 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1672473-f286-42a5-940f-1017d6437c2a-istio-envoy\") pod \"e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:14:50.831223 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.831221 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1672473-f286-42a5-940f-1017d6437c2a-istio-token\") pod \"e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:14:50.831589 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.831244 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1672473-f286-42a5-940f-1017d6437c2a-workload-socket\") pod \"e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:14:50.831589 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.831278 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1672473-f286-42a5-940f-1017d6437c2a-workload-certs\") pod \"e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:14:50.831589 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.831308 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1672473-f286-42a5-940f-1017d6437c2a-credential-socket\") pod \"e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:14:50.831589 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.831351 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1672473-f286-42a5-940f-1017d6437c2a-istio-data\") pod \"e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:14:50.931911 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.931885 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1672473-f286-42a5-940f-1017d6437c2a-istio-data\") pod \"e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:14:50.932018 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.931916 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smhf2\" (UniqueName: \"kubernetes.io/projected/b1672473-f286-42a5-940f-1017d6437c2a-kube-api-access-smhf2\") pod \"e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:14:50.932018 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.931946 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1672473-f286-42a5-940f-1017d6437c2a-istio-podinfo\") pod \"e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:14:50.932018 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.931964 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1672473-f286-42a5-940f-1017d6437c2a-istiod-ca-cert\") pod \"e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:14:50.932018 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.931989 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1672473-f286-42a5-940f-1017d6437c2a-istio-envoy\") pod \"e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:14:50.932204 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.932029 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1672473-f286-42a5-940f-1017d6437c2a-istio-token\") pod \"e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:14:50.932204 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.932075 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1672473-f286-42a5-940f-1017d6437c2a-workload-socket\") pod \"e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:14:50.932204 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.932094 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1672473-f286-42a5-940f-1017d6437c2a-workload-certs\") pod \"e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:14:50.932204 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.932137 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1672473-f286-42a5-940f-1017d6437c2a-credential-socket\") pod \"e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:14:50.932475 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.932339 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1672473-f286-42a5-940f-1017d6437c2a-istio-data\") pod \"e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:14:50.932475 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.932461 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1672473-f286-42a5-940f-1017d6437c2a-workload-socket\") pod \"e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:14:50.932594 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.932523 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1672473-f286-42a5-940f-1017d6437c2a-workload-certs\") pod \"e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:14:50.932594 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.932542 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1672473-f286-42a5-940f-1017d6437c2a-credential-socket\") pod \"e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:14:50.932923 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.932903 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1672473-f286-42a5-940f-1017d6437c2a-istiod-ca-cert\") pod \"e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:14:50.934492 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.934470 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1672473-f286-42a5-940f-1017d6437c2a-istio-envoy\") pod \"e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:14:50.934598 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.934544 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1672473-f286-42a5-940f-1017d6437c2a-istio-podinfo\") pod \"e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:14:50.941364 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.941324 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1672473-f286-42a5-940f-1017d6437c2a-istio-token\") pod \"e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:14:50.941656 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.941635 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smhf2\" (UniqueName: \"kubernetes.io/projected/b1672473-f286-42a5-940f-1017d6437c2a-kube-api-access-smhf2\") pod \"e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:14:50.979954 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:50.979934 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:14:51.115647 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:51.115622 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp"] Jul 07 13:14:51.117463 ip-10-0-136-245 kubenswrapper[2555]: W0707 13:14:51.117408 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1672473_f286_42a5_940f_1017d6437c2a.slice/crio-7acd0aa32d925b6a7db6be47e9e280ad782e2526d5287e05c9325f8dd5e62544 WatchSource:0}: Error finding container 7acd0aa32d925b6a7db6be47e9e280ad782e2526d5287e05c9325f8dd5e62544: Status 404 returned error can't find the container with id 7acd0aa32d925b6a7db6be47e9e280ad782e2526d5287e05c9325f8dd5e62544 Jul 07 13:14:51.119711 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:51.119675 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:14:51.119788 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:51.119757 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:14:51.119836 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:51.119799 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:14:51.855700 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:51.855671 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:14:51.952483 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:51.949935 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:14:51.954242 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:51.954207 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" event={"ID":"b1672473-f286-42a5-940f-1017d6437c2a","Type":"ContainerStarted","Data":"c8eb621fb60606aef863a99d70766c0e1d97ecd10aaa3b34a36c9b48987f65f8"} Jul 07 13:14:51.954393 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:51.954305 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" event={"ID":"b1672473-f286-42a5-940f-1017d6437c2a","Type":"ContainerStarted","Data":"7acd0aa32d925b6a7db6be47e9e280ad782e2526d5287e05c9325f8dd5e62544"} Jul 07 13:14:51.980163 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:51.980130 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:14:51.982725 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:51.982684 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" podStartSLOduration=1.9826713950000001 podStartE2EDuration="1.982671395s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:14:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:14:51.981054671 +0000 UTC m=+1600.702782185" watchObservedRunningTime="2026-07-07 13:14:51.982671395 +0000 UTC m=+1600.704398908" Jul 07 13:14:52.020315 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:52.020287 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:14:52.376460 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:52.376409 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:14:52.477565 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:52.477531 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:14:52.576637 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:52.576602 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:14:52.985982 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:52.985955 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:14:53.962271 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:53.962239 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:14:53.963139 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:53.963122 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:14:54.447766 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:54.447736 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:14:54.491883 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:54.491853 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:14:56.913377 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:56.913341 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:14:57.071671 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:57.071627 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp"] Jul 07 13:14:57.072168 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:57.072133 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" podUID="b1672473-f286-42a5-940f-1017d6437c2a" containerName="istio-proxy" containerID="cri-o://c8eb621fb60606aef863a99d70766c0e1d97ecd10aaa3b34a36c9b48987f65f8" gracePeriod=30 Jul 07 13:14:57.098142 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:57.098118 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:14:57.197793 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:57.197699 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:14:57.298633 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:57.298563 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:14:59.042651 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:14:59.042587 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:02.619483 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:02.619459 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:15:02.642242 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:02.642221 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1672473-f286-42a5-940f-1017d6437c2a-istio-podinfo\") pod \"b1672473-f286-42a5-940f-1017d6437c2a\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " Jul 07 13:15:02.642348 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:02.642252 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1672473-f286-42a5-940f-1017d6437c2a-istio-token\") pod \"b1672473-f286-42a5-940f-1017d6437c2a\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " Jul 07 13:15:02.642348 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:02.642273 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1672473-f286-42a5-940f-1017d6437c2a-istio-data\") pod \"b1672473-f286-42a5-940f-1017d6437c2a\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " Jul 07 13:15:02.642348 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:02.642333 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smhf2\" (UniqueName: \"kubernetes.io/projected/b1672473-f286-42a5-940f-1017d6437c2a-kube-api-access-smhf2\") pod \"b1672473-f286-42a5-940f-1017d6437c2a\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " Jul 07 13:15:02.642506 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:02.642360 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1672473-f286-42a5-940f-1017d6437c2a-workload-socket\") pod \"b1672473-f286-42a5-940f-1017d6437c2a\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " Jul 07 13:15:02.642506 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:02.642444 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1672473-f286-42a5-940f-1017d6437c2a-istiod-ca-cert\") pod \"b1672473-f286-42a5-940f-1017d6437c2a\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " Jul 07 13:15:02.642506 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:02.642504 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1672473-f286-42a5-940f-1017d6437c2a-workload-certs\") pod \"b1672473-f286-42a5-940f-1017d6437c2a\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " Jul 07 13:15:02.642670 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:02.642547 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1672473-f286-42a5-940f-1017d6437c2a-istio-envoy\") pod \"b1672473-f286-42a5-940f-1017d6437c2a\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " Jul 07 13:15:02.642670 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:02.642590 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1672473-f286-42a5-940f-1017d6437c2a-credential-socket\") pod \"b1672473-f286-42a5-940f-1017d6437c2a\" (UID: \"b1672473-f286-42a5-940f-1017d6437c2a\") " Jul 07 13:15:02.642767 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:02.642666 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1672473-f286-42a5-940f-1017d6437c2a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b1672473-f286-42a5-940f-1017d6437c2a" (UID: "b1672473-f286-42a5-940f-1017d6437c2a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:15:02.642851 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:02.642823 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1672473-f286-42a5-940f-1017d6437c2a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b1672473-f286-42a5-940f-1017d6437c2a" (UID: "b1672473-f286-42a5-940f-1017d6437c2a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:15:02.642946 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:02.642925 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1672473-f286-42a5-940f-1017d6437c2a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b1672473-f286-42a5-940f-1017d6437c2a" (UID: "b1672473-f286-42a5-940f-1017d6437c2a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:15:02.642991 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:02.642938 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1672473-f286-42a5-940f-1017d6437c2a-workload-socket\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:15:02.642991 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:02.642940 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1672473-f286-42a5-940f-1017d6437c2a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b1672473-f286-42a5-940f-1017d6437c2a" (UID: "b1672473-f286-42a5-940f-1017d6437c2a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:15:02.643255 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:02.643219 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1672473-f286-42a5-940f-1017d6437c2a-istio-data" (OuterVolumeSpecName: "istio-data") pod "b1672473-f286-42a5-940f-1017d6437c2a" (UID: "b1672473-f286-42a5-940f-1017d6437c2a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:15:02.645243 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:02.645219 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1672473-f286-42a5-940f-1017d6437c2a-istio-token" (OuterVolumeSpecName: "istio-token") pod "b1672473-f286-42a5-940f-1017d6437c2a" (UID: "b1672473-f286-42a5-940f-1017d6437c2a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:15:02.645546 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:02.645519 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1672473-f286-42a5-940f-1017d6437c2a-kube-api-access-smhf2" (OuterVolumeSpecName: "kube-api-access-smhf2") pod "b1672473-f286-42a5-940f-1017d6437c2a" (UID: "b1672473-f286-42a5-940f-1017d6437c2a"). InnerVolumeSpecName "kube-api-access-smhf2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:15:02.645862 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:02.645837 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1672473-f286-42a5-940f-1017d6437c2a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b1672473-f286-42a5-940f-1017d6437c2a" (UID: "b1672473-f286-42a5-940f-1017d6437c2a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:15:02.645862 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:02.645852 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b1672473-f286-42a5-940f-1017d6437c2a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b1672473-f286-42a5-940f-1017d6437c2a" (UID: "b1672473-f286-42a5-940f-1017d6437c2a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 13:15:02.743664 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:02.743629 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1672473-f286-42a5-940f-1017d6437c2a-istiod-ca-cert\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:15:02.743664 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:02.743660 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1672473-f286-42a5-940f-1017d6437c2a-workload-certs\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:15:02.743847 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:02.743671 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1672473-f286-42a5-940f-1017d6437c2a-istio-envoy\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:15:02.743847 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:02.743680 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1672473-f286-42a5-940f-1017d6437c2a-credential-socket\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:15:02.743847 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:02.743689 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1672473-f286-42a5-940f-1017d6437c2a-istio-podinfo\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:15:02.743847 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:02.743698 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1672473-f286-42a5-940f-1017d6437c2a-istio-token\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:15:02.743847 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:02.743708 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1672473-f286-42a5-940f-1017d6437c2a-istio-data\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:15:02.743847 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:02.743715 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smhf2\" (UniqueName: \"kubernetes.io/projected/b1672473-f286-42a5-940f-1017d6437c2a-kube-api-access-smhf2\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:15:03.013857 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.013770 2555 generic.go:356] "Generic (PLEG): container finished" podID="b1672473-f286-42a5-940f-1017d6437c2a" containerID="c8eb621fb60606aef863a99d70766c0e1d97ecd10aaa3b34a36c9b48987f65f8" exitCode=0 Jul 07 13:15:03.013857 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.013818 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" Jul 07 13:15:03.014049 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.013855 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" event={"ID":"b1672473-f286-42a5-940f-1017d6437c2a","Type":"ContainerDied","Data":"c8eb621fb60606aef863a99d70766c0e1d97ecd10aaa3b34a36c9b48987f65f8"} Jul 07 13:15:03.014049 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.013909 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp" event={"ID":"b1672473-f286-42a5-940f-1017d6437c2a","Type":"ContainerDied","Data":"7acd0aa32d925b6a7db6be47e9e280ad782e2526d5287e05c9325f8dd5e62544"} Jul 07 13:15:03.014049 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.013932 2555 scope.go:117] "RemoveContainer" containerID="c8eb621fb60606aef863a99d70766c0e1d97ecd10aaa3b34a36c9b48987f65f8" Jul 07 13:15:03.023334 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.023317 2555 scope.go:117] "RemoveContainer" containerID="c8eb621fb60606aef863a99d70766c0e1d97ecd10aaa3b34a36c9b48987f65f8" Jul 07 13:15:03.023591 ip-10-0-136-245 kubenswrapper[2555]: E0707 13:15:03.023571 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8eb621fb60606aef863a99d70766c0e1d97ecd10aaa3b34a36c9b48987f65f8\": container with ID starting with c8eb621fb60606aef863a99d70766c0e1d97ecd10aaa3b34a36c9b48987f65f8 not found: ID does not exist" containerID="c8eb621fb60606aef863a99d70766c0e1d97ecd10aaa3b34a36c9b48987f65f8" Jul 07 13:15:03.023680 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.023602 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8eb621fb60606aef863a99d70766c0e1d97ecd10aaa3b34a36c9b48987f65f8"} err="failed to get container status \"c8eb621fb60606aef863a99d70766c0e1d97ecd10aaa3b34a36c9b48987f65f8\": rpc error: code = NotFound desc = could not find container \"c8eb621fb60606aef863a99d70766c0e1d97ecd10aaa3b34a36c9b48987f65f8\": container with ID starting with c8eb621fb60606aef863a99d70766c0e1d97ecd10aaa3b34a36c9b48987f65f8 not found: ID does not exist" Jul 07 13:15:03.038567 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.038542 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp"] Jul 07 13:15:03.047972 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.044440 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-bafec94a-openshift-default-77b787dff7-w7vmp"] Jul 07 13:15:03.307247 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.307157 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:15:03.664081 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.664013 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c"] Jul 07 13:15:03.664416 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.664348 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1672473-f286-42a5-940f-1017d6437c2a" containerName="istio-proxy" Jul 07 13:15:03.664416 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.664358 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1672473-f286-42a5-940f-1017d6437c2a" containerName="istio-proxy" Jul 07 13:15:03.664510 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.664464 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1672473-f286-42a5-940f-1017d6437c2a" containerName="istio-proxy" Jul 07 13:15:03.667461 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.667439 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:03.674980 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.674955 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b0651b4d-openshift-default-dockercfg-6npg7\"" Jul 07 13:15:03.681983 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.681952 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c"] Jul 07 13:15:03.707174 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.707133 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:03.753457 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.753405 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a02351fb-0f31-4873-988a-2a0359ad8b7c-workload-certs\") pod \"e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:03.753587 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.753462 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a02351fb-0f31-4873-988a-2a0359ad8b7c-istio-token\") pod \"e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:03.753587 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.753515 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a02351fb-0f31-4873-988a-2a0359ad8b7c-istio-podinfo\") pod \"e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:03.753587 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.753531 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a02351fb-0f31-4873-988a-2a0359ad8b7c-istio-data\") pod \"e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:03.753587 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.753553 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wrdd\" (UniqueName: \"kubernetes.io/projected/a02351fb-0f31-4873-988a-2a0359ad8b7c-kube-api-access-7wrdd\") pod \"e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:03.753587 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.753578 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a02351fb-0f31-4873-988a-2a0359ad8b7c-istiod-ca-cert\") pod \"e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:03.753751 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.753596 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a02351fb-0f31-4873-988a-2a0359ad8b7c-istio-envoy\") pod \"e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:03.753751 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.753664 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a02351fb-0f31-4873-988a-2a0359ad8b7c-workload-socket\") pod \"e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:03.753751 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.753695 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a02351fb-0f31-4873-988a-2a0359ad8b7c-credential-socket\") pod \"e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:03.778764 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.778728 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:03.825418 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.825385 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1672473-f286-42a5-940f-1017d6437c2a" path="/var/lib/kubelet/pods/b1672473-f286-42a5-940f-1017d6437c2a/volumes" Jul 07 13:15:03.854828 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.854798 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a02351fb-0f31-4873-988a-2a0359ad8b7c-istio-podinfo\") pod \"e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:03.854947 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.854831 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a02351fb-0f31-4873-988a-2a0359ad8b7c-istio-data\") pod \"e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:03.854947 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.854854 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wrdd\" (UniqueName: \"kubernetes.io/projected/a02351fb-0f31-4873-988a-2a0359ad8b7c-kube-api-access-7wrdd\") pod \"e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:03.854947 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.854878 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a02351fb-0f31-4873-988a-2a0359ad8b7c-istiod-ca-cert\") pod \"e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:03.855122 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.855071 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a02351fb-0f31-4873-988a-2a0359ad8b7c-istio-envoy\") pod \"e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:03.855178 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.855152 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a02351fb-0f31-4873-988a-2a0359ad8b7c-workload-socket\") pod \"e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:03.855234 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.855187 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a02351fb-0f31-4873-988a-2a0359ad8b7c-credential-socket\") pod \"e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:03.855285 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.855240 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a02351fb-0f31-4873-988a-2a0359ad8b7c-istio-data\") pod \"e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:03.855285 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.855253 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a02351fb-0f31-4873-988a-2a0359ad8b7c-workload-certs\") pod \"e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:03.855393 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.855302 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a02351fb-0f31-4873-988a-2a0359ad8b7c-istio-token\") pod \"e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:03.855539 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.855515 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a02351fb-0f31-4873-988a-2a0359ad8b7c-workload-socket\") pod \"e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:03.855615 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.855560 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a02351fb-0f31-4873-988a-2a0359ad8b7c-workload-certs\") pod \"e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:03.855685 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.855616 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a02351fb-0f31-4873-988a-2a0359ad8b7c-credential-socket\") pod \"e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:03.855685 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.855660 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a02351fb-0f31-4873-988a-2a0359ad8b7c-istiod-ca-cert\") pod \"e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:03.857184 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.857166 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a02351fb-0f31-4873-988a-2a0359ad8b7c-istio-envoy\") pod \"e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:03.857415 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.857397 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a02351fb-0f31-4873-988a-2a0359ad8b7c-istio-podinfo\") pod \"e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:03.863462 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.863442 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wrdd\" (UniqueName: \"kubernetes.io/projected/a02351fb-0f31-4873-988a-2a0359ad8b7c-kube-api-access-7wrdd\") pod \"e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:03.863820 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.863796 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a02351fb-0f31-4873-988a-2a0359ad8b7c-istio-token\") pod \"e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:03.978636 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:03.978605 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:04.117560 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:04.117533 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c"] Jul 07 13:15:04.119855 ip-10-0-136-245 kubenswrapper[2555]: W0707 13:15:04.119823 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda02351fb_0f31_4873_988a_2a0359ad8b7c.slice/crio-72315d4561bc5fc58d1f9830d2df661e5b50a0e8d4feddfed84d56bb539b7093 WatchSource:0}: Error finding container 72315d4561bc5fc58d1f9830d2df661e5b50a0e8d4feddfed84d56bb539b7093: Status 404 returned error can't find the container with id 72315d4561bc5fc58d1f9830d2df661e5b50a0e8d4feddfed84d56bb539b7093 Jul 07 13:15:04.122126 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:04.122095 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:15:04.122235 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:04.122197 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:15:04.122300 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:04.122249 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:15:04.923637 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:04.923604 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:05.027552 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:05.027523 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" event={"ID":"a02351fb-0f31-4873-988a-2a0359ad8b7c","Type":"ContainerStarted","Data":"312103f4e24284387f865ce26c2be2ede0dd97f0b96fdf9ba6f571037ae13dbd"} Jul 07 13:15:05.027714 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:05.027572 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" event={"ID":"a02351fb-0f31-4873-988a-2a0359ad8b7c","Type":"ContainerStarted","Data":"72315d4561bc5fc58d1f9830d2df661e5b50a0e8d4feddfed84d56bb539b7093"} Jul 07 13:15:05.057528 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:05.057502 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:05.060177 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:05.060138 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" podStartSLOduration=2.060124123 podStartE2EDuration="2.060124123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:15:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:15:05.0599449 +0000 UTC m=+1613.781672414" watchObservedRunningTime="2026-07-07 13:15:05.060124123 +0000 UTC m=+1613.781851688" Jul 07 13:15:05.166157 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:05.166121 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:05.653575 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:05.653543 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:05.780788 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:05.780747 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:05.979493 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:05.979459 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:05.983971 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:05.983947 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:06.032623 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:06.032598 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:06.033418 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:06.033401 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:07.150618 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:07.150588 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:09.907577 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:09.907541 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:10.289260 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:10.289194 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:15.979955 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:15.979924 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c"] Jul 07 13:15:15.980340 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:15.980113 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" podUID="a02351fb-0f31-4873-988a-2a0359ad8b7c" containerName="istio-proxy" containerID="cri-o://312103f4e24284387f865ce26c2be2ede0dd97f0b96fdf9ba6f571037ae13dbd" gracePeriod=30 Jul 07 13:15:16.011340 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:16.011225 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:16.078181 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:16.078151 2555 generic.go:356] "Generic (PLEG): container finished" podID="a02351fb-0f31-4873-988a-2a0359ad8b7c" containerID="312103f4e24284387f865ce26c2be2ede0dd97f0b96fdf9ba6f571037ae13dbd" exitCode=0 Jul 07 13:15:16.078319 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:16.078215 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" event={"ID":"a02351fb-0f31-4873-988a-2a0359ad8b7c","Type":"ContainerDied","Data":"312103f4e24284387f865ce26c2be2ede0dd97f0b96fdf9ba6f571037ae13dbd"} Jul 07 13:15:16.108686 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:16.108658 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:16.116732 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:16.116714 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:16.162466 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:16.162435 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a02351fb-0f31-4873-988a-2a0359ad8b7c-workload-certs\") pod \"a02351fb-0f31-4873-988a-2a0359ad8b7c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " Jul 07 13:15:16.162634 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:16.162489 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a02351fb-0f31-4873-988a-2a0359ad8b7c-istio-podinfo\") pod \"a02351fb-0f31-4873-988a-2a0359ad8b7c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " Jul 07 13:15:16.162634 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:16.162527 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a02351fb-0f31-4873-988a-2a0359ad8b7c-istio-data\") pod \"a02351fb-0f31-4873-988a-2a0359ad8b7c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " Jul 07 13:15:16.162634 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:16.162557 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a02351fb-0f31-4873-988a-2a0359ad8b7c-istio-envoy\") pod \"a02351fb-0f31-4873-988a-2a0359ad8b7c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " Jul 07 13:15:16.162634 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:16.162585 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a02351fb-0f31-4873-988a-2a0359ad8b7c-credential-socket\") pod \"a02351fb-0f31-4873-988a-2a0359ad8b7c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " Jul 07 13:15:16.162634 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:16.162630 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a02351fb-0f31-4873-988a-2a0359ad8b7c-workload-socket\") pod \"a02351fb-0f31-4873-988a-2a0359ad8b7c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " Jul 07 13:15:16.162906 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:16.162653 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a02351fb-0f31-4873-988a-2a0359ad8b7c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a02351fb-0f31-4873-988a-2a0359ad8b7c" (UID: "a02351fb-0f31-4873-988a-2a0359ad8b7c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:15:16.162906 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:16.162701 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a02351fb-0f31-4873-988a-2a0359ad8b7c-istio-token\") pod \"a02351fb-0f31-4873-988a-2a0359ad8b7c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " Jul 07 13:15:16.162906 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:16.162747 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a02351fb-0f31-4873-988a-2a0359ad8b7c-istiod-ca-cert\") pod \"a02351fb-0f31-4873-988a-2a0359ad8b7c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " Jul 07 13:15:16.162906 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:16.162804 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wrdd\" (UniqueName: \"kubernetes.io/projected/a02351fb-0f31-4873-988a-2a0359ad8b7c-kube-api-access-7wrdd\") pod \"a02351fb-0f31-4873-988a-2a0359ad8b7c\" (UID: \"a02351fb-0f31-4873-988a-2a0359ad8b7c\") " Jul 07 13:15:16.162906 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:16.162882 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a02351fb-0f31-4873-988a-2a0359ad8b7c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a02351fb-0f31-4873-988a-2a0359ad8b7c" (UID: "a02351fb-0f31-4873-988a-2a0359ad8b7c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:15:16.163170 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:16.163121 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a02351fb-0f31-4873-988a-2a0359ad8b7c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a02351fb-0f31-4873-988a-2a0359ad8b7c" (UID: "a02351fb-0f31-4873-988a-2a0359ad8b7c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:15:16.163170 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:16.163136 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a02351fb-0f31-4873-988a-2a0359ad8b7c-credential-socket\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:15:16.163170 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:16.163154 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a02351fb-0f31-4873-988a-2a0359ad8b7c-workload-certs\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:15:16.163461 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:16.163434 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a02351fb-0f31-4873-988a-2a0359ad8b7c-istio-data" (OuterVolumeSpecName: "istio-data") pod "a02351fb-0f31-4873-988a-2a0359ad8b7c" (UID: "a02351fb-0f31-4873-988a-2a0359ad8b7c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:15:16.163552 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:16.163444 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a02351fb-0f31-4873-988a-2a0359ad8b7c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a02351fb-0f31-4873-988a-2a0359ad8b7c" (UID: "a02351fb-0f31-4873-988a-2a0359ad8b7c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:15:16.165284 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:16.165263 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a02351fb-0f31-4873-988a-2a0359ad8b7c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a02351fb-0f31-4873-988a-2a0359ad8b7c" (UID: "a02351fb-0f31-4873-988a-2a0359ad8b7c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:15:16.165477 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:16.165396 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a02351fb-0f31-4873-988a-2a0359ad8b7c-kube-api-access-7wrdd" (OuterVolumeSpecName: "kube-api-access-7wrdd") pod "a02351fb-0f31-4873-988a-2a0359ad8b7c" (UID: "a02351fb-0f31-4873-988a-2a0359ad8b7c"). InnerVolumeSpecName "kube-api-access-7wrdd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:15:16.165477 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:16.165449 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a02351fb-0f31-4873-988a-2a0359ad8b7c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a02351fb-0f31-4873-988a-2a0359ad8b7c" (UID: "a02351fb-0f31-4873-988a-2a0359ad8b7c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 13:15:16.165477 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:16.165457 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a02351fb-0f31-4873-988a-2a0359ad8b7c-istio-token" (OuterVolumeSpecName: "istio-token") pod "a02351fb-0f31-4873-988a-2a0359ad8b7c" (UID: "a02351fb-0f31-4873-988a-2a0359ad8b7c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:15:16.264201 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:16.264171 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wrdd\" (UniqueName: \"kubernetes.io/projected/a02351fb-0f31-4873-988a-2a0359ad8b7c-kube-api-access-7wrdd\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:15:16.264201 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:16.264198 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a02351fb-0f31-4873-988a-2a0359ad8b7c-istio-podinfo\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:15:16.264352 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:16.264207 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a02351fb-0f31-4873-988a-2a0359ad8b7c-istio-data\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:15:16.264352 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:16.264217 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a02351fb-0f31-4873-988a-2a0359ad8b7c-istio-envoy\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:15:16.264352 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:16.264225 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a02351fb-0f31-4873-988a-2a0359ad8b7c-workload-socket\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:15:16.264352 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:16.264235 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a02351fb-0f31-4873-988a-2a0359ad8b7c-istio-token\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:15:16.264352 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:16.264243 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a02351fb-0f31-4873-988a-2a0359ad8b7c-istiod-ca-cert\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:15:17.083437 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:17.083399 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" Jul 07 13:15:17.083882 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:17.083456 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c" event={"ID":"a02351fb-0f31-4873-988a-2a0359ad8b7c","Type":"ContainerDied","Data":"72315d4561bc5fc58d1f9830d2df661e5b50a0e8d4feddfed84d56bb539b7093"} Jul 07 13:15:17.083882 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:17.083516 2555 scope.go:117] "RemoveContainer" containerID="312103f4e24284387f865ce26c2be2ede0dd97f0b96fdf9ba6f571037ae13dbd" Jul 07 13:15:17.106029 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:17.106009 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c"] Jul 07 13:15:17.113300 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:17.113281 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b0651b4d-openshift-default-77dd7bdf5f-bh79c"] Jul 07 13:15:17.482339 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:17.482307 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:17.825594 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:17.825558 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a02351fb-0f31-4873-988a-2a0359ad8b7c" path="/var/lib/kubelet/pods/a02351fb-0f31-4873-988a-2a0359ad8b7c/volumes" Jul 07 13:15:22.246362 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.246315 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:22.386105 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.386075 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:22.411067 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.411030 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s"] Jul 07 13:15:22.411409 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.411394 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a02351fb-0f31-4873-988a-2a0359ad8b7c" containerName="istio-proxy" Jul 07 13:15:22.411608 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.411410 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a02351fb-0f31-4873-988a-2a0359ad8b7c" containerName="istio-proxy" Jul 07 13:15:22.411608 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.411497 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="a02351fb-0f31-4873-988a-2a0359ad8b7c" containerName="istio-proxy" Jul 07 13:15:22.414597 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.414577 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:22.418376 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.418357 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-34ce5f66-openshift-default-dockercfg-tjdxt\"" Jul 07 13:15:22.430604 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.430578 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s"] Jul 07 13:15:22.489063 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.489032 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:22.520831 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.520759 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71477eaf-80dd-473b-8e3d-e6387d57449f-workload-socket\") pod \"e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:22.520831 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.520796 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71477eaf-80dd-473b-8e3d-e6387d57449f-istio-token\") pod \"e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:22.520981 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.520847 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71477eaf-80dd-473b-8e3d-e6387d57449f-istio-podinfo\") pod \"e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:22.520981 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.520873 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71477eaf-80dd-473b-8e3d-e6387d57449f-credential-socket\") pod \"e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:22.520981 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.520904 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71477eaf-80dd-473b-8e3d-e6387d57449f-istio-envoy\") pod \"e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:22.520981 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.520929 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71477eaf-80dd-473b-8e3d-e6387d57449f-istiod-ca-cert\") pod \"e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:22.521123 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.521006 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c74nf\" (UniqueName: \"kubernetes.io/projected/71477eaf-80dd-473b-8e3d-e6387d57449f-kube-api-access-c74nf\") pod \"e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:22.521123 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.521027 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71477eaf-80dd-473b-8e3d-e6387d57449f-workload-certs\") pod \"e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:22.521123 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.521079 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71477eaf-80dd-473b-8e3d-e6387d57449f-istio-data\") pod \"e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:22.583617 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.583587 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:22.621855 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.621824 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c74nf\" (UniqueName: \"kubernetes.io/projected/71477eaf-80dd-473b-8e3d-e6387d57449f-kube-api-access-c74nf\") pod \"e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:22.621989 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.621863 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71477eaf-80dd-473b-8e3d-e6387d57449f-workload-certs\") pod \"e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:22.621989 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.621924 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71477eaf-80dd-473b-8e3d-e6387d57449f-istio-data\") pod \"e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:22.621989 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.621970 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71477eaf-80dd-473b-8e3d-e6387d57449f-workload-socket\") pod \"e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:22.622158 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.621999 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71477eaf-80dd-473b-8e3d-e6387d57449f-istio-token\") pod \"e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:22.622158 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.622029 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71477eaf-80dd-473b-8e3d-e6387d57449f-istio-podinfo\") pod \"e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:22.622158 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.622059 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71477eaf-80dd-473b-8e3d-e6387d57449f-credential-socket\") pod \"e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:22.622158 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.622088 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71477eaf-80dd-473b-8e3d-e6387d57449f-istio-envoy\") pod \"e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:22.622158 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.622113 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71477eaf-80dd-473b-8e3d-e6387d57449f-istiod-ca-cert\") pod \"e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:22.622408 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.622361 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71477eaf-80dd-473b-8e3d-e6387d57449f-istio-data\") pod \"e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:22.622408 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.622385 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71477eaf-80dd-473b-8e3d-e6387d57449f-workload-certs\") pod \"e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:22.622563 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.622486 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71477eaf-80dd-473b-8e3d-e6387d57449f-workload-socket\") pod \"e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:22.622563 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.622530 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71477eaf-80dd-473b-8e3d-e6387d57449f-credential-socket\") pod \"e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:22.622822 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.622805 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71477eaf-80dd-473b-8e3d-e6387d57449f-istiod-ca-cert\") pod \"e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:22.624533 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.624499 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71477eaf-80dd-473b-8e3d-e6387d57449f-istio-envoy\") pod \"e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:22.624635 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.624582 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71477eaf-80dd-473b-8e3d-e6387d57449f-istio-podinfo\") pod \"e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:22.631249 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.631228 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71477eaf-80dd-473b-8e3d-e6387d57449f-istio-token\") pod \"e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:22.631355 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.631249 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c74nf\" (UniqueName: \"kubernetes.io/projected/71477eaf-80dd-473b-8e3d-e6387d57449f-kube-api-access-c74nf\") pod \"e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:22.725141 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.725113 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:22.867387 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.867362 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s"] Jul 07 13:15:22.870022 ip-10-0-136-245 kubenswrapper[2555]: W0707 13:15:22.869995 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71477eaf_80dd_473b_8e3d_e6387d57449f.slice/crio-71a40513afdfa988874e77eff70803e04d70469c71623d7ffeb624327fc6e258 WatchSource:0}: Error finding container 71a40513afdfa988874e77eff70803e04d70469c71623d7ffeb624327fc6e258: Status 404 returned error can't find the container with id 71a40513afdfa988874e77eff70803e04d70469c71623d7ffeb624327fc6e258 Jul 07 13:15:22.872676 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.872645 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:15:22.872766 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.872709 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:15:22.872766 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:22.872741 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:15:23.115585 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:23.115505 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" event={"ID":"71477eaf-80dd-473b-8e3d-e6387d57449f","Type":"ContainerStarted","Data":"0deedf48738c0226496f1e9524fe11730e66b33f64689a67b25133a7d44d57ba"} Jul 07 13:15:23.115585 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:23.115561 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" event={"ID":"71477eaf-80dd-473b-8e3d-e6387d57449f","Type":"ContainerStarted","Data":"71a40513afdfa988874e77eff70803e04d70469c71623d7ffeb624327fc6e258"} Jul 07 13:15:23.136246 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:23.136195 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" podStartSLOduration=1.13617937 podStartE2EDuration="1.13617937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:15:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:15:23.135365934 +0000 UTC m=+1631.857093448" watchObservedRunningTime="2026-07-07 13:15:23.13617937 +0000 UTC m=+1631.857906861" Jul 07 13:15:23.568577 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:23.568546 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:23.673852 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:23.673824 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:23.725933 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:23.725907 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:23.730512 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:23.730492 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:23.891483 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:23.891362 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:24.119774 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:24.119741 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:24.120660 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:24.120636 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:24.207475 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:24.207446 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:24.412682 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:24.412656 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:24.513582 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:24.513549 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:25.727183 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:25.727155 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:26.899979 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:26.899945 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:15:28.005121 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:28.005092 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:28.188538 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:28.188489 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s"] Jul 07 13:15:28.188786 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:28.188754 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" podUID="71477eaf-80dd-473b-8e3d-e6387d57449f" containerName="istio-proxy" containerID="cri-o://0deedf48738c0226496f1e9524fe11730e66b33f64689a67b25133a7d44d57ba" gracePeriod=30 Jul 07 13:15:28.435235 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:28.435131 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:28.504835 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:28.504801 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:29.922675 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:29.922645 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:34.034358 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:34.034323 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:34.135031 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:34.135000 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:34.550311 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:34.550280 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:34.694753 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:34.694726 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:34.809266 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:34.809242 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:34.939626 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:34.939603 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:35.038443 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.038394 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71477eaf-80dd-473b-8e3d-e6387d57449f-workload-socket\") pod \"71477eaf-80dd-473b-8e3d-e6387d57449f\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " Jul 07 13:15:35.038443 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.038445 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71477eaf-80dd-473b-8e3d-e6387d57449f-istio-token\") pod \"71477eaf-80dd-473b-8e3d-e6387d57449f\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " Jul 07 13:15:35.038933 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.038485 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71477eaf-80dd-473b-8e3d-e6387d57449f-workload-certs\") pod \"71477eaf-80dd-473b-8e3d-e6387d57449f\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " Jul 07 13:15:35.038933 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.038506 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71477eaf-80dd-473b-8e3d-e6387d57449f-istiod-ca-cert\") pod \"71477eaf-80dd-473b-8e3d-e6387d57449f\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " Jul 07 13:15:35.038933 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.038524 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71477eaf-80dd-473b-8e3d-e6387d57449f-istio-data\") pod \"71477eaf-80dd-473b-8e3d-e6387d57449f\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " Jul 07 13:15:35.038933 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.038566 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c74nf\" (UniqueName: \"kubernetes.io/projected/71477eaf-80dd-473b-8e3d-e6387d57449f-kube-api-access-c74nf\") pod \"71477eaf-80dd-473b-8e3d-e6387d57449f\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " Jul 07 13:15:35.038933 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.038590 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71477eaf-80dd-473b-8e3d-e6387d57449f-credential-socket\") pod \"71477eaf-80dd-473b-8e3d-e6387d57449f\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " Jul 07 13:15:35.038933 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.038615 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71477eaf-80dd-473b-8e3d-e6387d57449f-istio-envoy\") pod \"71477eaf-80dd-473b-8e3d-e6387d57449f\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " Jul 07 13:15:35.038933 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.038656 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71477eaf-80dd-473b-8e3d-e6387d57449f-istio-podinfo\") pod \"71477eaf-80dd-473b-8e3d-e6387d57449f\" (UID: \"71477eaf-80dd-473b-8e3d-e6387d57449f\") " Jul 07 13:15:35.038933 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.038640 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71477eaf-80dd-473b-8e3d-e6387d57449f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "71477eaf-80dd-473b-8e3d-e6387d57449f" (UID: "71477eaf-80dd-473b-8e3d-e6387d57449f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:15:35.038933 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.038803 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71477eaf-80dd-473b-8e3d-e6387d57449f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "71477eaf-80dd-473b-8e3d-e6387d57449f" (UID: "71477eaf-80dd-473b-8e3d-e6387d57449f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:15:35.038933 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.038931 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71477eaf-80dd-473b-8e3d-e6387d57449f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "71477eaf-80dd-473b-8e3d-e6387d57449f" (UID: "71477eaf-80dd-473b-8e3d-e6387d57449f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:15:35.039387 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.039081 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71477eaf-80dd-473b-8e3d-e6387d57449f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "71477eaf-80dd-473b-8e3d-e6387d57449f" (UID: "71477eaf-80dd-473b-8e3d-e6387d57449f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:15:35.039608 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.039580 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71477eaf-80dd-473b-8e3d-e6387d57449f-istio-data" (OuterVolumeSpecName: "istio-data") pod "71477eaf-80dd-473b-8e3d-e6387d57449f" (UID: "71477eaf-80dd-473b-8e3d-e6387d57449f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:15:35.040842 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.040806 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71477eaf-80dd-473b-8e3d-e6387d57449f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "71477eaf-80dd-473b-8e3d-e6387d57449f" (UID: "71477eaf-80dd-473b-8e3d-e6387d57449f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:15:35.040842 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.040813 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/71477eaf-80dd-473b-8e3d-e6387d57449f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "71477eaf-80dd-473b-8e3d-e6387d57449f" (UID: "71477eaf-80dd-473b-8e3d-e6387d57449f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 13:15:35.041074 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.041053 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71477eaf-80dd-473b-8e3d-e6387d57449f-istio-token" (OuterVolumeSpecName: "istio-token") pod "71477eaf-80dd-473b-8e3d-e6387d57449f" (UID: "71477eaf-80dd-473b-8e3d-e6387d57449f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:15:35.041117 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.041065 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71477eaf-80dd-473b-8e3d-e6387d57449f-kube-api-access-c74nf" (OuterVolumeSpecName: "kube-api-access-c74nf") pod "71477eaf-80dd-473b-8e3d-e6387d57449f" (UID: "71477eaf-80dd-473b-8e3d-e6387d57449f"). InnerVolumeSpecName "kube-api-access-c74nf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:15:35.139940 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.139883 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71477eaf-80dd-473b-8e3d-e6387d57449f-workload-certs\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:15:35.139940 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.139904 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71477eaf-80dd-473b-8e3d-e6387d57449f-istiod-ca-cert\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:15:35.139940 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.139912 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71477eaf-80dd-473b-8e3d-e6387d57449f-istio-data\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:15:35.139940 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.139922 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c74nf\" (UniqueName: \"kubernetes.io/projected/71477eaf-80dd-473b-8e3d-e6387d57449f-kube-api-access-c74nf\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:15:35.139940 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.139930 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71477eaf-80dd-473b-8e3d-e6387d57449f-credential-socket\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:15:35.139940 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.139938 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71477eaf-80dd-473b-8e3d-e6387d57449f-istio-envoy\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:15:35.140187 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.139946 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71477eaf-80dd-473b-8e3d-e6387d57449f-istio-podinfo\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:15:35.140187 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.139954 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71477eaf-80dd-473b-8e3d-e6387d57449f-workload-socket\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:15:35.140187 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.139963 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71477eaf-80dd-473b-8e3d-e6387d57449f-istio-token\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:15:35.169437 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.169402 2555 generic.go:356] "Generic (PLEG): container finished" podID="71477eaf-80dd-473b-8e3d-e6387d57449f" containerID="0deedf48738c0226496f1e9524fe11730e66b33f64689a67b25133a7d44d57ba" exitCode=0 Jul 07 13:15:35.169531 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.169467 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" Jul 07 13:15:35.169531 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.169484 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" event={"ID":"71477eaf-80dd-473b-8e3d-e6387d57449f","Type":"ContainerDied","Data":"0deedf48738c0226496f1e9524fe11730e66b33f64689a67b25133a7d44d57ba"} Jul 07 13:15:35.169603 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.169540 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s" event={"ID":"71477eaf-80dd-473b-8e3d-e6387d57449f","Type":"ContainerDied","Data":"71a40513afdfa988874e77eff70803e04d70469c71623d7ffeb624327fc6e258"} Jul 07 13:15:35.169603 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.169564 2555 scope.go:117] "RemoveContainer" containerID="0deedf48738c0226496f1e9524fe11730e66b33f64689a67b25133a7d44d57ba" Jul 07 13:15:35.177956 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.177940 2555 scope.go:117] "RemoveContainer" containerID="0deedf48738c0226496f1e9524fe11730e66b33f64689a67b25133a7d44d57ba" Jul 07 13:15:35.178189 ip-10-0-136-245 kubenswrapper[2555]: E0707 13:15:35.178171 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0deedf48738c0226496f1e9524fe11730e66b33f64689a67b25133a7d44d57ba\": container with ID starting with 0deedf48738c0226496f1e9524fe11730e66b33f64689a67b25133a7d44d57ba not found: ID does not exist" containerID="0deedf48738c0226496f1e9524fe11730e66b33f64689a67b25133a7d44d57ba" Jul 07 13:15:35.178241 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.178196 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0deedf48738c0226496f1e9524fe11730e66b33f64689a67b25133a7d44d57ba"} err="failed to get container status \"0deedf48738c0226496f1e9524fe11730e66b33f64689a67b25133a7d44d57ba\": rpc error: code = NotFound desc = could not find container \"0deedf48738c0226496f1e9524fe11730e66b33f64689a67b25133a7d44d57ba\": container with ID starting with 0deedf48738c0226496f1e9524fe11730e66b33f64689a67b25133a7d44d57ba not found: ID does not exist" Jul 07 13:15:35.194101 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.194079 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s"] Jul 07 13:15:35.199999 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.199979 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-34ce5f66-openshift-default-797fb6b887-27v6s"] Jul 07 13:15:35.497403 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.497371 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:15:35.630961 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.630930 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:35.826913 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:35.826837 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71477eaf-80dd-473b-8e3d-e6387d57449f" path="/var/lib/kubelet/pods/71477eaf-80dd-473b-8e3d-e6387d57449f/volumes" Jul 07 13:15:36.148670 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:36.148595 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:41.933026 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:41.932995 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:42.001069 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:42.001035 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:42.092877 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:42.092838 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:42.191125 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:42.191053 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:42.291051 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:42.291019 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:42.721106 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:42.721071 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:57.445225 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:57.445185 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:15:57.521829 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:15:57.521800 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:16:08.610129 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:16:08.610093 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:16:14.628304 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:16:14.628268 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:16:14.747386 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:16:14.747360 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:16:14.947013 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:16:14.946928 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:16:30.821826 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:16:30.821790 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:16:36.890960 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:16:36.890888 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:16:36.990602 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:16:36.990565 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:16:37.111546 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:16:37.111510 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:16:47.730785 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:16:47.730751 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:16:48.991564 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:16:48.991528 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:16:54.494121 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:16:54.494076 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:16:54.600177 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:16:54.600148 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:16:54.694443 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:16:54.694393 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:16:54.795779 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:16:54.795703 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:16:55.738771 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:16:55.738739 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:16:55.903072 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:16:55.903045 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:16:56.058856 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:16:56.058779 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:16:57.094393 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:16:57.094359 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:16:57.890880 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:16:57.890847 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:04.141793 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:04.141762 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:04.239816 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:04.239781 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:04.807800 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:04.807769 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:17:04.923320 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:04.923289 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:11.239276 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:11.239239 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:11.342364 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:11.342335 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:11.527613 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:11.527533 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:11.865360 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:11.865281 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl"] Jul 07 13:17:11.865700 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:11.865683 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71477eaf-80dd-473b-8e3d-e6387d57449f" containerName="istio-proxy" Jul 07 13:17:11.865758 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:11.865702 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="71477eaf-80dd-473b-8e3d-e6387d57449f" containerName="istio-proxy" Jul 07 13:17:11.865796 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:11.865772 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="71477eaf-80dd-473b-8e3d-e6387d57449f" containerName="istio-proxy" Jul 07 13:17:11.867818 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:11.867802 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:11.870839 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:11.870818 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-d75b40cf-openshift-default-dockercfg-rb969\"" Jul 07 13:17:11.900166 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:11.900143 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl"] Jul 07 13:17:11.906129 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:11.906108 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:11.931333 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:11.931312 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7438bf47-f5db-43cd-9b37-7de99a21ca72-workload-certs\") pod \"e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:11.931465 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:11.931354 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7438bf47-f5db-43cd-9b37-7de99a21ca72-credential-socket\") pod \"e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:11.931465 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:11.931376 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7438bf47-f5db-43cd-9b37-7de99a21ca72-istio-envoy\") pod \"e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:11.931465 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:11.931405 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7438bf47-f5db-43cd-9b37-7de99a21ca72-istio-podinfo\") pod \"e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:11.931465 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:11.931441 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r488n\" (UniqueName: \"kubernetes.io/projected/7438bf47-f5db-43cd-9b37-7de99a21ca72-kube-api-access-r488n\") pod \"e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:11.931640 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:11.931473 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7438bf47-f5db-43cd-9b37-7de99a21ca72-workload-socket\") pod \"e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:11.931640 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:11.931525 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7438bf47-f5db-43cd-9b37-7de99a21ca72-istio-token\") pod \"e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:11.931640 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:11.931552 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7438bf47-f5db-43cd-9b37-7de99a21ca72-istiod-ca-cert\") pod \"e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:11.931640 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:11.931597 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7438bf47-f5db-43cd-9b37-7de99a21ca72-istio-data\") pod \"e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:12.032526 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:12.032493 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7438bf47-f5db-43cd-9b37-7de99a21ca72-credential-socket\") pod \"e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:12.032526 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:12.032530 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7438bf47-f5db-43cd-9b37-7de99a21ca72-istio-envoy\") pod \"e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:12.032762 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:12.032552 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7438bf47-f5db-43cd-9b37-7de99a21ca72-istio-podinfo\") pod \"e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:12.032762 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:12.032568 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r488n\" (UniqueName: \"kubernetes.io/projected/7438bf47-f5db-43cd-9b37-7de99a21ca72-kube-api-access-r488n\") pod \"e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:12.032762 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:12.032586 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7438bf47-f5db-43cd-9b37-7de99a21ca72-workload-socket\") pod \"e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:12.032762 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:12.032609 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7438bf47-f5db-43cd-9b37-7de99a21ca72-istio-token\") pod \"e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:12.032762 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:12.032633 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7438bf47-f5db-43cd-9b37-7de99a21ca72-istiod-ca-cert\") pod \"e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:12.032762 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:12.032693 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7438bf47-f5db-43cd-9b37-7de99a21ca72-istio-data\") pod \"e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:12.032762 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:12.032753 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7438bf47-f5db-43cd-9b37-7de99a21ca72-workload-certs\") pod \"e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:12.033109 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:12.032943 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7438bf47-f5db-43cd-9b37-7de99a21ca72-credential-socket\") pod \"e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:12.033109 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:12.033007 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7438bf47-f5db-43cd-9b37-7de99a21ca72-workload-socket\") pod \"e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:12.033109 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:12.033092 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7438bf47-f5db-43cd-9b37-7de99a21ca72-workload-certs\") pod \"e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:12.033227 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:12.033127 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7438bf47-f5db-43cd-9b37-7de99a21ca72-istio-data\") pod \"e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:12.033367 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:12.033347 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7438bf47-f5db-43cd-9b37-7de99a21ca72-istiod-ca-cert\") pod \"e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:12.034936 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:12.034907 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7438bf47-f5db-43cd-9b37-7de99a21ca72-istio-podinfo\") pod \"e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:12.035064 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:12.034938 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7438bf47-f5db-43cd-9b37-7de99a21ca72-istio-envoy\") pod \"e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:12.041408 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:12.041387 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7438bf47-f5db-43cd-9b37-7de99a21ca72-istio-token\") pod \"e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:12.041621 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:12.041603 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r488n\" (UniqueName: \"kubernetes.io/projected/7438bf47-f5db-43cd-9b37-7de99a21ca72-kube-api-access-r488n\") pod \"e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:12.061127 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:12.061103 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:12.180224 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:12.180146 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:12.318508 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:12.318479 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl"] Jul 07 13:17:12.320465 ip-10-0-136-245 kubenswrapper[2555]: W0707 13:17:12.320438 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7438bf47_f5db_43cd_9b37_7de99a21ca72.slice/crio-0210c64d42578b31899483c8803b56180fc4a2f63633342842429d3ce47b1e21 WatchSource:0}: Error finding container 0210c64d42578b31899483c8803b56180fc4a2f63633342842429d3ce47b1e21: Status 404 returned error can't find the container with id 0210c64d42578b31899483c8803b56180fc4a2f63633342842429d3ce47b1e21 Jul 07 13:17:12.322722 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:12.322686 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:17:12.322814 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:12.322767 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:17:12.322854 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:12.322817 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:17:12.606227 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:12.606179 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" event={"ID":"7438bf47-f5db-43cd-9b37-7de99a21ca72","Type":"ContainerStarted","Data":"7e24fbff8af0e6b1ed454eb46f6acd7a99479ee287f3fbece47bcee7f94eb597"} Jul 07 13:17:12.606470 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:12.606255 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" event={"ID":"7438bf47-f5db-43cd-9b37-7de99a21ca72","Type":"ContainerStarted","Data":"0210c64d42578b31899483c8803b56180fc4a2f63633342842429d3ce47b1e21"} Jul 07 13:17:12.628348 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:12.628302 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" podStartSLOduration=1.628286495 podStartE2EDuration="1.628286495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:17:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:17:12.627712253 +0000 UTC m=+1741.349439767" watchObservedRunningTime="2026-07-07 13:17:12.628286495 +0000 UTC m=+1741.350014007" Jul 07 13:17:12.689800 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:12.689772 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:17:13.180655 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:13.180623 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:13.185483 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:13.185455 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:13.611704 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:13.611675 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:13.612733 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:13.612714 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:14.912227 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:14.912184 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:15.017335 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:15.017304 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:15.170918 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:15.170834 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:15.384403 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:15.384370 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:15.771067 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:15.771038 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:15.863502 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:15.863468 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:19.396990 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:19.396957 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:20.140358 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:20.140325 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:20.226116 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:20.226090 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:20.559159 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:20.559124 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:24.300471 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:24.300439 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:17:25.667288 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:25.667213 2555 generic.go:356] "Generic (PLEG): container finished" podID="7438bf47-f5db-43cd-9b37-7de99a21ca72" containerID="7e24fbff8af0e6b1ed454eb46f6acd7a99479ee287f3fbece47bcee7f94eb597" exitCode=0 Jul 07 13:17:25.667701 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:25.667288 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" event={"ID":"7438bf47-f5db-43cd-9b37-7de99a21ca72","Type":"ContainerDied","Data":"7e24fbff8af0e6b1ed454eb46f6acd7a99479ee287f3fbece47bcee7f94eb597"} Jul 07 13:17:25.667701 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:25.667650 2555 scope.go:117] "RemoveContainer" containerID="7e24fbff8af0e6b1ed454eb46f6acd7a99479ee287f3fbece47bcee7f94eb597" Jul 07 13:17:25.668588 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:25.668554 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:17:25.668694 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:25.668623 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:17:25.668694 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:25.668679 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:17:26.476533 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:26.476443 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:26.577345 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:26.577283 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:26.676791 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:26.676747 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" event={"ID":"7438bf47-f5db-43cd-9b37-7de99a21ca72","Type":"ContainerStarted","Data":"958986aa650bc298107ffc76607bbf9a91786967a60a5286b4b0620be63ba2bd"} Jul 07 13:17:26.895487 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:26.895382 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:27.181162 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:27.181075 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:27.182290 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:27.182261 2555 patch_prober.go:28] interesting pod/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 07 13:17:27.182522 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:27.182488 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" podUID="7438bf47-f5db-43cd-9b37-7de99a21ca72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 07 13:17:27.260436 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:27.260404 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:27.359846 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:27.359810 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:28.181326 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:28.181289 2555 patch_prober.go:28] interesting pod/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 07 13:17:28.181952 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:28.181919 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" podUID="7438bf47-f5db-43cd-9b37-7de99a21ca72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 07 13:17:28.612540 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:28.612506 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:29.181154 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:29.181111 2555 patch_prober.go:28] interesting pod/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 07 13:17:29.181366 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:29.181177 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" podUID="7438bf47-f5db-43cd-9b37-7de99a21ca72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 07 13:17:30.181542 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:30.181507 2555 patch_prober.go:28] interesting pod/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 07 13:17:30.182159 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:30.182127 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" podUID="7438bf47-f5db-43cd-9b37-7de99a21ca72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 07 13:17:30.899236 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:30.899206 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:17:31.184447 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:31.184352 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:31.185450 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:31.185415 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:33.481583 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:33.481552 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:33.563802 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:33.563767 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:33.747350 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:33.747264 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl"] Jul 07 13:17:33.747534 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:33.747500 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" podUID="7438bf47-f5db-43cd-9b37-7de99a21ca72" containerName="istio-proxy" containerID="cri-o://958986aa650bc298107ffc76607bbf9a91786967a60a5286b4b0620be63ba2bd" gracePeriod=30 Jul 07 13:17:33.776135 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:33.776101 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:34.027983 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:34.027896 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:34.164578 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:34.164540 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:34.262529 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:34.262499 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:34.417652 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:34.417563 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:39.003397 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.003373 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:39.078222 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.078150 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7438bf47-f5db-43cd-9b37-7de99a21ca72-workload-socket\") pod \"7438bf47-f5db-43cd-9b37-7de99a21ca72\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " Jul 07 13:17:39.078222 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.078184 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7438bf47-f5db-43cd-9b37-7de99a21ca72-workload-certs\") pod \"7438bf47-f5db-43cd-9b37-7de99a21ca72\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " Jul 07 13:17:39.078222 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.078205 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7438bf47-f5db-43cd-9b37-7de99a21ca72-istio-token\") pod \"7438bf47-f5db-43cd-9b37-7de99a21ca72\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " Jul 07 13:17:39.078468 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.078247 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7438bf47-f5db-43cd-9b37-7de99a21ca72-credential-socket\") pod \"7438bf47-f5db-43cd-9b37-7de99a21ca72\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " Jul 07 13:17:39.078468 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.078291 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r488n\" (UniqueName: \"kubernetes.io/projected/7438bf47-f5db-43cd-9b37-7de99a21ca72-kube-api-access-r488n\") pod \"7438bf47-f5db-43cd-9b37-7de99a21ca72\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " Jul 07 13:17:39.078468 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.078341 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7438bf47-f5db-43cd-9b37-7de99a21ca72-istiod-ca-cert\") pod \"7438bf47-f5db-43cd-9b37-7de99a21ca72\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " Jul 07 13:17:39.078468 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.078460 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7438bf47-f5db-43cd-9b37-7de99a21ca72-istio-envoy\") pod \"7438bf47-f5db-43cd-9b37-7de99a21ca72\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " Jul 07 13:17:39.078692 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.078469 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7438bf47-f5db-43cd-9b37-7de99a21ca72-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7438bf47-f5db-43cd-9b37-7de99a21ca72" (UID: "7438bf47-f5db-43cd-9b37-7de99a21ca72"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:17:39.078692 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.078497 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7438bf47-f5db-43cd-9b37-7de99a21ca72-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7438bf47-f5db-43cd-9b37-7de99a21ca72" (UID: "7438bf47-f5db-43cd-9b37-7de99a21ca72"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:17:39.078692 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.078510 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7438bf47-f5db-43cd-9b37-7de99a21ca72-istio-podinfo\") pod \"7438bf47-f5db-43cd-9b37-7de99a21ca72\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " Jul 07 13:17:39.078692 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.078608 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7438bf47-f5db-43cd-9b37-7de99a21ca72-istio-data\") pod \"7438bf47-f5db-43cd-9b37-7de99a21ca72\" (UID: \"7438bf47-f5db-43cd-9b37-7de99a21ca72\") " Jul 07 13:17:39.078692 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.078616 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7438bf47-f5db-43cd-9b37-7de99a21ca72-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7438bf47-f5db-43cd-9b37-7de99a21ca72" (UID: "7438bf47-f5db-43cd-9b37-7de99a21ca72"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:17:39.078949 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.078927 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7438bf47-f5db-43cd-9b37-7de99a21ca72-workload-socket\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:17:39.078949 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.078948 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7438bf47-f5db-43cd-9b37-7de99a21ca72-workload-certs\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:17:39.079057 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.078963 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7438bf47-f5db-43cd-9b37-7de99a21ca72-credential-socket\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:17:39.079110 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.079051 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7438bf47-f5db-43cd-9b37-7de99a21ca72-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7438bf47-f5db-43cd-9b37-7de99a21ca72" (UID: "7438bf47-f5db-43cd-9b37-7de99a21ca72"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:17:39.079495 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.079473 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7438bf47-f5db-43cd-9b37-7de99a21ca72-istio-data" (OuterVolumeSpecName: "istio-data") pod "7438bf47-f5db-43cd-9b37-7de99a21ca72" (UID: "7438bf47-f5db-43cd-9b37-7de99a21ca72"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:17:39.080554 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.080519 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7438bf47-f5db-43cd-9b37-7de99a21ca72-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7438bf47-f5db-43cd-9b37-7de99a21ca72" (UID: "7438bf47-f5db-43cd-9b37-7de99a21ca72"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:17:39.080554 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.080521 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7438bf47-f5db-43cd-9b37-7de99a21ca72-kube-api-access-r488n" (OuterVolumeSpecName: "kube-api-access-r488n") pod "7438bf47-f5db-43cd-9b37-7de99a21ca72" (UID: "7438bf47-f5db-43cd-9b37-7de99a21ca72"). InnerVolumeSpecName "kube-api-access-r488n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:17:39.080851 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.080825 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7438bf47-f5db-43cd-9b37-7de99a21ca72-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7438bf47-f5db-43cd-9b37-7de99a21ca72" (UID: "7438bf47-f5db-43cd-9b37-7de99a21ca72"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 13:17:39.080851 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.080825 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7438bf47-f5db-43cd-9b37-7de99a21ca72-istio-token" (OuterVolumeSpecName: "istio-token") pod "7438bf47-f5db-43cd-9b37-7de99a21ca72" (UID: "7438bf47-f5db-43cd-9b37-7de99a21ca72"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:17:39.180022 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.179973 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r488n\" (UniqueName: \"kubernetes.io/projected/7438bf47-f5db-43cd-9b37-7de99a21ca72-kube-api-access-r488n\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:17:39.180022 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.180016 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7438bf47-f5db-43cd-9b37-7de99a21ca72-istiod-ca-cert\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:17:39.180022 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.180027 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7438bf47-f5db-43cd-9b37-7de99a21ca72-istio-envoy\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:17:39.180327 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.180036 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7438bf47-f5db-43cd-9b37-7de99a21ca72-istio-podinfo\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:17:39.180327 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.180043 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7438bf47-f5db-43cd-9b37-7de99a21ca72-istio-data\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:17:39.180327 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.180051 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7438bf47-f5db-43cd-9b37-7de99a21ca72-istio-token\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:17:39.745253 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.745218 2555 generic.go:356] "Generic (PLEG): container finished" podID="7438bf47-f5db-43cd-9b37-7de99a21ca72" containerID="958986aa650bc298107ffc76607bbf9a91786967a60a5286b4b0620be63ba2bd" exitCode=0 Jul 07 13:17:39.745444 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.745284 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" Jul 07 13:17:39.745444 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.745300 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" event={"ID":"7438bf47-f5db-43cd-9b37-7de99a21ca72","Type":"ContainerDied","Data":"958986aa650bc298107ffc76607bbf9a91786967a60a5286b4b0620be63ba2bd"} Jul 07 13:17:39.745444 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.745386 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl" event={"ID":"7438bf47-f5db-43cd-9b37-7de99a21ca72","Type":"ContainerDied","Data":"0210c64d42578b31899483c8803b56180fc4a2f63633342842429d3ce47b1e21"} Jul 07 13:17:39.745444 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.745417 2555 scope.go:117] "RemoveContainer" containerID="958986aa650bc298107ffc76607bbf9a91786967a60a5286b4b0620be63ba2bd" Jul 07 13:17:39.755087 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.755071 2555 scope.go:117] "RemoveContainer" containerID="7e24fbff8af0e6b1ed454eb46f6acd7a99479ee287f3fbece47bcee7f94eb597" Jul 07 13:17:39.762697 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.762679 2555 scope.go:117] "RemoveContainer" containerID="958986aa650bc298107ffc76607bbf9a91786967a60a5286b4b0620be63ba2bd" Jul 07 13:17:39.762940 ip-10-0-136-245 kubenswrapper[2555]: E0707 13:17:39.762921 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"958986aa650bc298107ffc76607bbf9a91786967a60a5286b4b0620be63ba2bd\": container with ID starting with 958986aa650bc298107ffc76607bbf9a91786967a60a5286b4b0620be63ba2bd not found: ID does not exist" containerID="958986aa650bc298107ffc76607bbf9a91786967a60a5286b4b0620be63ba2bd" Jul 07 13:17:39.763013 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.762949 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"958986aa650bc298107ffc76607bbf9a91786967a60a5286b4b0620be63ba2bd"} err="failed to get container status \"958986aa650bc298107ffc76607bbf9a91786967a60a5286b4b0620be63ba2bd\": rpc error: code = NotFound desc = could not find container \"958986aa650bc298107ffc76607bbf9a91786967a60a5286b4b0620be63ba2bd\": container with ID starting with 958986aa650bc298107ffc76607bbf9a91786967a60a5286b4b0620be63ba2bd not found: ID does not exist" Jul 07 13:17:39.763013 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.762973 2555 scope.go:117] "RemoveContainer" containerID="7e24fbff8af0e6b1ed454eb46f6acd7a99479ee287f3fbece47bcee7f94eb597" Jul 07 13:17:39.763207 ip-10-0-136-245 kubenswrapper[2555]: E0707 13:17:39.763190 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e24fbff8af0e6b1ed454eb46f6acd7a99479ee287f3fbece47bcee7f94eb597\": container with ID starting with 7e24fbff8af0e6b1ed454eb46f6acd7a99479ee287f3fbece47bcee7f94eb597 not found: ID does not exist" containerID="7e24fbff8af0e6b1ed454eb46f6acd7a99479ee287f3fbece47bcee7f94eb597" Jul 07 13:17:39.763253 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.763214 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e24fbff8af0e6b1ed454eb46f6acd7a99479ee287f3fbece47bcee7f94eb597"} err="failed to get container status \"7e24fbff8af0e6b1ed454eb46f6acd7a99479ee287f3fbece47bcee7f94eb597\": rpc error: code = NotFound desc = could not find container \"7e24fbff8af0e6b1ed454eb46f6acd7a99479ee287f3fbece47bcee7f94eb597\": container with ID starting with 7e24fbff8af0e6b1ed454eb46f6acd7a99479ee287f3fbece47bcee7f94eb597 not found: ID does not exist" Jul 07 13:17:39.776954 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.776931 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl"] Jul 07 13:17:39.782017 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.782000 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-d75b40cf-openshift-default-7fc6d8c775-4rcgl"] Jul 07 13:17:39.825591 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:39.825572 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7438bf47-f5db-43cd-9b37-7de99a21ca72" path="/var/lib/kubelet/pods/7438bf47-f5db-43cd-9b37-7de99a21ca72/volumes" Jul 07 13:17:40.558470 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:40.558405 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:40.673225 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:40.673193 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:40.800952 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:40.800923 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:40.962891 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:40.962821 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:46.686091 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:46.686054 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:46.801992 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:46.801966 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:53.591680 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:53.591644 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:53.872304 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:53.872232 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f"] Jul 07 13:17:53.872589 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:53.872575 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7438bf47-f5db-43cd-9b37-7de99a21ca72" containerName="istio-proxy" Jul 07 13:17:53.872637 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:53.872591 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7438bf47-f5db-43cd-9b37-7de99a21ca72" containerName="istio-proxy" Jul 07 13:17:53.872637 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:53.872605 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7438bf47-f5db-43cd-9b37-7de99a21ca72" containerName="istio-proxy" Jul 07 13:17:53.872637 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:53.872610 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7438bf47-f5db-43cd-9b37-7de99a21ca72" containerName="istio-proxy" Jul 07 13:17:53.872733 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:53.872673 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="7438bf47-f5db-43cd-9b37-7de99a21ca72" containerName="istio-proxy" Jul 07 13:17:53.872733 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:53.872680 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="7438bf47-f5db-43cd-9b37-7de99a21ca72" containerName="istio-proxy" Jul 07 13:17:53.874928 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:53.874912 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:17:53.878254 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:53.878235 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-9638b7d0-openshift-default-dockercfg-nsprd\"" Jul 07 13:17:53.892485 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:53.892464 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f"] Jul 07 13:17:53.922830 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:53.922800 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:54.007270 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.007224 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3efc41ef-3aed-47f9-b977-ca5acaed4765-istio-envoy\") pod \"e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:17:54.007462 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.007285 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8djjd\" (UniqueName: \"kubernetes.io/projected/3efc41ef-3aed-47f9-b977-ca5acaed4765-kube-api-access-8djjd\") pod \"e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:17:54.007462 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.007328 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3efc41ef-3aed-47f9-b977-ca5acaed4765-istiod-ca-cert\") pod \"e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:17:54.007462 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.007361 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3efc41ef-3aed-47f9-b977-ca5acaed4765-istio-data\") pod \"e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:17:54.007462 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.007387 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3efc41ef-3aed-47f9-b977-ca5acaed4765-istio-podinfo\") pod \"e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:17:54.007462 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.007410 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3efc41ef-3aed-47f9-b977-ca5acaed4765-istio-token\") pod \"e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:17:54.007656 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.007488 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3efc41ef-3aed-47f9-b977-ca5acaed4765-workload-socket\") pod \"e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:17:54.007656 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.007549 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3efc41ef-3aed-47f9-b977-ca5acaed4765-workload-certs\") pod \"e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:17:54.007656 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.007606 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3efc41ef-3aed-47f9-b977-ca5acaed4765-credential-socket\") pod \"e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:17:54.109056 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.109029 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3efc41ef-3aed-47f9-b977-ca5acaed4765-istio-envoy\") pod \"e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:17:54.109199 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.109061 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8djjd\" (UniqueName: \"kubernetes.io/projected/3efc41ef-3aed-47f9-b977-ca5acaed4765-kube-api-access-8djjd\") pod \"e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:17:54.109199 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.109090 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3efc41ef-3aed-47f9-b977-ca5acaed4765-istiod-ca-cert\") pod \"e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:17:54.109199 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.109122 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3efc41ef-3aed-47f9-b977-ca5acaed4765-istio-data\") pod \"e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:17:54.109199 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.109149 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3efc41ef-3aed-47f9-b977-ca5acaed4765-istio-podinfo\") pod \"e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:17:54.109199 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.109172 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3efc41ef-3aed-47f9-b977-ca5acaed4765-istio-token\") pod \"e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:17:54.109494 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.109215 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3efc41ef-3aed-47f9-b977-ca5acaed4765-workload-socket\") pod \"e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:17:54.109494 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.109242 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3efc41ef-3aed-47f9-b977-ca5acaed4765-workload-certs\") pod \"e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:17:54.109494 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.109288 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3efc41ef-3aed-47f9-b977-ca5acaed4765-credential-socket\") pod \"e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:17:54.109655 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.109623 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3efc41ef-3aed-47f9-b977-ca5acaed4765-istio-data\") pod \"e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:17:54.109769 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.109746 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3efc41ef-3aed-47f9-b977-ca5acaed4765-workload-socket\") pod \"e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:17:54.109832 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.109801 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3efc41ef-3aed-47f9-b977-ca5acaed4765-workload-certs\") pod \"e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:17:54.109899 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.109875 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3efc41ef-3aed-47f9-b977-ca5acaed4765-credential-socket\") pod \"e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:17:54.109982 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.109962 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3efc41ef-3aed-47f9-b977-ca5acaed4765-istiod-ca-cert\") pod \"e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:17:54.111691 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.111668 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3efc41ef-3aed-47f9-b977-ca5acaed4765-istio-envoy\") pod \"e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:17:54.111795 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.111739 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3efc41ef-3aed-47f9-b977-ca5acaed4765-istio-podinfo\") pod \"e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:17:54.117395 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.117372 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3efc41ef-3aed-47f9-b977-ca5acaed4765-istio-token\") pod \"e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:17:54.117789 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.117772 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8djjd\" (UniqueName: \"kubernetes.io/projected/3efc41ef-3aed-47f9-b977-ca5acaed4765-kube-api-access-8djjd\") pod \"e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:17:54.185102 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.185043 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:17:54.323983 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.323959 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f"] Jul 07 13:17:54.326117 ip-10-0-136-245 kubenswrapper[2555]: W0707 13:17:54.326086 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3efc41ef_3aed_47f9_b977_ca5acaed4765.slice/crio-0284e0bf6b2c9797ae4bca1059757a92ec0f58a761c9bf63a318ac935a8651a3 WatchSource:0}: Error finding container 0284e0bf6b2c9797ae4bca1059757a92ec0f58a761c9bf63a318ac935a8651a3: Status 404 returned error can't find the container with id 0284e0bf6b2c9797ae4bca1059757a92ec0f58a761c9bf63a318ac935a8651a3 Jul 07 13:17:54.328749 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.328711 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:17:54.328832 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.328809 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:17:54.328871 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.328855 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:17:54.406881 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.406856 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:54.819497 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.819455 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" event={"ID":"3efc41ef-3aed-47f9-b977-ca5acaed4765","Type":"ContainerStarted","Data":"e79d8f4ee2aa1f1ca98baa64f11db79c22ed718f033cf3811c5348819ef3aa1a"} Jul 07 13:17:54.819846 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.819517 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" event={"ID":"3efc41ef-3aed-47f9-b977-ca5acaed4765","Type":"ContainerStarted","Data":"0284e0bf6b2c9797ae4bca1059757a92ec0f58a761c9bf63a318ac935a8651a3"} Jul 07 13:17:54.846758 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:54.846712 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" podStartSLOduration=1.846693387 podStartE2EDuration="1.846693387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:17:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:17:54.845068713 +0000 UTC m=+1783.566796226" watchObservedRunningTime="2026-07-07 13:17:54.846693387 +0000 UTC m=+1783.568420901" Jul 07 13:17:55.185489 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:55.185366 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:17:55.190232 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:55.190208 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:17:55.825868 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:55.825838 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:17:55.826300 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:55.826287 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:17:56.815509 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:56.815473 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:56.916506 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:56.916467 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:57.043824 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:57.043792 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:57.350213 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:57.350183 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:17:57.454815 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:17:57.454785 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:18:01.280689 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:01.280659 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:18:03.201221 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:03.201190 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:18:11.024978 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:11.024545 2555 patch_prober.go:28] interesting pod/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": read tcp 10.132.0.2:35912->10.132.0.41:15021: read: connection reset by peer" start-of-body= Jul 07 13:18:11.024978 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:11.024622 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" podUID="3efc41ef-3aed-47f9-b977-ca5acaed4765" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": read tcp 10.132.0.2:35912->10.132.0.41:15021: read: connection reset by peer" Jul 07 13:18:11.850436 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:11.850391 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gqgkf_d9ad543c-2b24-443d-a2ed-e3bc420cd888/console-operator/1.log" Jul 07 13:18:11.853644 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:11.853620 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gqgkf_d9ad543c-2b24-443d-a2ed-e3bc420cd888/console-operator/1.log" Jul 07 13:18:11.905861 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:11.905827 2555 generic.go:356] "Generic (PLEG): container finished" podID="3efc41ef-3aed-47f9-b977-ca5acaed4765" containerID="e79d8f4ee2aa1f1ca98baa64f11db79c22ed718f033cf3811c5348819ef3aa1a" exitCode=0 Jul 07 13:18:11.906013 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:11.905870 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" event={"ID":"3efc41ef-3aed-47f9-b977-ca5acaed4765","Type":"ContainerDied","Data":"e79d8f4ee2aa1f1ca98baa64f11db79c22ed718f033cf3811c5348819ef3aa1a"} Jul 07 13:18:11.906347 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:11.906330 2555 scope.go:117] "RemoveContainer" containerID="e79d8f4ee2aa1f1ca98baa64f11db79c22ed718f033cf3811c5348819ef3aa1a" Jul 07 13:18:11.907511 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:11.907484 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:18:11.907577 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:11.907554 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:18:11.907622 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:11.907586 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:18:12.912718 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:12.912680 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" event={"ID":"3efc41ef-3aed-47f9-b977-ca5acaed4765","Type":"ContainerStarted","Data":"125df53cfac9d80346c0454805d280bc16787a810effe7e4cda1b7c707f95ffe"} Jul 07 13:18:13.185702 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:13.185617 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:18:13.185934 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:13.185913 2555 patch_prober.go:28] interesting pod/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 07 13:18:13.186034 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:13.185966 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" podUID="3efc41ef-3aed-47f9-b977-ca5acaed4765" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 07 13:18:14.185813 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:14.185779 2555 patch_prober.go:28] interesting pod/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 07 13:18:14.186379 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:14.186346 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" podUID="3efc41ef-3aed-47f9-b977-ca5acaed4765" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 07 13:18:15.130091 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:15.130059 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:18:15.187447 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:15.186853 2555 patch_prober.go:28] interesting pod/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 07 13:18:15.187447 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:15.186920 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" podUID="3efc41ef-3aed-47f9-b977-ca5acaed4765" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 07 13:18:16.185932 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:16.185890 2555 patch_prober.go:28] interesting pod/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 07 13:18:16.186655 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:16.186233 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" podUID="3efc41ef-3aed-47f9-b977-ca5acaed4765" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 07 13:18:17.185754 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:17.185719 2555 patch_prober.go:28] interesting pod/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body= Jul 07 13:18:17.186337 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:17.186306 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" podUID="3efc41ef-3aed-47f9-b977-ca5acaed4765" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" Jul 07 13:18:18.188725 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:18.188694 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:18:18.189161 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:18.188977 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:18:18.189755 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:18.189734 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:18:18.885232 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:18.885197 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:18:28.100608 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:28.100572 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:18:28.199664 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:28.199627 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:18:31.687544 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:31.687511 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:18:33.658214 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:33.658182 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:18:34.215196 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:34.215164 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:18:34.313686 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:34.313653 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:18:34.644818 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:34.644782 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:18:39.714973 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:39.714937 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:18:44.790473 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:44.790447 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:18:45.800756 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:18:45.800725 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:19:12.655795 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:12.655759 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:19:21.095129 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:21.095097 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:19:21.670537 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:21.670504 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:19:24.500745 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:24.500711 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:19:27.486746 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:27.486710 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:19:33.290410 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:33.290367 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:19:33.394418 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:33.394387 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:19:33.616876 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:33.616804 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f"] Jul 07 13:19:33.617053 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:33.617030 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" podUID="3efc41ef-3aed-47f9-b977-ca5acaed4765" containerName="istio-proxy" containerID="cri-o://125df53cfac9d80346c0454805d280bc16787a810effe7e4cda1b7c707f95ffe" gracePeriod=30 Jul 07 13:19:33.626438 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:33.626402 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:19:33.856490 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:33.856445 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:19:34.884142 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:34.884054 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:19:34.980147 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:34.980116 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:19:35.079578 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:35.079548 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:19:35.876032 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:35.876001 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:19:35.964399 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:35.964362 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:19:37.438176 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:37.438143 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:19:37.706818 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:37.706729 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:19:38.882130 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:38.882071 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:19:38.998865 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:38.998829 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8djjd\" (UniqueName: \"kubernetes.io/projected/3efc41ef-3aed-47f9-b977-ca5acaed4765-kube-api-access-8djjd\") pod \"3efc41ef-3aed-47f9-b977-ca5acaed4765\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " Jul 07 13:19:38.998865 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:38.998864 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3efc41ef-3aed-47f9-b977-ca5acaed4765-workload-socket\") pod \"3efc41ef-3aed-47f9-b977-ca5acaed4765\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " Jul 07 13:19:38.999123 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:38.998886 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3efc41ef-3aed-47f9-b977-ca5acaed4765-workload-certs\") pod \"3efc41ef-3aed-47f9-b977-ca5acaed4765\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " Jul 07 13:19:38.999123 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:38.998907 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3efc41ef-3aed-47f9-b977-ca5acaed4765-istio-data\") pod \"3efc41ef-3aed-47f9-b977-ca5acaed4765\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " Jul 07 13:19:38.999123 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:38.998936 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3efc41ef-3aed-47f9-b977-ca5acaed4765-credential-socket\") pod \"3efc41ef-3aed-47f9-b977-ca5acaed4765\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " Jul 07 13:19:38.999123 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:38.998982 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3efc41ef-3aed-47f9-b977-ca5acaed4765-istio-token\") pod \"3efc41ef-3aed-47f9-b977-ca5acaed4765\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " Jul 07 13:19:38.999335 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:38.999161 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3efc41ef-3aed-47f9-b977-ca5acaed4765-istiod-ca-cert\") pod \"3efc41ef-3aed-47f9-b977-ca5acaed4765\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " Jul 07 13:19:38.999335 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:38.999185 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3efc41ef-3aed-47f9-b977-ca5acaed4765-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3efc41ef-3aed-47f9-b977-ca5acaed4765" (UID: "3efc41ef-3aed-47f9-b977-ca5acaed4765"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:19:38.999335 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:38.999223 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3efc41ef-3aed-47f9-b977-ca5acaed4765-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3efc41ef-3aed-47f9-b977-ca5acaed4765" (UID: "3efc41ef-3aed-47f9-b977-ca5acaed4765"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:19:38.999335 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:38.999293 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3efc41ef-3aed-47f9-b977-ca5acaed4765-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3efc41ef-3aed-47f9-b977-ca5acaed4765" (UID: "3efc41ef-3aed-47f9-b977-ca5acaed4765"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:19:38.999553 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:38.999458 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3efc41ef-3aed-47f9-b977-ca5acaed4765-istio-podinfo\") pod \"3efc41ef-3aed-47f9-b977-ca5acaed4765\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " Jul 07 13:19:38.999553 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:38.999524 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3efc41ef-3aed-47f9-b977-ca5acaed4765-istio-envoy\") pod \"3efc41ef-3aed-47f9-b977-ca5acaed4765\" (UID: \"3efc41ef-3aed-47f9-b977-ca5acaed4765\") " Jul 07 13:19:38.999709 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:38.999683 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3efc41ef-3aed-47f9-b977-ca5acaed4765-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3efc41ef-3aed-47f9-b977-ca5acaed4765" (UID: "3efc41ef-3aed-47f9-b977-ca5acaed4765"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:19:38.999926 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:38.999861 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3efc41ef-3aed-47f9-b977-ca5acaed4765-workload-socket\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:19:38.999926 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:38.999881 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3efc41ef-3aed-47f9-b977-ca5acaed4765-workload-certs\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:19:38.999926 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:38.999895 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3efc41ef-3aed-47f9-b977-ca5acaed4765-credential-socket\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:19:38.999926 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:38.999907 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3efc41ef-3aed-47f9-b977-ca5acaed4765-istiod-ca-cert\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:19:39.000170 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:39.000046 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3efc41ef-3aed-47f9-b977-ca5acaed4765-istio-data" (OuterVolumeSpecName: "istio-data") pod "3efc41ef-3aed-47f9-b977-ca5acaed4765" (UID: "3efc41ef-3aed-47f9-b977-ca5acaed4765"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:19:39.001533 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:39.001505 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3efc41ef-3aed-47f9-b977-ca5acaed4765-istio-token" (OuterVolumeSpecName: "istio-token") pod "3efc41ef-3aed-47f9-b977-ca5acaed4765" (UID: "3efc41ef-3aed-47f9-b977-ca5acaed4765"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:19:39.001636 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:39.001511 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3efc41ef-3aed-47f9-b977-ca5acaed4765-kube-api-access-8djjd" (OuterVolumeSpecName: "kube-api-access-8djjd") pod "3efc41ef-3aed-47f9-b977-ca5acaed4765" (UID: "3efc41ef-3aed-47f9-b977-ca5acaed4765"). InnerVolumeSpecName "kube-api-access-8djjd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:19:39.001726 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:39.001709 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3efc41ef-3aed-47f9-b977-ca5acaed4765-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3efc41ef-3aed-47f9-b977-ca5acaed4765" (UID: "3efc41ef-3aed-47f9-b977-ca5acaed4765"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 13:19:39.002161 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:39.002145 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3efc41ef-3aed-47f9-b977-ca5acaed4765-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3efc41ef-3aed-47f9-b977-ca5acaed4765" (UID: "3efc41ef-3aed-47f9-b977-ca5acaed4765"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:19:39.100438 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:39.100388 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8djjd\" (UniqueName: \"kubernetes.io/projected/3efc41ef-3aed-47f9-b977-ca5acaed4765-kube-api-access-8djjd\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:19:39.100438 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:39.100436 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3efc41ef-3aed-47f9-b977-ca5acaed4765-istio-data\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:19:39.100663 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:39.100452 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3efc41ef-3aed-47f9-b977-ca5acaed4765-istio-token\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:19:39.100663 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:39.100465 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3efc41ef-3aed-47f9-b977-ca5acaed4765-istio-podinfo\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:19:39.100663 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:39.100478 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3efc41ef-3aed-47f9-b977-ca5acaed4765-istio-envoy\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:19:39.303413 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:39.303376 2555 generic.go:356] "Generic (PLEG): container finished" podID="3efc41ef-3aed-47f9-b977-ca5acaed4765" containerID="125df53cfac9d80346c0454805d280bc16787a810effe7e4cda1b7c707f95ffe" exitCode=0 Jul 07 13:19:39.303599 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:39.303473 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" event={"ID":"3efc41ef-3aed-47f9-b977-ca5acaed4765","Type":"ContainerDied","Data":"125df53cfac9d80346c0454805d280bc16787a810effe7e4cda1b7c707f95ffe"} Jul 07 13:19:39.303599 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:39.303547 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" event={"ID":"3efc41ef-3aed-47f9-b977-ca5acaed4765","Type":"ContainerDied","Data":"0284e0bf6b2c9797ae4bca1059757a92ec0f58a761c9bf63a318ac935a8651a3"} Jul 07 13:19:39.303599 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:39.303478 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f" Jul 07 13:19:39.303599 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:39.303573 2555 scope.go:117] "RemoveContainer" containerID="125df53cfac9d80346c0454805d280bc16787a810effe7e4cda1b7c707f95ffe" Jul 07 13:19:39.316722 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:39.316699 2555 scope.go:117] "RemoveContainer" containerID="e79d8f4ee2aa1f1ca98baa64f11db79c22ed718f033cf3811c5348819ef3aa1a" Jul 07 13:19:39.324997 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:39.324981 2555 scope.go:117] "RemoveContainer" containerID="125df53cfac9d80346c0454805d280bc16787a810effe7e4cda1b7c707f95ffe" Jul 07 13:19:39.325257 ip-10-0-136-245 kubenswrapper[2555]: E0707 13:19:39.325239 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"125df53cfac9d80346c0454805d280bc16787a810effe7e4cda1b7c707f95ffe\": container with ID starting with 125df53cfac9d80346c0454805d280bc16787a810effe7e4cda1b7c707f95ffe not found: ID does not exist" containerID="125df53cfac9d80346c0454805d280bc16787a810effe7e4cda1b7c707f95ffe" Jul 07 13:19:39.325308 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:39.325266 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"125df53cfac9d80346c0454805d280bc16787a810effe7e4cda1b7c707f95ffe"} err="failed to get container status \"125df53cfac9d80346c0454805d280bc16787a810effe7e4cda1b7c707f95ffe\": rpc error: code = NotFound desc = could not find container \"125df53cfac9d80346c0454805d280bc16787a810effe7e4cda1b7c707f95ffe\": container with ID starting with 125df53cfac9d80346c0454805d280bc16787a810effe7e4cda1b7c707f95ffe not found: ID does not exist" Jul 07 13:19:39.325308 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:39.325283 2555 scope.go:117] "RemoveContainer" containerID="e79d8f4ee2aa1f1ca98baa64f11db79c22ed718f033cf3811c5348819ef3aa1a" Jul 07 13:19:39.325550 ip-10-0-136-245 kubenswrapper[2555]: E0707 13:19:39.325526 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e79d8f4ee2aa1f1ca98baa64f11db79c22ed718f033cf3811c5348819ef3aa1a\": container with ID starting with e79d8f4ee2aa1f1ca98baa64f11db79c22ed718f033cf3811c5348819ef3aa1a not found: ID does not exist" containerID="e79d8f4ee2aa1f1ca98baa64f11db79c22ed718f033cf3811c5348819ef3aa1a" Jul 07 13:19:39.325612 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:39.325555 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e79d8f4ee2aa1f1ca98baa64f11db79c22ed718f033cf3811c5348819ef3aa1a"} err="failed to get container status \"e79d8f4ee2aa1f1ca98baa64f11db79c22ed718f033cf3811c5348819ef3aa1a\": rpc error: code = NotFound desc = could not find container \"e79d8f4ee2aa1f1ca98baa64f11db79c22ed718f033cf3811c5348819ef3aa1a\": container with ID starting with e79d8f4ee2aa1f1ca98baa64f11db79c22ed718f033cf3811c5348819ef3aa1a not found: ID does not exist" Jul 07 13:19:39.332643 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:39.332615 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f"] Jul 07 13:19:39.336896 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:39.336875 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-9638b7d0-openshift-default-74fdd77c75-n9p8f"] Jul 07 13:19:39.825622 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:39.825592 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3efc41ef-3aed-47f9-b977-ca5acaed4765" path="/var/lib/kubelet/pods/3efc41ef-3aed-47f9-b977-ca5acaed4765/volumes" Jul 07 13:19:43.422909 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:43.422878 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:19:43.491048 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:43.491017 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:19:44.117931 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:44.117902 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:19:50.698310 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:50.698283 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:19:50.813038 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:50.813010 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:19:50.935801 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:50.935770 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:19:51.509407 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:19:51.509374 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:20:01.522283 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:01.522252 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:20:01.785071 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:01.784991 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:20:22.740871 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:22.740841 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:20:28.806176 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:28.806135 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:20:28.906464 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:28.906415 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:20:29.161911 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.161840 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:20:29.428977 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.428901 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g"] Jul 07 13:20:29.429242 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.429230 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3efc41ef-3aed-47f9-b977-ca5acaed4765" containerName="istio-proxy" Jul 07 13:20:29.429294 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.429244 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="3efc41ef-3aed-47f9-b977-ca5acaed4765" containerName="istio-proxy" Jul 07 13:20:29.429294 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.429257 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3efc41ef-3aed-47f9-b977-ca5acaed4765" containerName="istio-proxy" Jul 07 13:20:29.429294 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.429262 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="3efc41ef-3aed-47f9-b977-ca5acaed4765" containerName="istio-proxy" Jul 07 13:20:29.429403 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.429320 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="3efc41ef-3aed-47f9-b977-ca5acaed4765" containerName="istio-proxy" Jul 07 13:20:29.431316 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.431301 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:29.433978 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.433957 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-5ba2ec-openshift-default-dockercfg-24vqk\"" Jul 07 13:20:29.448540 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.448519 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g"] Jul 07 13:20:29.459005 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.458979 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:20:29.525703 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.525664 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4cf99f3-446f-40b2-a18d-22936db0fe27-istio-data\") pod \"e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:29.525863 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.525713 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4cf99f3-446f-40b2-a18d-22936db0fe27-istio-token\") pod \"e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:29.525863 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.525780 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4cf99f3-446f-40b2-a18d-22936db0fe27-workload-socket\") pod \"e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:29.525863 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.525835 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4cf99f3-446f-40b2-a18d-22936db0fe27-istio-podinfo\") pod \"e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:29.526023 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.525871 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4cf99f3-446f-40b2-a18d-22936db0fe27-istio-envoy\") pod \"e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:29.526023 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.525942 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4cf99f3-446f-40b2-a18d-22936db0fe27-credential-socket\") pod \"e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:29.526023 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.526002 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4cf99f3-446f-40b2-a18d-22936db0fe27-workload-certs\") pod \"e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:29.526023 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.526021 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvfqg\" (UniqueName: \"kubernetes.io/projected/d4cf99f3-446f-40b2-a18d-22936db0fe27-kube-api-access-dvfqg\") pod \"e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:29.526224 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.526045 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4cf99f3-446f-40b2-a18d-22936db0fe27-istiod-ca-cert\") pod \"e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:29.614844 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.614807 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:20:29.627091 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.627065 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4cf99f3-446f-40b2-a18d-22936db0fe27-istio-data\") pod \"e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:29.627199 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.627095 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4cf99f3-446f-40b2-a18d-22936db0fe27-istio-token\") pod \"e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:29.627199 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.627116 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4cf99f3-446f-40b2-a18d-22936db0fe27-workload-socket\") pod \"e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:29.627199 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.627139 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4cf99f3-446f-40b2-a18d-22936db0fe27-istio-podinfo\") pod \"e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:29.627199 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.627170 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4cf99f3-446f-40b2-a18d-22936db0fe27-istio-envoy\") pod \"e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:29.627460 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.627224 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4cf99f3-446f-40b2-a18d-22936db0fe27-credential-socket\") pod \"e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:29.627460 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.627251 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4cf99f3-446f-40b2-a18d-22936db0fe27-workload-certs\") pod \"e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:29.627460 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.627271 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvfqg\" (UniqueName: \"kubernetes.io/projected/d4cf99f3-446f-40b2-a18d-22936db0fe27-kube-api-access-dvfqg\") pod \"e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:29.627460 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.627304 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4cf99f3-446f-40b2-a18d-22936db0fe27-istiod-ca-cert\") pod \"e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:29.627745 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.627561 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4cf99f3-446f-40b2-a18d-22936db0fe27-istio-data\") pod \"e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:29.627745 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.627597 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4cf99f3-446f-40b2-a18d-22936db0fe27-workload-socket\") pod \"e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:29.627745 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.627685 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4cf99f3-446f-40b2-a18d-22936db0fe27-workload-certs\") pod \"e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:29.627864 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.627836 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4cf99f3-446f-40b2-a18d-22936db0fe27-credential-socket\") pod \"e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:29.627966 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.627948 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4cf99f3-446f-40b2-a18d-22936db0fe27-istiod-ca-cert\") pod \"e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:29.629677 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.629658 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4cf99f3-446f-40b2-a18d-22936db0fe27-istio-envoy\") pod \"e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:29.629776 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.629762 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4cf99f3-446f-40b2-a18d-22936db0fe27-istio-podinfo\") pod \"e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:29.636399 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.636377 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4cf99f3-446f-40b2-a18d-22936db0fe27-istio-token\") pod \"e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:29.637565 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.637543 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvfqg\" (UniqueName: \"kubernetes.io/projected/d4cf99f3-446f-40b2-a18d-22936db0fe27-kube-api-access-dvfqg\") pod \"e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:29.741749 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.741712 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:29.877348 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.877324 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g"] Jul 07 13:20:29.879779 ip-10-0-136-245 kubenswrapper[2555]: W0707 13:20:29.879751 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4cf99f3_446f_40b2_a18d_22936db0fe27.slice/crio-e62f68d58c9ffec8ab4ab3a60b54f4c700da17dc8cca24b58fd31ab69718d0d4 WatchSource:0}: Error finding container e62f68d58c9ffec8ab4ab3a60b54f4c700da17dc8cca24b58fd31ab69718d0d4: Status 404 returned error can't find the container with id e62f68d58c9ffec8ab4ab3a60b54f4c700da17dc8cca24b58fd31ab69718d0d4 Jul 07 13:20:29.881800 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.881770 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:20:29.881887 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.881829 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:20:29.881887 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:29.881857 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:20:30.533940 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:30.533905 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" event={"ID":"d4cf99f3-446f-40b2-a18d-22936db0fe27","Type":"ContainerStarted","Data":"4a537ac2ce240089070b64725e315420ba368ef2b1fe841c080947b4a2d4186f"} Jul 07 13:20:30.534134 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:30.533959 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" event={"ID":"d4cf99f3-446f-40b2-a18d-22936db0fe27","Type":"ContainerStarted","Data":"e62f68d58c9ffec8ab4ab3a60b54f4c700da17dc8cca24b58fd31ab69718d0d4"} Jul 07 13:20:30.556762 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:30.556719 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" podStartSLOduration=1.556704407 podStartE2EDuration="1.556704407s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:20:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:20:30.555069988 +0000 UTC m=+1939.276797501" watchObservedRunningTime="2026-07-07 13:20:30.556704407 +0000 UTC m=+1939.278431919" Jul 07 13:20:30.741927 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:30.741889 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:30.746653 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:30.746630 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:31.539582 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:31.539553 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:31.540660 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:31.540639 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:32.494825 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:32.494793 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:20:32.586340 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:32.586312 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:20:32.792101 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:32.792019 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:20:33.238779 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:33.238744 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:20:33.430485 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:33.430456 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:20:33.531949 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:33.531872 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:20:36.984628 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:36.984601 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:20:37.341253 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.341179 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:20:37.681866 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.681793 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g"] Jul 07 13:20:37.682393 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.682380 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="3efc41ef-3aed-47f9-b977-ca5acaed4765" containerName="istio-proxy" Jul 07 13:20:37.684769 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.684752 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:37.692069 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.692049 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-256cc6-openshift-default-dockercfg-52c2c\"" Jul 07 13:20:37.736712 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.736689 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g"] Jul 07 13:20:37.768924 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.768892 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:20:37.799811 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.799780 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc594994-1c1a-40d7-a81f-7ec40e61f27e-istio-token\") pod \"e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:37.799999 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.799821 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc594994-1c1a-40d7-a81f-7ec40e61f27e-istio-data\") pod \"e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:37.799999 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.799858 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc594994-1c1a-40d7-a81f-7ec40e61f27e-istio-envoy\") pod \"e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:37.799999 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.799909 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc594994-1c1a-40d7-a81f-7ec40e61f27e-istio-podinfo\") pod \"e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:37.799999 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.799947 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc594994-1c1a-40d7-a81f-7ec40e61f27e-workload-socket\") pod \"e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:37.799999 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.799971 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc594994-1c1a-40d7-a81f-7ec40e61f27e-credential-socket\") pod \"e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:37.800250 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.800002 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5vb8\" (UniqueName: \"kubernetes.io/projected/cc594994-1c1a-40d7-a81f-7ec40e61f27e-kube-api-access-q5vb8\") pod \"e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:37.800250 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.800062 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc594994-1c1a-40d7-a81f-7ec40e61f27e-istiod-ca-cert\") pod \"e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:37.800250 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.800103 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc594994-1c1a-40d7-a81f-7ec40e61f27e-workload-certs\") pod \"e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:37.900942 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.900913 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc594994-1c1a-40d7-a81f-7ec40e61f27e-workload-certs\") pod \"e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:37.901132 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.901110 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc594994-1c1a-40d7-a81f-7ec40e61f27e-istio-token\") pod \"e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:37.901194 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.901162 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc594994-1c1a-40d7-a81f-7ec40e61f27e-istio-data\") pod \"e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:37.901308 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.901280 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc594994-1c1a-40d7-a81f-7ec40e61f27e-istio-envoy\") pod \"e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:37.901469 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.901329 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc594994-1c1a-40d7-a81f-7ec40e61f27e-istio-podinfo\") pod \"e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:37.901469 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.901343 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc594994-1c1a-40d7-a81f-7ec40e61f27e-workload-certs\") pod \"e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:37.901469 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.901374 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc594994-1c1a-40d7-a81f-7ec40e61f27e-workload-socket\") pod \"e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:37.901469 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.901399 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc594994-1c1a-40d7-a81f-7ec40e61f27e-credential-socket\") pod \"e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:37.901469 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.901406 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc594994-1c1a-40d7-a81f-7ec40e61f27e-istio-data\") pod \"e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:37.901469 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.901447 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5vb8\" (UniqueName: \"kubernetes.io/projected/cc594994-1c1a-40d7-a81f-7ec40e61f27e-kube-api-access-q5vb8\") pod \"e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:37.901815 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.901482 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc594994-1c1a-40d7-a81f-7ec40e61f27e-istiod-ca-cert\") pod \"e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:37.901815 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.901749 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc594994-1c1a-40d7-a81f-7ec40e61f27e-credential-socket\") pod \"e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:37.901921 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.901891 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc594994-1c1a-40d7-a81f-7ec40e61f27e-workload-socket\") pod \"e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:37.902165 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.902145 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc594994-1c1a-40d7-a81f-7ec40e61f27e-istiod-ca-cert\") pod \"e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:37.903564 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.903545 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc594994-1c1a-40d7-a81f-7ec40e61f27e-istio-envoy\") pod \"e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:37.903729 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.903710 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc594994-1c1a-40d7-a81f-7ec40e61f27e-istio-podinfo\") pod \"e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:37.919482 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.919460 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc594994-1c1a-40d7-a81f-7ec40e61f27e-istio-token\") pod \"e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:37.920479 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.920453 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5vb8\" (UniqueName: \"kubernetes.io/projected/cc594994-1c1a-40d7-a81f-7ec40e61f27e-kube-api-access-q5vb8\") pod \"e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:37.984602 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.984572 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:20:37.995605 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:37.995580 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:38.131818 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:38.131790 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g"] Jul 07 13:20:38.134329 ip-10-0-136-245 kubenswrapper[2555]: W0707 13:20:38.134304 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc594994_1c1a_40d7_a81f_7ec40e61f27e.slice/crio-902c1dbb8ee6c94ed39764f3489ec79cef630839e7f594ec20af22376045b226 WatchSource:0}: Error finding container 902c1dbb8ee6c94ed39764f3489ec79cef630839e7f594ec20af22376045b226: Status 404 returned error can't find the container with id 902c1dbb8ee6c94ed39764f3489ec79cef630839e7f594ec20af22376045b226 Jul 07 13:20:38.136533 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:38.136504 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:20:38.136610 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:38.136566 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:20:38.136610 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:38.136594 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:20:38.571694 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:38.571660 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" event={"ID":"cc594994-1c1a-40d7-a81f-7ec40e61f27e","Type":"ContainerStarted","Data":"750ee862ba6ba323fefd03b6999d1abdfe4e87751c604602642bced06f7f99de"} Jul 07 13:20:38.571855 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:38.571706 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" event={"ID":"cc594994-1c1a-40d7-a81f-7ec40e61f27e","Type":"ContainerStarted","Data":"902c1dbb8ee6c94ed39764f3489ec79cef630839e7f594ec20af22376045b226"} Jul 07 13:20:38.610989 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:38.610946 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" podStartSLOduration=1.610928766 podStartE2EDuration="1.610928766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:20:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:20:38.608374117 +0000 UTC m=+1947.330101630" watchObservedRunningTime="2026-07-07 13:20:38.610928766 +0000 UTC m=+1947.332656280" Jul 07 13:20:38.996700 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:38.996658 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:40.000934 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:40.000906 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:40.581977 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:40.581947 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:40.582798 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:40.582772 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:40.633716 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:40.633682 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:20:40.707731 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:40.707657 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:20:40.891060 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:40.890937 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:20:40.988702 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:40.988662 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:20:41.396359 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:41.396332 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:20:41.497321 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:41.497290 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:20:45.123849 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:45.123805 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:20:45.833325 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:45.833271 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:20:47.582574 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:47.582530 2555 patch_prober.go:28] interesting pod/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 07 13:20:47.583053 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:47.582599 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" podUID="d4cf99f3-446f-40b2-a18d-22936db0fe27" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 07 13:20:48.623794 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:48.623765 2555 generic.go:356] "Generic (PLEG): container finished" podID="d4cf99f3-446f-40b2-a18d-22936db0fe27" containerID="4a537ac2ce240089070b64725e315420ba368ef2b1fe841c080947b4a2d4186f" exitCode=0 Jul 07 13:20:48.624231 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:48.623807 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" event={"ID":"d4cf99f3-446f-40b2-a18d-22936db0fe27","Type":"ContainerDied","Data":"4a537ac2ce240089070b64725e315420ba368ef2b1fe841c080947b4a2d4186f"} Jul 07 13:20:48.624231 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:48.624178 2555 scope.go:117] "RemoveContainer" containerID="4a537ac2ce240089070b64725e315420ba368ef2b1fe841c080947b4a2d4186f" Jul 07 13:20:48.625131 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:48.625103 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:20:48.625195 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:48.625185 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:20:48.625232 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:48.625216 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:20:49.630067 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:49.630028 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" event={"ID":"d4cf99f3-446f-40b2-a18d-22936db0fe27","Type":"ContainerStarted","Data":"5bd34470f88605190580e779907128927fce86e32ff2c3272956569089d52f46"} Jul 07 13:20:49.742218 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:49.742178 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:49.742537 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:49.742513 2555 patch_prober.go:28] interesting pod/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 07 13:20:49.742598 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:49.742567 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" podUID="d4cf99f3-446f-40b2-a18d-22936db0fe27" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 07 13:20:50.742546 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:50.742508 2555 patch_prober.go:28] interesting pod/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 07 13:20:50.742974 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:50.742588 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" podUID="d4cf99f3-446f-40b2-a18d-22936db0fe27" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 07 13:20:51.743077 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:51.743045 2555 patch_prober.go:28] interesting pod/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 07 13:20:51.743584 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:51.743558 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" podUID="d4cf99f3-446f-40b2-a18d-22936db0fe27" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 07 13:20:51.838175 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:51.838142 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:20:52.742385 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:52.742343 2555 patch_prober.go:28] interesting pod/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 07 13:20:52.742615 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:52.742408 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" podUID="d4cf99f3-446f-40b2-a18d-22936db0fe27" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 07 13:20:53.745316 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:53.745285 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:53.745744 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:53.745569 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:53.746276 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:53.746259 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:20:55.133190 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:55.133153 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:20:55.231572 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:55.231538 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:20:55.583224 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:55.583191 2555 patch_prober.go:28] interesting pod/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 07 13:20:55.583394 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:55.583255 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" podUID="cc594994-1c1a-40d7-a81f-7ec40e61f27e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 07 13:20:55.661398 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:55.661366 2555 generic.go:356] "Generic (PLEG): container finished" podID="cc594994-1c1a-40d7-a81f-7ec40e61f27e" containerID="750ee862ba6ba323fefd03b6999d1abdfe4e87751c604602642bced06f7f99de" exitCode=0 Jul 07 13:20:55.661598 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:55.661459 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" event={"ID":"cc594994-1c1a-40d7-a81f-7ec40e61f27e","Type":"ContainerDied","Data":"750ee862ba6ba323fefd03b6999d1abdfe4e87751c604602642bced06f7f99de"} Jul 07 13:20:55.661945 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:55.661928 2555 scope.go:117] "RemoveContainer" containerID="750ee862ba6ba323fefd03b6999d1abdfe4e87751c604602642bced06f7f99de" Jul 07 13:20:55.663000 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:55.662973 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:20:55.663076 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:55.663037 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:20:55.663115 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:55.663079 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:20:56.670001 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:56.669956 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" event={"ID":"cc594994-1c1a-40d7-a81f-7ec40e61f27e","Type":"ContainerStarted","Data":"7613ebc265ae829a24357aca19ad8010d8f21888f9aad18a8de7d39f231f294b"} Jul 07 13:20:56.996692 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:56.996652 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:20:56.996885 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:56.996865 2555 patch_prober.go:28] interesting pod/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 07 13:20:56.996930 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:56.996912 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" podUID="cc594994-1c1a-40d7-a81f-7ec40e61f27e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 07 13:20:57.996843 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:57.996807 2555 patch_prober.go:28] interesting pod/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 07 13:20:57.997216 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:57.996862 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" podUID="cc594994-1c1a-40d7-a81f-7ec40e61f27e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 07 13:20:58.850145 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:58.850113 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:20:58.996644 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:58.996616 2555 patch_prober.go:28] interesting pod/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 07 13:20:58.996884 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:58.996862 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" podUID="cc594994-1c1a-40d7-a81f-7ec40e61f27e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 07 13:20:59.996437 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:59.996396 2555 patch_prober.go:28] interesting pod/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 07 13:20:59.996655 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:20:59.996483 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" podUID="cc594994-1c1a-40d7-a81f-7ec40e61f27e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 07 13:21:01.000393 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:21:01.000362 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:21:01.000809 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:21:01.000623 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:21:01.001189 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:21:01.001174 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:21:02.216345 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:21:02.216312 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:21:02.319887 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:21:02.319850 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:21:04.802415 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:21:04.802335 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:21:25.281495 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:21:25.281465 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:21:31.297726 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:21:31.297684 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:21:43.680675 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:21:43.680639 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:21:44.551373 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:21:44.551330 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:21:44.795350 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:21:44.795314 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:21:45.287212 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:21:45.287180 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:21:45.399394 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:21:45.399363 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:21:45.505990 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:21:45.505943 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:21:45.670886 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:21:45.670796 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:21:49.298125 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:21:49.298092 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:21:50.325997 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:21:50.325965 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:27.397960 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:27.397924 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:27.649148 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:27.649071 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g"] Jul 07 13:22:27.649305 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:27.649285 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" podUID="d4cf99f3-446f-40b2-a18d-22936db0fe27" containerName="istio-proxy" containerID="cri-o://5bd34470f88605190580e779907128927fce86e32ff2c3272956569089d52f46" gracePeriod=30 Jul 07 13:22:27.703171 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:27.703145 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:27.895861 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:27.895832 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:28.080852 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:28.080825 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:28.438350 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:28.438215 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:28.626792 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:28.626725 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:28.756731 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:28.756688 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:28.891942 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:28.891891 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:31.817832 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:31.817801 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:22:32.894082 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:32.894060 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:22:33.009888 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.009859 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4cf99f3-446f-40b2-a18d-22936db0fe27-istiod-ca-cert\") pod \"d4cf99f3-446f-40b2-a18d-22936db0fe27\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " Jul 07 13:22:33.010061 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.009899 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4cf99f3-446f-40b2-a18d-22936db0fe27-workload-certs\") pod \"d4cf99f3-446f-40b2-a18d-22936db0fe27\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " Jul 07 13:22:33.010061 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.009973 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4cf99f3-446f-40b2-a18d-22936db0fe27-istio-token\") pod \"d4cf99f3-446f-40b2-a18d-22936db0fe27\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " Jul 07 13:22:33.010061 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.009993 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4cf99f3-446f-40b2-a18d-22936db0fe27-istio-envoy\") pod \"d4cf99f3-446f-40b2-a18d-22936db0fe27\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " Jul 07 13:22:33.010061 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.010031 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4cf99f3-446f-40b2-a18d-22936db0fe27-istio-data\") pod \"d4cf99f3-446f-40b2-a18d-22936db0fe27\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " Jul 07 13:22:33.010061 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.010045 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4cf99f3-446f-40b2-a18d-22936db0fe27-workload-socket\") pod \"d4cf99f3-446f-40b2-a18d-22936db0fe27\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " Jul 07 13:22:33.010333 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.010065 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvfqg\" (UniqueName: \"kubernetes.io/projected/d4cf99f3-446f-40b2-a18d-22936db0fe27-kube-api-access-dvfqg\") pod \"d4cf99f3-446f-40b2-a18d-22936db0fe27\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " Jul 07 13:22:33.010333 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.010085 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4cf99f3-446f-40b2-a18d-22936db0fe27-istio-podinfo\") pod \"d4cf99f3-446f-40b2-a18d-22936db0fe27\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " Jul 07 13:22:33.010333 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.010118 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4cf99f3-446f-40b2-a18d-22936db0fe27-credential-socket\") pod \"d4cf99f3-446f-40b2-a18d-22936db0fe27\" (UID: \"d4cf99f3-446f-40b2-a18d-22936db0fe27\") " Jul 07 13:22:33.010333 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.010221 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4cf99f3-446f-40b2-a18d-22936db0fe27-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d4cf99f3-446f-40b2-a18d-22936db0fe27" (UID: "d4cf99f3-446f-40b2-a18d-22936db0fe27"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:22:33.010333 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.010275 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4cf99f3-446f-40b2-a18d-22936db0fe27-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d4cf99f3-446f-40b2-a18d-22936db0fe27" (UID: "d4cf99f3-446f-40b2-a18d-22936db0fe27"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:22:33.010634 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.010399 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4cf99f3-446f-40b2-a18d-22936db0fe27-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d4cf99f3-446f-40b2-a18d-22936db0fe27" (UID: "d4cf99f3-446f-40b2-a18d-22936db0fe27"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:22:33.010634 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.010418 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4cf99f3-446f-40b2-a18d-22936db0fe27-istiod-ca-cert\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:22:33.010634 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.010455 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4cf99f3-446f-40b2-a18d-22936db0fe27-workload-certs\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:22:33.010634 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.010517 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4cf99f3-446f-40b2-a18d-22936db0fe27-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d4cf99f3-446f-40b2-a18d-22936db0fe27" (UID: "d4cf99f3-446f-40b2-a18d-22936db0fe27"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:22:33.011060 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.011038 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4cf99f3-446f-40b2-a18d-22936db0fe27-istio-data" (OuterVolumeSpecName: "istio-data") pod "d4cf99f3-446f-40b2-a18d-22936db0fe27" (UID: "d4cf99f3-446f-40b2-a18d-22936db0fe27"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:22:33.012331 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.012308 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4cf99f3-446f-40b2-a18d-22936db0fe27-kube-api-access-dvfqg" (OuterVolumeSpecName: "kube-api-access-dvfqg") pod "d4cf99f3-446f-40b2-a18d-22936db0fe27" (UID: "d4cf99f3-446f-40b2-a18d-22936db0fe27"). InnerVolumeSpecName "kube-api-access-dvfqg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:22:33.012552 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.012512 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d4cf99f3-446f-40b2-a18d-22936db0fe27-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d4cf99f3-446f-40b2-a18d-22936db0fe27" (UID: "d4cf99f3-446f-40b2-a18d-22936db0fe27"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 13:22:33.012671 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.012595 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4cf99f3-446f-40b2-a18d-22936db0fe27-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d4cf99f3-446f-40b2-a18d-22936db0fe27" (UID: "d4cf99f3-446f-40b2-a18d-22936db0fe27"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:22:33.012671 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.012606 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4cf99f3-446f-40b2-a18d-22936db0fe27-istio-token" (OuterVolumeSpecName: "istio-token") pod "d4cf99f3-446f-40b2-a18d-22936db0fe27" (UID: "d4cf99f3-446f-40b2-a18d-22936db0fe27"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:22:33.111207 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.111185 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4cf99f3-446f-40b2-a18d-22936db0fe27-istio-token\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:22:33.111207 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.111206 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4cf99f3-446f-40b2-a18d-22936db0fe27-istio-envoy\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:22:33.111349 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.111214 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4cf99f3-446f-40b2-a18d-22936db0fe27-istio-data\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:22:33.111349 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.111223 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4cf99f3-446f-40b2-a18d-22936db0fe27-workload-socket\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:22:33.111349 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.111232 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvfqg\" (UniqueName: \"kubernetes.io/projected/d4cf99f3-446f-40b2-a18d-22936db0fe27-kube-api-access-dvfqg\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:22:33.111349 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.111242 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4cf99f3-446f-40b2-a18d-22936db0fe27-istio-podinfo\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:22:33.111349 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.111250 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4cf99f3-446f-40b2-a18d-22936db0fe27-credential-socket\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:22:33.140875 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.140845 2555 generic.go:356] "Generic (PLEG): container finished" podID="d4cf99f3-446f-40b2-a18d-22936db0fe27" containerID="5bd34470f88605190580e779907128927fce86e32ff2c3272956569089d52f46" exitCode=0 Jul 07 13:22:33.140968 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.140890 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" Jul 07 13:22:33.140968 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.140929 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" event={"ID":"d4cf99f3-446f-40b2-a18d-22936db0fe27","Type":"ContainerDied","Data":"5bd34470f88605190580e779907128927fce86e32ff2c3272956569089d52f46"} Jul 07 13:22:33.147966 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.141173 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g" event={"ID":"d4cf99f3-446f-40b2-a18d-22936db0fe27","Type":"ContainerDied","Data":"e62f68d58c9ffec8ab4ab3a60b54f4c700da17dc8cca24b58fd31ab69718d0d4"} Jul 07 13:22:33.147966 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.141240 2555 scope.go:117] "RemoveContainer" containerID="5bd34470f88605190580e779907128927fce86e32ff2c3272956569089d52f46" Jul 07 13:22:33.158043 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.158027 2555 scope.go:117] "RemoveContainer" containerID="4a537ac2ce240089070b64725e315420ba368ef2b1fe841c080947b4a2d4186f" Jul 07 13:22:33.165966 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.165946 2555 scope.go:117] "RemoveContainer" containerID="5bd34470f88605190580e779907128927fce86e32ff2c3272956569089d52f46" Jul 07 13:22:33.166245 ip-10-0-136-245 kubenswrapper[2555]: E0707 13:22:33.166224 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bd34470f88605190580e779907128927fce86e32ff2c3272956569089d52f46\": container with ID starting with 5bd34470f88605190580e779907128927fce86e32ff2c3272956569089d52f46 not found: ID does not exist" containerID="5bd34470f88605190580e779907128927fce86e32ff2c3272956569089d52f46" Jul 07 13:22:33.166304 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.166252 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bd34470f88605190580e779907128927fce86e32ff2c3272956569089d52f46"} err="failed to get container status \"5bd34470f88605190580e779907128927fce86e32ff2c3272956569089d52f46\": rpc error: code = NotFound desc = could not find container \"5bd34470f88605190580e779907128927fce86e32ff2c3272956569089d52f46\": container with ID starting with 5bd34470f88605190580e779907128927fce86e32ff2c3272956569089d52f46 not found: ID does not exist" Jul 07 13:22:33.166304 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.166268 2555 scope.go:117] "RemoveContainer" containerID="4a537ac2ce240089070b64725e315420ba368ef2b1fe841c080947b4a2d4186f" Jul 07 13:22:33.166514 ip-10-0-136-245 kubenswrapper[2555]: E0707 13:22:33.166494 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a537ac2ce240089070b64725e315420ba368ef2b1fe841c080947b4a2d4186f\": container with ID starting with 4a537ac2ce240089070b64725e315420ba368ef2b1fe841c080947b4a2d4186f not found: ID does not exist" containerID="4a537ac2ce240089070b64725e315420ba368ef2b1fe841c080947b4a2d4186f" Jul 07 13:22:33.166561 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.166519 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a537ac2ce240089070b64725e315420ba368ef2b1fe841c080947b4a2d4186f"} err="failed to get container status \"4a537ac2ce240089070b64725e315420ba368ef2b1fe841c080947b4a2d4186f\": rpc error: code = NotFound desc = could not find container \"4a537ac2ce240089070b64725e315420ba368ef2b1fe841c080947b4a2d4186f\": container with ID starting with 4a537ac2ce240089070b64725e315420ba368ef2b1fe841c080947b4a2d4186f not found: ID does not exist" Jul 07 13:22:33.167316 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.167300 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g"] Jul 07 13:22:33.170869 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.170851 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-5ba2ec-openshift-default-7b56cdd4b5-kf57g"] Jul 07 13:22:33.825625 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:33.825587 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4cf99f3-446f-40b2-a18d-22936db0fe27" path="/var/lib/kubelet/pods/d4cf99f3-446f-40b2-a18d-22936db0fe27/volumes" Jul 07 13:22:34.285177 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:34.285148 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:34.384872 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:34.384837 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:34.522035 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:34.522003 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g"] Jul 07 13:22:34.522306 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:34.522279 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" podUID="cc594994-1c1a-40d7-a81f-7ec40e61f27e" containerName="istio-proxy" containerID="cri-o://7613ebc265ae829a24357aca19ad8010d8f21888f9aad18a8de7d39f231f294b" gracePeriod=30 Jul 07 13:22:34.544810 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:34.544727 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:34.775314 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:34.775287 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:35.139218 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.139186 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:35.409792 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.409714 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg"] Jul 07 13:22:35.410153 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.410097 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4cf99f3-446f-40b2-a18d-22936db0fe27" containerName="istio-proxy" Jul 07 13:22:35.410153 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.410113 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4cf99f3-446f-40b2-a18d-22936db0fe27" containerName="istio-proxy" Jul 07 13:22:35.410153 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.410134 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4cf99f3-446f-40b2-a18d-22936db0fe27" containerName="istio-proxy" Jul 07 13:22:35.410153 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.410140 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4cf99f3-446f-40b2-a18d-22936db0fe27" containerName="istio-proxy" Jul 07 13:22:35.410289 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.410200 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4cf99f3-446f-40b2-a18d-22936db0fe27" containerName="istio-proxy" Jul 07 13:22:35.414751 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.414731 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:35.417095 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.417071 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-aa07aa-openshift-default-dockercfg-ts5pg\"" Jul 07 13:22:35.427790 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.427769 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg"] Jul 07 13:22:35.440082 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.440059 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:35.532679 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.532642 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aff04da5-047a-46bc-b102-aa9aedf7c66f-istio-envoy\") pod \"e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:35.532871 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.532688 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aff04da5-047a-46bc-b102-aa9aedf7c66f-istio-data\") pod \"e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:35.532871 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.532716 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aff04da5-047a-46bc-b102-aa9aedf7c66f-workload-certs\") pod \"e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:35.532871 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.532795 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aff04da5-047a-46bc-b102-aa9aedf7c66f-istio-podinfo\") pod \"e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:35.533011 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.532865 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd9hm\" (UniqueName: \"kubernetes.io/projected/aff04da5-047a-46bc-b102-aa9aedf7c66f-kube-api-access-xd9hm\") pod \"e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:35.533011 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.532956 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aff04da5-047a-46bc-b102-aa9aedf7c66f-istio-token\") pod \"e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:35.533011 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.532982 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aff04da5-047a-46bc-b102-aa9aedf7c66f-istiod-ca-cert\") pod \"e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:35.533121 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.533008 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff04da5-047a-46bc-b102-aa9aedf7c66f-credential-socket\") pod \"e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:35.533121 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.533064 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff04da5-047a-46bc-b102-aa9aedf7c66f-workload-socket\") pod \"e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:35.634403 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.634378 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aff04da5-047a-46bc-b102-aa9aedf7c66f-istio-token\") pod \"e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:35.634403 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.634406 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aff04da5-047a-46bc-b102-aa9aedf7c66f-istiod-ca-cert\") pod \"e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:35.634598 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.634445 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff04da5-047a-46bc-b102-aa9aedf7c66f-credential-socket\") pod \"e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:35.634598 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.634469 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff04da5-047a-46bc-b102-aa9aedf7c66f-workload-socket\") pod \"e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:35.634598 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.634508 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aff04da5-047a-46bc-b102-aa9aedf7c66f-istio-envoy\") pod \"e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:35.634737 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.634619 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aff04da5-047a-46bc-b102-aa9aedf7c66f-istio-data\") pod \"e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:35.634737 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.634684 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aff04da5-047a-46bc-b102-aa9aedf7c66f-workload-certs\") pod \"e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:35.634737 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.634717 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aff04da5-047a-46bc-b102-aa9aedf7c66f-istio-podinfo\") pod \"e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:35.634898 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.634749 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd9hm\" (UniqueName: \"kubernetes.io/projected/aff04da5-047a-46bc-b102-aa9aedf7c66f-kube-api-access-xd9hm\") pod \"e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:35.634952 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.634898 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff04da5-047a-46bc-b102-aa9aedf7c66f-credential-socket\") pod \"e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:35.635225 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.635122 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aff04da5-047a-46bc-b102-aa9aedf7c66f-istio-data\") pod \"e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:35.635225 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.635174 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff04da5-047a-46bc-b102-aa9aedf7c66f-workload-socket\") pod \"e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:35.635225 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.635221 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aff04da5-047a-46bc-b102-aa9aedf7c66f-workload-certs\") pod \"e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:35.635543 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.635524 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aff04da5-047a-46bc-b102-aa9aedf7c66f-istiod-ca-cert\") pod \"e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:35.637249 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.637228 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aff04da5-047a-46bc-b102-aa9aedf7c66f-istio-envoy\") pod \"e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:35.637499 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.637476 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aff04da5-047a-46bc-b102-aa9aedf7c66f-istio-podinfo\") pod \"e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:35.643358 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.643333 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aff04da5-047a-46bc-b102-aa9aedf7c66f-istio-token\") pod \"e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:35.643482 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.643463 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd9hm\" (UniqueName: \"kubernetes.io/projected/aff04da5-047a-46bc-b102-aa9aedf7c66f-kube-api-access-xd9hm\") pod \"e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:35.728018 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.727993 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:35.779561 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.779536 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:35.899333 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.899306 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg"] Jul 07 13:22:35.900819 ip-10-0-136-245 kubenswrapper[2555]: W0707 13:22:35.900791 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaff04da5_047a_46bc_b102_aa9aedf7c66f.slice/crio-1d3398530624cb2c00d73f8f86587d735365642c0547a899f2a27b674cc088fb WatchSource:0}: Error finding container 1d3398530624cb2c00d73f8f86587d735365642c0547a899f2a27b674cc088fb: Status 404 returned error can't find the container with id 1d3398530624cb2c00d73f8f86587d735365642c0547a899f2a27b674cc088fb Jul 07 13:22:35.902866 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.902839 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:22:35.902947 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.902899 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:22:35.902947 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:35.902929 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:22:36.157192 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:36.157107 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" event={"ID":"aff04da5-047a-46bc-b102-aa9aedf7c66f","Type":"ContainerStarted","Data":"a660878d5489b92422f515033c9897fed18c16b12c62e6d4c6f3976e46a39d29"} Jul 07 13:22:36.157192 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:36.157176 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" event={"ID":"aff04da5-047a-46bc-b102-aa9aedf7c66f","Type":"ContainerStarted","Data":"1d3398530624cb2c00d73f8f86587d735365642c0547a899f2a27b674cc088fb"} Jul 07 13:22:36.178738 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:36.178691 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" podStartSLOduration=1.1786755979999999 podStartE2EDuration="1.178675598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:22:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:22:36.176462138 +0000 UTC m=+2064.898189653" watchObservedRunningTime="2026-07-07 13:22:36.178675598 +0000 UTC m=+2064.900403110" Jul 07 13:22:36.728475 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:36.728442 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:36.733213 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:36.733192 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:37.161986 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:37.161910 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:37.162817 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:37.162795 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:38.151347 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:38.151283 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:38.252367 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:38.252313 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:38.466251 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:38.466177 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:38.610410 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:38.610349 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:38.941632 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:38.941598 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:39.046065 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:39.046035 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:39.768568 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:39.768541 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:22:39.870150 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:39.870082 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc594994-1c1a-40d7-a81f-7ec40e61f27e-istio-data\") pod \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " Jul 07 13:22:39.870150 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:39.870109 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc594994-1c1a-40d7-a81f-7ec40e61f27e-istio-podinfo\") pod \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " Jul 07 13:22:39.870150 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:39.870135 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc594994-1c1a-40d7-a81f-7ec40e61f27e-credential-socket\") pod \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " Jul 07 13:22:39.870400 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:39.870172 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5vb8\" (UniqueName: \"kubernetes.io/projected/cc594994-1c1a-40d7-a81f-7ec40e61f27e-kube-api-access-q5vb8\") pod \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " Jul 07 13:22:39.870400 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:39.870190 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc594994-1c1a-40d7-a81f-7ec40e61f27e-istio-token\") pod \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " Jul 07 13:22:39.870400 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:39.870229 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc594994-1c1a-40d7-a81f-7ec40e61f27e-workload-certs\") pod \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " Jul 07 13:22:39.870400 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:39.870312 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc594994-1c1a-40d7-a81f-7ec40e61f27e-istio-envoy\") pod \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " Jul 07 13:22:39.870400 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:39.870337 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc594994-1c1a-40d7-a81f-7ec40e61f27e-istiod-ca-cert\") pod \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " Jul 07 13:22:39.870400 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:39.870400 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc594994-1c1a-40d7-a81f-7ec40e61f27e-workload-socket\") pod \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\" (UID: \"cc594994-1c1a-40d7-a81f-7ec40e61f27e\") " Jul 07 13:22:39.870763 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:39.870564 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc594994-1c1a-40d7-a81f-7ec40e61f27e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cc594994-1c1a-40d7-a81f-7ec40e61f27e" (UID: "cc594994-1c1a-40d7-a81f-7ec40e61f27e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:22:39.870763 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:39.870589 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc594994-1c1a-40d7-a81f-7ec40e61f27e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cc594994-1c1a-40d7-a81f-7ec40e61f27e" (UID: "cc594994-1c1a-40d7-a81f-7ec40e61f27e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:22:39.870763 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:39.870743 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc594994-1c1a-40d7-a81f-7ec40e61f27e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cc594994-1c1a-40d7-a81f-7ec40e61f27e" (UID: "cc594994-1c1a-40d7-a81f-7ec40e61f27e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:22:39.870921 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:39.870814 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc594994-1c1a-40d7-a81f-7ec40e61f27e-credential-socket\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:22:39.870921 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:39.870836 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc594994-1c1a-40d7-a81f-7ec40e61f27e-workload-certs\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:22:39.870921 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:39.870849 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc594994-1c1a-40d7-a81f-7ec40e61f27e-workload-socket\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:22:39.871079 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:39.870915 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc594994-1c1a-40d7-a81f-7ec40e61f27e-istio-data" (OuterVolumeSpecName: "istio-data") pod "cc594994-1c1a-40d7-a81f-7ec40e61f27e" (UID: "cc594994-1c1a-40d7-a81f-7ec40e61f27e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:22:39.871079 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:39.871042 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc594994-1c1a-40d7-a81f-7ec40e61f27e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cc594994-1c1a-40d7-a81f-7ec40e61f27e" (UID: "cc594994-1c1a-40d7-a81f-7ec40e61f27e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:22:39.872397 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:39.872372 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cc594994-1c1a-40d7-a81f-7ec40e61f27e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cc594994-1c1a-40d7-a81f-7ec40e61f27e" (UID: "cc594994-1c1a-40d7-a81f-7ec40e61f27e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 13:22:39.872530 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:39.872440 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc594994-1c1a-40d7-a81f-7ec40e61f27e-kube-api-access-q5vb8" (OuterVolumeSpecName: "kube-api-access-q5vb8") pod "cc594994-1c1a-40d7-a81f-7ec40e61f27e" (UID: "cc594994-1c1a-40d7-a81f-7ec40e61f27e"). InnerVolumeSpecName "kube-api-access-q5vb8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:22:39.872530 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:39.872520 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc594994-1c1a-40d7-a81f-7ec40e61f27e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cc594994-1c1a-40d7-a81f-7ec40e61f27e" (UID: "cc594994-1c1a-40d7-a81f-7ec40e61f27e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:22:39.872644 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:39.872631 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc594994-1c1a-40d7-a81f-7ec40e61f27e-istio-token" (OuterVolumeSpecName: "istio-token") pod "cc594994-1c1a-40d7-a81f-7ec40e61f27e" (UID: "cc594994-1c1a-40d7-a81f-7ec40e61f27e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:22:39.971522 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:39.971496 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc594994-1c1a-40d7-a81f-7ec40e61f27e-istio-data\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:22:39.971522 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:39.971518 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc594994-1c1a-40d7-a81f-7ec40e61f27e-istio-podinfo\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:22:39.971522 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:39.971527 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5vb8\" (UniqueName: \"kubernetes.io/projected/cc594994-1c1a-40d7-a81f-7ec40e61f27e-kube-api-access-q5vb8\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:22:39.971734 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:39.971536 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc594994-1c1a-40d7-a81f-7ec40e61f27e-istio-token\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:22:39.971734 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:39.971546 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc594994-1c1a-40d7-a81f-7ec40e61f27e-istio-envoy\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:22:39.971734 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:39.971553 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc594994-1c1a-40d7-a81f-7ec40e61f27e-istiod-ca-cert\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:22:40.177206 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:40.177109 2555 generic.go:356] "Generic (PLEG): container finished" podID="cc594994-1c1a-40d7-a81f-7ec40e61f27e" containerID="7613ebc265ae829a24357aca19ad8010d8f21888f9aad18a8de7d39f231f294b" exitCode=0 Jul 07 13:22:40.177206 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:40.177161 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" Jul 07 13:22:40.177206 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:40.177170 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" event={"ID":"cc594994-1c1a-40d7-a81f-7ec40e61f27e","Type":"ContainerDied","Data":"7613ebc265ae829a24357aca19ad8010d8f21888f9aad18a8de7d39f231f294b"} Jul 07 13:22:40.177591 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:40.177221 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g" event={"ID":"cc594994-1c1a-40d7-a81f-7ec40e61f27e","Type":"ContainerDied","Data":"902c1dbb8ee6c94ed39764f3489ec79cef630839e7f594ec20af22376045b226"} Jul 07 13:22:40.177591 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:40.177244 2555 scope.go:117] "RemoveContainer" containerID="7613ebc265ae829a24357aca19ad8010d8f21888f9aad18a8de7d39f231f294b" Jul 07 13:22:40.186377 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:40.186359 2555 scope.go:117] "RemoveContainer" containerID="750ee862ba6ba323fefd03b6999d1abdfe4e87751c604602642bced06f7f99de" Jul 07 13:22:40.195019 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:40.195004 2555 scope.go:117] "RemoveContainer" containerID="7613ebc265ae829a24357aca19ad8010d8f21888f9aad18a8de7d39f231f294b" Jul 07 13:22:40.195247 ip-10-0-136-245 kubenswrapper[2555]: E0707 13:22:40.195228 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7613ebc265ae829a24357aca19ad8010d8f21888f9aad18a8de7d39f231f294b\": container with ID starting with 7613ebc265ae829a24357aca19ad8010d8f21888f9aad18a8de7d39f231f294b not found: ID does not exist" containerID="7613ebc265ae829a24357aca19ad8010d8f21888f9aad18a8de7d39f231f294b" Jul 07 13:22:40.195300 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:40.195255 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7613ebc265ae829a24357aca19ad8010d8f21888f9aad18a8de7d39f231f294b"} err="failed to get container status \"7613ebc265ae829a24357aca19ad8010d8f21888f9aad18a8de7d39f231f294b\": rpc error: code = NotFound desc = could not find container \"7613ebc265ae829a24357aca19ad8010d8f21888f9aad18a8de7d39f231f294b\": container with ID starting with 7613ebc265ae829a24357aca19ad8010d8f21888f9aad18a8de7d39f231f294b not found: ID does not exist" Jul 07 13:22:40.195300 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:40.195272 2555 scope.go:117] "RemoveContainer" containerID="750ee862ba6ba323fefd03b6999d1abdfe4e87751c604602642bced06f7f99de" Jul 07 13:22:40.195487 ip-10-0-136-245 kubenswrapper[2555]: E0707 13:22:40.195471 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"750ee862ba6ba323fefd03b6999d1abdfe4e87751c604602642bced06f7f99de\": container with ID starting with 750ee862ba6ba323fefd03b6999d1abdfe4e87751c604602642bced06f7f99de not found: ID does not exist" containerID="750ee862ba6ba323fefd03b6999d1abdfe4e87751c604602642bced06f7f99de" Jul 07 13:22:40.195534 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:40.195491 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"750ee862ba6ba323fefd03b6999d1abdfe4e87751c604602642bced06f7f99de"} err="failed to get container status \"750ee862ba6ba323fefd03b6999d1abdfe4e87751c604602642bced06f7f99de\": rpc error: code = NotFound desc = could not find container \"750ee862ba6ba323fefd03b6999d1abdfe4e87751c604602642bced06f7f99de\": container with ID starting with 750ee862ba6ba323fefd03b6999d1abdfe4e87751c604602642bced06f7f99de not found: ID does not exist" Jul 07 13:22:40.200895 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:40.200876 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g"] Jul 07 13:22:40.206044 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:40.206025 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-256cc6-openshift-default-84d4f595fc-qw99g"] Jul 07 13:22:41.826132 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:41.826099 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc594994-1c1a-40d7-a81f-7ec40e61f27e" path="/var/lib/kubelet/pods/cc594994-1c1a-40d7-a81f-7ec40e61f27e/volumes" Jul 07 13:22:42.627992 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:42.627960 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:43.138417 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.138387 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:43.434270 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.434200 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw"] Jul 07 13:22:43.434563 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.434551 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc594994-1c1a-40d7-a81f-7ec40e61f27e" containerName="istio-proxy" Jul 07 13:22:43.434605 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.434566 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc594994-1c1a-40d7-a81f-7ec40e61f27e" containerName="istio-proxy" Jul 07 13:22:43.434651 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.434631 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc594994-1c1a-40d7-a81f-7ec40e61f27e" containerName="istio-proxy" Jul 07 13:22:43.434651 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.434640 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc594994-1c1a-40d7-a81f-7ec40e61f27e" containerName="istio-proxy" Jul 07 13:22:43.434651 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.434646 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4cf99f3-446f-40b2-a18d-22936db0fe27" containerName="istio-proxy" Jul 07 13:22:43.437682 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.437665 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:22:43.440939 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.440918 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-619289-openshift-default-dockercfg-mcstf\"" Jul 07 13:22:43.454148 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.454123 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw"] Jul 07 13:22:43.482632 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.482607 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:43.505092 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.505065 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b2d0451-7206-4693-b7e4-a0e5af2169f5-istio-token\") pod \"e2e-api-b-619289-openshift-default-654ffdc547-nn8xw\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:22:43.505207 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.505105 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6drk\" (UniqueName: \"kubernetes.io/projected/8b2d0451-7206-4693-b7e4-a0e5af2169f5-kube-api-access-n6drk\") pod \"e2e-api-b-619289-openshift-default-654ffdc547-nn8xw\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:22:43.505207 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.505141 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b2d0451-7206-4693-b7e4-a0e5af2169f5-istio-podinfo\") pod \"e2e-api-b-619289-openshift-default-654ffdc547-nn8xw\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:22:43.505207 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.505172 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b2d0451-7206-4693-b7e4-a0e5af2169f5-workload-certs\") pod \"e2e-api-b-619289-openshift-default-654ffdc547-nn8xw\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:22:43.505372 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.505218 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b2d0451-7206-4693-b7e4-a0e5af2169f5-istio-envoy\") pod \"e2e-api-b-619289-openshift-default-654ffdc547-nn8xw\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:22:43.505372 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.505295 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b2d0451-7206-4693-b7e4-a0e5af2169f5-credential-socket\") pod \"e2e-api-b-619289-openshift-default-654ffdc547-nn8xw\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:22:43.505372 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.505340 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b2d0451-7206-4693-b7e4-a0e5af2169f5-istiod-ca-cert\") pod \"e2e-api-b-619289-openshift-default-654ffdc547-nn8xw\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:22:43.505526 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.505396 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b2d0451-7206-4693-b7e4-a0e5af2169f5-istio-data\") pod \"e2e-api-b-619289-openshift-default-654ffdc547-nn8xw\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:22:43.505526 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.505434 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b2d0451-7206-4693-b7e4-a0e5af2169f5-workload-socket\") pod \"e2e-api-b-619289-openshift-default-654ffdc547-nn8xw\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:22:43.595118 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.595091 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:43.606460 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.606403 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b2d0451-7206-4693-b7e4-a0e5af2169f5-istio-data\") pod \"e2e-api-b-619289-openshift-default-654ffdc547-nn8xw\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:22:43.606596 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.606476 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b2d0451-7206-4693-b7e4-a0e5af2169f5-workload-socket\") pod \"e2e-api-b-619289-openshift-default-654ffdc547-nn8xw\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:22:43.606596 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.606555 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b2d0451-7206-4693-b7e4-a0e5af2169f5-istio-token\") pod \"e2e-api-b-619289-openshift-default-654ffdc547-nn8xw\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:22:43.606596 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.606586 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6drk\" (UniqueName: \"kubernetes.io/projected/8b2d0451-7206-4693-b7e4-a0e5af2169f5-kube-api-access-n6drk\") pod \"e2e-api-b-619289-openshift-default-654ffdc547-nn8xw\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:22:43.606774 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.606624 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b2d0451-7206-4693-b7e4-a0e5af2169f5-istio-podinfo\") pod \"e2e-api-b-619289-openshift-default-654ffdc547-nn8xw\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:22:43.606774 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.606652 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b2d0451-7206-4693-b7e4-a0e5af2169f5-workload-certs\") pod \"e2e-api-b-619289-openshift-default-654ffdc547-nn8xw\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:22:43.606774 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.606710 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b2d0451-7206-4693-b7e4-a0e5af2169f5-istio-envoy\") pod \"e2e-api-b-619289-openshift-default-654ffdc547-nn8xw\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:22:43.606774 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.606761 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b2d0451-7206-4693-b7e4-a0e5af2169f5-credential-socket\") pod \"e2e-api-b-619289-openshift-default-654ffdc547-nn8xw\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:22:43.606977 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.606801 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b2d0451-7206-4693-b7e4-a0e5af2169f5-istiod-ca-cert\") pod \"e2e-api-b-619289-openshift-default-654ffdc547-nn8xw\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:22:43.606977 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.606856 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b2d0451-7206-4693-b7e4-a0e5af2169f5-istio-data\") pod \"e2e-api-b-619289-openshift-default-654ffdc547-nn8xw\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:22:43.607088 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.607018 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b2d0451-7206-4693-b7e4-a0e5af2169f5-workload-certs\") pod \"e2e-api-b-619289-openshift-default-654ffdc547-nn8xw\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:22:43.607175 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.607155 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b2d0451-7206-4693-b7e4-a0e5af2169f5-workload-socket\") pod \"e2e-api-b-619289-openshift-default-654ffdc547-nn8xw\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:22:43.607323 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.607251 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b2d0451-7206-4693-b7e4-a0e5af2169f5-credential-socket\") pod \"e2e-api-b-619289-openshift-default-654ffdc547-nn8xw\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:22:43.607584 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.607565 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b2d0451-7206-4693-b7e4-a0e5af2169f5-istiod-ca-cert\") pod \"e2e-api-b-619289-openshift-default-654ffdc547-nn8xw\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:22:43.609238 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.609206 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b2d0451-7206-4693-b7e4-a0e5af2169f5-istio-envoy\") pod \"e2e-api-b-619289-openshift-default-654ffdc547-nn8xw\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:22:43.609661 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.609640 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b2d0451-7206-4693-b7e4-a0e5af2169f5-istio-podinfo\") pod \"e2e-api-b-619289-openshift-default-654ffdc547-nn8xw\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:22:43.617399 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.617373 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b2d0451-7206-4693-b7e4-a0e5af2169f5-istio-token\") pod \"e2e-api-b-619289-openshift-default-654ffdc547-nn8xw\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:22:43.617509 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.617438 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6drk\" (UniqueName: \"kubernetes.io/projected/8b2d0451-7206-4693-b7e4-a0e5af2169f5-kube-api-access-n6drk\") pod \"e2e-api-b-619289-openshift-default-654ffdc547-nn8xw\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:22:43.750978 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.750950 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:22:43.898031 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.897886 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw"] Jul 07 13:22:43.900374 ip-10-0-136-245 kubenswrapper[2555]: W0707 13:22:43.900348 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b2d0451_7206_4693_b7e4_a0e5af2169f5.slice/crio-5b7d313c5388c32acfda78de0d914a368513469544b2da4b90ac9b1f32589ed1 WatchSource:0}: Error finding container 5b7d313c5388c32acfda78de0d914a368513469544b2da4b90ac9b1f32589ed1: Status 404 returned error can't find the container with id 5b7d313c5388c32acfda78de0d914a368513469544b2da4b90ac9b1f32589ed1 Jul 07 13:22:43.902593 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.902562 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:22:43.902668 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.902629 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:22:43.902668 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:43.902660 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:22:44.198634 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:44.198550 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" event={"ID":"8b2d0451-7206-4693-b7e4-a0e5af2169f5","Type":"ContainerStarted","Data":"d7f0b86e494cd4462e4043b87c16c4a2b083070cb29633637b54999fa10df409"} Jul 07 13:22:44.198634 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:44.198604 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" event={"ID":"8b2d0451-7206-4693-b7e4-a0e5af2169f5","Type":"ContainerStarted","Data":"5b7d313c5388c32acfda78de0d914a368513469544b2da4b90ac9b1f32589ed1"} Jul 07 13:22:44.222092 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:44.222043 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" podStartSLOduration=1.222028147 podStartE2EDuration="1.222028147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:22:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:22:44.219224837 +0000 UTC m=+2072.940952353" watchObservedRunningTime="2026-07-07 13:22:44.222028147 +0000 UTC m=+2072.943755660" Jul 07 13:22:44.751414 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:44.751383 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:22:44.756622 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:44.756597 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:22:45.203814 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:45.203739 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:22:45.204782 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:45.204765 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:22:46.104945 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:46.104912 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:22:46.211017 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:46.210962 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:46.327672 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:46.327625 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:46.409657 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:46.409578 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:46.814997 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:46.814964 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:46.985218 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:46.985157 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:47.090728 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:47.090662 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:50.693890 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:50.693851 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:53.203608 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:53.203565 2555 patch_prober.go:28] interesting pod/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 07 13:22:53.204012 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:53.203660 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" podUID="aff04da5-047a-46bc-b102-aa9aedf7c66f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 07 13:22:54.247743 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:54.247713 2555 generic.go:356] "Generic (PLEG): container finished" podID="aff04da5-047a-46bc-b102-aa9aedf7c66f" containerID="a660878d5489b92422f515033c9897fed18c16b12c62e6d4c6f3976e46a39d29" exitCode=0 Jul 07 13:22:54.248153 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:54.247786 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" event={"ID":"aff04da5-047a-46bc-b102-aa9aedf7c66f","Type":"ContainerDied","Data":"a660878d5489b92422f515033c9897fed18c16b12c62e6d4c6f3976e46a39d29"} Jul 07 13:22:54.248213 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:54.248159 2555 scope.go:117] "RemoveContainer" containerID="a660878d5489b92422f515033c9897fed18c16b12c62e6d4c6f3976e46a39d29" Jul 07 13:22:54.249170 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:54.249142 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:22:54.249253 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:54.249223 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:22:54.249307 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:54.249270 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:22:55.255112 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:55.255074 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" event={"ID":"aff04da5-047a-46bc-b102-aa9aedf7c66f","Type":"ContainerStarted","Data":"8784cd69a9240747fe900fd8b91562132ffaa55e5bcb289d2464fd5937e3965a"} Jul 07 13:22:55.584553 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:55.584455 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:55.685980 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:55.685906 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:55.729207 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:55.729168 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:55.729497 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:55.729472 2555 patch_prober.go:28] interesting pod/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 07 13:22:55.729597 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:55.729532 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" podUID="aff04da5-047a-46bc-b102-aa9aedf7c66f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 07 13:22:56.729701 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:56.729666 2555 patch_prober.go:28] interesting pod/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 07 13:22:56.730174 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:56.729727 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" podUID="aff04da5-047a-46bc-b102-aa9aedf7c66f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 07 13:22:57.728986 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:57.728945 2555 patch_prober.go:28] interesting pod/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 07 13:22:57.729238 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:57.729006 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" podUID="aff04da5-047a-46bc-b102-aa9aedf7c66f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 07 13:22:58.729284 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:58.729253 2555 patch_prober.go:28] interesting pod/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 07 13:22:58.729696 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:58.729308 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" podUID="aff04da5-047a-46bc-b102-aa9aedf7c66f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 07 13:22:58.784332 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:58.784250 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:59.180338 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:59.180300 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:59.334137 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:59.334101 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:59.434675 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:59.434593 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:59.608220 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:59.608178 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:22:59.732085 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:59.732057 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:59.732510 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:59.732334 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:22:59.733117 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:22:59.733099 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:23:00.986284 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:00.986251 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:23:01.245612 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:01.245533 2555 patch_prober.go:28] interesting pod/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 07 13:23:01.245612 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:01.245598 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" podUID="8b2d0451-7206-4693-b7e4-a0e5af2169f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 07 13:23:02.294170 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:02.294131 2555 generic.go:356] "Generic (PLEG): container finished" podID="8b2d0451-7206-4693-b7e4-a0e5af2169f5" containerID="d7f0b86e494cd4462e4043b87c16c4a2b083070cb29633637b54999fa10df409" exitCode=0 Jul 07 13:23:02.294680 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:02.294219 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" event={"ID":"8b2d0451-7206-4693-b7e4-a0e5af2169f5","Type":"ContainerDied","Data":"d7f0b86e494cd4462e4043b87c16c4a2b083070cb29633637b54999fa10df409"} Jul 07 13:23:02.294680 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:02.294650 2555 scope.go:117] "RemoveContainer" containerID="d7f0b86e494cd4462e4043b87c16c4a2b083070cb29633637b54999fa10df409" Jul 07 13:23:02.295771 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:02.295743 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:23:02.295870 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:02.295815 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:23:02.295870 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:02.295858 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:23:03.300801 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:03.300771 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" event={"ID":"8b2d0451-7206-4693-b7e4-a0e5af2169f5","Type":"ContainerStarted","Data":"8bfe53bea3d2dac58c3366f54a45297ff047155bdf68315506398f8eb94120f0"} Jul 07 13:23:03.752084 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:03.752053 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:23:03.752265 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:03.752250 2555 patch_prober.go:28] interesting pod/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 07 13:23:03.752315 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:03.752296 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" podUID="8b2d0451-7206-4693-b7e4-a0e5af2169f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 07 13:23:04.751777 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:04.751735 2555 patch_prober.go:28] interesting pod/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 07 13:23:04.752154 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:04.751816 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" podUID="8b2d0451-7206-4693-b7e4-a0e5af2169f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 07 13:23:05.074778 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:05.074678 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:05.177471 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:05.177405 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:05.322647 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:05.322617 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg"] Jul 07 13:23:05.322851 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:05.322825 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" podUID="aff04da5-047a-46bc-b102-aa9aedf7c66f" containerName="istio-proxy" containerID="cri-o://8784cd69a9240747fe900fd8b91562132ffaa55e5bcb289d2464fd5937e3965a" gracePeriod=30 Jul 07 13:23:05.353093 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:05.353025 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:05.578893 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:05.578810 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:05.751479 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:05.751454 2555 patch_prober.go:28] interesting pod/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 07 13:23:05.751656 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:05.751502 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" podUID="8b2d0451-7206-4693-b7e4-a0e5af2169f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 07 13:23:05.776775 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:05.776747 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:06.141725 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:06.141643 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:06.272629 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:06.272595 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:06.373488 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:06.373455 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:06.506875 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:06.506840 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:06.751938 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:06.751902 2555 patch_prober.go:28] interesting pod/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 07 13:23:06.752101 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:06.751964 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" podUID="8b2d0451-7206-4693-b7e4-a0e5af2169f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 07 13:23:07.755028 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:07.755000 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:23:07.755486 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:07.755274 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:23:07.756028 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:07.756010 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:23:10.570302 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:10.570278 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:23:10.658034 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:10.657972 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aff04da5-047a-46bc-b102-aa9aedf7c66f-istio-podinfo\") pod \"aff04da5-047a-46bc-b102-aa9aedf7c66f\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " Jul 07 13:23:10.658034 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:10.658023 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aff04da5-047a-46bc-b102-aa9aedf7c66f-istiod-ca-cert\") pod \"aff04da5-047a-46bc-b102-aa9aedf7c66f\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " Jul 07 13:23:10.658215 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:10.658047 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff04da5-047a-46bc-b102-aa9aedf7c66f-workload-socket\") pod \"aff04da5-047a-46bc-b102-aa9aedf7c66f\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " Jul 07 13:23:10.658215 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:10.658075 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aff04da5-047a-46bc-b102-aa9aedf7c66f-workload-certs\") pod \"aff04da5-047a-46bc-b102-aa9aedf7c66f\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " Jul 07 13:23:10.658215 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:10.658129 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff04da5-047a-46bc-b102-aa9aedf7c66f-credential-socket\") pod \"aff04da5-047a-46bc-b102-aa9aedf7c66f\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " Jul 07 13:23:10.658215 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:10.658187 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xd9hm\" (UniqueName: \"kubernetes.io/projected/aff04da5-047a-46bc-b102-aa9aedf7c66f-kube-api-access-xd9hm\") pod \"aff04da5-047a-46bc-b102-aa9aedf7c66f\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " Jul 07 13:23:10.658458 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:10.658222 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aff04da5-047a-46bc-b102-aa9aedf7c66f-istio-token\") pod \"aff04da5-047a-46bc-b102-aa9aedf7c66f\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " Jul 07 13:23:10.658458 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:10.658259 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aff04da5-047a-46bc-b102-aa9aedf7c66f-istio-envoy\") pod \"aff04da5-047a-46bc-b102-aa9aedf7c66f\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " Jul 07 13:23:10.658458 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:10.658300 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aff04da5-047a-46bc-b102-aa9aedf7c66f-istio-data\") pod \"aff04da5-047a-46bc-b102-aa9aedf7c66f\" (UID: \"aff04da5-047a-46bc-b102-aa9aedf7c66f\") " Jul 07 13:23:10.658458 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:10.658373 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aff04da5-047a-46bc-b102-aa9aedf7c66f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aff04da5-047a-46bc-b102-aa9aedf7c66f" (UID: "aff04da5-047a-46bc-b102-aa9aedf7c66f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:23:10.658458 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:10.658401 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aff04da5-047a-46bc-b102-aa9aedf7c66f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aff04da5-047a-46bc-b102-aa9aedf7c66f" (UID: "aff04da5-047a-46bc-b102-aa9aedf7c66f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:23:10.658458 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:10.658410 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aff04da5-047a-46bc-b102-aa9aedf7c66f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aff04da5-047a-46bc-b102-aa9aedf7c66f" (UID: "aff04da5-047a-46bc-b102-aa9aedf7c66f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:23:10.658458 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:10.658453 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aff04da5-047a-46bc-b102-aa9aedf7c66f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aff04da5-047a-46bc-b102-aa9aedf7c66f" (UID: "aff04da5-047a-46bc-b102-aa9aedf7c66f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:23:10.658839 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:10.658693 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aff04da5-047a-46bc-b102-aa9aedf7c66f-istiod-ca-cert\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:23:10.658839 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:10.658713 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff04da5-047a-46bc-b102-aa9aedf7c66f-workload-socket\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:23:10.658839 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:10.658727 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aff04da5-047a-46bc-b102-aa9aedf7c66f-workload-certs\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:23:10.658839 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:10.658741 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff04da5-047a-46bc-b102-aa9aedf7c66f-credential-socket\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:23:10.659358 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:10.659330 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aff04da5-047a-46bc-b102-aa9aedf7c66f-istio-data" (OuterVolumeSpecName: "istio-data") pod "aff04da5-047a-46bc-b102-aa9aedf7c66f" (UID: "aff04da5-047a-46bc-b102-aa9aedf7c66f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:23:10.660352 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:10.660317 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aff04da5-047a-46bc-b102-aa9aedf7c66f-kube-api-access-xd9hm" (OuterVolumeSpecName: "kube-api-access-xd9hm") pod "aff04da5-047a-46bc-b102-aa9aedf7c66f" (UID: "aff04da5-047a-46bc-b102-aa9aedf7c66f"). InnerVolumeSpecName "kube-api-access-xd9hm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:23:10.660352 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:10.660339 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aff04da5-047a-46bc-b102-aa9aedf7c66f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aff04da5-047a-46bc-b102-aa9aedf7c66f" (UID: "aff04da5-047a-46bc-b102-aa9aedf7c66f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 13:23:10.660530 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:10.660372 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aff04da5-047a-46bc-b102-aa9aedf7c66f-istio-token" (OuterVolumeSpecName: "istio-token") pod "aff04da5-047a-46bc-b102-aa9aedf7c66f" (UID: "aff04da5-047a-46bc-b102-aa9aedf7c66f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:23:10.660530 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:10.660405 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aff04da5-047a-46bc-b102-aa9aedf7c66f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aff04da5-047a-46bc-b102-aa9aedf7c66f" (UID: "aff04da5-047a-46bc-b102-aa9aedf7c66f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:23:10.765268 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:10.759535 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xd9hm\" (UniqueName: \"kubernetes.io/projected/aff04da5-047a-46bc-b102-aa9aedf7c66f-kube-api-access-xd9hm\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:23:10.765268 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:10.759575 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aff04da5-047a-46bc-b102-aa9aedf7c66f-istio-token\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:23:10.765268 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:10.759599 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aff04da5-047a-46bc-b102-aa9aedf7c66f-istio-envoy\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:23:10.765268 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:10.759633 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aff04da5-047a-46bc-b102-aa9aedf7c66f-istio-data\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:23:10.765268 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:10.759656 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aff04da5-047a-46bc-b102-aa9aedf7c66f-istio-podinfo\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:23:10.904185 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:10.904153 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:23:11.347337 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:11.347303 2555 generic.go:356] "Generic (PLEG): container finished" podID="aff04da5-047a-46bc-b102-aa9aedf7c66f" containerID="8784cd69a9240747fe900fd8b91562132ffaa55e5bcb289d2464fd5937e3965a" exitCode=0 Jul 07 13:23:11.347552 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:11.347366 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" event={"ID":"aff04da5-047a-46bc-b102-aa9aedf7c66f","Type":"ContainerDied","Data":"8784cd69a9240747fe900fd8b91562132ffaa55e5bcb289d2464fd5937e3965a"} Jul 07 13:23:11.347552 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:11.347378 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" Jul 07 13:23:11.347552 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:11.347411 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg" event={"ID":"aff04da5-047a-46bc-b102-aa9aedf7c66f","Type":"ContainerDied","Data":"1d3398530624cb2c00d73f8f86587d735365642c0547a899f2a27b674cc088fb"} Jul 07 13:23:11.347552 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:11.347455 2555 scope.go:117] "RemoveContainer" containerID="8784cd69a9240747fe900fd8b91562132ffaa55e5bcb289d2464fd5937e3965a" Jul 07 13:23:11.356892 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:11.356875 2555 scope.go:117] "RemoveContainer" containerID="a660878d5489b92422f515033c9897fed18c16b12c62e6d4c6f3976e46a39d29" Jul 07 13:23:11.364276 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:11.364259 2555 scope.go:117] "RemoveContainer" containerID="8784cd69a9240747fe900fd8b91562132ffaa55e5bcb289d2464fd5937e3965a" Jul 07 13:23:11.364531 ip-10-0-136-245 kubenswrapper[2555]: E0707 13:23:11.364510 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8784cd69a9240747fe900fd8b91562132ffaa55e5bcb289d2464fd5937e3965a\": container with ID starting with 8784cd69a9240747fe900fd8b91562132ffaa55e5bcb289d2464fd5937e3965a not found: ID does not exist" containerID="8784cd69a9240747fe900fd8b91562132ffaa55e5bcb289d2464fd5937e3965a" Jul 07 13:23:11.364589 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:11.364540 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8784cd69a9240747fe900fd8b91562132ffaa55e5bcb289d2464fd5937e3965a"} err="failed to get container status \"8784cd69a9240747fe900fd8b91562132ffaa55e5bcb289d2464fd5937e3965a\": rpc error: code = NotFound desc = could not find container \"8784cd69a9240747fe900fd8b91562132ffaa55e5bcb289d2464fd5937e3965a\": container with ID starting with 8784cd69a9240747fe900fd8b91562132ffaa55e5bcb289d2464fd5937e3965a not found: ID does not exist" Jul 07 13:23:11.364589 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:11.364557 2555 scope.go:117] "RemoveContainer" containerID="a660878d5489b92422f515033c9897fed18c16b12c62e6d4c6f3976e46a39d29" Jul 07 13:23:11.364795 ip-10-0-136-245 kubenswrapper[2555]: E0707 13:23:11.364781 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a660878d5489b92422f515033c9897fed18c16b12c62e6d4c6f3976e46a39d29\": container with ID starting with a660878d5489b92422f515033c9897fed18c16b12c62e6d4c6f3976e46a39d29 not found: ID does not exist" containerID="a660878d5489b92422f515033c9897fed18c16b12c62e6d4c6f3976e46a39d29" Jul 07 13:23:11.364845 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:11.364797 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a660878d5489b92422f515033c9897fed18c16b12c62e6d4c6f3976e46a39d29"} err="failed to get container status \"a660878d5489b92422f515033c9897fed18c16b12c62e6d4c6f3976e46a39d29\": rpc error: code = NotFound desc = could not find container \"a660878d5489b92422f515033c9897fed18c16b12c62e6d4c6f3976e46a39d29\": container with ID starting with a660878d5489b92422f515033c9897fed18c16b12c62e6d4c6f3976e46a39d29 not found: ID does not exist" Jul 07 13:23:11.369622 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:11.369602 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg"] Jul 07 13:23:11.373459 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:11.373437 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-aa07aa-openshift-default-6fdd6ffbfc-42fmg"] Jul 07 13:23:11.826042 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:11.826009 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aff04da5-047a-46bc-b102-aa9aedf7c66f" path="/var/lib/kubelet/pods/aff04da5-047a-46bc-b102-aa9aedf7c66f/volumes" Jul 07 13:23:11.878897 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:11.878869 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gqgkf_d9ad543c-2b24-443d-a2ed-e3bc420cd888/console-operator/1.log" Jul 07 13:23:11.882011 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:11.881985 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gqgkf_d9ad543c-2b24-443d-a2ed-e3bc420cd888/console-operator/1.log" Jul 07 13:23:11.998024 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:11.998000 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:12.062461 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:12.062417 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:12.243679 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:12.243650 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw"] Jul 07 13:23:12.243916 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:12.243891 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" podUID="8b2d0451-7206-4693-b7e4-a0e5af2169f5" containerName="istio-proxy" containerID="cri-o://8bfe53bea3d2dac58c3366f54a45297ff047155bdf68315506398f8eb94120f0" gracePeriod=30 Jul 07 13:23:12.271068 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:12.271045 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:12.489113 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:12.489081 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:12.811447 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:12.811387 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:13.094989 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.094907 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr"] Jul 07 13:23:13.095397 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.095382 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aff04da5-047a-46bc-b102-aa9aedf7c66f" containerName="istio-proxy" Jul 07 13:23:13.095464 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.095400 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="aff04da5-047a-46bc-b102-aa9aedf7c66f" containerName="istio-proxy" Jul 07 13:23:13.095464 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.095418 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aff04da5-047a-46bc-b102-aa9aedf7c66f" containerName="istio-proxy" Jul 07 13:23:13.095464 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.095454 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="aff04da5-047a-46bc-b102-aa9aedf7c66f" containerName="istio-proxy" Jul 07 13:23:13.095571 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.095488 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc594994-1c1a-40d7-a81f-7ec40e61f27e" containerName="istio-proxy" Jul 07 13:23:13.095571 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.095497 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc594994-1c1a-40d7-a81f-7ec40e61f27e" containerName="istio-proxy" Jul 07 13:23:13.095633 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.095576 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="aff04da5-047a-46bc-b102-aa9aedf7c66f" containerName="istio-proxy" Jul 07 13:23:13.095633 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.095589 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="aff04da5-047a-46bc-b102-aa9aedf7c66f" containerName="istio-proxy" Jul 07 13:23:13.099026 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.099004 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:13.101563 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.101541 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-951cca-openshift-default-dockercfg-ff8pj\"" Jul 07 13:23:13.109677 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.109658 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr"] Jul 07 13:23:13.129635 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.129606 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:13.182483 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.182457 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71f23128-cc00-412d-af86-49cdcfbb5cb0-workload-socket\") pod \"e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:13.182584 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.182503 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71f23128-cc00-412d-af86-49cdcfbb5cb0-credential-socket\") pod \"e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:13.182629 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.182585 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71f23128-cc00-412d-af86-49cdcfbb5cb0-workload-certs\") pod \"e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:13.182666 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.182628 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71f23128-cc00-412d-af86-49cdcfbb5cb0-istio-data\") pod \"e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:13.182666 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.182645 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71f23128-cc00-412d-af86-49cdcfbb5cb0-istiod-ca-cert\") pod \"e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:13.182736 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.182697 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71f23128-cc00-412d-af86-49cdcfbb5cb0-istio-envoy\") pod \"e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:13.182736 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.182713 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71f23128-cc00-412d-af86-49cdcfbb5cb0-istio-podinfo\") pod \"e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:13.182805 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.182741 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71f23128-cc00-412d-af86-49cdcfbb5cb0-istio-token\") pod \"e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:13.182805 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.182761 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf7wd\" (UniqueName: \"kubernetes.io/projected/71f23128-cc00-412d-af86-49cdcfbb5cb0-kube-api-access-mf7wd\") pod \"e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:13.283394 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.283364 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71f23128-cc00-412d-af86-49cdcfbb5cb0-workload-certs\") pod \"e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:13.283579 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.283403 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71f23128-cc00-412d-af86-49cdcfbb5cb0-istio-data\") pod \"e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:13.283579 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.283446 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71f23128-cc00-412d-af86-49cdcfbb5cb0-istiod-ca-cert\") pod \"e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:13.283579 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.283487 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71f23128-cc00-412d-af86-49cdcfbb5cb0-istio-envoy\") pod \"e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:13.283579 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.283510 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71f23128-cc00-412d-af86-49cdcfbb5cb0-istio-podinfo\") pod \"e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:13.283579 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.283544 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71f23128-cc00-412d-af86-49cdcfbb5cb0-istio-token\") pod \"e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:13.283579 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.283566 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf7wd\" (UniqueName: \"kubernetes.io/projected/71f23128-cc00-412d-af86-49cdcfbb5cb0-kube-api-access-mf7wd\") pod \"e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:13.283906 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.283650 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71f23128-cc00-412d-af86-49cdcfbb5cb0-workload-socket\") pod \"e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:13.283906 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.283682 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71f23128-cc00-412d-af86-49cdcfbb5cb0-credential-socket\") pod \"e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:13.283906 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.283896 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71f23128-cc00-412d-af86-49cdcfbb5cb0-istio-data\") pod \"e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:13.284070 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.284024 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71f23128-cc00-412d-af86-49cdcfbb5cb0-workload-certs\") pod \"e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:13.284133 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.284086 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71f23128-cc00-412d-af86-49cdcfbb5cb0-credential-socket\") pod \"e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:13.284192 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.284175 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71f23128-cc00-412d-af86-49cdcfbb5cb0-workload-socket\") pod \"e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:13.284317 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.284297 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71f23128-cc00-412d-af86-49cdcfbb5cb0-istiod-ca-cert\") pod \"e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:13.286087 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.286060 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71f23128-cc00-412d-af86-49cdcfbb5cb0-istio-envoy\") pod \"e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:13.286189 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.286114 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71f23128-cc00-412d-af86-49cdcfbb5cb0-istio-podinfo\") pod \"e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:13.293278 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.293253 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71f23128-cc00-412d-af86-49cdcfbb5cb0-istio-token\") pod \"e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:13.293414 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.293351 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf7wd\" (UniqueName: \"kubernetes.io/projected/71f23128-cc00-412d-af86-49cdcfbb5cb0-kube-api-access-mf7wd\") pod \"e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:13.410781 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.410716 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:13.551937 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.551911 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr"] Jul 07 13:23:13.553107 ip-10-0-136-245 kubenswrapper[2555]: W0707 13:23:13.553080 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71f23128_cc00_412d_af86_49cdcfbb5cb0.slice/crio-1ddfe97b92d1882e179b9e32e31a275e368a4fbeee548c65bacd412e95e71cf9 WatchSource:0}: Error finding container 1ddfe97b92d1882e179b9e32e31a275e368a4fbeee548c65bacd412e95e71cf9: Status 404 returned error can't find the container with id 1ddfe97b92d1882e179b9e32e31a275e368a4fbeee548c65bacd412e95e71cf9 Jul 07 13:23:13.555382 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.555354 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:23:13.555470 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.555414 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:23:13.555510 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.555477 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:23:13.623921 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:13.623894 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:14.363408 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:14.363360 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" event={"ID":"71f23128-cc00-412d-af86-49cdcfbb5cb0","Type":"ContainerStarted","Data":"0cae4475f6ab7164e6ce7e4c05a4372443f041b5f2b453d9ddabd50b409d8c54"} Jul 07 13:23:14.363906 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:14.363451 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" event={"ID":"71f23128-cc00-412d-af86-49cdcfbb5cb0","Type":"ContainerStarted","Data":"1ddfe97b92d1882e179b9e32e31a275e368a4fbeee548c65bacd412e95e71cf9"} Jul 07 13:23:14.385983 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:14.385938 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" podStartSLOduration=1.3859227760000001 podStartE2EDuration="1.385922776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:23:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:23:14.385292261 +0000 UTC m=+2103.107019776" watchObservedRunningTime="2026-07-07 13:23:14.385922776 +0000 UTC m=+2103.107650289" Jul 07 13:23:14.411524 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:14.411498 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:14.416396 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:14.416376 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:15.367725 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:15.367691 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:15.368634 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:15.368615 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:16.304236 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:16.304206 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:16.445221 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:16.445190 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:16.601161 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:16.601068 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:16.722398 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:16.722366 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:17.349101 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:17.349070 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:17.379340 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:17.379315 2555 generic.go:356] "Generic (PLEG): container finished" podID="8b2d0451-7206-4693-b7e4-a0e5af2169f5" containerID="8bfe53bea3d2dac58c3366f54a45297ff047155bdf68315506398f8eb94120f0" exitCode=0 Jul 07 13:23:17.379498 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:17.379392 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" event={"ID":"8b2d0451-7206-4693-b7e4-a0e5af2169f5","Type":"ContainerDied","Data":"8bfe53bea3d2dac58c3366f54a45297ff047155bdf68315506398f8eb94120f0"} Jul 07 13:23:17.379498 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:17.379474 2555 scope.go:117] "RemoveContainer" containerID="d7f0b86e494cd4462e4043b87c16c4a2b083070cb29633637b54999fa10df409" Jul 07 13:23:17.464630 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:17.464601 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:17.500772 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:17.500749 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:23:17.623890 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:17.623816 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b2d0451-7206-4693-b7e4-a0e5af2169f5-istio-envoy\") pod \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " Jul 07 13:23:17.623890 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:17.623866 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b2d0451-7206-4693-b7e4-a0e5af2169f5-workload-socket\") pod \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " Jul 07 13:23:17.623890 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:17.623888 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b2d0451-7206-4693-b7e4-a0e5af2169f5-istio-data\") pod \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " Jul 07 13:23:17.624149 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:17.623931 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b2d0451-7206-4693-b7e4-a0e5af2169f5-workload-certs\") pod \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " Jul 07 13:23:17.624149 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:17.623951 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b2d0451-7206-4693-b7e4-a0e5af2169f5-istio-token\") pod \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " Jul 07 13:23:17.624149 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:17.623968 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b2d0451-7206-4693-b7e4-a0e5af2169f5-credential-socket\") pod \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " Jul 07 13:23:17.624149 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:17.623993 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6drk\" (UniqueName: \"kubernetes.io/projected/8b2d0451-7206-4693-b7e4-a0e5af2169f5-kube-api-access-n6drk\") pod \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " Jul 07 13:23:17.624149 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:17.624088 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b2d0451-7206-4693-b7e4-a0e5af2169f5-istiod-ca-cert\") pod \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " Jul 07 13:23:17.624149 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:17.624114 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b2d0451-7206-4693-b7e4-a0e5af2169f5-istio-podinfo\") pod \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\" (UID: \"8b2d0451-7206-4693-b7e4-a0e5af2169f5\") " Jul 07 13:23:17.624492 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:17.624261 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b2d0451-7206-4693-b7e4-a0e5af2169f5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8b2d0451-7206-4693-b7e4-a0e5af2169f5" (UID: "8b2d0451-7206-4693-b7e4-a0e5af2169f5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:23:17.624492 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:17.624320 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b2d0451-7206-4693-b7e4-a0e5af2169f5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8b2d0451-7206-4693-b7e4-a0e5af2169f5" (UID: "8b2d0451-7206-4693-b7e4-a0e5af2169f5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:23:17.624492 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:17.624390 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b2d0451-7206-4693-b7e4-a0e5af2169f5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8b2d0451-7206-4693-b7e4-a0e5af2169f5" (UID: "8b2d0451-7206-4693-b7e4-a0e5af2169f5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:23:17.624492 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:17.624481 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b2d0451-7206-4693-b7e4-a0e5af2169f5-workload-certs\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:23:17.624694 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:17.624501 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b2d0451-7206-4693-b7e4-a0e5af2169f5-workload-socket\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:23:17.624694 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:17.624668 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b2d0451-7206-4693-b7e4-a0e5af2169f5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8b2d0451-7206-4693-b7e4-a0e5af2169f5" (UID: "8b2d0451-7206-4693-b7e4-a0e5af2169f5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:23:17.624994 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:17.624971 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b2d0451-7206-4693-b7e4-a0e5af2169f5-istio-data" (OuterVolumeSpecName: "istio-data") pod "8b2d0451-7206-4693-b7e4-a0e5af2169f5" (UID: "8b2d0451-7206-4693-b7e4-a0e5af2169f5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:23:17.626315 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:17.626296 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8b2d0451-7206-4693-b7e4-a0e5af2169f5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8b2d0451-7206-4693-b7e4-a0e5af2169f5" (UID: "8b2d0451-7206-4693-b7e4-a0e5af2169f5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 13:23:17.626395 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:17.626332 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b2d0451-7206-4693-b7e4-a0e5af2169f5-istio-token" (OuterVolumeSpecName: "istio-token") pod "8b2d0451-7206-4693-b7e4-a0e5af2169f5" (UID: "8b2d0451-7206-4693-b7e4-a0e5af2169f5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:23:17.626475 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:17.626457 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b2d0451-7206-4693-b7e4-a0e5af2169f5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8b2d0451-7206-4693-b7e4-a0e5af2169f5" (UID: "8b2d0451-7206-4693-b7e4-a0e5af2169f5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:23:17.626517 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:17.626501 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b2d0451-7206-4693-b7e4-a0e5af2169f5-kube-api-access-n6drk" (OuterVolumeSpecName: "kube-api-access-n6drk") pod "8b2d0451-7206-4693-b7e4-a0e5af2169f5" (UID: "8b2d0451-7206-4693-b7e4-a0e5af2169f5"). InnerVolumeSpecName "kube-api-access-n6drk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:23:17.725510 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:17.725486 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b2d0451-7206-4693-b7e4-a0e5af2169f5-istio-token\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:23:17.725510 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:17.725508 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b2d0451-7206-4693-b7e4-a0e5af2169f5-credential-socket\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:23:17.725654 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:17.725519 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6drk\" (UniqueName: \"kubernetes.io/projected/8b2d0451-7206-4693-b7e4-a0e5af2169f5-kube-api-access-n6drk\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:23:17.725654 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:17.725528 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b2d0451-7206-4693-b7e4-a0e5af2169f5-istiod-ca-cert\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:23:17.725654 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:17.725536 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b2d0451-7206-4693-b7e4-a0e5af2169f5-istio-podinfo\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:23:17.725654 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:17.725544 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b2d0451-7206-4693-b7e4-a0e5af2169f5-istio-envoy\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:23:17.725654 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:17.725551 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b2d0451-7206-4693-b7e4-a0e5af2169f5-istio-data\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:23:18.384718 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:18.384687 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" Jul 07 13:23:18.384718 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:18.384695 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw" event={"ID":"8b2d0451-7206-4693-b7e4-a0e5af2169f5","Type":"ContainerDied","Data":"5b7d313c5388c32acfda78de0d914a368513469544b2da4b90ac9b1f32589ed1"} Jul 07 13:23:18.384940 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:18.384754 2555 scope.go:117] "RemoveContainer" containerID="8bfe53bea3d2dac58c3366f54a45297ff047155bdf68315506398f8eb94120f0" Jul 07 13:23:18.410580 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:18.410558 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw"] Jul 07 13:23:18.419969 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:18.419947 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-619289-openshift-default-654ffdc547-nn8xw"] Jul 07 13:23:19.827188 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:19.827157 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b2d0451-7206-4693-b7e4-a0e5af2169f5" path="/var/lib/kubelet/pods/8b2d0451-7206-4693-b7e4-a0e5af2169f5/volumes" Jul 07 13:23:20.825556 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:20.825524 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:21.142344 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.142264 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:21.436476 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.436389 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq"] Jul 07 13:23:21.437007 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.436977 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b2d0451-7206-4693-b7e4-a0e5af2169f5" containerName="istio-proxy" Jul 07 13:23:21.437007 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.437004 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b2d0451-7206-4693-b7e4-a0e5af2169f5" containerName="istio-proxy" Jul 07 13:23:21.437196 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.437019 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b2d0451-7206-4693-b7e4-a0e5af2169f5" containerName="istio-proxy" Jul 07 13:23:21.437196 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.437029 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b2d0451-7206-4693-b7e4-a0e5af2169f5" containerName="istio-proxy" Jul 07 13:23:21.437196 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.437142 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b2d0451-7206-4693-b7e4-a0e5af2169f5" containerName="istio-proxy" Jul 07 13:23:21.437196 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.437156 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b2d0451-7206-4693-b7e4-a0e5af2169f5" containerName="istio-proxy" Jul 07 13:23:21.440472 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.440452 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:21.443775 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.443753 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-38a70c-openshift-default-dockercfg-rtzmr\"" Jul 07 13:23:21.453273 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.453254 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq"] Jul 07 13:23:21.478719 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.478700 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:21.557202 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.557174 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec9055da-806b-4dec-8b23-8608c8ff07a6-workload-socket\") pod \"e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:21.557402 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.557208 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec9055da-806b-4dec-8b23-8608c8ff07a6-istio-podinfo\") pod \"e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:21.557402 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.557234 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec9055da-806b-4dec-8b23-8608c8ff07a6-istio-data\") pod \"e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:21.557402 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.557320 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec9055da-806b-4dec-8b23-8608c8ff07a6-workload-certs\") pod \"e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:21.557605 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.557444 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f75mm\" (UniqueName: \"kubernetes.io/projected/ec9055da-806b-4dec-8b23-8608c8ff07a6-kube-api-access-f75mm\") pod \"e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:21.557605 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.557532 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec9055da-806b-4dec-8b23-8608c8ff07a6-istio-envoy\") pod \"e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:21.557605 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.557585 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec9055da-806b-4dec-8b23-8608c8ff07a6-istiod-ca-cert\") pod \"e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:21.557761 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.557640 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec9055da-806b-4dec-8b23-8608c8ff07a6-credential-socket\") pod \"e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:21.557761 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.557661 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec9055da-806b-4dec-8b23-8608c8ff07a6-istio-token\") pod \"e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:21.658772 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.658745 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec9055da-806b-4dec-8b23-8608c8ff07a6-istio-data\") pod \"e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:21.658772 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.658774 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec9055da-806b-4dec-8b23-8608c8ff07a6-workload-certs\") pod \"e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:21.658976 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.658794 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f75mm\" (UniqueName: \"kubernetes.io/projected/ec9055da-806b-4dec-8b23-8608c8ff07a6-kube-api-access-f75mm\") pod \"e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:21.658976 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.658836 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec9055da-806b-4dec-8b23-8608c8ff07a6-istio-envoy\") pod \"e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:21.658976 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.658858 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec9055da-806b-4dec-8b23-8608c8ff07a6-istiod-ca-cert\") pod \"e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:21.658976 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.658880 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec9055da-806b-4dec-8b23-8608c8ff07a6-credential-socket\") pod \"e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:21.659174 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.658971 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec9055da-806b-4dec-8b23-8608c8ff07a6-istio-token\") pod \"e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:21.659174 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.659082 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec9055da-806b-4dec-8b23-8608c8ff07a6-workload-socket\") pod \"e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:21.659174 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.659115 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec9055da-806b-4dec-8b23-8608c8ff07a6-istio-podinfo\") pod \"e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:21.659324 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.659234 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec9055da-806b-4dec-8b23-8608c8ff07a6-istio-data\") pod \"e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:21.659324 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.659285 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec9055da-806b-4dec-8b23-8608c8ff07a6-credential-socket\") pod \"e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:21.659558 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.659533 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec9055da-806b-4dec-8b23-8608c8ff07a6-workload-socket\") pod \"e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:21.659703 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.659608 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec9055da-806b-4dec-8b23-8608c8ff07a6-workload-certs\") pod \"e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:21.659703 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.659670 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec9055da-806b-4dec-8b23-8608c8ff07a6-istiod-ca-cert\") pod \"e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:21.661143 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.661125 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec9055da-806b-4dec-8b23-8608c8ff07a6-istio-envoy\") pod \"e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:21.661435 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.661409 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec9055da-806b-4dec-8b23-8608c8ff07a6-istio-podinfo\") pod \"e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:21.666715 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.666695 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec9055da-806b-4dec-8b23-8608c8ff07a6-istio-token\") pod \"e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:21.666872 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.666855 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f75mm\" (UniqueName: \"kubernetes.io/projected/ec9055da-806b-4dec-8b23-8608c8ff07a6-kube-api-access-f75mm\") pod \"e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:21.751723 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.751700 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:21.819465 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.819389 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:21.891647 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.891604 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq"] Jul 07 13:23:21.894818 ip-10-0-136-245 kubenswrapper[2555]: W0707 13:23:21.894792 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec9055da_806b_4dec_8b23_8608c8ff07a6.slice/crio-326dd0567deaa0f6b5ad60e4f2f44ca154234fef9e20210b5a10eb4fa67d7381 WatchSource:0}: Error finding container 326dd0567deaa0f6b5ad60e4f2f44ca154234fef9e20210b5a10eb4fa67d7381: Status 404 returned error can't find the container with id 326dd0567deaa0f6b5ad60e4f2f44ca154234fef9e20210b5a10eb4fa67d7381 Jul 07 13:23:21.897410 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.897378 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:23:21.897533 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.897455 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:23:21.897533 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:21.897487 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:23:22.405970 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:22.405931 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" event={"ID":"ec9055da-806b-4dec-8b23-8608c8ff07a6","Type":"ContainerStarted","Data":"75123e921ad3e5f4873f464d0a6535efd90dfb5d0162a321b8dadfabbfa8675a"} Jul 07 13:23:22.406333 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:22.406005 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" event={"ID":"ec9055da-806b-4dec-8b23-8608c8ff07a6","Type":"ContainerStarted","Data":"326dd0567deaa0f6b5ad60e4f2f44ca154234fef9e20210b5a10eb4fa67d7381"} Jul 07 13:23:22.428373 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:22.428329 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" podStartSLOduration=1.4283129190000001 podStartE2EDuration="1.428312919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:23:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:23:22.426243739 +0000 UTC m=+2111.147971263" watchObservedRunningTime="2026-07-07 13:23:22.428312919 +0000 UTC m=+2111.150040435" Jul 07 13:23:22.752354 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:22.752322 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:22.757070 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:22.757048 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:23.411073 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:23.411042 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:23.411967 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:23.411946 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:23.815923 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:23.815890 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:23:24.378400 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:24.378360 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:24.507971 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:24.507930 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:24.623741 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:24.623706 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:25.219516 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:25.219482 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:25.318443 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:25.318392 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:28.854344 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:28.854298 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:28.963518 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:28.963444 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:31.409618 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:31.409575 2555 patch_prober.go:28] interesting pod/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 07 13:23:31.411033 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:31.409640 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" podUID="71f23128-cc00-412d-af86-49cdcfbb5cb0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 07 13:23:32.453811 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:32.453777 2555 generic.go:356] "Generic (PLEG): container finished" podID="71f23128-cc00-412d-af86-49cdcfbb5cb0" containerID="0cae4475f6ab7164e6ce7e4c05a4372443f041b5f2b453d9ddabd50b409d8c54" exitCode=0 Jul 07 13:23:32.454223 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:32.453832 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" event={"ID":"71f23128-cc00-412d-af86-49cdcfbb5cb0","Type":"ContainerDied","Data":"0cae4475f6ab7164e6ce7e4c05a4372443f041b5f2b453d9ddabd50b409d8c54"} Jul 07 13:23:32.454275 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:32.454249 2555 scope.go:117] "RemoveContainer" containerID="0cae4475f6ab7164e6ce7e4c05a4372443f041b5f2b453d9ddabd50b409d8c54" Jul 07 13:23:32.455285 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:32.455255 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:23:32.455357 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:32.455339 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:23:32.455406 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:32.455389 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:23:33.460892 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:33.460860 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" event={"ID":"71f23128-cc00-412d-af86-49cdcfbb5cb0","Type":"ContainerStarted","Data":"57035444d931296d8abf7fdfa9efe5029c2c93059b9d51658a21fb0d53627e96"} Jul 07 13:23:34.411630 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:34.411593 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:34.411993 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:34.411971 2555 patch_prober.go:28] interesting pod/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 07 13:23:34.412174 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:34.412148 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" podUID="71f23128-cc00-412d-af86-49cdcfbb5cb0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 07 13:23:35.191840 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:35.191791 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:23:35.411520 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:35.411474 2555 patch_prober.go:28] interesting pod/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 07 13:23:35.411739 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:35.411526 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" podUID="71f23128-cc00-412d-af86-49cdcfbb5cb0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 07 13:23:36.412030 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:36.411994 2555 patch_prober.go:28] interesting pod/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 07 13:23:36.412529 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:36.412052 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" podUID="71f23128-cc00-412d-af86-49cdcfbb5cb0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 07 13:23:37.411577 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:37.411532 2555 patch_prober.go:28] interesting pod/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 07 13:23:37.411798 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:37.411604 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" podUID="71f23128-cc00-412d-af86-49cdcfbb5cb0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 07 13:23:38.170265 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:38.170217 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:38.271780 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:38.271752 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:38.415203 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:38.415174 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:38.415489 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:38.415459 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:38.416240 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:38.416221 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:23:38.734151 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:38.734124 2555 patch_prober.go:28] interesting pod/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": read tcp 10.132.0.2:58000->10.132.0.47:15021: read: connection reset by peer" start-of-body= Jul 07 13:23:38.734271 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:38.734190 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" podUID="ec9055da-806b-4dec-8b23-8608c8ff07a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": read tcp 10.132.0.2:58000->10.132.0.47:15021: read: connection reset by peer" Jul 07 13:23:39.501522 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:39.501487 2555 generic.go:356] "Generic (PLEG): container finished" podID="ec9055da-806b-4dec-8b23-8608c8ff07a6" containerID="75123e921ad3e5f4873f464d0a6535efd90dfb5d0162a321b8dadfabbfa8675a" exitCode=0 Jul 07 13:23:39.501948 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:39.501561 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" event={"ID":"ec9055da-806b-4dec-8b23-8608c8ff07a6","Type":"ContainerDied","Data":"75123e921ad3e5f4873f464d0a6535efd90dfb5d0162a321b8dadfabbfa8675a"} Jul 07 13:23:39.502074 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:39.502058 2555 scope.go:117] "RemoveContainer" containerID="75123e921ad3e5f4873f464d0a6535efd90dfb5d0162a321b8dadfabbfa8675a" Jul 07 13:23:39.502999 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:39.502968 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:23:39.503104 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:39.503047 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:23:39.503104 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:39.503092 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 13:23:40.509217 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:40.509182 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" event={"ID":"ec9055da-806b-4dec-8b23-8608c8ff07a6","Type":"ContainerStarted","Data":"5a907233307457ef347b945adcb0519ca82f05c45322d78bdc60a27f4337eff6"} Jul 07 13:23:40.752809 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:40.752772 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:40.753008 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:40.752988 2555 patch_prober.go:28] interesting pod/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 07 13:23:40.753061 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:40.753040 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" podUID="ec9055da-806b-4dec-8b23-8608c8ff07a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 07 13:23:41.752725 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:41.752690 2555 patch_prober.go:28] interesting pod/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 07 13:23:41.753131 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:41.752776 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" podUID="ec9055da-806b-4dec-8b23-8608c8ff07a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 07 13:23:42.752772 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:42.752736 2555 patch_prober.go:28] interesting pod/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 07 13:23:42.753246 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:42.752795 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" podUID="ec9055da-806b-4dec-8b23-8608c8ff07a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 07 13:23:43.752062 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:43.752028 2555 patch_prober.go:28] interesting pod/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 07 13:23:43.752240 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:43.752082 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" podUID="ec9055da-806b-4dec-8b23-8608c8ff07a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 07 13:23:44.756250 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:44.756224 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:44.756642 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:44.756465 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:44.757087 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:44.757066 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:23:45.967352 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:45.967317 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:46.071570 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:46.071541 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:46.737875 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:46.737845 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:23:50.400382 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:50.400346 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:23:58.435831 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:23:58.435782 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:24:13.144235 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:24:13.144201 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:24:16.888099 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:24:16.888066 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:24:41.123606 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:24:41.123571 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:24:59.797094 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:24:59.797059 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:25:18.198259 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:25:18.198221 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:25:33.113226 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:25:33.113193 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:25:51.110181 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:25:51.110097 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:26:05.693286 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:05.693252 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:26:17.786403 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:17.786370 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:26:18.730151 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:18.730120 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:26:21.602059 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:21.602024 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:26:35.516083 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:35.516034 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:26:41.303821 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:41.303784 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:26:56.802185 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:56.802150 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx"] Jul 07 13:26:56.804863 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:56.804845 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx" Jul 07 13:26:56.808536 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:56.808488 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-38a70c\"/\"default-dockercfg-qz2q2\"" Jul 07 13:26:56.808536 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:56.808491 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-38a70c\"/\"sub-test-model-38a70c-kserve-self-signed-certs\"" Jul 07 13:26:56.808734 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:56.808622 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-38a70c\"/\"kube-root-ca.crt\"" Jul 07 13:26:56.808791 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:56.808738 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-38a70c\"/\"openshift-service-ca.crt\"" Jul 07 13:26:56.816865 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:56.816843 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx"] Jul 07 13:26:56.844572 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:56.844546 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:26:56.900894 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:56.900855 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/664e1c9c-dc57-495f-81a5-78d6f642deb8-home\") pod \"sub-test-model-38a70c-kserve-59db8f5ddc-28dmx\" (UID: \"664e1c9c-dc57-495f-81a5-78d6f642deb8\") " pod="ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx" Jul 07 13:26:56.900894 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:56.900894 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/664e1c9c-dc57-495f-81a5-78d6f642deb8-tmp-dir\") pod \"sub-test-model-38a70c-kserve-59db8f5ddc-28dmx\" (UID: \"664e1c9c-dc57-495f-81a5-78d6f642deb8\") " pod="ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx" Jul 07 13:26:56.901111 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:56.900916 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6qph\" (UniqueName: \"kubernetes.io/projected/664e1c9c-dc57-495f-81a5-78d6f642deb8-kube-api-access-p6qph\") pod \"sub-test-model-38a70c-kserve-59db8f5ddc-28dmx\" (UID: \"664e1c9c-dc57-495f-81a5-78d6f642deb8\") " pod="ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx" Jul 07 13:26:56.901111 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:56.901021 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/664e1c9c-dc57-495f-81a5-78d6f642deb8-dshm\") pod \"sub-test-model-38a70c-kserve-59db8f5ddc-28dmx\" (UID: \"664e1c9c-dc57-495f-81a5-78d6f642deb8\") " pod="ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx" Jul 07 13:26:56.901111 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:56.901049 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/664e1c9c-dc57-495f-81a5-78d6f642deb8-tls-certs\") pod \"sub-test-model-38a70c-kserve-59db8f5ddc-28dmx\" (UID: \"664e1c9c-dc57-495f-81a5-78d6f642deb8\") " pod="ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx" Jul 07 13:26:56.901111 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:56.901076 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/664e1c9c-dc57-495f-81a5-78d6f642deb8-model-cache\") pod \"sub-test-model-38a70c-kserve-59db8f5ddc-28dmx\" (UID: \"664e1c9c-dc57-495f-81a5-78d6f642deb8\") " pod="ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx" Jul 07 13:26:57.001799 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:57.001770 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/664e1c9c-dc57-495f-81a5-78d6f642deb8-home\") pod \"sub-test-model-38a70c-kserve-59db8f5ddc-28dmx\" (UID: \"664e1c9c-dc57-495f-81a5-78d6f642deb8\") " pod="ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx" Jul 07 13:26:57.002009 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:57.001809 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/664e1c9c-dc57-495f-81a5-78d6f642deb8-tmp-dir\") pod \"sub-test-model-38a70c-kserve-59db8f5ddc-28dmx\" (UID: \"664e1c9c-dc57-495f-81a5-78d6f642deb8\") " pod="ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx" Jul 07 13:26:57.002009 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:57.001834 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6qph\" (UniqueName: \"kubernetes.io/projected/664e1c9c-dc57-495f-81a5-78d6f642deb8-kube-api-access-p6qph\") pod \"sub-test-model-38a70c-kserve-59db8f5ddc-28dmx\" (UID: \"664e1c9c-dc57-495f-81a5-78d6f642deb8\") " pod="ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx" Jul 07 13:26:57.002009 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:57.001898 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/664e1c9c-dc57-495f-81a5-78d6f642deb8-dshm\") pod \"sub-test-model-38a70c-kserve-59db8f5ddc-28dmx\" (UID: \"664e1c9c-dc57-495f-81a5-78d6f642deb8\") " pod="ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx" Jul 07 13:26:57.002009 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:57.001918 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/664e1c9c-dc57-495f-81a5-78d6f642deb8-tls-certs\") pod \"sub-test-model-38a70c-kserve-59db8f5ddc-28dmx\" (UID: \"664e1c9c-dc57-495f-81a5-78d6f642deb8\") " pod="ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx" Jul 07 13:26:57.002009 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:57.001942 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/664e1c9c-dc57-495f-81a5-78d6f642deb8-model-cache\") pod \"sub-test-model-38a70c-kserve-59db8f5ddc-28dmx\" (UID: \"664e1c9c-dc57-495f-81a5-78d6f642deb8\") " pod="ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx" Jul 07 13:26:57.002299 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:57.002238 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/664e1c9c-dc57-495f-81a5-78d6f642deb8-home\") pod \"sub-test-model-38a70c-kserve-59db8f5ddc-28dmx\" (UID: \"664e1c9c-dc57-495f-81a5-78d6f642deb8\") " pod="ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx" Jul 07 13:26:57.002299 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:57.002246 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/664e1c9c-dc57-495f-81a5-78d6f642deb8-tmp-dir\") pod \"sub-test-model-38a70c-kserve-59db8f5ddc-28dmx\" (UID: \"664e1c9c-dc57-495f-81a5-78d6f642deb8\") " pod="ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx" Jul 07 13:26:57.002400 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:57.002325 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/664e1c9c-dc57-495f-81a5-78d6f642deb8-model-cache\") pod \"sub-test-model-38a70c-kserve-59db8f5ddc-28dmx\" (UID: \"664e1c9c-dc57-495f-81a5-78d6f642deb8\") " pod="ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx" Jul 07 13:26:57.004262 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:57.004236 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/664e1c9c-dc57-495f-81a5-78d6f642deb8-dshm\") pod \"sub-test-model-38a70c-kserve-59db8f5ddc-28dmx\" (UID: \"664e1c9c-dc57-495f-81a5-78d6f642deb8\") " pod="ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx" Jul 07 13:26:57.004497 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:57.004482 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/664e1c9c-dc57-495f-81a5-78d6f642deb8-tls-certs\") pod \"sub-test-model-38a70c-kserve-59db8f5ddc-28dmx\" (UID: \"664e1c9c-dc57-495f-81a5-78d6f642deb8\") " pod="ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx" Jul 07 13:26:57.010916 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:57.010892 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6qph\" (UniqueName: \"kubernetes.io/projected/664e1c9c-dc57-495f-81a5-78d6f642deb8-kube-api-access-p6qph\") pod \"sub-test-model-38a70c-kserve-59db8f5ddc-28dmx\" (UID: \"664e1c9c-dc57-495f-81a5-78d6f642deb8\") " pod="ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx" Jul 07 13:26:57.114644 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:57.114554 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx" Jul 07 13:26:57.451509 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:57.451484 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx"] Jul 07 13:26:57.453505 ip-10-0-136-245 kubenswrapper[2555]: W0707 13:26:57.453475 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod664e1c9c_dc57_495f_81a5_78d6f642deb8.slice/crio-ef9183e3ef2ca93c655a1629b97f051c98f3b2fd24906c8088819a9367a4e7e8 WatchSource:0}: Error finding container ef9183e3ef2ca93c655a1629b97f051c98f3b2fd24906c8088819a9367a4e7e8: Status 404 returned error can't find the container with id ef9183e3ef2ca93c655a1629b97f051c98f3b2fd24906c8088819a9367a4e7e8 Jul 07 13:26:58.435492 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:58.435454 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx" event={"ID":"664e1c9c-dc57-495f-81a5-78d6f642deb8","Type":"ContainerStarted","Data":"3692ca1ffd3c9c6c13f11d8f64969e2c948df614f985d56e4322b771a1ac1a01"} Jul 07 13:26:58.435887 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:58.435496 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx" event={"ID":"664e1c9c-dc57-495f-81a5-78d6f642deb8","Type":"ContainerStarted","Data":"ef9183e3ef2ca93c655a1629b97f051c98f3b2fd24906c8088819a9367a4e7e8"} Jul 07 13:26:58.453227 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:26:58.453186 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx" podStartSLOduration=2.453172102 podStartE2EDuration="2.453172102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:26:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:26:58.451856647 +0000 UTC m=+2327.173584163" watchObservedRunningTime="2026-07-07 13:26:58.453172102 +0000 UTC m=+2327.174899614" Jul 07 13:27:01.544060 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:01.544028 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:27:07.115608 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:07.115531 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx" Jul 07 13:27:07.115608 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:07.115588 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx" Jul 07 13:27:07.127768 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:07.127741 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx" Jul 07 13:27:07.488845 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:07.488818 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx" Jul 07 13:27:26.707530 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:26.707492 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:27:42.946125 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:42.946091 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:27:43.876929 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:43.876891 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx"] Jul 07 13:27:43.902145 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:43.902098 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:27:48.599047 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:48.594929 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:27:53.946786 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:53.946739 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:27:58.896867 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:58.896818 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx" podUID="664e1c9c-dc57-495f-81a5-78d6f642deb8" containerName="main" containerID="cri-o://3692ca1ffd3c9c6c13f11d8f64969e2c948df614f985d56e4322b771a1ac1a01" gracePeriod=45 Jul 07 13:27:59.149700 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:59.149639 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx" Jul 07 13:27:59.151303 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:59.151280 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6qph\" (UniqueName: \"kubernetes.io/projected/664e1c9c-dc57-495f-81a5-78d6f642deb8-kube-api-access-p6qph\") pod \"664e1c9c-dc57-495f-81a5-78d6f642deb8\" (UID: \"664e1c9c-dc57-495f-81a5-78d6f642deb8\") " Jul 07 13:27:59.151392 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:59.151354 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/664e1c9c-dc57-495f-81a5-78d6f642deb8-dshm\") pod \"664e1c9c-dc57-495f-81a5-78d6f642deb8\" (UID: \"664e1c9c-dc57-495f-81a5-78d6f642deb8\") " Jul 07 13:27:59.151479 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:59.151407 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/664e1c9c-dc57-495f-81a5-78d6f642deb8-tls-certs\") pod \"664e1c9c-dc57-495f-81a5-78d6f642deb8\" (UID: \"664e1c9c-dc57-495f-81a5-78d6f642deb8\") " Jul 07 13:27:59.151479 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:59.151457 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/664e1c9c-dc57-495f-81a5-78d6f642deb8-model-cache\") pod \"664e1c9c-dc57-495f-81a5-78d6f642deb8\" (UID: \"664e1c9c-dc57-495f-81a5-78d6f642deb8\") " Jul 07 13:27:59.151599 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:59.151490 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/664e1c9c-dc57-495f-81a5-78d6f642deb8-tmp-dir\") pod \"664e1c9c-dc57-495f-81a5-78d6f642deb8\" (UID: \"664e1c9c-dc57-495f-81a5-78d6f642deb8\") " Jul 07 13:27:59.151657 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:59.151617 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/664e1c9c-dc57-495f-81a5-78d6f642deb8-home\") pod \"664e1c9c-dc57-495f-81a5-78d6f642deb8\" (UID: \"664e1c9c-dc57-495f-81a5-78d6f642deb8\") " Jul 07 13:27:59.151773 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:59.151751 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/664e1c9c-dc57-495f-81a5-78d6f642deb8-model-cache" (OuterVolumeSpecName: "model-cache") pod "664e1c9c-dc57-495f-81a5-78d6f642deb8" (UID: "664e1c9c-dc57-495f-81a5-78d6f642deb8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:27:59.151837 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:59.151786 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/664e1c9c-dc57-495f-81a5-78d6f642deb8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "664e1c9c-dc57-495f-81a5-78d6f642deb8" (UID: "664e1c9c-dc57-495f-81a5-78d6f642deb8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:27:59.151964 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:59.151942 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/664e1c9c-dc57-495f-81a5-78d6f642deb8-home" (OuterVolumeSpecName: "home") pod "664e1c9c-dc57-495f-81a5-78d6f642deb8" (UID: "664e1c9c-dc57-495f-81a5-78d6f642deb8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:27:59.152029 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:59.152000 2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/664e1c9c-dc57-495f-81a5-78d6f642deb8-model-cache\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:27:59.152029 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:59.152018 2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/664e1c9c-dc57-495f-81a5-78d6f642deb8-tmp-dir\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:27:59.153632 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:59.153606 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/664e1c9c-dc57-495f-81a5-78d6f642deb8-dshm" (OuterVolumeSpecName: "dshm") pod "664e1c9c-dc57-495f-81a5-78d6f642deb8" (UID: "664e1c9c-dc57-495f-81a5-78d6f642deb8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:27:59.153756 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:59.153646 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/664e1c9c-dc57-495f-81a5-78d6f642deb8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "664e1c9c-dc57-495f-81a5-78d6f642deb8" (UID: "664e1c9c-dc57-495f-81a5-78d6f642deb8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:27:59.153824 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:59.153792 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/664e1c9c-dc57-495f-81a5-78d6f642deb8-kube-api-access-p6qph" (OuterVolumeSpecName: "kube-api-access-p6qph") pod "664e1c9c-dc57-495f-81a5-78d6f642deb8" (UID: "664e1c9c-dc57-495f-81a5-78d6f642deb8"). InnerVolumeSpecName "kube-api-access-p6qph". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:27:59.252890 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:59.252859 2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/664e1c9c-dc57-495f-81a5-78d6f642deb8-dshm\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:27:59.252890 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:59.252888 2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/664e1c9c-dc57-495f-81a5-78d6f642deb8-tls-certs\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:27:59.252890 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:59.252898 2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/664e1c9c-dc57-495f-81a5-78d6f642deb8-home\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:27:59.253126 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:59.252910 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6qph\" (UniqueName: \"kubernetes.io/projected/664e1c9c-dc57-495f-81a5-78d6f642deb8-kube-api-access-p6qph\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:27:59.722590 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:59.722559 2555 generic.go:356] "Generic (PLEG): container finished" podID="664e1c9c-dc57-495f-81a5-78d6f642deb8" containerID="3692ca1ffd3c9c6c13f11d8f64969e2c948df614f985d56e4322b771a1ac1a01" exitCode=0 Jul 07 13:27:59.722769 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:59.722602 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx" Jul 07 13:27:59.722769 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:59.722643 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx" event={"ID":"664e1c9c-dc57-495f-81a5-78d6f642deb8","Type":"ContainerDied","Data":"3692ca1ffd3c9c6c13f11d8f64969e2c948df614f985d56e4322b771a1ac1a01"} Jul 07 13:27:59.722769 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:59.722695 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx" event={"ID":"664e1c9c-dc57-495f-81a5-78d6f642deb8","Type":"ContainerDied","Data":"ef9183e3ef2ca93c655a1629b97f051c98f3b2fd24906c8088819a9367a4e7e8"} Jul 07 13:27:59.722769 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:59.722719 2555 scope.go:117] "RemoveContainer" containerID="3692ca1ffd3c9c6c13f11d8f64969e2c948df614f985d56e4322b771a1ac1a01" Jul 07 13:27:59.732199 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:59.732184 2555 scope.go:117] "RemoveContainer" containerID="3692ca1ffd3c9c6c13f11d8f64969e2c948df614f985d56e4322b771a1ac1a01" Jul 07 13:27:59.732462 ip-10-0-136-245 kubenswrapper[2555]: E0707 13:27:59.732445 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3692ca1ffd3c9c6c13f11d8f64969e2c948df614f985d56e4322b771a1ac1a01\": container with ID starting with 3692ca1ffd3c9c6c13f11d8f64969e2c948df614f985d56e4322b771a1ac1a01 not found: ID does not exist" containerID="3692ca1ffd3c9c6c13f11d8f64969e2c948df614f985d56e4322b771a1ac1a01" Jul 07 13:27:59.732518 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:59.732470 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3692ca1ffd3c9c6c13f11d8f64969e2c948df614f985d56e4322b771a1ac1a01"} err="failed to get container status \"3692ca1ffd3c9c6c13f11d8f64969e2c948df614f985d56e4322b771a1ac1a01\": rpc error: code = NotFound desc = could not find container \"3692ca1ffd3c9c6c13f11d8f64969e2c948df614f985d56e4322b771a1ac1a01\": container with ID starting with 3692ca1ffd3c9c6c13f11d8f64969e2c948df614f985d56e4322b771a1ac1a01 not found: ID does not exist" Jul 07 13:27:59.745184 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:59.745162 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx"] Jul 07 13:27:59.749144 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:59.749121 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-38a70c/sub-test-model-38a70c-kserve-59db8f5ddc-28dmx"] Jul 07 13:27:59.825826 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:27:59.825796 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="664e1c9c-dc57-495f-81a5-78d6f642deb8" path="/var/lib/kubelet/pods/664e1c9c-dc57-495f-81a5-78d6f642deb8/volumes" Jul 07 13:28:05.797915 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:05.797884 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:28:11.909692 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:11.909666 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gqgkf_d9ad543c-2b24-443d-a2ed-e3bc420cd888/console-operator/1.log" Jul 07 13:28:11.913320 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:11.913296 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gqgkf_d9ad543c-2b24-443d-a2ed-e3bc420cd888/console-operator/1.log" Jul 07 13:28:19.207803 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.207769 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw"] Jul 07 13:28:19.208193 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.208111 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="664e1c9c-dc57-495f-81a5-78d6f642deb8" containerName="main" Jul 07 13:28:19.208193 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.208124 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="664e1c9c-dc57-495f-81a5-78d6f642deb8" containerName="main" Jul 07 13:28:19.208282 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.208195 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="664e1c9c-dc57-495f-81a5-78d6f642deb8" containerName="main" Jul 07 13:28:19.210457 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.210418 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw" Jul 07 13:28:19.213290 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.213270 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-38a70c\"/\"kube-root-ca.crt\"" Jul 07 13:28:19.214175 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.214158 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-38a70c\"/\"default-dockercfg-qz2q2\"" Jul 07 13:28:19.214259 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.214172 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-38a70c\"/\"openshift-service-ca.crt\"" Jul 07 13:28:19.214365 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.214346 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-38a70c\"/\"rate-test-model-38a70c-kserve-self-signed-certs\"" Jul 07 13:28:19.223880 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.223395 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw"] Jul 07 13:28:19.281639 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.281582 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:28:19.323795 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.323767 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e288613-5e15-40c2-a2fe-66644d5459e5-tls-certs\") pod \"rate-test-model-38a70c-kserve-58cbbdd795-lnfzw\" (UID: \"4e288613-5e15-40c2-a2fe-66644d5459e5\") " pod="ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw" Jul 07 13:28:19.323908 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.323804 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e288613-5e15-40c2-a2fe-66644d5459e5-model-cache\") pod \"rate-test-model-38a70c-kserve-58cbbdd795-lnfzw\" (UID: \"4e288613-5e15-40c2-a2fe-66644d5459e5\") " pod="ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw" Jul 07 13:28:19.323908 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.323824 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbtd8\" (UniqueName: \"kubernetes.io/projected/4e288613-5e15-40c2-a2fe-66644d5459e5-kube-api-access-tbtd8\") pod \"rate-test-model-38a70c-kserve-58cbbdd795-lnfzw\" (UID: \"4e288613-5e15-40c2-a2fe-66644d5459e5\") " pod="ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw" Jul 07 13:28:19.323981 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.323964 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e288613-5e15-40c2-a2fe-66644d5459e5-dshm\") pod \"rate-test-model-38a70c-kserve-58cbbdd795-lnfzw\" (UID: \"4e288613-5e15-40c2-a2fe-66644d5459e5\") " pod="ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw" Jul 07 13:28:19.324020 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.323992 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e288613-5e15-40c2-a2fe-66644d5459e5-home\") pod \"rate-test-model-38a70c-kserve-58cbbdd795-lnfzw\" (UID: \"4e288613-5e15-40c2-a2fe-66644d5459e5\") " pod="ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw" Jul 07 13:28:19.324020 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.324011 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e288613-5e15-40c2-a2fe-66644d5459e5-tmp-dir\") pod \"rate-test-model-38a70c-kserve-58cbbdd795-lnfzw\" (UID: \"4e288613-5e15-40c2-a2fe-66644d5459e5\") " pod="ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw" Jul 07 13:28:19.424649 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.424617 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e288613-5e15-40c2-a2fe-66644d5459e5-dshm\") pod \"rate-test-model-38a70c-kserve-58cbbdd795-lnfzw\" (UID: \"4e288613-5e15-40c2-a2fe-66644d5459e5\") " pod="ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw" Jul 07 13:28:19.424649 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.424651 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e288613-5e15-40c2-a2fe-66644d5459e5-home\") pod \"rate-test-model-38a70c-kserve-58cbbdd795-lnfzw\" (UID: \"4e288613-5e15-40c2-a2fe-66644d5459e5\") " pod="ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw" Jul 07 13:28:19.424895 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.424667 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e288613-5e15-40c2-a2fe-66644d5459e5-tmp-dir\") pod \"rate-test-model-38a70c-kserve-58cbbdd795-lnfzw\" (UID: \"4e288613-5e15-40c2-a2fe-66644d5459e5\") " pod="ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw" Jul 07 13:28:19.424895 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.424812 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e288613-5e15-40c2-a2fe-66644d5459e5-tls-certs\") pod \"rate-test-model-38a70c-kserve-58cbbdd795-lnfzw\" (UID: \"4e288613-5e15-40c2-a2fe-66644d5459e5\") " pod="ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw" Jul 07 13:28:19.424895 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.424867 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e288613-5e15-40c2-a2fe-66644d5459e5-model-cache\") pod \"rate-test-model-38a70c-kserve-58cbbdd795-lnfzw\" (UID: \"4e288613-5e15-40c2-a2fe-66644d5459e5\") " pod="ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw" Jul 07 13:28:19.425054 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.424901 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbtd8\" (UniqueName: \"kubernetes.io/projected/4e288613-5e15-40c2-a2fe-66644d5459e5-kube-api-access-tbtd8\") pod \"rate-test-model-38a70c-kserve-58cbbdd795-lnfzw\" (UID: \"4e288613-5e15-40c2-a2fe-66644d5459e5\") " pod="ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw" Jul 07 13:28:19.425054 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.425030 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e288613-5e15-40c2-a2fe-66644d5459e5-tmp-dir\") pod \"rate-test-model-38a70c-kserve-58cbbdd795-lnfzw\" (UID: \"4e288613-5e15-40c2-a2fe-66644d5459e5\") " pod="ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw" Jul 07 13:28:19.425135 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.425109 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e288613-5e15-40c2-a2fe-66644d5459e5-home\") pod \"rate-test-model-38a70c-kserve-58cbbdd795-lnfzw\" (UID: \"4e288613-5e15-40c2-a2fe-66644d5459e5\") " pod="ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw" Jul 07 13:28:19.425193 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.425178 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e288613-5e15-40c2-a2fe-66644d5459e5-model-cache\") pod \"rate-test-model-38a70c-kserve-58cbbdd795-lnfzw\" (UID: \"4e288613-5e15-40c2-a2fe-66644d5459e5\") " pod="ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw" Jul 07 13:28:19.426967 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.426945 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e288613-5e15-40c2-a2fe-66644d5459e5-dshm\") pod \"rate-test-model-38a70c-kserve-58cbbdd795-lnfzw\" (UID: \"4e288613-5e15-40c2-a2fe-66644d5459e5\") " pod="ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw" Jul 07 13:28:19.427198 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.427180 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e288613-5e15-40c2-a2fe-66644d5459e5-tls-certs\") pod \"rate-test-model-38a70c-kserve-58cbbdd795-lnfzw\" (UID: \"4e288613-5e15-40c2-a2fe-66644d5459e5\") " pod="ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw" Jul 07 13:28:19.432974 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.432950 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbtd8\" (UniqueName: \"kubernetes.io/projected/4e288613-5e15-40c2-a2fe-66644d5459e5-kube-api-access-tbtd8\") pod \"rate-test-model-38a70c-kserve-58cbbdd795-lnfzw\" (UID: \"4e288613-5e15-40c2-a2fe-66644d5459e5\") " pod="ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw" Jul 07 13:28:19.520820 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.520785 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw" Jul 07 13:28:19.653161 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.653138 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw"] Jul 07 13:28:19.655604 ip-10-0-136-245 kubenswrapper[2555]: W0707 13:28:19.655577 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e288613_5e15_40c2_a2fe_66644d5459e5.slice/crio-18d8cd1c80489eb7c2713ff6e91e546204791d1c8531af604f57835778407e46 WatchSource:0}: Error finding container 18d8cd1c80489eb7c2713ff6e91e546204791d1c8531af604f57835778407e46: Status 404 returned error can't find the container with id 18d8cd1c80489eb7c2713ff6e91e546204791d1c8531af604f57835778407e46 Jul 07 13:28:19.817486 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.817375 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw" event={"ID":"4e288613-5e15-40c2-a2fe-66644d5459e5","Type":"ContainerStarted","Data":"b16a9617ccae1b5c067d2fffc2d06606e27f8da5dd1d1f423f46dd8b96e6fc3e"} Jul 07 13:28:19.817486 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.817437 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw" event={"ID":"4e288613-5e15-40c2-a2fe-66644d5459e5","Type":"ContainerStarted","Data":"18d8cd1c80489eb7c2713ff6e91e546204791d1c8531af604f57835778407e46"} Jul 07 13:28:19.835241 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:19.835195 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw" podStartSLOduration=0.835180933 podStartE2EDuration="835.180933ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:28:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:28:19.833747729 +0000 UTC m=+2408.555475241" watchObservedRunningTime="2026-07-07 13:28:19.835180933 +0000 UTC m=+2408.556908423" Jul 07 13:28:23.199405 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:23.199376 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:28:29.521164 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:29.521130 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw" Jul 07 13:28:29.521623 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:29.521181 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw" Jul 07 13:28:29.533506 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:29.533482 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw" Jul 07 13:28:29.707993 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:29.707964 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:28:29.809375 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:29.809268 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:28:29.877235 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:29.877207 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw" Jul 07 13:28:30.588906 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:30.588876 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:28:38.894998 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:38.894884 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:28:38.898886 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:38.898864 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:28:38.998035 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:38.998005 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:28:47.056014 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:47.055975 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:28:47.123948 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:47.123902 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:28:59.297061 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:28:59.297022 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:29:03.103534 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:03.103492 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:29:03.970687 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:03.970650 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw"] Jul 07 13:29:04.240143 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:04.240110 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:29:17.899683 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:17.899643 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:29:18.990717 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:18.990651 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw" podUID="4e288613-5e15-40c2-a2fe-66644d5459e5" containerName="main" containerID="cri-o://b16a9617ccae1b5c067d2fffc2d06606e27f8da5dd1d1f423f46dd8b96e6fc3e" gracePeriod=45 Jul 07 13:29:19.240341 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:19.240319 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw" Jul 07 13:29:19.336074 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:19.336008 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e288613-5e15-40c2-a2fe-66644d5459e5-model-cache\") pod \"4e288613-5e15-40c2-a2fe-66644d5459e5\" (UID: \"4e288613-5e15-40c2-a2fe-66644d5459e5\") " Jul 07 13:29:19.336074 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:19.336047 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbtd8\" (UniqueName: \"kubernetes.io/projected/4e288613-5e15-40c2-a2fe-66644d5459e5-kube-api-access-tbtd8\") pod \"4e288613-5e15-40c2-a2fe-66644d5459e5\" (UID: \"4e288613-5e15-40c2-a2fe-66644d5459e5\") " Jul 07 13:29:19.336074 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:19.336072 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e288613-5e15-40c2-a2fe-66644d5459e5-home\") pod \"4e288613-5e15-40c2-a2fe-66644d5459e5\" (UID: \"4e288613-5e15-40c2-a2fe-66644d5459e5\") " Jul 07 13:29:19.336335 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:19.336102 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e288613-5e15-40c2-a2fe-66644d5459e5-tmp-dir\") pod \"4e288613-5e15-40c2-a2fe-66644d5459e5\" (UID: \"4e288613-5e15-40c2-a2fe-66644d5459e5\") " Jul 07 13:29:19.336335 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:19.336136 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e288613-5e15-40c2-a2fe-66644d5459e5-dshm\") pod \"4e288613-5e15-40c2-a2fe-66644d5459e5\" (UID: \"4e288613-5e15-40c2-a2fe-66644d5459e5\") " Jul 07 13:29:19.336335 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:19.336162 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e288613-5e15-40c2-a2fe-66644d5459e5-tls-certs\") pod \"4e288613-5e15-40c2-a2fe-66644d5459e5\" (UID: \"4e288613-5e15-40c2-a2fe-66644d5459e5\") " Jul 07 13:29:19.336335 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:19.336288 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e288613-5e15-40c2-a2fe-66644d5459e5-model-cache" (OuterVolumeSpecName: "model-cache") pod "4e288613-5e15-40c2-a2fe-66644d5459e5" (UID: "4e288613-5e15-40c2-a2fe-66644d5459e5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:29:19.336536 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:19.336387 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e288613-5e15-40c2-a2fe-66644d5459e5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4e288613-5e15-40c2-a2fe-66644d5459e5" (UID: "4e288613-5e15-40c2-a2fe-66644d5459e5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:29:19.336536 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:19.336396 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e288613-5e15-40c2-a2fe-66644d5459e5-home" (OuterVolumeSpecName: "home") pod "4e288613-5e15-40c2-a2fe-66644d5459e5" (UID: "4e288613-5e15-40c2-a2fe-66644d5459e5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:29:19.336536 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:19.336486 2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e288613-5e15-40c2-a2fe-66644d5459e5-home\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:29:19.336536 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:19.336528 2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e288613-5e15-40c2-a2fe-66644d5459e5-tmp-dir\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:29:19.336760 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:19.336542 2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e288613-5e15-40c2-a2fe-66644d5459e5-model-cache\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:29:19.338121 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:19.338090 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e288613-5e15-40c2-a2fe-66644d5459e5-dshm" (OuterVolumeSpecName: "dshm") pod "4e288613-5e15-40c2-a2fe-66644d5459e5" (UID: "4e288613-5e15-40c2-a2fe-66644d5459e5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:29:19.338194 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:19.338142 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e288613-5e15-40c2-a2fe-66644d5459e5-kube-api-access-tbtd8" (OuterVolumeSpecName: "kube-api-access-tbtd8") pod "4e288613-5e15-40c2-a2fe-66644d5459e5" (UID: "4e288613-5e15-40c2-a2fe-66644d5459e5"). InnerVolumeSpecName "kube-api-access-tbtd8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:29:19.338240 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:19.338200 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e288613-5e15-40c2-a2fe-66644d5459e5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4e288613-5e15-40c2-a2fe-66644d5459e5" (UID: "4e288613-5e15-40c2-a2fe-66644d5459e5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 13:29:19.437284 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:19.437250 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbtd8\" (UniqueName: \"kubernetes.io/projected/4e288613-5e15-40c2-a2fe-66644d5459e5-kube-api-access-tbtd8\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:29:19.437284 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:19.437282 2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e288613-5e15-40c2-a2fe-66644d5459e5-dshm\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:29:19.437284 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:19.437292 2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e288613-5e15-40c2-a2fe-66644d5459e5-tls-certs\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:29:20.106871 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:20.106783 2555 generic.go:356] "Generic (PLEG): container finished" podID="4e288613-5e15-40c2-a2fe-66644d5459e5" containerID="b16a9617ccae1b5c067d2fffc2d06606e27f8da5dd1d1f423f46dd8b96e6fc3e" exitCode=0 Jul 07 13:29:20.106871 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:20.106830 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw" Jul 07 13:29:20.106871 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:20.106849 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw" event={"ID":"4e288613-5e15-40c2-a2fe-66644d5459e5","Type":"ContainerDied","Data":"b16a9617ccae1b5c067d2fffc2d06606e27f8da5dd1d1f423f46dd8b96e6fc3e"} Jul 07 13:29:20.107389 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:20.106887 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw" event={"ID":"4e288613-5e15-40c2-a2fe-66644d5459e5","Type":"ContainerDied","Data":"18d8cd1c80489eb7c2713ff6e91e546204791d1c8531af604f57835778407e46"} Jul 07 13:29:20.107389 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:20.106909 2555 scope.go:117] "RemoveContainer" containerID="b16a9617ccae1b5c067d2fffc2d06606e27f8da5dd1d1f423f46dd8b96e6fc3e" Jul 07 13:29:20.116155 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:20.116137 2555 scope.go:117] "RemoveContainer" containerID="b16a9617ccae1b5c067d2fffc2d06606e27f8da5dd1d1f423f46dd8b96e6fc3e" Jul 07 13:29:20.116414 ip-10-0-136-245 kubenswrapper[2555]: E0707 13:29:20.116392 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b16a9617ccae1b5c067d2fffc2d06606e27f8da5dd1d1f423f46dd8b96e6fc3e\": container with ID starting with b16a9617ccae1b5c067d2fffc2d06606e27f8da5dd1d1f423f46dd8b96e6fc3e not found: ID does not exist" containerID="b16a9617ccae1b5c067d2fffc2d06606e27f8da5dd1d1f423f46dd8b96e6fc3e" Jul 07 13:29:20.116501 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:20.116435 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b16a9617ccae1b5c067d2fffc2d06606e27f8da5dd1d1f423f46dd8b96e6fc3e"} err="failed to get container status \"b16a9617ccae1b5c067d2fffc2d06606e27f8da5dd1d1f423f46dd8b96e6fc3e\": rpc error: code = NotFound desc = could not find container \"b16a9617ccae1b5c067d2fffc2d06606e27f8da5dd1d1f423f46dd8b96e6fc3e\": container with ID starting with b16a9617ccae1b5c067d2fffc2d06606e27f8da5dd1d1f423f46dd8b96e6fc3e not found: ID does not exist" Jul 07 13:29:20.126454 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:20.126417 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw"] Jul 07 13:29:20.129978 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:20.129958 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-38a70c/rate-test-model-38a70c-kserve-58cbbdd795-lnfzw"] Jul 07 13:29:21.826010 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:21.825977 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e288613-5e15-40c2-a2fe-66644d5459e5" path="/var/lib/kubelet/pods/4e288613-5e15-40c2-a2fe-66644d5459e5/volumes" Jul 07 13:29:31.996591 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:31.996562 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:29:35.910189 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:35.910151 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:29:47.275957 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:47.275921 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:29:47.716265 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:47.716186 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:29:47.813534 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:47.813497 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:29:47.999474 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:47.999408 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:29:51.602465 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:51.602434 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:29:54.108317 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:54.108284 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:29:54.209613 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:54.209580 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:29:54.331112 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:54.331070 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr"] Jul 07 13:29:54.331304 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:54.331267 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" podUID="71f23128-cc00-412d-af86-49cdcfbb5cb0" containerName="istio-proxy" containerID="cri-o://57035444d931296d8abf7fdfa9efe5029c2c93059b9d51658a21fb0d53627e96" gracePeriod=30 Jul 07 13:29:54.359344 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:54.359268 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:29:54.639902 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:54.639824 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:29:54.813377 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:54.813347 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:29:55.248087 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:55.248054 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:29:55.430848 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:55.430810 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:29:55.623983 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:55.623905 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:29:59.583417 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:59.583393 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:29:59.688964 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:59.688890 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71f23128-cc00-412d-af86-49cdcfbb5cb0-workload-certs\") pod \"71f23128-cc00-412d-af86-49cdcfbb5cb0\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " Jul 07 13:29:59.688964 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:59.688931 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71f23128-cc00-412d-af86-49cdcfbb5cb0-istio-envoy\") pod \"71f23128-cc00-412d-af86-49cdcfbb5cb0\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " Jul 07 13:29:59.688964 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:59.688948 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71f23128-cc00-412d-af86-49cdcfbb5cb0-istiod-ca-cert\") pod \"71f23128-cc00-412d-af86-49cdcfbb5cb0\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " Jul 07 13:29:59.688964 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:59.688965 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71f23128-cc00-412d-af86-49cdcfbb5cb0-istio-podinfo\") pod \"71f23128-cc00-412d-af86-49cdcfbb5cb0\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " Jul 07 13:29:59.689259 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:59.688998 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71f23128-cc00-412d-af86-49cdcfbb5cb0-credential-socket\") pod \"71f23128-cc00-412d-af86-49cdcfbb5cb0\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " Jul 07 13:29:59.689259 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:59.689023 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mf7wd\" (UniqueName: \"kubernetes.io/projected/71f23128-cc00-412d-af86-49cdcfbb5cb0-kube-api-access-mf7wd\") pod \"71f23128-cc00-412d-af86-49cdcfbb5cb0\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " Jul 07 13:29:59.689259 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:59.689043 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71f23128-cc00-412d-af86-49cdcfbb5cb0-istio-token\") pod \"71f23128-cc00-412d-af86-49cdcfbb5cb0\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " Jul 07 13:29:59.689259 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:59.689107 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71f23128-cc00-412d-af86-49cdcfbb5cb0-workload-socket\") pod \"71f23128-cc00-412d-af86-49cdcfbb5cb0\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " Jul 07 13:29:59.689507 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:59.689333 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71f23128-cc00-412d-af86-49cdcfbb5cb0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "71f23128-cc00-412d-af86-49cdcfbb5cb0" (UID: "71f23128-cc00-412d-af86-49cdcfbb5cb0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:29:59.689507 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:59.689475 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71f23128-cc00-412d-af86-49cdcfbb5cb0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "71f23128-cc00-412d-af86-49cdcfbb5cb0" (UID: "71f23128-cc00-412d-af86-49cdcfbb5cb0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:29:59.689507 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:59.689488 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71f23128-cc00-412d-af86-49cdcfbb5cb0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "71f23128-cc00-412d-af86-49cdcfbb5cb0" (UID: "71f23128-cc00-412d-af86-49cdcfbb5cb0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:29:59.689675 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:59.689510 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71f23128-cc00-412d-af86-49cdcfbb5cb0-istio-data\") pod \"71f23128-cc00-412d-af86-49cdcfbb5cb0\" (UID: \"71f23128-cc00-412d-af86-49cdcfbb5cb0\") " Jul 07 13:29:59.689675 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:59.689628 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71f23128-cc00-412d-af86-49cdcfbb5cb0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "71f23128-cc00-412d-af86-49cdcfbb5cb0" (UID: "71f23128-cc00-412d-af86-49cdcfbb5cb0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:29:59.689902 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:59.689882 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71f23128-cc00-412d-af86-49cdcfbb5cb0-credential-socket\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:29:59.689970 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:59.689908 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71f23128-cc00-412d-af86-49cdcfbb5cb0-workload-socket\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:29:59.689970 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:59.689924 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71f23128-cc00-412d-af86-49cdcfbb5cb0-workload-certs\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:29:59.689970 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:59.689940 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71f23128-cc00-412d-af86-49cdcfbb5cb0-istiod-ca-cert\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:29:59.690272 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:59.690249 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71f23128-cc00-412d-af86-49cdcfbb5cb0-istio-data" (OuterVolumeSpecName: "istio-data") pod "71f23128-cc00-412d-af86-49cdcfbb5cb0" (UID: "71f23128-cc00-412d-af86-49cdcfbb5cb0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:29:59.691325 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:59.691298 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71f23128-cc00-412d-af86-49cdcfbb5cb0-istio-token" (OuterVolumeSpecName: "istio-token") pod "71f23128-cc00-412d-af86-49cdcfbb5cb0" (UID: "71f23128-cc00-412d-af86-49cdcfbb5cb0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:29:59.691419 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:59.691333 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71f23128-cc00-412d-af86-49cdcfbb5cb0-kube-api-access-mf7wd" (OuterVolumeSpecName: "kube-api-access-mf7wd") pod "71f23128-cc00-412d-af86-49cdcfbb5cb0" (UID: "71f23128-cc00-412d-af86-49cdcfbb5cb0"). InnerVolumeSpecName "kube-api-access-mf7wd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:29:59.691520 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:59.691503 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71f23128-cc00-412d-af86-49cdcfbb5cb0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "71f23128-cc00-412d-af86-49cdcfbb5cb0" (UID: "71f23128-cc00-412d-af86-49cdcfbb5cb0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:29:59.691604 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:59.691585 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/71f23128-cc00-412d-af86-49cdcfbb5cb0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "71f23128-cc00-412d-af86-49cdcfbb5cb0" (UID: "71f23128-cc00-412d-af86-49cdcfbb5cb0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 13:29:59.791120 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:59.791086 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71f23128-cc00-412d-af86-49cdcfbb5cb0-istio-envoy\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:29:59.791120 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:59.791113 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71f23128-cc00-412d-af86-49cdcfbb5cb0-istio-podinfo\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:29:59.791120 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:59.791123 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mf7wd\" (UniqueName: \"kubernetes.io/projected/71f23128-cc00-412d-af86-49cdcfbb5cb0-kube-api-access-mf7wd\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:29:59.791361 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:59.791135 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71f23128-cc00-412d-af86-49cdcfbb5cb0-istio-token\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:29:59.791361 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:29:59.791144 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71f23128-cc00-412d-af86-49cdcfbb5cb0-istio-data\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:30:00.299733 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:00.299698 2555 generic.go:356] "Generic (PLEG): container finished" podID="71f23128-cc00-412d-af86-49cdcfbb5cb0" containerID="57035444d931296d8abf7fdfa9efe5029c2c93059b9d51658a21fb0d53627e96" exitCode=0 Jul 07 13:30:00.299909 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:00.299746 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" Jul 07 13:30:00.299909 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:00.299774 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" event={"ID":"71f23128-cc00-412d-af86-49cdcfbb5cb0","Type":"ContainerDied","Data":"57035444d931296d8abf7fdfa9efe5029c2c93059b9d51658a21fb0d53627e96"} Jul 07 13:30:00.299909 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:00.299829 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr" event={"ID":"71f23128-cc00-412d-af86-49cdcfbb5cb0","Type":"ContainerDied","Data":"1ddfe97b92d1882e179b9e32e31a275e368a4fbeee548c65bacd412e95e71cf9"} Jul 07 13:30:00.299909 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:00.299869 2555 scope.go:117] "RemoveContainer" containerID="57035444d931296d8abf7fdfa9efe5029c2c93059b9d51658a21fb0d53627e96" Jul 07 13:30:00.309150 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:00.309123 2555 scope.go:117] "RemoveContainer" containerID="0cae4475f6ab7164e6ce7e4c05a4372443f041b5f2b453d9ddabd50b409d8c54" Jul 07 13:30:00.317142 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:00.317121 2555 scope.go:117] "RemoveContainer" containerID="57035444d931296d8abf7fdfa9efe5029c2c93059b9d51658a21fb0d53627e96" Jul 07 13:30:00.317375 ip-10-0-136-245 kubenswrapper[2555]: E0707 13:30:00.317354 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57035444d931296d8abf7fdfa9efe5029c2c93059b9d51658a21fb0d53627e96\": container with ID starting with 57035444d931296d8abf7fdfa9efe5029c2c93059b9d51658a21fb0d53627e96 not found: ID does not exist" containerID="57035444d931296d8abf7fdfa9efe5029c2c93059b9d51658a21fb0d53627e96" Jul 07 13:30:00.317459 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:00.317382 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57035444d931296d8abf7fdfa9efe5029c2c93059b9d51658a21fb0d53627e96"} err="failed to get container status \"57035444d931296d8abf7fdfa9efe5029c2c93059b9d51658a21fb0d53627e96\": rpc error: code = NotFound desc = could not find container \"57035444d931296d8abf7fdfa9efe5029c2c93059b9d51658a21fb0d53627e96\": container with ID starting with 57035444d931296d8abf7fdfa9efe5029c2c93059b9d51658a21fb0d53627e96 not found: ID does not exist" Jul 07 13:30:00.317459 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:00.317397 2555 scope.go:117] "RemoveContainer" containerID="0cae4475f6ab7164e6ce7e4c05a4372443f041b5f2b453d9ddabd50b409d8c54" Jul 07 13:30:00.317661 ip-10-0-136-245 kubenswrapper[2555]: E0707 13:30:00.317646 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cae4475f6ab7164e6ce7e4c05a4372443f041b5f2b453d9ddabd50b409d8c54\": container with ID starting with 0cae4475f6ab7164e6ce7e4c05a4372443f041b5f2b453d9ddabd50b409d8c54 not found: ID does not exist" containerID="0cae4475f6ab7164e6ce7e4c05a4372443f041b5f2b453d9ddabd50b409d8c54" Jul 07 13:30:00.317699 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:00.317669 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cae4475f6ab7164e6ce7e4c05a4372443f041b5f2b453d9ddabd50b409d8c54"} err="failed to get container status \"0cae4475f6ab7164e6ce7e4c05a4372443f041b5f2b453d9ddabd50b409d8c54\": rpc error: code = NotFound desc = could not find container \"0cae4475f6ab7164e6ce7e4c05a4372443f041b5f2b453d9ddabd50b409d8c54\": container with ID starting with 0cae4475f6ab7164e6ce7e4c05a4372443f041b5f2b453d9ddabd50b409d8c54 not found: ID does not exist" Jul 07 13:30:00.350971 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:00.350940 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr"] Jul 07 13:30:00.356669 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:00.356648 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-951cca-openshift-default-6bf946f6b7-7ptmr"] Jul 07 13:30:01.562692 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:01.562657 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:30:01.665933 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:01.665905 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:30:01.828040 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:01.827951 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71f23128-cc00-412d-af86-49cdcfbb5cb0" path="/var/lib/kubelet/pods/71f23128-cc00-412d-af86-49cdcfbb5cb0/volumes" Jul 07 13:30:01.874311 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:01.874277 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq"] Jul 07 13:30:01.874523 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:01.874498 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" podUID="ec9055da-806b-4dec-8b23-8608c8ff07a6" containerName="istio-proxy" containerID="cri-o://5a907233307457ef347b945adcb0519ca82f05c45322d78bdc60a27f4337eff6" gracePeriod=30 Jul 07 13:30:01.885861 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:01.885836 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:30:02.147535 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:02.147451 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:30:02.630310 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:02.630281 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5b74bd9b95-ws24f_508c8201-0684-4157-b17e-46f1db331610/authorino/0.log" Jul 07 13:30:04.212747 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:04.212667 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwht"] Jul 07 13:30:07.136614 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.136558 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:30:07.260236 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.260194 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f75mm\" (UniqueName: \"kubernetes.io/projected/ec9055da-806b-4dec-8b23-8608c8ff07a6-kube-api-access-f75mm\") pod \"ec9055da-806b-4dec-8b23-8608c8ff07a6\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " Jul 07 13:30:07.260236 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.260246 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec9055da-806b-4dec-8b23-8608c8ff07a6-workload-socket\") pod \"ec9055da-806b-4dec-8b23-8608c8ff07a6\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " Jul 07 13:30:07.260507 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.260268 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec9055da-806b-4dec-8b23-8608c8ff07a6-istio-data\") pod \"ec9055da-806b-4dec-8b23-8608c8ff07a6\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " Jul 07 13:30:07.260507 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.260285 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec9055da-806b-4dec-8b23-8608c8ff07a6-istio-podinfo\") pod \"ec9055da-806b-4dec-8b23-8608c8ff07a6\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " Jul 07 13:30:07.260507 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.260335 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec9055da-806b-4dec-8b23-8608c8ff07a6-workload-certs\") pod \"ec9055da-806b-4dec-8b23-8608c8ff07a6\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " Jul 07 13:30:07.260507 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.260361 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec9055da-806b-4dec-8b23-8608c8ff07a6-credential-socket\") pod \"ec9055da-806b-4dec-8b23-8608c8ff07a6\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " Jul 07 13:30:07.260507 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.260391 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec9055da-806b-4dec-8b23-8608c8ff07a6-istio-token\") pod \"ec9055da-806b-4dec-8b23-8608c8ff07a6\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " Jul 07 13:30:07.260507 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.260416 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec9055da-806b-4dec-8b23-8608c8ff07a6-istiod-ca-cert\") pod \"ec9055da-806b-4dec-8b23-8608c8ff07a6\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " Jul 07 13:30:07.260507 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.260499 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec9055da-806b-4dec-8b23-8608c8ff07a6-istio-envoy\") pod \"ec9055da-806b-4dec-8b23-8608c8ff07a6\" (UID: \"ec9055da-806b-4dec-8b23-8608c8ff07a6\") " Jul 07 13:30:07.260868 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.260625 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec9055da-806b-4dec-8b23-8608c8ff07a6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ec9055da-806b-4dec-8b23-8608c8ff07a6" (UID: "ec9055da-806b-4dec-8b23-8608c8ff07a6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:30:07.260868 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.260726 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec9055da-806b-4dec-8b23-8608c8ff07a6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ec9055da-806b-4dec-8b23-8608c8ff07a6" (UID: "ec9055da-806b-4dec-8b23-8608c8ff07a6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:30:07.260868 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.260738 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec9055da-806b-4dec-8b23-8608c8ff07a6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ec9055da-806b-4dec-8b23-8608c8ff07a6" (UID: "ec9055da-806b-4dec-8b23-8608c8ff07a6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:30:07.260868 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.260841 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec9055da-806b-4dec-8b23-8608c8ff07a6-credential-socket\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:30:07.260868 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.260860 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec9055da-806b-4dec-8b23-8608c8ff07a6-workload-socket\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:30:07.261135 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.260899 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec9055da-806b-4dec-8b23-8608c8ff07a6-workload-certs\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:30:07.261135 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.261041 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec9055da-806b-4dec-8b23-8608c8ff07a6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ec9055da-806b-4dec-8b23-8608c8ff07a6" (UID: "ec9055da-806b-4dec-8b23-8608c8ff07a6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 13:30:07.261250 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.261150 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec9055da-806b-4dec-8b23-8608c8ff07a6-istio-data" (OuterVolumeSpecName: "istio-data") pod "ec9055da-806b-4dec-8b23-8608c8ff07a6" (UID: "ec9055da-806b-4dec-8b23-8608c8ff07a6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:30:07.262563 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.262538 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec9055da-806b-4dec-8b23-8608c8ff07a6-kube-api-access-f75mm" (OuterVolumeSpecName: "kube-api-access-f75mm") pod "ec9055da-806b-4dec-8b23-8608c8ff07a6" (UID: "ec9055da-806b-4dec-8b23-8608c8ff07a6"). InnerVolumeSpecName "kube-api-access-f75mm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:30:07.262673 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.262655 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec9055da-806b-4dec-8b23-8608c8ff07a6-istio-token" (OuterVolumeSpecName: "istio-token") pod "ec9055da-806b-4dec-8b23-8608c8ff07a6" (UID: "ec9055da-806b-4dec-8b23-8608c8ff07a6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 13:30:07.263048 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.263028 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec9055da-806b-4dec-8b23-8608c8ff07a6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ec9055da-806b-4dec-8b23-8608c8ff07a6" (UID: "ec9055da-806b-4dec-8b23-8608c8ff07a6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 13:30:07.263105 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.263032 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ec9055da-806b-4dec-8b23-8608c8ff07a6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ec9055da-806b-4dec-8b23-8608c8ff07a6" (UID: "ec9055da-806b-4dec-8b23-8608c8ff07a6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 13:30:07.336767 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.336732 2555 generic.go:356] "Generic (PLEG): container finished" podID="ec9055da-806b-4dec-8b23-8608c8ff07a6" containerID="5a907233307457ef347b945adcb0519ca82f05c45322d78bdc60a27f4337eff6" exitCode=0 Jul 07 13:30:07.336954 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.336781 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" Jul 07 13:30:07.336954 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.336813 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" event={"ID":"ec9055da-806b-4dec-8b23-8608c8ff07a6","Type":"ContainerDied","Data":"5a907233307457ef347b945adcb0519ca82f05c45322d78bdc60a27f4337eff6"} Jul 07 13:30:07.336954 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.336870 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq" event={"ID":"ec9055da-806b-4dec-8b23-8608c8ff07a6","Type":"ContainerDied","Data":"326dd0567deaa0f6b5ad60e4f2f44ca154234fef9e20210b5a10eb4fa67d7381"} Jul 07 13:30:07.336954 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.336903 2555 scope.go:117] "RemoveContainer" containerID="5a907233307457ef347b945adcb0519ca82f05c45322d78bdc60a27f4337eff6" Jul 07 13:30:07.345953 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.345936 2555 scope.go:117] "RemoveContainer" containerID="75123e921ad3e5f4873f464d0a6535efd90dfb5d0162a321b8dadfabbfa8675a" Jul 07 13:30:07.353768 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.353754 2555 scope.go:117] "RemoveContainer" containerID="5a907233307457ef347b945adcb0519ca82f05c45322d78bdc60a27f4337eff6" Jul 07 13:30:07.353990 ip-10-0-136-245 kubenswrapper[2555]: E0707 13:30:07.353972 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a907233307457ef347b945adcb0519ca82f05c45322d78bdc60a27f4337eff6\": container with ID starting with 5a907233307457ef347b945adcb0519ca82f05c45322d78bdc60a27f4337eff6 not found: ID does not exist" containerID="5a907233307457ef347b945adcb0519ca82f05c45322d78bdc60a27f4337eff6" Jul 07 13:30:07.354039 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.353999 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a907233307457ef347b945adcb0519ca82f05c45322d78bdc60a27f4337eff6"} err="failed to get container status \"5a907233307457ef347b945adcb0519ca82f05c45322d78bdc60a27f4337eff6\": rpc error: code = NotFound desc = could not find container \"5a907233307457ef347b945adcb0519ca82f05c45322d78bdc60a27f4337eff6\": container with ID starting with 5a907233307457ef347b945adcb0519ca82f05c45322d78bdc60a27f4337eff6 not found: ID does not exist" Jul 07 13:30:07.354039 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.354017 2555 scope.go:117] "RemoveContainer" containerID="75123e921ad3e5f4873f464d0a6535efd90dfb5d0162a321b8dadfabbfa8675a" Jul 07 13:30:07.354190 ip-10-0-136-245 kubenswrapper[2555]: E0707 13:30:07.354178 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75123e921ad3e5f4873f464d0a6535efd90dfb5d0162a321b8dadfabbfa8675a\": container with ID starting with 75123e921ad3e5f4873f464d0a6535efd90dfb5d0162a321b8dadfabbfa8675a not found: ID does not exist" containerID="75123e921ad3e5f4873f464d0a6535efd90dfb5d0162a321b8dadfabbfa8675a" Jul 07 13:30:07.354229 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.354193 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75123e921ad3e5f4873f464d0a6535efd90dfb5d0162a321b8dadfabbfa8675a"} err="failed to get container status \"75123e921ad3e5f4873f464d0a6535efd90dfb5d0162a321b8dadfabbfa8675a\": rpc error: code = NotFound desc = could not find container \"75123e921ad3e5f4873f464d0a6535efd90dfb5d0162a321b8dadfabbfa8675a\": container with ID starting with 75123e921ad3e5f4873f464d0a6535efd90dfb5d0162a321b8dadfabbfa8675a not found: ID does not exist" Jul 07 13:30:07.359649 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.359630 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq"] Jul 07 13:30:07.361819 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.361700 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f75mm\" (UniqueName: \"kubernetes.io/projected/ec9055da-806b-4dec-8b23-8608c8ff07a6-kube-api-access-f75mm\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:30:07.361819 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.361725 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec9055da-806b-4dec-8b23-8608c8ff07a6-istio-data\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:30:07.361819 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.361738 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec9055da-806b-4dec-8b23-8608c8ff07a6-istio-podinfo\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:30:07.361819 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.361749 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec9055da-806b-4dec-8b23-8608c8ff07a6-istio-token\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:30:07.361819 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.361761 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec9055da-806b-4dec-8b23-8608c8ff07a6-istiod-ca-cert\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:30:07.361819 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.361772 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec9055da-806b-4dec-8b23-8608c8ff07a6-istio-envoy\") on node \"ip-10-0-136-245.ec2.internal\" DevicePath \"\"" Jul 07 13:30:07.363281 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.363260 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-38a70c-openshift-default-7bc5b44fcf-hkkdq"] Jul 07 13:30:07.830601 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:07.830566 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec9055da-806b-4dec-8b23-8608c8ff07a6" path="/var/lib/kubelet/pods/ec9055da-806b-4dec-8b23-8608c8ff07a6/volumes" Jul 07 13:30:09.080090 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:09.080053 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c99b98b8b-chn9l_d8da2cc5-9445-4dd5-bc89-3d2b88c7be21/manager/0.log" Jul 07 13:30:09.086745 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:09.086726 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c99b98b8b-chn9l_d8da2cc5-9445-4dd5-bc89-3d2b88c7be21/copy-manifests/0.log" Jul 07 13:30:11.951715 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:11.951684 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5b74bd9b95-ws24f_508c8201-0684-4157-b17e-46f1db331610/authorino/0.log" Jul 07 13:30:12.021791 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:12.021760 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:30:12.788044 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:12.788013 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-5nwht_8b3c2af3-cabd-4b04-8ae3-defb1be20de6/limitador/0.log" Jul 07 13:30:13.323685 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:13.323646 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4fbwlx_f7368a1a-91d8-45e2-932c-d1bab2eed80c/istio-proxy/0.log" Jul 07 13:30:13.823664 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:13.823630 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vg4ns_6d192d0f-161c-4eee-8493-f872408fbc10/istio-proxy/1.log" Jul 07 13:30:14.250155 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:14.250127 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-759d8757b9-whth9_bb41588d-7d7e-4497-ac10-caad90123497/router/0.log" Jul 07 13:30:14.901836 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:14.901810 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-qdmlr_56556382-f0f8-496a-841c-95bad2fd97ed/main/0.log" Jul 07 13:30:15.172560 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:15.172491 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-xhz49_ea2f1630-286b-4bda-96df-3ea2e9eb5338/main/0.log" Jul 07 13:30:19.689267 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:19.689233 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:30:19.797410 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:19.797376 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" limit=1024 Jul 07 13:30:22.641033 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:22.641001 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-m6fbl_99606493-0799-450b-a6f8-d3795ff36e30/global-pull-secret-syncer/0.log" Jul 07 13:30:22.701757 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:22.701729 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8k6fx_401b54f0-9e30-4ac3-8238-067fe8dd42c8/konnectivity-agent/0.log" Jul 07 13:30:22.873562 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:22.873520 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-245.ec2.internal_7c175a9fb55810a6c1b33f39f05a41c8/haproxy/0.log" Jul 07 13:30:27.984932 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:27.984895 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5b74bd9b95-ws24f_508c8201-0684-4157-b17e-46f1db331610/authorino/0.log" Jul 07 13:30:28.352928 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:28.352858 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-5nwht_8b3c2af3-cabd-4b04-8ae3-defb1be20de6/limitador/0.log" Jul 07 13:30:30.431673 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:30.431636 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-44dxc_3ac07d23-9858-4ce7-a553-812f8a2151a4/cluster-monitoring-operator/0.log" Jul 07 13:30:30.743793 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:30.743765 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-srfjq_879d02ae-7cba-48f4-bba7-2a123c96e2e5/node-exporter/0.log" Jul 07 13:30:30.769296 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:30.769269 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-srfjq_879d02ae-7cba-48f4-bba7-2a123c96e2e5/kube-rbac-proxy/0.log" Jul 07 13:30:30.792584 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:30.792552 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-srfjq_879d02ae-7cba-48f4-bba7-2a123c96e2e5/init-textfile/0.log" Jul 07 13:30:32.830722 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:32.830690 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-cxjzh_4799efdd-3758-4f1f-b17e-05d428ce8edf/networking-console-plugin/0.log" Jul 07 13:30:33.066821 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.066785 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kfwnx/perf-node-gather-daemonset-9r2zk"] Jul 07 13:30:33.067119 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.067107 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec9055da-806b-4dec-8b23-8608c8ff07a6" containerName="istio-proxy" Jul 07 13:30:33.067163 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.067120 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec9055da-806b-4dec-8b23-8608c8ff07a6" containerName="istio-proxy" Jul 07 13:30:33.067163 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.067137 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71f23128-cc00-412d-af86-49cdcfbb5cb0" containerName="istio-proxy" Jul 07 13:30:33.067163 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.067143 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="71f23128-cc00-412d-af86-49cdcfbb5cb0" containerName="istio-proxy" Jul 07 13:30:33.067163 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.067149 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e288613-5e15-40c2-a2fe-66644d5459e5" containerName="main" Jul 07 13:30:33.067163 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.067155 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e288613-5e15-40c2-a2fe-66644d5459e5" containerName="main" Jul 07 13:30:33.067319 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.067174 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71f23128-cc00-412d-af86-49cdcfbb5cb0" containerName="istio-proxy" Jul 07 13:30:33.067319 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.067179 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="71f23128-cc00-412d-af86-49cdcfbb5cb0" containerName="istio-proxy" Jul 07 13:30:33.067319 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.067227 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec9055da-806b-4dec-8b23-8608c8ff07a6" containerName="istio-proxy" Jul 07 13:30:33.067319 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.067234 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="71f23128-cc00-412d-af86-49cdcfbb5cb0" containerName="istio-proxy" Jul 07 13:30:33.067319 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.067241 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e288613-5e15-40c2-a2fe-66644d5459e5" containerName="main" Jul 07 13:30:33.070171 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.070150 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-9r2zk" Jul 07 13:30:33.072849 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.072828 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kfwnx\"/\"openshift-service-ca.crt\"" Jul 07 13:30:33.073733 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.073716 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kfwnx\"/\"default-dockercfg-kcgqp\"" Jul 07 13:30:33.073798 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.073735 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kfwnx\"/\"kube-root-ca.crt\"" Jul 07 13:30:33.083971 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.083917 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kfwnx/perf-node-gather-daemonset-9r2zk"] Jul 07 13:30:33.169403 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.169373 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1255994-ac7f-4908-909d-1a90a7d020dd-sys\") pod \"perf-node-gather-daemonset-9r2zk\" (UID: \"f1255994-ac7f-4908-909d-1a90a7d020dd\") " pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-9r2zk" Jul 07 13:30:33.169580 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.169447 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f1255994-ac7f-4908-909d-1a90a7d020dd-lib-modules\") pod \"perf-node-gather-daemonset-9r2zk\" (UID: \"f1255994-ac7f-4908-909d-1a90a7d020dd\") " pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-9r2zk" Jul 07 13:30:33.169580 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.169492 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f1255994-ac7f-4908-909d-1a90a7d020dd-proc\") pod \"perf-node-gather-daemonset-9r2zk\" (UID: \"f1255994-ac7f-4908-909d-1a90a7d020dd\") " pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-9r2zk" Jul 07 13:30:33.169580 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.169508 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f1255994-ac7f-4908-909d-1a90a7d020dd-podres\") pod \"perf-node-gather-daemonset-9r2zk\" (UID: \"f1255994-ac7f-4908-909d-1a90a7d020dd\") " pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-9r2zk" Jul 07 13:30:33.169741 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.169624 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtxjg\" (UniqueName: \"kubernetes.io/projected/f1255994-ac7f-4908-909d-1a90a7d020dd-kube-api-access-qtxjg\") pod \"perf-node-gather-daemonset-9r2zk\" (UID: \"f1255994-ac7f-4908-909d-1a90a7d020dd\") " pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-9r2zk" Jul 07 13:30:33.270303 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.270272 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f1255994-ac7f-4908-909d-1a90a7d020dd-lib-modules\") pod \"perf-node-gather-daemonset-9r2zk\" (UID: \"f1255994-ac7f-4908-909d-1a90a7d020dd\") " pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-9r2zk" Jul 07 13:30:33.270447 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.270330 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f1255994-ac7f-4908-909d-1a90a7d020dd-proc\") pod \"perf-node-gather-daemonset-9r2zk\" (UID: \"f1255994-ac7f-4908-909d-1a90a7d020dd\") " pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-9r2zk" Jul 07 13:30:33.270447 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.270355 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f1255994-ac7f-4908-909d-1a90a7d020dd-podres\") pod \"perf-node-gather-daemonset-9r2zk\" (UID: \"f1255994-ac7f-4908-909d-1a90a7d020dd\") " pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-9r2zk" Jul 07 13:30:33.270447 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.270401 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtxjg\" (UniqueName: \"kubernetes.io/projected/f1255994-ac7f-4908-909d-1a90a7d020dd-kube-api-access-qtxjg\") pod \"perf-node-gather-daemonset-9r2zk\" (UID: \"f1255994-ac7f-4908-909d-1a90a7d020dd\") " pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-9r2zk" Jul 07 13:30:33.270612 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.270455 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f1255994-ac7f-4908-909d-1a90a7d020dd-lib-modules\") pod \"perf-node-gather-daemonset-9r2zk\" (UID: \"f1255994-ac7f-4908-909d-1a90a7d020dd\") " pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-9r2zk" Jul 07 13:30:33.270612 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.270464 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1255994-ac7f-4908-909d-1a90a7d020dd-sys\") pod \"perf-node-gather-daemonset-9r2zk\" (UID: \"f1255994-ac7f-4908-909d-1a90a7d020dd\") " pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-9r2zk" Jul 07 13:30:33.270612 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.270460 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f1255994-ac7f-4908-909d-1a90a7d020dd-proc\") pod \"perf-node-gather-daemonset-9r2zk\" (UID: \"f1255994-ac7f-4908-909d-1a90a7d020dd\") " pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-9r2zk" Jul 07 13:30:33.270612 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.270504 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1255994-ac7f-4908-909d-1a90a7d020dd-sys\") pod \"perf-node-gather-daemonset-9r2zk\" (UID: \"f1255994-ac7f-4908-909d-1a90a7d020dd\") " pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-9r2zk" Jul 07 13:30:33.270612 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.270517 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f1255994-ac7f-4908-909d-1a90a7d020dd-podres\") pod \"perf-node-gather-daemonset-9r2zk\" (UID: \"f1255994-ac7f-4908-909d-1a90a7d020dd\") " pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-9r2zk" Jul 07 13:30:33.279246 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.279219 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtxjg\" (UniqueName: \"kubernetes.io/projected/f1255994-ac7f-4908-909d-1a90a7d020dd-kube-api-access-qtxjg\") pod \"perf-node-gather-daemonset-9r2zk\" (UID: \"f1255994-ac7f-4908-909d-1a90a7d020dd\") " pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-9r2zk" Jul 07 13:30:33.380559 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.380505 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-9r2zk" Jul 07 13:30:33.499335 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.499305 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gqgkf_d9ad543c-2b24-443d-a2ed-e3bc420cd888/console-operator/1.log" Jul 07 13:30:33.503040 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.503016 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gqgkf_d9ad543c-2b24-443d-a2ed-e3bc420cd888/console-operator/2.log" Jul 07 13:30:33.514124 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:33.514104 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kfwnx/perf-node-gather-daemonset-9r2zk"] Jul 07 13:30:33.516036 ip-10-0-136-245 kubenswrapper[2555]: W0707 13:30:33.516013 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf1255994_ac7f_4908_909d_1a90a7d020dd.slice/crio-dd63ef23d6cf0db9e5f7f08f40e57d582fcfd221add6980630fc8a2e6cb3bb35 WatchSource:0}: Error finding container dd63ef23d6cf0db9e5f7f08f40e57d582fcfd221add6980630fc8a2e6cb3bb35: Status 404 returned error can't find the container with id dd63ef23d6cf0db9e5f7f08f40e57d582fcfd221add6980630fc8a2e6cb3bb35 Jul 07 13:30:34.051792 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:34.051759 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-9npsg_31d76d64-0d00-4ee6-ad7b-92e297328b2b/download-server/0.log" Jul 07 13:30:34.462843 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:34.462749 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-9r2zk" event={"ID":"f1255994-ac7f-4908-909d-1a90a7d020dd","Type":"ContainerStarted","Data":"42e037a281d408da85939cad9b22fafe1419ff5b7d72748044cc14a6cbe584ca"} Jul 07 13:30:34.462843 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:34.462810 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-9r2zk" event={"ID":"f1255994-ac7f-4908-909d-1a90a7d020dd","Type":"ContainerStarted","Data":"dd63ef23d6cf0db9e5f7f08f40e57d582fcfd221add6980630fc8a2e6cb3bb35"} Jul 07 13:30:34.462843 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:34.462839 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-9r2zk" Jul 07 13:30:34.484363 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:34.484321 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-9r2zk" podStartSLOduration=1.48430545 podStartE2EDuration="1.48430545s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:30:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:30:34.484103719 +0000 UTC m=+2543.205831231" watchObservedRunningTime="2026-07-07 13:30:34.48430545 +0000 UTC m=+2543.206032965" Jul 07 13:30:34.683916 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:34.683893 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-7twbn_7b758bf7-cc6b-43ec-ae60-997d0c9c1b05/volume-data-source-validator/0.log" Jul 07 13:30:35.851006 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:35.850979 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kvkc7_99331929-499a-431f-a1eb-81521986520b/dns/0.log" Jul 07 13:30:35.875418 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:35.875394 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kvkc7_99331929-499a-431f-a1eb-81521986520b/kube-rbac-proxy/0.log" Jul 07 13:30:36.017285 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:36.017259 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x9n7p_162131a6-2800-4824-81fb-10c5396199ea/dns-node-resolver/0.log" Jul 07 13:30:36.807126 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:36.807101 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xqj9j_cd96639c-8bd3-4c04-aedd-41dbd1c2acdb/node-ca/0.log" Jul 07 13:30:37.854805 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:37.854775 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4fbwlx_f7368a1a-91d8-45e2-932c-d1bab2eed80c/istio-proxy/0.log" Jul 07 13:30:38.073831 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:38.073796 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vg4ns_6d192d0f-161c-4eee-8493-f872408fbc10/istio-proxy/0.log" Jul 07 13:30:38.099877 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:38.099855 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vg4ns_6d192d0f-161c-4eee-8493-f872408fbc10/istio-proxy/1.log" Jul 07 13:30:38.314463 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:38.314435 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-759d8757b9-whth9_bb41588d-7d7e-4497-ac10-caad90123497/router/0.log" Jul 07 13:30:39.121267 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:39.121236 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m2kzs_8a3eff27-1183-4cc7-850c-216d0af8714a/serve-healthcheck-canary/0.log" Jul 07 13:30:39.616595 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:39.616558 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-kqkwl_280e8e44-e7c9-47ad-9cc9-611821d9bcfa/insights-operator/0.log" Jul 07 13:30:39.617497 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:39.617484 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-kqkwl_280e8e44-e7c9-47ad-9cc9-611821d9bcfa/insights-operator/1.log" Jul 07 13:30:39.653386 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:39.653360 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qvthj_711bbda5-9512-4927-8fd3-6c02b2fdb682/kube-rbac-proxy/0.log" Jul 07 13:30:39.685686 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:39.685668 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qvthj_711bbda5-9512-4927-8fd3-6c02b2fdb682/exporter/0.log" Jul 07 13:30:39.723763 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:39.723745 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qvthj_711bbda5-9512-4927-8fd3-6c02b2fdb682/extractor/0.log" Jul 07 13:30:40.476221 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:40.476199 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kfwnx/perf-node-gather-daemonset-9r2zk" Jul 07 13:30:43.283138 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:43.283111 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c99b98b8b-chn9l_d8da2cc5-9445-4dd5-bc89-3d2b88c7be21/manager/0.log" Jul 07 13:30:43.311685 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:43.311617 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c99b98b8b-chn9l_d8da2cc5-9445-4dd5-bc89-3d2b88c7be21/copy-manifests/0.log" Jul 07 13:30:43.591990 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:43.591897 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4fbwlx_f7368a1a-91d8-45e2-932c-d1bab2eed80c/istio-proxy/0.log" Jul 07 13:30:43.844235 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:43.844157 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vg4ns_6d192d0f-161c-4eee-8493-f872408fbc10/istio-proxy/0.log" Jul 07 13:30:43.869564 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:43.869534 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vg4ns_6d192d0f-161c-4eee-8493-f872408fbc10/istio-proxy/1.log" Jul 07 13:30:44.021235 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:44.021204 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-759d8757b9-whth9_bb41588d-7d7e-4497-ac10-caad90123497/router/0.log" Jul 07 13:30:45.138988 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:45.138960 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7c57499d8c-9k4tn_afa4a5db-47ce-47dc-af97-e6757838a1fd/manager/0.log" Jul 07 13:30:45.246381 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:45.246358 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4fbwlx_f7368a1a-91d8-45e2-932c-d1bab2eed80c/istio-proxy/0.log" Jul 07 13:30:45.399020 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:45.398938 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vg4ns_6d192d0f-161c-4eee-8493-f872408fbc10/istio-proxy/0.log" Jul 07 13:30:45.423118 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:45.423092 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-vg4ns_6d192d0f-161c-4eee-8493-f872408fbc10/istio-proxy/1.log" Jul 07 13:30:45.554159 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:45.554136 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-759d8757b9-whth9_bb41588d-7d7e-4497-ac10-caad90123497/router/0.log" Jul 07 13:30:50.301245 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:50.301214 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-pd985_ae903d64-7b28-4dec-a634-ff46544d4f1d/migrator/0.log" Jul 07 13:30:50.328618 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:50.328590 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-pd985_ae903d64-7b28-4dec-a634-ff46544d4f1d/graceful-termination/0.log" Jul 07 13:30:50.760741 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:50.760709 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-j9zrl_5525b878-d89e-41f7-8c51-8e1ca4007876/kube-storage-version-migrator-operator/1.log" Jul 07 13:30:50.761492 ip-10-0-136-245 kubenswrapper[2555]: I0707 13:30:50.761473 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-j9zrl_5525b878-d89e-41f7-8c51-8e1ca4007876/kube-storage-version-migrator-operator/0.log"